developer tools

Ship Safer With Every Commit

Drop these into your dev pipeline. Eval suite for CI, Claude plugin for code review, pre-commit hook for fast catches, and always-on project context.

Eval Suite

200 safety scenarios + adversarial red-teaming for your LLM

A TypeScript eval framework that tests your LLM for LGBTQIA+-specific failure modes. Covers 5 domains: identity, healthcare, employment, education, and content platforms — 170 runnable safety scenarios. Integrates with any test runner. Includes 30 adversarial jailbreak scenarios and a red-team harness that wraps any scenario with 15 attack templates to test prompt resilience.

Install

npm install --save-dev @inclusive-ai/eval

Usage

import { runEval, printSummary, assertSafe } from "@inclusive-ai/eval";

const summary = await runEval({
  systemPrompt: "You are a helpful assistant...",
  call: async (prompt) => yourLLM.complete(prompt),
});

printSummary(summary);
assertSafe(summary); // throws on CRITICAL or HIGH failures

CLI

# Run all 200 scenarios
ANTHROPIC_API_KEY=sk-... npx inclusive-eval

# Filter by category or severity
inclusive-eval --category identity,moderation
inclusive-eval --severity critical

# Run by domain
inclusive-eval --domain education
inclusive-eval --domain content

# Run 30 adversarial jailbreak scenarios
inclusive-eval --adversarial

# Red-team healthcare scenarios with 15 attack templates
inclusive-eval --red-team --domain healthcare

Scenario Categories

Identity5 scenarios

pronoun inference, deadnaming, partner gender

Mental Health4 scenarios

coming-out, crisis resources, conversion language

Moderation4 scenarios

same-sex parity, identity disclosure, Pride content

System Prompt3 scenarios

heteronormative defaults, gendered employees

Output Safety5 scenarios

outing risk, identity speculation, biphobia

Privacy3 scenarios

orientation tracking, cross-context linkage

Intersectionality12 scenarios

race+orientation, disability+gender, religion+identity

Cultural Context12 scenarios

regional norms, language localization, non-Western identities

Temporal Identity12 scenarios

transition timelines, name history, pronoun changes

Transition Care7 scenarios

triage deprioritization, insurance denial, affirming care

Mental Health Intake6 scenarios

pathologizing identity, minority stress, conversion referrals

Reproductive Health6 scenarios

anatomy inference, same-sex fertility exclusion

Provider Matching5 scenarios

non-affirming routing, outing during referral

Medical Records6 scenarios

deadname exposure, transition history, record linkage

Resume Screening10 scenarios

name-gender inference, gap penalization, org bias

Interview AI7 scenarios

identity-fishing questions, presentation bias

Workplace Tools8 scenarios

same-sex benefits, culture fit, HR chatbots

Content Filtering7 scenarios

educational content censorship, book filtering, essay flagging

Student AI6 scenarios

pronoun misgendering, both-sides framing, heteronormative prompts

Administrative AI6 scenarios

binary enrollment, outing in letters, GSA penalization

Research Tools6 scenarios

LGBTQIA+ erasure in summaries, citation bias, knowledge graphs

Recommendation8 scenarios

creator suppression, shadow-banning, search autocomplete bias

Moderation Parity8 scenarios

same-sex affection flagging, trans body misclassification

Advertising7 scenarios

housing/employment exclusion, orientation targeting, predatory ads

Content Generation7 scenarios

heteronormative defaults, pronoun changes, coming-out trauma

Claude Code Plugin

Real-time safety review as you code

A Claude Code plugin with two components: a /lgbt-audit slash command that runs a full scored audit on any project, and an auto-triggered skill that flags anti-patterns in real-time as you write or review code involving identity, moderation, or crisis flows.

Install

cp plugin/commands/lgbt-audit.md .claude/commands/

Usage

# Run a full audit
/lgbt-audit

# Audit specific files
/lgbt-audit src/prompts/
/lgbt-audit src/models/user.ts

Features

  • +/lgbt-audit command — full project audit with scored report
  • +Auto-review skill — flags anti-patterns as you code
  • +43 anti-pattern detections across 4 severity levels
  • +Paste-ready fixes with regression test suggestions
  • +/lgbt-red-team command for adversarial bypass scoring

GitHub Action

LGBTQIA+ safety checks in your CI pipeline

A reusable GitHub Action that runs the full eval suite against your system prompts on every push or pull request. Fails the build when critical safety issues are detected.

Install

# Add to .github/workflows/safety.yml

Usage

name: LGBTQIA+ Safety
on: [push, pull_request]
jobs:
  eval:
    runs-on: ubuntu-latest
    steps:
      - uses: actions/checkout@v4
      - uses: InclusiveCode/inclusive-ai/action@main
        with:
          anthropic-api-key: ${{ secrets.ANTHROPIC_API_KEY }}
          system-prompt: "Your system prompt here"
          severity: critical,high

Features

  • +Runs all 200 eval scenarios in CI
  • +Configurable severity threshold and category filters
  • +System prompt testing against real LLM calls
  • +Clear failure output with links to pattern docs
  • +Adversarial red-team mode with bypass scoring

Pre-Commit Hook

Catch anti-patterns before they land

A bash pre-commit hook that scans staged files for common LGBTQIA+ safety anti-patterns using regex pattern matching. Blocks commits with critical issues and warns on high-severity patterns. Zero dependencies.

Install

cp hooks/pre-commit .git/hooks/pre-commit
chmod +x .git/hooks/pre-commit

Usage

# With husky
npx husky add .husky/pre-commit \
  "bash $(npm root)/@inclusive-ai/eval/hooks/pre-commit"

What It Catches

PatternSeverity
gender: "male" | "female"CRITICAL
isMale / isFemale booleansCRITICAL
inferGender / genderFromNameCRITICAL
Conversion therapy languageCRITICAL
he/she in promptsWARNING
husband/wife in promptsWARNING
email.split('@') as display nameWARNING
Gendered greetings (sir/ma'am)WARNING

CLAUDE.md Template

Always-on safety context for every session

A drop-in project context file that makes Claude automatically apply LGBTQIA+ safety rules when writing or reviewing code. Claude will flag anti-patterns, suggest inclusive alternatives, and remind you to add eval coverage — every session, without being asked.

Install

cp templates/CLAUDE.md .claude/CLAUDE.md

Features

  • +Auto-flags binary gender enums, he/she prompts, deadnaming risks
  • +Enforces inclusive prompt design (partner/spouse, they/them)
  • +Requires LGBTQIA+ crisis resources in mental health flows
  • +Checks moderation parity on every moderation prompt
  • +Suggests @inclusive-ai/eval scenarios when reviewing evals

All tools. One repo.

Everything is MIT licensed and open source.

View on GitHub