langfair logo

langfair

cvs-health/langfair

LangFair: Use-Case Level LLM Bias and Fairness Assessments

GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026

39views this month

261 stars46 forksLast push Aug 26, 2026 Python Other

Decision brief

LangFair is a Python library designed for assessing bias and fairness in large language model (LLM) use cases using user-specific prompts.

Good fit when

  • - You need to conduct bias and fairness assessments specific to the application domain of your LLM.
  • - Your project requires evaluation through output-based metrics suitable for governance audits.

Avoid when

  • - If you require access to internal model states for your evaluations, as LangFair focuses on output-based metrics instead.
  • - You are looking for a static benchmark assessment that does not consider use-case-specific prompts, preferring generalized metrics over tailored evaluations.

Observed Jul 12, 2026 · Source: enrich:decision_facts

Verify the decision

Maintenance and security

Full trust report
Maintenance
Active (12d since push)
As of Sep 8, 2026
Provenance
Not a fork · Organization account
As of Sep 8, 2026
Security (OSV)
No lockfile
As of Jul 11, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

pip install langfair
PyPI

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

A comprehensive Python library designed to conduct bias and fairness assessments of large language model (LLM) use cases.

Capability facts

Languages
python

Source: github.language+pyproject.toml · Sep 8, 2026

Categories

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

LangChain integrationLangChain

Source: README excerpt (regex_v1, Sep 8, 2026)

nses, we can use LangFair's `ResponseGenerator` class. First, we must create a `langchain` LLM object. Below we use `ChatVertexAI`, but **any of [LangChain’s LLM classes
Source link
Python runtimePython

Source: README excerpt (regex_v1, Sep 8, 2026)

LangFair is a comprehensive Python library designed for conducting bias and fairness assessments of large language
Source link

Tags

README

<p align="center" <img src="https://raw.githubusercontent.com/cvs health/langfair/main/assets/images/langfair logo.png" / </p LangFair: Use Case Level LLM Bias and Fairness Assessments LangFair is a comprehensive Python library designed for conducting bias and fairness assessment...

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.