langtest.transform.fairness#

Classes

BaseFairness()

Abstract base class for implementing accuracy measures.

FairnessTestFactory(data_handler, tests, ...)

A class for performing fairness tests on a given dataset.

MaxGenderF1Score()

Subclass of BaseFairness that implements the maximum F1 score.

MaxGenderLLMEval()

Class for evaluating fairness based on maximum gender performance in question-answering tasks using Language Model.

MaxGenderRougeScore()

Subclass of BaseFairness that implements the Rouge score.

MinGenderF1Score()

Subclass of BaseFairness that implements the minimum F1 score.

MinGenderLLMEval()

Class for evaluating fairness based on minimum gender performance in question-answering tasks using a Language Model.

MinGenderRougeScore()

Subclass of BaseFairness that implements the minimum Rouge score.