langtest.transform.accuracy#

Classes

AccuracyTestFactory(data_handler, tests, ...)

A class for performing accuracy tests on a given dataset.

BaseAccuracy()

Abstract base class for implementing accuracy measures.

LLMEval()

Evaluation class for Language Model performance on question-answering tasks using the Language Model Metric (LLM).

MinBLEUcore()

Subclass of BaseAccuracy that implements the minimum precision score.

MinEMcore()

Subclass of BaseAccuracy that implements the minimum precision score.

MinF1Score()

Subclass of BaseAccuracy that implements the minimum F1 score.

MinMacroF1Score()

Subclass of BaseAccuracy that implements the minimum macro score.

MinMicroF1Score()

Subclass of BaseAccuracy that implements the minimum micro f1 score.

MinPrecisionScore()

Subclass of BaseAccuracy that implements the minimum precision score.

MinROUGEcore()

Subclass of BaseAccuracy that implements the minimum precision score.

MinRecallScore()

Subclass of BaseAccuracy that implements the minimum recall score.

MinWeightedF1Score()

Subclass of BaseAccuracy that implements the minimum weighted f1 score.