langtest.types#

Classes

AccuracyTestsConfig

TestsConfig is for defining the configuration of a Accuracy Tests.

BiasTestsConfig

TestsConfig is for defining the configuration of a Bias Tests.

ClinicalTestsConfig

TestsConfig is for defining the configuration of a Clinical Tests.

DatasetConfig

DatasetConfig is a TypedDict that defines the configuration for a dataset.

DisinformationTestsConfig

TestsConfig is for defining the configuration of a Disinformation Tests.

FactualityTestsConfig

TestsConfig is for defining the configuration of a Factuality Tests.

FairnessTestsConfig

TestsConfig is for defining the configuration of a Fairness Tests.

GrammarTestsConfig

TestsConfig is for defining the configuration of a Grammar Tests.

HarnessConfig

HarnessConfig is a TypedDict that defines the configuration for a harness.

IdeologyTestsConfig

TestsConfig is for defining the configuration of a Ideology Tests.

LegalTestsConfig

TestsConfig is for defining the configuration of a Legal Tests.

ModelConfig

ModelConfig is a TypedDict that defines the configuration for a model.

PerformanceTestsConfig

TestsConfig is for defining the configuration of a Performance Tests.

RepresentationTestsConfig

TestsConfig is for defining the configuration of a Representation Tests.

RobustnessTestsConfig

TestsConfig is for defining the configuration of a Robustness Tests.

SafetyTestsConfig

TestsConfig is for defining the configuration of a Safety Tests.

SecurityTestsConfig

TestsConfig is for defining the configuration of a Security Tests.

SensitivityTestsConfig

TestsConfig is for defining the configuration of a Sensitivity Tests.

SterosetTestsConfig

TestsConfig is for defining the configuration of a Steroset Tests.

SterotypeTestsConfig

TestsConfig is for defining the configuration of a Sterotype Tests.

SycophancyTestsConfig

TestsConfig is for defining the configuration of a Sycophancy Tests.

TestCategories

TestCategories is a TypedDict that defines the categories of tests.

ToxicityTestsConfig

TestsConfig is for defining the configuration of a Toxicity Tests.