langtest.modelhandler.custom_modelhandler#

Classes

PretrainedCustomModel(model)

Abstract base class for a custom pretrained model.

PretrainedModelForCrowsPairs(model)

A custom model handler for pretrained models that are used for crows pairs.

PretrainedModelForDisinformationTest(model)

A custom model handler for pretrained models that are used for disinformation.

PretrainedModelForFactualityTest(model)

A class representing a pretrained model for factuality test.

PretrainedModelForPolitical(model)

A custom model handler for pretrained models that are used for political.

PretrainedModelForQA(model)

A class for handling a pre-trained model for question answering.

PretrainedModelForSecurity(model)

A custom model handler for pretrained models that are used for security.

PretrainedModelForSensitivityTest(model)

A class representing a pre-trained model for sensitivity testing.

PretrainedModelForSummarization(model)

A custom model handler for pretrained models that are used for summarization.

PretrainedModelForSycophancyTest(model)

A custom model handler for testing sycophancy using a pre-trained model.

PretrainedModelForTextClassification(model)

A custom model handler for text classification using a pre-trained model.

PretrainedModelForToxicity(model)

A custom model handler for pretrained models that are used for toxicity.

PretrainedModelForTranslation(model)

A custom model handler for pretrained models that are used for translation.

PretrainedModelForWinoBias(model)

A custom model handler for pretrained models that are used for wino bias.