langtest.transform.robustness.RobustnessTestFactory#

class RobustnessTestFactory(data_handler: List[Sample], tests: Dict | None = None, **kwargs)#

Bases: ITests

A class for performing robustness tests on a given dataset.

__init__(data_handler: List[Sample], tests: Dict | None = None, **kwargs) → None#

Initializes a new instance of the Robustness class.

Parameters:

• data_handler (List[Sample]) – A list of Sample objects representing the input dataset.

• Optional[Dict] (tests) – A dictionary of test names and corresponding parameters (default is None).

Methods

__init__(data_handler[, tests])	Initializes a new instance of the Robustness class.
available_tests()	Get a dictionary of all available tests, with their names as keys and their corresponding classes as values.
run(sample_list, model, **kwargs)	Runs the specified tests on the given data and returns a list of results.
transform()	Runs the robustness test and returns the resulting Sample objects.

Attributes

alias_name

static available_tests() → dict#

Get a dictionary of all available tests, with their names as keys and their corresponding classes as values.

Returns:

A dictionary of test names and classes.

Return type:

dict

classmethod run(sample_list: Dict[str, List[Sample]], model: ModelAPI, **kwargs) → List[Sample]#

Runs the specified tests on the given data and returns a list of results.

Parameters:

• sample_list (Dict[str, List[Sample]]) – A dictionary mapping test scenario names to a list of Sample objects.

• model (ModelAPI) – A ModelAPI object representing the model to be tested.

Returns:

A list of Sample objects with the test results.

Return type:

List[Sample]

transform() → List[Sample]#

Runs the robustness test and returns the resulting Sample objects.

Returns:

List[Sample]

A list of Sample objects representing the resulting dataset after running the robustness test.