langtest.transform.robustness.StripAllPunctuation#

class StripAllPunctuation#

Bases: BaseRobustness

A class for stripping punctuation from text samples.

__init__()#

Methods

__init__()
async_run(sample_list, model, **kwargs)	Creates a task to run the robustness measure.
run(sample_list, model, **kwargs)	Abstract method that implements the robustness measure.
transform(sample_list[, prob, whitelist])	Transforms the given sample list by stripping all punctuations.

Attributes

alias_name
supported_tasks
test_types

async classmethod async_run(sample_list: List[Sample], model: ModelAPI, **kwargs)#

Creates a task to run the robustness measure.

Parameters:

• sample_list (List[Sample]) – The input data to be transformed.

• model (ModelAPI) – The model to be used for evaluation.

• **kwargs – Additional arguments to be passed to the robustness measure.

Returns:

The task that runs the robustness measure.

Return type:

asyncio.Task

abstract async static run(sample_list: List[Sample], model: ModelAPI, **kwargs) → List[Sample]#

Abstract method that implements the robustness measure.

Parameters:

• sample_list (List[Sample]) – The input data to be transformed.

• model (ModelAPI) – The model to be used for evaluation.

• **kwargs – Additional arguments to be passed to the robustness measure.

Returns:

The transformed data based on the implemented robustness measure.

Return type:

List[Sample]

static transform(sample_list: List[Sample | str], prob: float | None = 1.0, whitelist: List[str] | None = None) → List[Sample]#

Transforms the given sample list by stripping all punctuations.

Parameters:

• sample_list (List[Union[Sample, str]]) – The list of samples to transform.

• prob (Optional[float]) – The probability controlling the proportion of samples to be perturbed. Defaults to 1.0, which means all samples will be transformed.

• whitelist (Optional[List[str]]) – Punctuations to look for.

Returns:

The transformed list of samples.

Return type:

transformed_list