langtest.utils.config_utils.BenchmarkDatasets#

class BenchmarkDatasets(task: str, dataset_name: str)#

Bases: object

__init__(task: str, dataset_name: str)#

Methods

__init__(task, dataset_name)
get_dataset_dict(dataset_name, task)	Get the benchmark dataset configuration for the given dataset name.
get_datasets()	Get the list of benchmark datasets available in the library.

Attributes

dataset_name
task

classmethod get_dataset_dict(dataset_name: str, task: str) → dict#

Get the benchmark dataset configuration for the given dataset name.

classmethod get_datasets() → List[str]#

Get the list of benchmark datasets available in the library.