langtest.datahandler.datasource#

Classes

BaseDataset()

Abstract base class for Dataset.

CSVDataset(file_path, task, **kwargs)

ConllDataset(file_path, task)

Class to handle Conll files.

DataFactory(file_path, task, **kwargs)

Data factory for creating Dataset objects.

HuggingFaceDataset(source_info, task, **kwargs)

Example dataset class that loads data using the Hugging Face dataset library.

JSONDataset(file_path)

Class to handle JSON dataset files.

JSONLDataset(file_path, task)

Class to handle JSONL datasets.

PandasDataset(file_path, task, **kwargs)

Class to handle Pandas datasets.

SynteticDataset(dataset, task)

Example dataset class that loads data using the Hugging Face dataset library and also generates synthetic math data.