langtest.datahandler.datasource.BaseDataset#

class BaseDataset#

Bases: ABC

Abstract base class for Dataset.

Defines the load_data method that all subclasses must implement.

__init__()#

Methods

__init__()
export_data(data, output_path)	Exports the data to the corresponding format and saves it to 'output_path'.
load_data()	Load data from the file_path into the right Sample object.
load_raw_data()	Load data from the file_path into raw format.

Attributes

data_sources
dataset_size

abstract export_data(data: List[Sample], output_path: str)#

Exports the data to the corresponding format and saves it to ‘output_path’.

Parameters:

• data (List[Sample]) – data to export

• output_path (str) – path to save the data to

abstract load_data()#

Load data from the file_path into the right Sample object.

abstract load_raw_data()#

Load data from the file_path into raw format.