langtest.utils.hf_utils#

Functions

build_dataset(dataset_name, dataset_subset, ...)

Uses inputted dataset details to build dictionaries of train/test values.

clean_input(example)

Clean and format input example.

get_model_n_tokenizer(model_name)

Load a pre-trained model and tokenizer from Hugging Face Model Hub.

login_with_token()

Log in to the Hugging Face Hub using the provided API token.

Classes

HuggingFacePipeline([model_id, task, ...])

HuggingFace Pipeline API.

Exceptions

GatedRepoAccessError

Exception raised when there is an attempt to access a gated Hugging Face repository without proper authorization.