langtest.utils.custom_types.helpers.prepare_llm_evaluation_data#

prepare_llm_evaluation_data(original_question: str, answer: str, perturbed_question: str, prediction: str) → Tuple[List[dict], List[dict]]#

Prepares inputs and predictions in the required format for language model evaluation.

Parameters:

• original_question (str) – Original question.

• answer (str) – Ground truth answer.

• perturbed_question (str) – Perturbed/question with modifications.

• prediction (str) – Model’s prediction for the perturbed question.

Returns:

Input and prediction lists.

Return type:

Tuple[List[dict], List[dict]]