Add Speech to Text Typo

This test evaluates the NLP model’s proficiency in handling input text that contains common typos resulting from Speech to Text conversion. A Speech to Text typo dictionary is utilized to apply the most frequent typos found in speech recognition output to the input data.

alias_name: add_speech_to_text_typo

To test QA models, we are using QAEval from Langchain where we need to use the model itself or other ML model for evaluation, which can make mistakes.


    min_pass_rate: 0.7
    prob: 0.5 # Defaults to 1.0, which means all words will be transformed.
      count: 1 # Defaults to 1

You can adjust the level of transformation in the sentence by using the “prob” parameter, which controls the proportion of words to be changed during add_speech_to_text_typo test.

  • min_pass_rate (float): Minimum pass rate to pass the test.
  • prob (float): Controls the proportion of words to be changed.
  • count (int): Number of variations of sentence to be constructed.


Original Test Case
Andrew finally returned the French book to Chris that I bought last week. Andrew finally returned the French book to Chris that I bot lass week.
The more you learn, the more you grow. Thee morr you learn, the morr you grow.