Min Exact Match Score

This test uses the “exact_match” from evaluate library. Test is passed if the score is higher than the configured min score.

alias_name: min_exact_match_score

supported tasks: question_answering

Config

min_exact_match_score:
      min_score: 0.8

• min_score (float): Minimum score to pass the test.