Min Macro-F1 Score

This test checks the macro-f1 score. Test is passed if the macro-f1 score is higher than the configured min score.

alias_name: min_macro_f1_score

supported tasks: ner, text-classification

Config

min_macro_f1_score:
      min_score: 0.8
  • min_score (float): Minimum pass rate to pass the test.