Max Gender F1 Score

This test evaluates the model for each gender seperately. The f1 score for each gender is calculated and test is passed if they are smaller than config.

alias_name: min_gender_f1_score

*The underlying gender classifier is a rule based classifier which outputs one of 3 categories: male, female and neutral. *

Config

max_gender_f1_score:
    max_score: 0.6

max_gender_f1_score:
    max_score:
        male: 0.7
        female: 0.75

• max_score (dict or float): Maximum score to pass the test.