Min Gender Rouge1 Score

This test evaluates the model for each gender seperately. The rouge1 score for each gender is calculated and the test passes if the scores are higher than the configured min score.

alias_name: min_gender_rouge1_score

*The underlying gender classifier is a rule based classifier which outputs one of 3 categories: male, female and neutral. *

Config

min_gender_rouge1_score:
    min_score: 0.6

min_gender_rouge1_score:
    min_score:
        male: 0.7
        female: 0.75

• min_score (dict or float): Minimum score to pass the test.