Min Gender RougeLsum Score
This test evaluates the model for each gender seperately. The rougeLsum score for each gender is calculated and test is passed if they are higher than config.
alias_name: min_gender_rougeLsum_score
*The underlying gender classifier is a rule based classifier which outputs one of 3 categories: male, female and neutral. *
Config
min_gender_rougeLsum_score:
min_score: 0.6
min_gender_rougeLsum_score:
min_score:
male: 0.7
female: 0.75
- min_score (dict or float): Minimum score to pass the test.
PREVIOUSContribution Guidelines