Grammar Notebook

 

Overview

In the Grammar notebook, we’re looking at how tough the lvwerra/distilbert-imdb model is. The Grammar Test assesses language models’ proficiency in intelligently identifying and correcting intentional grammatical errors, ensuring refined language understanding and enhancing overall processing quality.

Open in Collab

Category Hub Task Open In Colab
Grammar Huggingface Text-Classification Open In Colab

Config Used

tests:     
  defaults:
    min_pass_rate: 0.65
  grammar:
    paraphrase:
      min_score: 0.66

Supported Tests

  • paraphrase: Assesses a model’s ability to identify and generate linguistic alternatives conveying the same meaning, evaluating its proficiency in understanding and expressing diverse language constructs within the Grammar Testing framework.