Performance Notebook

 

Overview

In this performance notebook, we are evaluating dslim/bert-base-NER model on Performance test. The goal of performance testing is to determine the average time taken by the model to give the complete response.

Open in Collab

Category Hub Task Open In Colab
Performance Huggingface NER Open In Colab

Config Used

tests:
  defaults:
    min_pass_rate: 0.65
  robustness:
    lowercase:
      min_pass_rate: 0.66
    uppercase:
      min_pass_rate: 0.66
  performance:
    speed:
      min_pass_rate: 100
      unit: 'token/sec'