LangTest is an open-source Python library designed to help developers deliver safe and effective Natural Language Processing (NLP) models. You can install langtest using pip.
Installation
Using PyPI:
pip install langtest
The library supports 60+ out of the box tests for John Snow Labs, Hugging Face, OpenAI, Cohere, AI21, Azure-OpenAI and Spacy models. These tests fall into robustness, toxicity, accuracy, bias, representation, legal-tests, clinical-tests, sensitivity, sycophancy, fairness and many other test categories for NER, Text Classification, Summarization, Translation, Text-Generation, Fill-Mask and Question Answering models, with support for many more models and test types actively being developed.