1.3.0
📢 Highlights
LangTest 1.3.0 Release by John Snow Labs 🚀: We’ve amped up our support for Clinical-Tests, made it simpler to upload models and augmented datasets to HF, and ventured into the domain of Prompt-Injection tests. Streamlined codebase, bolstered unit test coverage, added support for custom column names in harness for CSVs and polished contribution protocols with bug fixes!
🔥 New Features
- Adding support for clinical-tests.
- Adding support for prompt-injection test.
- Updated Harness format.
- Adding support for model/dataset upload to HF.
- Adding contribution guidelines.
- Improving Unittest coverage.
- Adding support for custom column names in harness for csv.
❓ How to Use
pip install "langtest[langchain,openai,transformers]"
import os
os.environ["OPENAI_API_KEY"] = <ADD OPEN-AI-KEY>
Create your test harness in 3 lines of code 
# Import and create a Harness object
from langtest import Harness
harness = Harness(task="clinical-tests",model={"model": "gpt-3.5-turbo-instruct", "hub": "openai"},data = {"data_source": "Gastroenterology-files"})
# Generate test cases, run them and view a report
h.generate().run().report()
🐛 Bug Fixes
- Fix fairness scores