Packages
Each package has a page, which is its README.
TypeScript
Section titled “TypeScript”| Package | Purpose | Uses from your project |
|---|---|---|
@trialkit/vitest |
Vitest adapter | vitest ^4.1.12 || ^5.0.3 |
@trialkit/jest |
Jest adapter | jest ^29 || ^30 |
@trialkit/node-test |
node:test adapter |
None (Node.js built-in) |
@trialkit/core |
Run evals without a test runner | None |
@trialkit/scorers |
Exact match, regex, schema validation and other scorers | None; schema takes your Standard Schema validator |
@trialkit/judge |
LLM judges, calibration and drafts of cases for review | Optional: openai ^4.55 to ^7, or ai ^6.0.214 || ^7.0.4 |
@trialkit/replay |
Record HTTP replies and replay offline | None |
@trialkit/cases |
Cases from YAML and TOML files; drafts to YAML or JSON Lines | Optional: yaml ^2.8.3 or smol-toml ^1.9 |
trialkit |
Reports and regression gates | None |
@trialkit/report-junit |
JUnit XML | None |
@trialkit/report-otel |
OpenTelemetry | @opentelemetry/api ^1 |
@trialkit/report-mlflow |
MLflow and Databricks | None |
@trialkit/studio |
Alpha, parked: local page to edit config and cases and run trials | @trialkit/core, trialkit |
Python
Section titled “Python”| Package | Purpose | Uses from your project |
|---|---|---|
pytest-trialkit |
pytest plugin | pytest >=9.0.3,<10 |
trialkit-core |
Python core | None |
trialkit-scorers |
Deterministic scorers | None |
trialkit-cases |
Cases from YAML and TOML files; drafts to YAML or JSON Lines | TOML: standard library; YAML: extra ruamel.yaml |
trialkit-judge |
Judges, calibration, an OpenAI-compatible client and drafts of cases | None (standard library HTTP) |
trialkit-report-mlflow |
MLflow reporter | None (standard library HTTP) |