Skip to content

Packages

Each package has a page, which is its README.

Package Purpose Uses from your project
@trialkit/vitest Vitest adapter vitest ^4.1.12 || ^5.0.3
@trialkit/jest Jest adapter jest ^29 || ^30
@trialkit/node-test node:test adapter None (Node.js built-in)
@trialkit/core Run evals without a test runner None
@trialkit/scorers Exact match, regex, schema validation and other scorers None; schema takes your Standard Schema validator
@trialkit/judge LLM judges, calibration and drafts of cases for review Optional: openai ^4.55 to ^7, or ai ^6.0.214 || ^7.0.4
@trialkit/replay Record HTTP replies and replay offline None
@trialkit/cases Cases from YAML and TOML files; drafts to YAML or JSON Lines Optional: yaml ^2.8.3 or smol-toml ^1.9
trialkit Reports and regression gates None
@trialkit/report-junit JUnit XML None
@trialkit/report-otel OpenTelemetry @opentelemetry/api ^1
@trialkit/report-mlflow MLflow and Databricks None
@trialkit/studio Alpha, parked: local page to edit config and cases and run trials @trialkit/core, trialkit
Package Purpose Uses from your project
pytest-trialkit pytest plugin pytest >=9.0.3,<10
trialkit-core Python core None
trialkit-scorers Deterministic scorers None
trialkit-cases Cases from YAML and TOML files; drafts to YAML or JSON Lines TOML: standard library; YAML: extra ruamel.yaml
trialkit-judge Judges, calibration, an OpenAI-compatible client and drafts of cases None (standard library HTTP)
trialkit-report-mlflow MLflow reporter None (standard library HTTP)