trialkit: design
Why trialkit works the way it does. The README and the guide show how to use it. This page keeps decisions and their reasons; each contract lives in one README or in spec/, and a link says which. It is a living document.
- Name:
trialkit. npm packages@trialkit/*; PyPI distributionstrialkit-*, imported astrialkit.*. (evalkitis taken on npm and PyPI, and someone else published@evalkit/core.)
Sections
Section titled “Sections”- 1. Problem
- 2. Prior art
- 3. Goals and non-goals
- 4. Concepts
- 5. Architecture
- 6. Core API
- 7. Trials, outcomes and statistics
- 8. Judges
- 9. Model port
- 10. Runner adapters
- 11. Events, results and backends
- 12. Guidance: unit tests, component evals and black-box evals
- 13. Testing the library
- 14. Open questions
- 15. Studio (alpha, parked)