flex-evals. A Python implementation of the Flexible Evaluation Protocol (FEP) - a vendor-neutral, schema-driven standard for evaluating any system that produces complex or variable outputs, from deterministic APIs to non-deterministic LLMs and agentic workflows.

github.com/shane-kercheval/flex-evals

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.