Rare find

prometheus. [ICLR 2024 & NeurIPS 2023 WS] An Evaluator LM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically designed for fine-grained evaluation on a customized score rubric, Prometheus is a good alternative for human evaluation and GPT-4 evaluation.

github.com/prometheus-eval/prometheus

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.