Rare find
Needle. Test how well AI models find specific information buried in long documents.
github.com/gkamradt/needle-in-a-haystack
Vaya's read on this project
Problem, audience, market, and the verdict — sign in to see it.
Updates
June 2026
- Merge pull request #61 from waylonflinn/main
- add support for alternate OpenAI providers, including local models
May 2026
- Add 'niah demo' zero-config command and simplify README quickstart
- README: split end-user (pip install + bare niah) from contributor (gi…
- Release —v2.0.0 — Clean refactor
- Merge refactor/v2: clean v2.0.0 rewrite
- Auto-load .env on niah startup + add gpt-4o-mini model config
- niah validate: skip SDK client construction so it works without API keys
- README: v2 rewrite with quick start + niah CLI
- Phase 7: real provider plugins (OpenAI, Anthropic, Cohere)
- RepeatingTextHaystack: soft warning when source text exceeds 10 KB
- Phase 6: config schema, niah CLI, reconstruction
- Phase 5: runner, sweep, and JSONL store
- Phase 4: task layer + registry (single, multi, uuid, uuid_chain)
- Phase 3: haystacks, needles, inserters, scorers
- Refactor v2 phases 0-2: uv packaging, core types, FakeProvider
April 2024
- Merge pull request #40 from arkadyark-cohere/add-cohere
- Merge branch 'main' into add-cohere
March 2024
- Merge pull request #26 from pavelkraleu/17-implement-docker-for-testing
- Update requirements, clean up cohere SDK code, add langchain to suppo…
- Update README.md