sgrep.

github.com/andrewgazelka/sgrep

Problem

The full read on this project is a sign-in away — what it solves, who it serves, and where it sits in the market.

Audience

The full read on this project is a sign-in away — what it solves, who it serves, and where it sits in the market.

Market

The full read on this project is a sign-in away — what it solves, who it serves, and where it sits in the market.

Pricing

The full read on this project is a sign-in away — what it solves, who it serves, and where it sits in the market.

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

December 2025

Reuse input buffers across batch encodings Dec 10
Batch GPU MaxSim into single matmul Dec 10
Add batch write support to embedding store Dec 10
Add document chunking for improved search quality Dec 10
Parallelize file I/O and increase batch sizes Dec 10
Exclude .git/ directory from indexing Dec 10
Add BM25 tokenizer quality tests Dec 10
Include file path header in BM25 and embedding indexing Dec 10
Refactor tokenizer to use tantivy pipeline Dec 10
Batch BM25 index writes for ~100x faster indexing Dec 10
Enable native CPU optimizations Dec 10
Add parallel tokenization, GPU normalization, dynamic batching Dec 10
Pre-allocate contiguous buffers in batch encoding Dec 10
Add semantic quality tests for ColBERT encoder Dec 10
Add batched GPU encoding for ~3x faster indexing Dec 10
Always ignore .sgrep directory during indexing Dec 10
Show current file in progress bar, remove verbose flag Dec 10
Add progress bar for indexing with indicatif Dec 10
Add badges: license, platform, Rust version, issues Dec 9
Add MIT LICENSE file Dec 9