Rare find

Aici. Control what an AI model generates, token by token.

github.com/microsoft/aici

Problem

The full read on this project is a sign-in away — what it solves, who it serves, and where it sits in the market.

Audience

The full read on this project is a sign-in away — what it solves, who it serves, and where it sits in the market.

Market

The full read on this project is a sign-in away — what it solves, who it serves, and where it sits in the market.

Pricing

The full read on this project is a sign-in away — what it solves, who it serves, and where it sits in the market.

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

January 2025

Update README.md Jan 22

November 2024

chore: update Dockerfile-prod-cpp (#118) Nov 10

August 2024

Uninstall transformer_engine (#110) Aug 13
Merge remote-tracking branch 'origin/main' into split_toktrie Aug 12
update vllm to 0.5.3.post1 + patch Aug 12
update submodules Aug 12

July 2024

add test scripts Jul 30
fix cleanup of aborted reqs Jul 30
fix crash Jul 30
update submodules Jul 24
fix script Jul 24
fix TokenParser ctor call Jul 22
update submodules Jul 22
Bump openssl in the cargo group across 1 directory (#113) Jul 22
fix vllm submodule Jul 19
update submodules Jul 19
check for backtracking Jul 11
add missing config file Jul 11
perf work Jul 11
fix token accounting Jul 10

April 2024

Release —v0.2.1 Apr 29
Release —v0.2.0 Apr 23
Release —v0.1.0 Apr 15

February 2024

Release —v0.0.10 Feb 23
Release —v0.0.9 Feb 22
Release —v0.0.8 Feb 9
Release —v0.0.7 Feb 2

January 2024

Release —v0.0.5 Jan 31
Release —v0.0.4 Jan 26
Release —v0.0.3 Jan 19