Rare find

oxibonsai. OxiBonsai is a zero-FFI, zero-C/C++ inference engine for PrismML's sub-2-bit Bonsai family — both the 1-bit line (Q1_0_g128) and the ternary line (TQ2_0_g128). It runs on CPU (SIMD), Apple Silicon (Metal), and NVIDIA (CUDA) without depending on llama.cpp, BLAS, or any C/Fortran runtime.

github.com/cool-japan/oxibonsai

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.