Rare find

LM.rs. Run AI language models on your computer without needing special software or the internet.

github.com/samuel-vitorino/lm.rs

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

October 2024
  • Minor fix
  • Remove old comment
  • Minor warnings fix
  • Merge with main
  • Remove unsafe code
  • Use matmul for conv2d
  • Update README with video demos
  • Change the resize filter to triangle
  • Change default temperature
  • Minor README update
  • Update some benchmarks
  • Update README
  • Minor matmul fix
  • Minor fix for 9B
  • Minor fix
  • Unroll matmul and parallelize layernorm
  • Add batch preprocessing
  • Unroll outer matmul loop
  • Minor backend fix
  • Fix backend dependecies