Rare find

TinyChat. Run AI chat models on your laptop without sending data to the cloud.

mit-han-lab.github.io/TinyChatEngine

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

July 2024
  • Update README.md
  • Update huggingface models (#114)
June 2024
  • Fix CUDA implementation (#112)
May 2024
  • Support Llama-3 and Mistral models (#107)
April 2024
  • Fix bugs for ARM platforms (#103)
  • Update models (#102)
March 2024
  • update readme
  • update readme
  • Update VILA and UI (#97)
February 2024
  • fix bug
  • fix matrix3d int type error for windows (#81)
  • Support VILA (#94)
  • Update README.md
  • update figure
  • update readme and add figures
  • Support LLaVA (#89)
January 2024
  • minor
  • update readme
  • support voicechat
  • Update README.md