Rare find

DeepSeek Flash. Run a powerful AI model on your Mac without needing a data center.

github.com/antirez/llama.cpp-deepseek-v4-flash

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

April 2026
  • Speed up DeepSeek V4 prompt replay
  • Add DeepSeek V4 tool-call chat template
  • Fix DeepSeek V4 long-context graph metadata
  • Remove stale DeepSeek V4 quantize tool build entry
  • Optimize DeepSeek V4 Metal HC decode
  • README: advertise this is a fork, and provide instructions.
  • Add DeepSeek V4 Flash inference support
  • metal : print GPU description (#22318)
  • common : fix jinja warnings with clang 21 (#22313)
  • ggml : minor coding style (#22308)
  • jinja : remove unused header (#22310)
  • server : fix swa-full logic (#22288)
  • server: rename debug tags to match --cache-idle-slots naming (#22292)
  • hexagon: add SOLVE_TRI op (#21974)
  • fix(shader): handle the buffer aliasing for rms fuse (#22266)
  • cli: Remove redundant local sampling variables (#20429) (#22264)
  • hexagon: add support for basic and extended Op profiling (#22269)
  • Enable testing on Snapdragon devices (#21051)
  • server : convert_anthropic_to_oai: also copy chat_template_kwargs (#2…
  • server: fix heap-buffer-overflow from negative n_discard (CVE-2026-21…