RWKV-LM. RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

github.com/ishandutta2007/RWKV-LM

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

June 2026
  • context parallelism demo
  • better
  • rwkv7 vs qwen35
  • Update README.md
  • Merge branch 'main' of https://github.com/BlinkDL/RWKV-LM
  • numpy demo to compare RWKV-7 & QWEN3.5
  • Update README.md
  • Update README.md
May 2026
  • alt kernel
  • Update README.md
  • update
  • Update README.md
  • Update README.md
  • option for new kernel
  • guide for reducing VRAM (for large bsz)
  • rwkv7 hsz 128 kernel
  • faster kernel
April 2026
  • Update RWKV7-G1x-templates.txt
  • Update RWKV7-G1x-templates.txt
  • Update RWKV7-G1x-templates.txt