Rare find

LLM Viewer. See how AI models actually run on your hardware.

github.com/hahnyuan/LLM-Viewer

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

September 2024
  • api port
  • frontend version 0.4.0
  • hardware params add A6000 Ada
  • Fix
  • Tensor parallelism support
August 2024
  • Update model_analyzer.py
  • Merge pull request #3 from feifeibear/0311
  • Merge branch 'main' into 0311
July 2024
  • fix bug in compute flashattntion kv load data
June 2024
  • api.llm-viewer.com no port
May 2024
  • add citation
  • support gpt-j-6B in frontend
April 2024
  • Support EleutherAI/gpt-j-6B
  • Merge pull request #5 from jschenxiaoyu/main
  • [fix] Fix data of qk_matmul in prefill stage
March 2024
  • Create LICENSE
  • fix bug in node click after change graph
  • DiT cli ok
  • support opt model
  • 2-bit and 1-bit support