Rare find

LLM.C. Train AI models in plain C instead of heavy frameworks.

github.com/karpathy/llm.c

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

May 2025
  • Merge pull request #801 from ngc92/ngc92/fix-test
April 2025
  • adjusted error thresholds
  • reorder checks to match actual tensor order
October 2024
  • Merge pull request #766 from msaroufim/patch-1
September 2024
  • Update README.md
  • cuda mode -> gpu mode
  • change default params: use tinyshakespeare and decrease LR
August 2024
  • Merge pull request #724 from GaoYusong/master
  • Merge pull request #733 from zhangpiu/feature/llm.cpp
  • Merge pull request #735 from gordicaleksa/minor_refactor3
  • Merge pull request #744 from dengl11/pr
  • Merge pull request #745 from karpathy/feature/managed2
  • i misspelled reduced
  • reduce across GPUs nicer
  • fallback to memory allocation of m,v,master_weights on host automatic…
  • fix makefile for multigpu setups
  • hint to host
  • just try to allocate on device; fallback if that fails
  • fall back to cudaMallocManaged for optimizer states if we're out of m…
  • fix a typo