Rare find

Llama4Micro. An AI model that runs on a tiny computer chip instead of a big server.

github.com/maxbbraun/llama4micro

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

December 2023
  • Cleaner way to specify the custom linker script
  • Clarify that we're not using the smallest model
November 2023
  • Highlight inference location
  • Fix variable name typo
  • Merge pull request #7 from maxbbraun/camera-input
  • Remove unused intermediate file
  • Move TPU context to narrower scope
  • Freeing up memory from TPU doens't seem to work
  • No objects log is no error
  • Implement non-maximum suppression
  • Switch to YOLOv5 for object detection
  • Move models dir and include them in the repo
  • Add ultralytics/yolov5 submodule
  • Merge branch 'main' into camera-input
  • Code cleanup
  • Add image classification (on TPU) to use in prompt
  • Adjust memory map for adding camera/TPU inference
  • Clarify that Llama isn't running on the TPU
  • Code cleanup
  • Remove the need for a forked coralmicro