astro-mecure. My personal blog built with Astro, React and Tailwindcss.
79ullm. Lightweight LLM inference engine inspired by nano-vllm, with radix-tree based prefix cache, tp & pp, cuda graph, openai api, async scheduling, and more.
11hexo-theme-mercure. JavaScript
4flash_attention_cute. Python
3TensorRT-Runtime. a python wrapper for TensorRT API
2cuda_reduce_optimization. Cuda
2super-mario. 超级马里奥游戏仿制
2