LLM practitioner specializing in model training and infrastructure inference.
MINI_LLM. This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.
503infini-mini-transformer. This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and training code.
59MiniCharacterLLM. 这是一个一键让小参数大模型进行角色扮演的项目,从数据构成和训练都包含在这项目中
27llm_learning. 这是个人关于llm的学习归纳,把我学到的知识分享给大家,让大家也能系统和简单学习llm理论及应用实战
8python. Python学习
1BaldEagle. Unofficial implementation of EAGLE Speculative Decoding
1