WEI HAORAN

picotron. Minimalistic 4D-parallelism distributed training framework for education purpose

immersive-translate. 沉浸式双语网页翻译扩展 , 支持输入框翻译， 鼠标悬停翻译， PDF, Epub, 字幕文件, TXT 文件翻译 - Immersive Dual Web Page Translation Extension

TheAgentCompany. An agent benchmark with tasks in a simulated software company.

multilingual-needle-in-a-haystack. Jupyter Notebook

PRIME. Scalable RL solution for advanced reasoning of language models

idioms-incontext-mt. idioms in context dataset

minimal-stable-PPO. A minimal and stable PPO.

EQ-Bench. A benchmark for emotional intelligence in large language models

mt-evaluation. A framework for evaluating Machine Translation models.

llm-datasets. A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.

prompt-cache. Modular and structured prompt caching for low-latency LLM inference

LanguageCodes. We present a list of languages with their codes, families, regions and etc. We also present a list of multi-lingual corpora (with urls).

GeniL. GeniL dataset is an effort for detecting various types of generalization in language. This multilingual dataset covers sentences in EN, FR, ES, PT, AR, HI, BN, MS, and ID and is annotated by native speakers of each language. Each sentence is collected from a public corpora of language and contains at least one identity group name and an attribute.

ethnologue. Data from Ethnologue (language code conversion & language family) and the web scraper.

ai-notes. notes for software engineers getting up to speed on new AI developments. Serves as datastore for https://latent.space writing, and product brainstorming, but has cleaned up canonical references under the /Resources folder.

OmniSearch. Repo for Benchmarking Multimodal Retrieval Augmented Generation with Dynamic VQA Dataset and Self-adaptive Planning Agent

lingua. Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.

Everything-of-Thoughts-XoT. An implemtation of Everyting of Thoughts (XoT).

Awesome-LLM-Strawberry. A collection of LLM papers, blogs, and projects, with a focus on OpenAI o1 🍓 and reasoning techniques.

O1-Journey. O1 Replication Journey

url-nlp. Python

lars_datasets. Lars's datasets

List-of-Dirty-Naughty-Obscene-and-Otherwise-Bad-Words. List of Dirty, Naughty, Obscene, and Otherwise Bad Words

sacreCOMET. Python

Qwen3-VL. Qwen3-VL is the multimodal large language model series developed by Qwen team, Alibaba Cloud.

ChatLearn. A flexible and efficient training framework for large-scale alignment tasks

Liger-Kernel. Efficient Triton Kernels for LLM Training

courses. Anthropic's educational courses

global-exams. Multilingual Global Exams

fragments. Open-source Next.js template for building apps that are fully generated by AI. By E2B.

Minitron. A family of compressed models obtained via pruning and knowledge distillation

cookbook. Deep learning for dummies. All the practical details and useful utilities that go into working with real models.

llm-datasets. Curated list of datasets and tools for post-training.

ToolLearningPapers.

deep-significance. Enabling easy statistical significance testing for deep neural networks.

opensubtitles-scraper. scrape subtitles from opensubtitles.org

llm-leaderboard. Project of llm evaluation to Japanese tasks

crewAI. Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.

MinerU. Transforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic workflows.

pypandoc. Thin wrapper for "pandoc" (MIT)

pandoc. Universal markup converter

math-evaluation-harness. A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨

ddgs. A metasearch library that aggregates results from diverse web search services

maps. Multicultural Proverbs and Sayings

LLM101n. LLM101n: Let's build a Storyteller

METAL-Towards-Multilingual-Meta-Evaluation. Official Codebase for "METAL: Towards Multilingual Meta-Evaluation" (published in Findings of ACL: NAACL 2024)

reddit-to-threads. Convert arctic_shift Reddit data dumps into thread-view documents

arctic_shift. Making Reddit data accessible to researchers, moderators and everyone else. Interact with the data through large dumps, an API or web interface.

clemcore. A Framework for the Systematic Evaluation of Chat-Optimized Language Models as Conversational Agents and an Extensible Benchmark

segmoe. Python

paxqa. Code and Data for "PAXQA: Generating Cross-lingual Question Answering Examples at Training Scale" (EMNLP 2023)

translation-agent. Python

NTREX. NTREX -- News Test References for MT Evaluation

xstreet.

Sophia. Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.

online_merging_optimizers. Implementations of online merging optimizers proposed by Online Merging Optimizers for Boosting Rewards and Mitigating Tax in Alignment

torchtitan. A PyTorch native platform for training generative AI models

transagents. The official repository of the paper "(Perhaps) Beyond Human Translation: Harnessing Multi-Agent Collaboration for Translating Ultra-Long Literary Texts"

Collie. [ICLR 2024] COLLIE: Systematic Construction of Constrained Text Generation Tasks

JMMLU. 日本語マルチタスク言語理解ベンチマーク Japanese Massive Multitask Language Understanding Benchmark

GuoFeng-Webnovel. Multilingual Corpus of Web Fiction

3AM. Official code and data of "3AM: An Ambiguity-Aware Multi-Modal Machine Translation Dataset"

SeaEval. NAACL 2024: SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural Reasoning

awesome-synthetic-datasets. awesome synthetic (text) datasets

UltraEval. [ACL 2024 Demo] Official GitHub repo for UltraEval: An open source framework for evaluating foundation models.

multilingual-register-labeling. Multilingual, multilabel modeling of registers

NeuScraper. [ACL 2024] This is the code repo for our ACL’24 paper "Cleaner Pretraining Corpus Curation with Neural Web Scraping".

QuRating. [ICML 2024] Selecting High-Quality Data for Training Language Models

LlamaFactory. Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

ThunderKittens. Tile primitives for speedy kernels

Xpersona. XPersona: Evaluating Multilingual Personalized Chatbot

simple-evals. Python

seahorse. Seahorse is a dataset for multilingual, multi-faceted summarization evaluation. It consists of 96K summaries with human ratings along 6 quality dimensions: comprehensibility, repetition, grammar, attribution, main idea(s), and conciseness, covering 6 languages, 9 systems and 4 datasets.

marker. Convert PDF to markdown + JSON quickly with high accuracy

sailcraft. 🚢 Data Toolkit for Sailor Language Models

databonsai. clean & curate your data with LLMs.

RTP-LX. Repository for the paper "RTP-LX: Can LLMs Evaluate Toxicity in Multilingual Scenarios?"

megalodon. Reference implementation of Megalodon 7B model

CLIcK. CLIcK: A Benchmark Dataset of Cultural and Linguistic Intelligence in Korean

CLiKA. Evaluation of the Cross-Lingual Knowledge Alignment in LLMs

EasyContext. Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.

tasksource. Datasets collection and preprocessings framework for NLP extreme multitask learning

GlotLID. [EMNLP 2023] 💬 Language Identification with Support for More Than 2000 Labels

mc2_corpus. [ACL'24] MC^2: A Multilingual Corpus of Minority Languages in China (Tibetan, Uyghur, Kazakh, and Mongolian)

flores. The FLORES+ Machine Translation Benchmark

mlama. Python

DeepSeek-VL. DeepSeek-VL: Towards Real-World Vision-Language Understanding

infinity. The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text.

aisys-building-blocks. Building blocks for foundation models.

OpenCodeInterpreter. OpenCodeInterpreter is a suite of open-source code generation systems aimed at bridging the gap between large language models and sophisticated proprietary systems like the GPT-4 Code Interpreter. It significantly enhances code generation capabilities by integrating execution and iterative refinement functionalities.

LWM. Large World Model -- Modeling Text and Video with Millions Context

unsloth. Unsloth is a local UI for training and running Kimi K3, Gemma 4, Qwen3.6, DeepSeek, GLM and other models.

GPTFast. Accelerate your Hugging Face Transformers 7.6-9x. Native to Hugging Face and PyTorch.

AceGPT. Python

nusa-crowd. A collaborative project to collect datasets in Indonesian languages.

wikipedia-utils. Utility scripts for preprocessing Wikipedia texts for NLP

Mr.Translate. ChatGPT 翻译助手 Prompt

Noi. 🚀 Less chaos. More flow.

mlx. MLX: An array framework for Apple silicon

SALMON. Self-Alignment with Principle-Following Reward Models

minbpe. Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

mamba-scans. Blog post

JCoLA.

FollowBench. [ACL 2024] FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models

Qwen3. Qwen3 is the large language model series developed by Qwen team, Alibaba Cloud.

Long-Context-Data-Engineering. Implementation of paper Data Engineering for Scaling Language Models to 128K Context

alignment-handbook. Robust recipes to align language models with human and AI preferences

lm-human-preferences. Code for the paper Fine-Tuning Language Models from Human Preferences

HaluEval. This is the repository of HaluEval, a large-scale hallucination evaluation benchmark for Large Language Models.

XGLUE. Cross-lingual GLUE

genshin-langdata. English-Chinese-Japanese translation dataset of the terms in Genshin Impact

nanotron. Minimalistic large language model 3D-parallelism training

deita. Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]

self-rewarding-lm-pytorch. Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI

primeqa. The prime repository for state-of-the-art Multilingual Question Answering research and development.

ToRA. ToRA is a series of Tool-integrated Reasoning LLM Agents designed to solve challenging mathematical reasoning problems by interacting with tools [ICLR'24].

Awesome-LLM-Long-Context-Modeling. 📰 Must-read papers and blogs on LLM based Long Context Modeling 🔥

Multilingual-Evaluation-of-Generative-AI-MEGA. Code for Multilingual Eval of Generative AI paper published at EMNLP 2023

globalbench. GlobalBench: A Benchmark for Global Progress in Language Technology

annotated-mamba. Annotated version of the Mamba paper

llama-moe. ⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)

mars. Mars is a tensor-based unified framework for large-scale data computation which scales numpy, pandas, scikit-learn and Python functions.

PowerInfer. High-speed Large Language Model Serving for Local Deployment

catwalk. This project studies the performance and robustness of language models and task-adaptation methods.

agentlego. Enhance LLM agents with rich tool APIs

SafetyBench. Official github repo for SafetyBench, a comprehensive benchmark to evaluate LLMs' safety. [ACL 2024]

InfiniteBench. Codes for the paper "∞Bench: Extending Long Context Evaluation Beyond 100K Tokens": https://arxiv.org/abs/2402.13718

weak-to-strong. Python

promptbase. All things prompt engineering

Safety-Prompts. Chinese safety prompts for evaluating and improving the safety of LLMs. 中文安全prompts，用于评估和提升大模型的安全性。

OMGEval. OMGEval😮: An Open Multilingual Generative Evaluation Benchmark for Foundation Models

mamba. Mamba SSM architecture

seamless_communication. Foundational Models for State-of-the-Art Speech and Text Translation

software-documentation-data-set-for-machine-translation. A parallel evaluation data set of SAP software documentation with document structure annotation

RefGPT. Python

gpt-fast. Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

DeepSeek-LLM. DeepSeek LLM: Let there be answers

chatgpt_system_prompt. A collection of GPT system prompts and various prompt injection/leaking knowledge.

MELA. TeX

XLingEval. Code and Resources for the paper, "Better to Ask in English: Cross-Lingual Evaluation of Large Language Models for Healthcare Queries"

Yuan-2.0. Yuan 2.0 Large Language Model

bff. Rust

open-instruct. AllenAI's post-training codebase

work_space. NLP 项目记录档案

InstructionWild.

LookaheadDecoding. [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding

Awesome-Embodied-Robotics-and-Agent. This is a curated list of "Embodied AI or robot with Large Language Models" research. Watch this repository for the latest updates! 🔥

Active-IT. Code for our EMNLP-2023 paper: "Active Instruction Tuning: Improving Cross-Task Generalization by Training on Prompt Sensitive Tasks"

UniversalNER.

lm-polygraph. Python

PiPPy. Pipeline Parallelism for PyTorch

XVERSE-65B. XVERSE-65B: A multilingual large language model developed by XVERSE Technology Inc.

fondant. Production-ready data processing made easy and shareable

Yi. A series of large language models trained from scratch by developers @01-ai

DeepSeek-Coder. DeepSeek Coder: Let the Code Write Itself

SWE-bench. SWE-bench: Can Language Models Resolve Real-world Github Issues?

FastChat. An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

data-juicer. Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

ScienceWorld. ScienceWorld is a text-based virtual environment centered around accomplishing tasks from the standardized elementary science curriculum.

LLMDataHub. A quick guide (especially) for trending instruction finetuning datasets

TensorRT-LLM. TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

maxtext. A simple, performant, and scalable Jax LLM!

autogen. A programming framework for agentic AI

CloudflareSpeedTest. 🌩「自选优选 IP」测试 Cloudflare CDN 延迟和速度，获取最快 IP ！当然也支持其他 CDN / 多个解析 IP 的网站 ~

LightSeq. Official repository for DistFlashAttn: Distributed Memory-efficient Attention for Long-context LLMs Training

chathub. TypeScript

Deep-reinforcement-learning-with-pytorch. PyTorch implementation of DQN, AC, ACER, A2C, A3C, PG, DDPG, TRPO, PPO, SAC, TD3 and ....

streaming-llm. [ICLR 2024] Efficient Streaming Language Models with Attention Sinks

SmartPlay. SmartPlay is a benchmark for Large Language Models (LLMs). Uses a variety of games to test various important LLM capabilities as agents. SmartPlay is designed to be easy to use, and to support future development of LLMs.

NGT. Nearest Neighbor Search with Neighborhood Graph and Tree for High-dimensional Data

belebele. Repo for the Belebele dataset, a massively multilingual reading comprehension dataset.

ebooklib. A versatile Python library for EPUB2/EPUB3 manipulation and processing.

BMPrinciples. A collection of phenomenons observed during the scaling of big foundation models, which may be developed into consensus, principles, or laws in the future

Xwin-LM. Xwin-LM: Powerful, Stable, and Reproducible LLM Alignment

OpenRLHF. An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)

LLM-Agent-Survey.

cog. Containers for machine learning

LLM-Agent-Paper-List. The paper list of the 86-page SCIS cover paper "The Rise and Potential of Large Language Model Based Agents: A Survey" by Zhiheng Xi et al.

Pai-Megatron-Patch. The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.

guidance. A guidance language for controlling large language models.

agents. An Open-source Framework for Data-centric, Self-evolving Autonomous Language Agents

reflexion. [NeurIPS 2023] Reflexion: Language Agents with Verbal Reinforcement Learning

mlc-llm. Universal LLM Deployment Engine with ML Compilation

OmniQuant. [ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.

tm2tb. Bilingual term extractor

linguee-api. Proxy to convert HTML responses from linguee.com to JSON format

localization-xml-mt. A High-Quality Multilingual Dataset for Structured Documentation Translation

LLMAgentPapers. Must-read Papers on LLM Agents.

akshare. AKShare is an elegant and simple financial data interface library for Python, built for human beings! 开源财经数据接口库

ms-agent. MS-Agent: a lightweight framework to empower agentic execution of complex tasks

ToolQA. ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels (easy/hard) across eight real-life scenarios.

openinterpreter. A coding agent for open models like Kimi K3

Baichuan2. A series of large language models developed by Baichuan Intelligent Technology

DiffusionLLM. Code for paper "Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning"

Awesome-Code-LLM. 👨‍💻 An awesome and curated list of best code-LLM for research.

GPTQ-triton. GPTQ inference Triton kernel

Mol-Instructions. [ICLR 2024] Mol-Instructions: A Large-Scale Biomolecular Instruction Dataset for Large Language Models

xtuner. A Next-Generation Training Engine Built for Ultra-Large MoE Models

FinGPT. FinGPT: Open-Source Financial Large Language Models! Revolutionize 🔥 We release the trained model on HuggingFace.

llama_index. LlamaIndex is the leading document agent and OCR platform