YuanLi

UniWorld-View. Official implementation of UniWorld-View

ChronoPhyBench. Python

OpenAI4S. 9.9 元豆包API复刻 Claude Science

GEAR. Python

MoleCode. Molecode presents molecules as code and enables LLMs to operate and reason on chemistry directly.

OSP-Next. OSP-Next

OmniPSD. Official code implementation of "OmniPSD: Layered PSD Generation with Diffusion Transformer"

TIDE-Page. Turning the TIDE: Cross-Architecture Distillation for Diffusion Large Language Models

TIDE. Turning the TIDE: Cross-Architecture Distillation for Diffusion Large Language Models

ClawGame. A living arena for Human vs Agent and Agent vs Agent competition, testing OpenClaw intelligence through real-time gameplay.

Helios. Helios: Real Real-Time Long Video Generation Model

ChemCraft. Official Implementation of "Agentic reinforcement learning empowers next-generation chemical language models for molecular design and synthesis"

UltraShape-1.0. High-Fidelity 3D Shape Generation via Scalable Geometric Refinement

UniSandBox. Does Understanding Inform Generation in Unified Multimodal Models? From Analysis to Path Forward

Edit-R1. Edit-R1: Reinforce Image Editing with Diffusion Negative-Aware Finetuning and MLLM Implicit Feedback

FlashI2V. An official implementation of FlashI2V.

UAE. Official repository for the UAE paper, unified-GRPO, and unified-Bench

HME. Here is the official code for Nature Communications "Navigating Chemical-Linguistic Sharing Space with Heterogeneous Molecular Encoding".

AsFT. Code for the paper "AsFT: Anchoring Safety During LLM Fune-Tuning Within Narrow Safety Basin".

Look-Back. This repository is the official implementation of "Look-Back: Implicit Visual Re-focusing in MLLM Reasoning".

ChemCoTBench. LLM Reasoning Benchmark & Chain-of-Thoughts Dataset for Chemistry

safe-rlhf. Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

UniWorld. UniWorld: High-Resolution Semantic Encoders for Unified Visual Understanding and Generation

OpenS2V-Nexus. [NeurIPS 2025 D&B🔥] OpenS2V-Nexus: A Detailed Benchmark and Million-Scale Dataset for Subject-to-Video Generation

GS2E. [NeurIPS 2025 D&B🔥] Implementation of "GS2E: Gaussian Splatting is an Effective Data Generator for Event Stream Generation"

ImgEdit. [NeurIPS 2025 D&B🔥] ImgEdit: A Unified Image Editing Dataset and Benchmark

bioprobench. Code for 2026 ICML paper 'BioProBench: Comprehensive Dataset and Benchmark in Biological Protocol Understanding and Reasoning'.

HoloTime. [ACM MM 2025] HoloTime: Taming Video Diffusion Models for Panoramic 4D Scene Generation

GPT-ImgEval. GPT-ImgEval: Evaluating GPT-4o’s state-of-the-art image generation capabilities

WISE. [ICML 2026🔥] WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generation

SwapAnyone. An official implementation of SwapAnyone.

Reasoning-Attack.

NeuralGS. [AAAI 2026 🔥] Official implementation of "NeuralGS: Bridging Neural Fields and 3D Gaussian Splatting for Compact 3D Representation"

GPT-as-Language-Tree. GPT as a Monte Carlo Language Tree: A Probabilistic Perspective

Next-Patch-Prediction. [AAAI26] Next Patch Prediction

O1-Journey. O1 Replication Journey

ReconDreamer. [CVPR 2025] ReconDreamer

SciPIP. The official repository for the Scientific Paper Idea Proposer (SciPIP)

N-LoRA. 【COLING 2025🔥】Code for the paper "Is Parameter Collision Hindering Continual Learning in LLMs?".

ConsisID. [CVPR 2025 Highlight🔥] Identity-Preserving Text-to-Video Generation by Frequency Decomposition

WF-VAE. [CVPR 2025🔥] Enhancing Video VAE by Wavelet-Driven Energy Flow for Latent Video Diffusion Model

LLaVA-CoT. [ICCV 2025] LLaVA-CoT, a visual language model capable of spontaneous, systematic reasoning

VideoGen-Eval. VideoGen-Eval: Agent-based System for Video Generation Evaluation

Allegro. Allegro is a powerful text-to-video model that generates high-quality videos up to 6 seconds at 15 FPS and 720p resolution from simple text input.

MoH. MoH: Multi-Head Attention as Mixture-of-Head Attention

MoE-plus-plus. [ICLR 2025] MoE++: Accelerating Mixture-of-Experts Methods with Zero-Computation Experts

Artemis. [NeurIPS 2024] Artemis: Towards Referential Understanding in Complex Videos

ViewCrafter. [TPAMI 2025] ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesis

CRAT. Python

Cycle3D. [AAAI 2025🔥] Official implementation of Cycle3D: High-quality and Consistent Image-to-3D Generation via Generation-Reconstruction Cycle

ChronoMagic-Bench. [NeurIPS 2024 D&B Spotlight🔥] ChronoMagic-Bench: A Benchmark for Metamorphic Evaluation of Text-to-Time-lapse Video Generation

chameleon. Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.

LLMBind. LLMBind: A Unified Modality-Task Integration Framework

ShareGPT4Video. [NeurIPS 2024] An official implementation of "ShareGPT4Video: Improving Video Understanding and Generation with Better Captions"

EvaGaussians.

InternLM-XComposer. InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

Omost. Your image is almost there!

DCVC. Deep Contextual Video Compression

ReVideo. NeurIPS 2024

Uniaa. Unified Multi-modal IAA Baseline and Benchmark

Open-Sora-Dataset. Python

MagicTime. [TPAMI 2025🔥] MagicTime: Time-lapse Video Generation Models as Metamorphic Simulators

Envision3D. Envision3D: One Image to 3D with Anchor Views Interpolation

Open-Sora-Plan. This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.

TaxDiff. The official code for "TaxDiff: Taxonomic-Guided Diffusion Model for Protein Sequence Generation"

ProLLaMA. A Protein Large Language Model for Multi-Task Protein Language Processing

ECDFormer. 【Nature Computational Science 2025🔥】Deep peak property learning for efficient chiral molecules ECD spectra prediction

MoE-LLaVA. 【TMM 2025🔥】 Mixture-of-Experts for Large Vision-Language Models

repaint123. Official implementation of Repaint123: Fast and High-quality One Image to 3D Generation with Progressive Controllable 2D Repainting (ECCV 2024)

Machine-Mindset. An MBTI Exploration of Large Language Models

minGPT. A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

MedLLMsPracticalGuide. [Nature Reviews Bioengineering🔥] Application of Large Language Models in Medicine. A curated list of practical guide resources of Medical LLMs (Medical LLMs Tree, Tables, and Papers)

Video-Bench. A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language Models!

Video-LLaVA. 【EMNLP 2024🔥】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection

GPT-4V_Social_Media. GPT-4V(ision) as A Social Media Analysis Engine

Chat-UniVi. [CVPR 2024 Highlight🔥] Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understanding

Progressive3D. Official implementation of "Progressive3D: Progressively Local Editing for Text-to-3D Content Creation with Complex Semantic Prompts" [ICLR 2024]

GraphMotion. [NeurIPS 2023] Act As You Wish: Fine-Grained Control of Motion Diffusion Model with Hierarchical Semantic Graphs

LanguageBind. 【ICLR 2024🔥】 Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment

Hallucination-Attack. Attack to induce LLMs within hallucinations

Chinese-LLaMA-Alpaca-2. 中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)

T2I-Adapter. T2I-Adapter

DiffusionRet. [ICCV 2023] DiffusionRet: Generative Text-Video Retrieval with Diffusion Model

Spike-Driven-Transformer. Offical implementation of "Spike-driven Transformer" (NeurIPS2023)

MADAv2. MADAv2: Advanced Multi-Anchor Based Active Domain Adaptation Segmentation

DragDiffusion. [CVPR2024, Highlight] Official code for DragDiffusion

ChatExcel.

ChatLaw. ChatLaw：A Powerful LLM Tailored for Chinese Legal. 中文法律大模型

PointGPT. [NeurIPS 2023] PointGPT: Auto-regressively Generative Pre-training from Point Clouds

SAVC. [CVPR 2023] Learning with Fantasy: Semantic-Aware Virtual Contrastive Constraint for Few-Shot Class-Incremental Learning

LoRA. Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

HBI. [CVPR 2023 Highlight & TPAMI] Video-Text as Game Players: Hierarchical Banzhaf Interaction for Cross-Modal Representation Learning

prompts.chat. f.k.a. Awesome ChatGPT Prompts. Share, discover, and collect prompts from the community. Free and open source — self-host for your organization with complete privacy.

FedCLS. [ICLR2023] Towards Understanding and Mitigating Dimensional Collapse in Heterogeneous Federated Learning (https://arxiv.org/abs/2210.00226)

spikformer. ICLR 2023, Spikformer: When Spiking Neural Network Meets Transformer

fairseq. Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

DynaMixer. Python

GraphMAE. GraphMAE: Self-Supervised Masked Graph Autoencoders in KDD'22

tiny-transformers. [ECCV 2022] Implementation of the paper "Locality Guidance for Improving Vision Transformers on Tiny Datasets"

adapters. A Unified Library for Parameter-Efficient and Modular Transfer Learning

ViT-CIFAR. PyTorch implementation for Vision Transformer[Dosovitskiy, A.(ICLR'21)] modified to obtain over 90% accuracy FROM SCRATCH on CIFAR-10 with small number of parameters (= 6.3M, originally ViT-B has 86M).

MADA. Multi-Anchor Active Domain Adaptation for Semantic Segmentation (ICCV 2021 Oral)

HAT. Implementation of HAT https://arxiv.org/pdf/2204.00993

Point-MAE. [ECCV2022] Masked Autoencoders for Point Cloud Self-supervised Learning

AI4Science101. AI for Science

Uni-Mol. Official Repository for the Uni-Mol Series Methods

se3-transformer-public. code for the SE3 Transformers paper: https://arxiv.org/abs/2006.10503

v2ray-core. A platform for building proxies to bypass network restrictions.

Qv2ray. :star: Linux / Windows / macOS 跨平台 V2Ray 客户端 | 支持 VMess / VLESS / SSR / Trojan / Trojan-Go / NaiveProxy / HTTP / HTTPS / SOCKS5 | 使用 C++ / Qt 开发 | 可拓展插件式设计 :star:

shadowsocks-qt5. A cross-platform shadowsocks GUI client

GeoMol. Python

paper-reading. 深度学习经典、新论文逐段精读

FAN. Official PyTorch implementation of Fully Attentional Networks

Paper-Writing-Tips. MLNLP社区用来帮助大家避免论文投稿小错误的整理仓库。 Paper Writing Tips

PaddleViT. :robot: PaddleViT: State-of-the-art Visual Transformer and MLP Models for PaddlePaddle 2.0+

Jittor-MLP. Unofficial Implementation of MLP-Mixer, gMLP, resMLP, Vision Permutator, S2MLP, S2MLPv2, RaftMLP, HireMLP, ConvMLP, AS-MLP, SparseMLP, ConvMixer, SwinMLP, RepMLPNet, WaveMLP, MorphMLP, DynaMixer, MS-MLP, Sequencer2D in Jittor and PyTorch! Now, Rearrange and Reduce in einops.layers.jittor are support!! trunc_normal_ is supported for Jittor!! MLP Paper is uploaded!

PoseTriplet. [CVPR 2022] PoseTriplet: Co-evolving 3D Human Pose Estimation, Imitation, and Hallucination under Self-supervision (Oral)

botbowl. A Blood Bowl AI framework.

iNSFC. An awesome LaTeX template for NSFC proposal.

CwD. Official Implementation of CVPR 2022 paper: "Mimicking the Oracle: An Initial Phase Decorrelation Approach for Class Incremental Learning"

mmpretrain. OpenMMLab Pre-training Toolbox and Benchmark

NATSpeech. A Non-Autoregressive Text-to-Speech (NAR-TTS) framework, including official PyTorch implementation of PortaSpeech (NeurIPS 2021) and DiffSpeech (AAAI 2022)

DIT. [TNNLS] Full Transformer Framework for Robust Point Cloud Registration with Deep Information Interaction

T2T-ViT. ICCV2021, Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet

TransFG. This is the official PyTorch implementation of the paper "TransFG: A Transformer Architecture for Fine-grained Recognition" (Ju He, Jie-Neng Chen, Shuai Liu, Adam Kortylewski, Cheng Yang, Yutong Bai, Changhu Wang, Alan Yuille).

torch-dct. DCT (discrete cosine transform) functions for pytorch

mmsegmentation. OpenMMLab Semantic Segmentation Toolbox and Benchmark.

recovering-unbiased-scene-graphs. Official implementation of "Recovering the Unbiased Scene Graphs from the Biased Ones" (ACMMM 2021)

ml-visuals. 🎨 ML Visuals contains figures and templates which you can reuse and customize to improve your scientific writing.

NSFC-LaTex. BibTeX Style

bindsnet. Simulation of spiking neural networks (SNNs) using PyTorch.

Spiking-Neural-Network. Pure python implementation of SNN

pnp-detr. Implementation of ICCV21 paper: PnP-DETR: Towards Efficient Visual Analysis with Transformers

ImageNet21K. Official Pytorch Implementation of: "ImageNet-21K Pretraining for the Masses"(NeurIPS, 2021) paper

nerf-pytorch. A PyTorch implementation of NeRF (Neural Radiance Fields) that reproduces the results.

artificial-neural-variability-for-deep-learning. [Neural Computation, MIT Press] The PyTorch Implementation of Variable Optimizers/ Neural Variable Risk Minimization proposed in our Neural Computation paper: Artificial Neural Variability for Deep Learning: On overfitting, Noise Memorization, and Catastrophic Forgetting.

ddfnet. The official implementation of the CVPR2021 paper: Decoupled Dynamic Filter Networks

volo. VOLO: Vision Outlooker for Visual Recognition

VisionPermutator. MLP-Like Vision Permutator for Visual Recognition (PyTorch)

LV-BERT. LV-BERT: Exploiting Layer Variety for BERT (Findings of ACL 2021)

PoseAug. [CVPR 2021 Best Paper Award Candidate] PoseAug: A Differentiable Pose Augmentation Framework for 3D Human Pose Estimation, (Oral, Best Paper Award Finalist)

Dynamic-Vision-Transformer. Accelerating T2t-ViT by 1.6-3.6x.

Refiner_ViT. Python

IPViT. Official repository for "Intriguing Properties of Vision Transformers" (NeurIPS 2021--Spotlight)

BLIP. Official Implementation of CVPR2021 paper: Continual Learning via Bit-Level Information Preserving

BMP. [CVPR 2021] Body Meshes as Points.

rl-generalization-paper. A list of papers regarding generalization in (deep) reinforcement learning

TokenLabeling. Pytorch implementation of "All Tokens Matter: Token Labeling for Training Better Vision Transformers"

Adaptive-Attention. Python

Positive-Negative-Momentum. [ICML 2021] The official PyTorch Implementations of Positive-Negative Momentum Optimizers.

autoclip. Adaptive Gradient Clipping

BossNAS. (ICCV 2021) BossNAS: Exploring Hybrid CNN-transformers with Block-wisely Self-supervised Neural Architecture Search

dvit_repo. Python

vit-pytorch. Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

CoordAttention. Code for our CVPR2021 paper coordinate attention

Visual-Transformer-Paper-Summary. Summary of Transformer applications for computer vision tasks.

Awesome-Visual-Transformer. Collect some papers about transformer with vision. Awesome Transformer with Computer Vision (CV)

pytorch-image-models. The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more

DeepHash-pytorch. Implementation of Some Deep Hash Algorithms, Including DPSH、DSH、DHN、HashNet、DSDH、DTSH、DFH、GreedyHash、CSQ.

nn-compression. A Pytorch implementation of Neural Network Compression (pruning, deep compression, channel pruning)

dm_control. Google DeepMind's software stack for physics-based simulation and Reinforcement Learning environments, using MuJoCo.

prml. Repository of notes, code and notebooks in Python for the book Pattern Recognition and Machine Learning by Christopher Bishop

wtfpython. What the f*ck Python? 😱

neural-tangents. Fast and Easy Infinite Neural Networks in Python

computervision-recipes. Best Practices, code samples, and documentation for Computer Vision.

StanfordQuadruped. Python

spotMicro. Spot Micro Quadruped Project

pytorch-YOLOv4. PyTorch ,ONNX and TensorRT implementation of YOLOv4

PaddleDetection. Object Detection toolkit based on PaddlePaddle. It supports object detection, instance segmentation, multiple object tracking and real-time multi-person keypoint detection.

torch-scae. PyTorch implementation of Stacked Capsule Auto-Encoders

BalancedGroupSoftmax. CVPR 2020 oral paper: Overcoming Classifier Imbalance for Long-tail Object Detection with Balanced Group Softmax.

Awesome-Knowledge-Distillation. Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。

project-based-learning. Curated list of project-based tutorials

toolbox. various cv tools, such as label tools, data augmentation, label conversion, etc.

cnn-explainer. Learning Convolutional Neural Networks with Interactive Visualization.

caltech-pedestrian-dataset-converter. Download Caltech Pedestrian Dataset and convert them for Python users without using MATLAB

HigherHRNet-Human-Pose-Estimation. This is an official implementation of our CVPR 2020 paper "HigherHRNet: Scale-Aware Representation Learning for Bottom-Up Human Pose Estimation" (https://arxiv.org/abs/1908.10357)

PoseFix_RELEASE. Official TensorFlow implementation of "PoseFix: Model-agnostic General Human Pose Refinement Network", CVPR 2019

human-pose-estimation.pytorch. The project is an official implement of our ECCV2018 paper "Simple Baselines for Human Pose Estimation and Tracking(https://arxiv.org/abs/1804.06208)"

Games. Games: Create interesting games in pure python.

White-box-Cartoonization. Official tensorflow implementation for CVPR2020 paper “Learning to Cartoonize Using White-box Cartoon Representations”

BMXNet-v2. BMXNet 2: An Open-Source Binary Neural Network Implementation Based on MXNet

face.evoLVe. 🔥🔥High-Performance Face Recognition Library on PaddlePaddle & PyTorch🔥🔥

Fewshot_Detection. Few-shot Object Detection via Feature Reweighting

npc. Code for Neural Population Control

XDream. gradient-free act max for visual neurons

Paddle. PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

Teacher-free-Knowledge-Distillation. Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularization

CartoonGAN. Tensorflow inplementation of CartoonGAN

CKA-Centered-Kernel-Alignment. Reproduce CKA: Similarity of Neural Network Representations Revisited

PerformanceVSadversarial. This is the code for the project: "Understanding Adversarial Behavior of DNNs By Disentangling Non-robust and Robust Component"

CfMatting_cuda_mkl. A cuda & mkl implementation of closed-form matting

flops-counter.pytorch. Flops counter for neural networks in pytorch framework

attention-is-all-you-need-pytorch. A PyTorch implementation of the Transformer model in "Attention is All You Need".

nasnet-pytorch. A neat pytorch implementation of nasnet and the ported weights from tensorflow

rethinking-network-pruning. Rethinking the Value of Network Pruning (Pytorch) (ICLR 2019)

Hadamard-Matrix-for-hashing. CVPR2020/TNNLS2023: Central Similarity Quantization/Hashing for Efficient Image and Video Retrieval

Kalman-Filter. Kalman-Filter simulation

KD_methods_with_TF. Knowledge distillation methods implemented with Tensorflow (now there are 11 (+1) methods, and will be added more.)

pytorch-prunes. Code for https://arxiv.org/abs/1810.04622