Zhiheng_Ma

obsidian-fast-note-sync. Can be privately deployed, focusing on providing Obsidian users with a seamless, distraction-free note synchronization plugin with real-time sync across multiple platforms, supporting Mac, Windows, Android, iOS, and offering multilingual support.可私有化部署，专注为 Obsidian 用户提供无打扰、丝般顺滑、多端实时同步的多平台笔记同步插件。

XRZero-G0. XRZero-G0: Pushing the Frontier of Dexterous Robotic Manipulation with Interfaces, Quality and Ratios

RoboOrchard. Python

hiddify-app. Multi-platform auto-proxy client, supporting Sing-box, X-ray, TUIC, Hysteria, Reality, Trojan, SSH etc. It’s an open-source, secure and ad-free.

AiScientist. Python

DiT4DiT. This is the official code repo for DiT4DiT, a Vision-Action-Model (VAM) framework that combines video generation model with flow-matching-based action prediction for generalizable robotic manipulation.

freemocap. Free Motion Capture for Everyone 💀✨

deer-flow. An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, subagents and message gateway, it handles different levels of tasks that could take minutes to hours.

last30days-skill. AI agent skill that researches any topic across Reddit, X, YouTube, HN, Polymarket, and the web - then synthesizes a grounded summary

hermes-agent. The agent that grows with you

skills. Skills for Real Engineers. Straight from my .agents directory.

claude-howto. A visual, example-driven guide to Claude Code — from basic concepts to advanced agents, with copy-paste templates that bring immediate value.

sherlock. Hunt down social media accounts by username across social networks

fff. The fastest and the most accurate file search SDK for AI agents, Neovim, Rust, C, Python, Bun and NodeJS

awesome-autoresearch. awesome autoresearch list

learn-claude-code. Bash is all you need - A nano claude code–like 「agent harness」, built from 0 to 1

PointWorld. PointWorld: Scaling 3D World Models for In-The-Wild Robotic Manipulation

LATENT. Official implementation of Learning Athletic Humanoid Tennis Skills from Imperfect Human Motion Data

autoresearch. AI agents running research on single-GPU nanochat training automatically

Auto-claude-code-research-in-sleep. ARIS ⚔️ (Auto-Research-In-Sleep) — Lightweight Markdown-only skills for autonomous ML research: cross-model review loops, idea discovery, and experiment automation. No framework, no lock-in — works with Claude Code, Codex, OpenClaw, or any LLM agent.

awesome-video-action-models. 🤖 A curated list of Video Action Models (VAMs) — papers using video generation models to produce executable robot actions. Covers UniPi, UVA, mimic-video, Motus, Cosmos Policy, DreamZero, and more.

kai0. Code for kai0, including training, inference and data collection.

OpenReal2Sim. A toolbox for real-to-sim reconstruction and robotic simulation

mimicdroid-robocasa. MimicDroid: In-Context Learning for Humanoid Robot Manipulation from Human Play Videos

FastTD3. Python

XLeRobot. XLeRobot: Practical Dual-Arm Mobile Home Robot for $660

Awesome-Imitation-Learning. A curated list of awesome imitation learning resources and publications

xr_teleoperate. This repository implements teleoperation of the Unitree humanoid robot using XR Devices.

awesome-implicit-representations. A curated list of resources on implicit neural representations.

Awesome-Video-Robotic-Papers. This repository compiles a list of papers related to the application of video technology in the field of robotics! Star⭐ the repo and follow me if you like what you see🤩.

BridgeVLA. ✨✨【NeurIPS 2025】Official implementation of BridgeVLA

SimpleVLA-RL. [ICLR 2026] SimpleVLA-RL: Scaling VLA Training via Reinforcement Learning

DexGraspVLA. [AAAI'26 Oral] DexGraspVLA: A Vision-Language-Action Framework Towards General Dexterous Grasping

Hybrid-VLA. HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Model

RynnVLA-002. RynnVLA-002: A Unified Vision-Language-Action and World Model

OpenVLA. 多模态具身智能大模型 OpenVLA 的复现以及在 LIBERO 数据集上的微调改进

3D-VLA. [ICML 2024] 3D-VLA: A 3D Vision-Language-Action Generative World Model

diffusion_policy. [RSS 2023] Diffusion Policy Visuomotor Policy Learning via Action Diffusion

SpatialVLA. 🔥 SpatialVLA: a spatial-enhanced vision-language-action model that is trained on 1.1 Million real robot episodes. Accepted at RSS 2025.

My-awesome-PINN-papers.

awesome-pinn. A curated list of awesome Physics Informed Neural Network, projects and communities.

SimplerEnv-OpenVLA. Evaluating and reproducing real-world robot manipulation policies (e.g., RT-1, RT-1-X, Octo, and OpenVLA) in simulation under common setups (e.g., Google Robot, WidowX+Bridge)

openvla-oft. Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success

openvla. OpenVLA: An open-source vision-language-action model for robotic manipulation.

CogACT. A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation

torchdiffeq. Differentiable ODE solvers with full GPU support and O(1)-memory backpropagation.

simple_neural_ode. Simple implementation of neural ODE in autograd. For learning only

QueST. Official code for "QueST: Self-Supervised Skill Abstractions for Continuous Control" [NeurIPS 2024]

awesome-AI4EDA. This repo awesome-AI4EDA contains the source for the webpage: https://ai4eda.github.io, which is a curated paper list of awesome AI for EDA.

Awesome-LLM4EDA.

Awesome-VLA-RL. This repository summarizes recent advances in the VLA + RL paradigm and provides a taxonomic classification of relevant works.

awesome-embodied-vla-va-vln. A curated list of state-of-the-art research in embodied AI, focusing on vision-language-action (VLA) models, vision-language navigation (VLN), and related multimodal learning approaches.

Embodied-AI-Paper-TopConf. [Actively Maintained🔥] A list of Embodied AI papers accepted by top conferences (ICLR, NeurIPS, ICML, RSS, CoRL, ICRA, IROS, CVPR, ICCV, ECCV).

Awesome-MCoT. Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey

uqlm. UQLM: Uncertainty Quantification for Language Models, is a Python package for UQ-based LLM hallucination detection

continuous-thought-machines. Continuous Thought Machines, because thought takes time and reasoning is a process.

mem0. Universal memory layer for AI Agents

mindshub. Make AI do actual work. Swap the model anytime — keep everything you've built.

graphiti. Build Real-Time Knowledge Graphs for AI Agents

humanoid-gym. Humanoid-Gym: Reinforcement Learning for Humanoid Robot with Zero-Shot Sim2Real Transfer https://arxiv.org/abs/2404.05695

AgenticRAG-Survey. Agentic-RAG explores advanced Retrieval-Augmented Generation systems enhanced with AI LLM agents.

agents-course. This repository contains the Hugging Face Agents Course.

Embodied-AI-Guide. [Lumina具身智能社区] 具身智能技术指南 Embodied-AI-Guide

Awesome-Robotics-Manipulation. A comprehensive list of papers about Robot Manipulation, including papers, codes, and related websites.

awesome-robotic-manipulation. A curated list of robotic manipulation papers

awesome-humanoid-learning. Humanoid Robots Resources

Awesome-VLA.

awesome-vision-language-action-model. Latest Advances on Vison-Language-Action Models.

awesome-humanoid-robot-learning. A Paper List for Humanoid Robot Learning.

xiaozhi-esp32. An MCP-based chatbot | 一个基于MCP的聊天机器人

LLMEvaluation. A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use cases, promote the adoption of best practices in LLM assessment, and critically assess the effectiveness of these evaluation methods.

gorilla. Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)

LightRAG. [EMNLP2025] "LightRAG: Simple and Fast Retrieval-Augmented Generation"

self-llm. 《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调（全参数/Lora）、部署国内外开源大模型（LLM）/多模态大模型（MLLM）教程

evals. Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

llm-action. 本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）

llama-cookbook. Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services

Awesome-Chinese-LLM. 整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。

Awesome-LLM. Awesome-LLM: a curated list of Large Language Model

composio. Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into action.

1Panel. 🔥 1Panel is a modern, open-source VPS control panel — and the only one with native AI agent support. Run Ollama models, deploy OpenClaw agents, and manage your entire server stack from one clean web interface.

awesome-LLM-resources. 🧑‍🚀 全世界最好的LLM资料总结（多模态生成、Agent、辅助编程、AI审稿、数据处理、模型训练、模型推理、o1 模型、MCP、小语言模型、视觉语言模型） | Summary of the world's best LLM resources.

RAG_Techniques. This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. Each technique has a detailed notebook tutorial.

vanna. 🤖 Chat with your SQL database 📊. Accurate Text-to-SQL Generation via LLMs using Agentic Retrieval 🔄.

RagaAI-Catalyst. Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view

pandas-ai. Chat with your database or your datalake (SQL, CSV, parquet). PandasAI makes data analysis conversational using LLMs and RAG.

awesome-llm-apps. 100+ AI Agents, Agent Skills and RAG Apps - Free and Open Source.

agno. Build, run, and manage agent platforms.

LLMs-from-scratch. Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

llm-course. Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

cs-self-learning. 计算机自学指南

KnowledgeEditingPapers. Must-read Papers on Knowledge Editing for Large Language Models.

PRAG. Code for Parametric RAG, SIGIR 2025 Full Paper

topoloss. Induce brain-like topographic structure in your neural networks

ComprehendEdit. Python

awesome_lists. Awesome Lists for Tenure-Track Assistant Professors and PhD students. (助理教授/博士生生存指南)

acad-homepage.github.io. AcadHomepage: A Modern and Responsive Academic Personal Homepage

R1-V. Witness the aha moment of VLM with less than $3.

openai-structured-outputs-samples. Sample apps to help developers get started with Structured Outputs

victoreke.com. My personal portfolio website built with Next.js, Sanity and Tailwind CSS.

EnzymeCAGE. A geometric foundation model for enzyme retrieval with evolutionary insights.

EnzymeFlow. Official repository of EnzymeFlow

GENzyme. Official repository of GENzyme

bRAG-langchain. Everything you need to know to build your own RAG application

PDFMathTranslate. [EMNLP 2025 Demo] PDF scientific paper translation with preserved formats - 基于 AI 完整保留排版的 PDF 文档全文双语翻译，支持 Google/DeepL/Ollama/OpenAI 等服务，提供 CLI/GUI/MCP/Docker/Zotero

ReactZyme. Official repository of ReactZyme

lingua. Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.

circuit_training. Python

ProteusAI. ProteusAI is a library for the machine learning driven engineering of proteins. The library enables workflows from protein structure prediction, prediction of mutational effects to protein ligand interactions powered by artificial intelligence.

Emu3. Next-Token Prediction is All You Need

llm-mutate. Python

PixWizard. [ICLR2025] A versatile image-to-image visual assistant, designed for image generation, manipulation, and translation based on free-from user instructions.

Awsome-Multimodal-In-Context-Learning. A curated list of multimodal in context learning.

MIC. MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU

Mu-Protein. Jupyter Notebook

computer-science. 🎓 Path to a free self-taught education in Computer Science!

kotaemon. An open-source RAG-based tool for chatting with your documents.

ChannelViT. Channel Vision Transformers: An Image Is Worth C x 16 x 16 Words

warm-up-kit. Warm-up Kit for Erasing the Invisible Competition @ NeurIPS 2024

Awesome-Phenotypic-Drug-Discovery. PDD: Awesome Phenotypic Drug Discovery

GOT-OCR2.0. Official code implementation of General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Model

Awesome-Bio-Foundation-Models. A collection of awesome bio-foundation models, including protein, RNA, DNA, gene, single-cell, and so on.

awesome-described-object-detection. A curated list of papers and resources related to Described Object Detection, Open-Vocabulary/Open-World Object Detection and Referring Expression Comprehension. Updated frequently and pull requests welcomed.

ML-YouTube-Courses. 📺 Discover the latest machine learning / AI courses on YouTube.

Awesome-Video-Diffusion. A curated list of recent diffusion models for video generation, editing, and various other applications.

MemoRAG. Empowering RAG with a memory-based data interface for all-purpose applications!

knowledge_graph. Convert any text to a graph of knowledge. This can be used for Graph Augmented Generation or Knowledge Graph based QnA

Awesome-Graph-LLM. A collection of AWESOME things about Graph-Related LLMs.

KG-LLM-Papers. [Paper List] Papers integrating knowledge graphs (KGs) and large language models (LLMs)

nano-graphrag. A simple, easy-to-hack GraphRAG implementation

SciAgentsDiscovery. Python

paper-qa. High accuracy RAG for answering questions from scientific documents with citations

ai-for-grant-writing. A curated list of resources for using LLMs to develop more competitive grant applications.

prompts.chat. f.k.a. Awesome ChatGPT Prompts. Share, discover, and collect prompts from the community. Free and open source — self-host for your organization with complete privacy.

ComfyUI. The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.

firecrawl. The API to search, scrape, and interact with the web at scale. 🔥

Deep-Live-Cam. real time face swap and one-click video deepfake with only a single image

Vane. Vane is an AI-powered answering engine.

anything-llm. Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience

Awesome-Model-Merging-Methods-Theories-Applications. Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. ACM Computing Surveys, 2026.

relik. Retrieve, Read and LinK: Fast and Accurate Entity Linking and Relation Extraction on an Academic Budget (ACL 2024)

ADAS. [ICLR 2025] Automated Design of Agentic Systems

AutoSurvey. Python

Awesome-LLM-3D. Awesome-LLM-3D: a curated list of Multi-modal Large Language Model in 3D world Resources

MinerU. Transforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic workflows.

data-juicer. Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

OpenResearcher. OpenResearcher, an advanced Scientific Research Assistant

AI-Scientist. The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery 🧑‍🔬

3DeeCellTracker. A python algorithm for tracking cells in 3D deforming organs

Segment-Any-Anomaly. Official implementation of "Segment Any Anomaly without Training via Hybrid Prompt Regularization (SAA+)".

Tranception. Official repository for the paper "Tranception: Protein Fitness Prediction with Autoregressive Transformers and Inference-time Retrieval"

LitSearch. [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search

LLM101n. LLM101n: Let's build a Storyteller

NOS. Protein Design with Guided Discrete Diffusion

esm. Jupyter Notebook

magiclens. [ICML'24 Oral] "MagicLens: Self-Supervised Image Retrieval with Open-Ended Instructions"

EVE. EVE Series: Encoder-Free Vision-Language Models from BAAI

hyperui. Free Tailwind CSS v4 components for your next project, designed to enhance your web development with the latest features and styles 🚀

ultimate-react-course. Starter files, final projects, and FAQ for my Ultimate React course

react-complete-guide-course-resources. React - The Complete Guide Course Resources (Code, Attachments, Slides)

dify. Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.

photoshot. An open-source AI avatar generator web app - https://photoshot.app

ragflow. RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs

AutoWebGLM. An LLM-based Web Navigating Agent (KDD'24)

VAR. [NeurIPS 2024 Best Paper Award][GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!

ml-aim. This repository provides the code and model checkpoints for AIMv1 and AIMv2 research projects.

LlamaFactory. Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

walk-jump. Official repository for discrete Walk-Jump Sampling (dWJS)

ssms_event_cameras. [CVPR'24 Spotlight] The official implementation of "State Space Models for Event Cameras"

ProteinInvBench. The official implementation of the NeurIPS'23 paper ProteinInvBench: Benchmarking Protein Design on Diverse Tasks, Models, and Metrics

esm. Evolutionary Scale Modeling (esm): Pretrained language models for proteins

protein-sequence-models. Python

ByProt. Python

Machine-learning-for-proteins. Listing of papers about machine learning for proteins.

ProteinDT. A Text-guided Protein Design Framework, Nat Mach Intell 2025 (https://www.nature.com/articles/s42256-025-01011-z)

papers_for_protein_design_using_DL. List of papers about Proteins Design using Deep Learning

ELLA. ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignment

GPU-Benchmarks-on-LLM-Inference. Multiple NVIDIA GPUs or Apple Silicon for Large Language Model Inference?

awesome-large-multimodal-agents.

all-seeing. [ICLR 2024 & ECCV 2024] The All-Seeing Projects: Towards Panoptic Visual Recognition&Understanding and General Relation Comprehension of the Open World"

bgpt. Beyond Language Models: Byte Models are Digital World Simulators

PseCo. (CVPR 2024) Point, Segment and Count: A Generalized Framework for Object Counting

Osprey. [CVPR2024] The code for "Osprey: Pixel Understanding with Visual Instruction Tuning"

LLM-in-Vision. Recent LLM-based CV and related works. Welcome to comment/contribute!

Awesome-LLM-Robotics. A comprehensive list of papers using large language/multi-modal models for Robotics/RL, including papers, codes, and related websites

Scientific-LLM-Survey. Scientific Large Language Models: A Survey on Biological & Chemical Domains

symbolicai. A neurosymbolic perspective on LLMs

MoE-LLaVA. 【TMM 2025🔥】 Mixture-of-Experts for Large Vision-Language Models

MobileVLM. Strong and Open Vision Language Assistant for Mobile Devices

SynthCLIP. Code base of SynthCLIP: CLIP training with purely synthetic text-image pairs from LLMs and TTIs.

COMM. Pytorch code for paper From CLIP to DINO: Visual Encoders Shout in Multi-modal Large Language Models

Awesome-Mamba. Awesome list of papers that extend Mamba to various applications.

EVA. EVA Series: Visual Representation Fantasies from BAAI

jepa. PyTorch code and models for V-JEPA self-supervised learning from video.

LWM. Large World Model -- Modeling Text and Video with Millions Context

prismatic-vlms. A flexible and efficient codebase for training visually-conditioned language models (VLMs)

LLaVA. [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

awesome-ssm-ml. Reading list for research topics in state-space models

Awesome-state-space-models. Collection of papers on state-space models

mamba. Mamba SSM architecture