ZeyueT

OPSD-V. On-Policy Self-Distillation for Post-Training Few-Step Autoregressive Video Generators

Awesome-MLLM-Reasoning-Collection. A collection of multimodal reasoning papers, codes, datasets, benchmarks and resources.

Boogu-Image. Boogu-Image-0.1 is an Apache-2.0 open-source image generation and editing model family that delivers near-closed-source performance with an order of magnitude less data.

AudioX-Turbo. 🚀 Fastest Anything-to-Audio Gen for conditioned sound and music creation.

MMAE. MMAE: A Massive Multitask Audio Editing Benchmark

sonoworld. Official implementation of the CVPR 2026 paper "SonoWorld: From One Image to a 3D Audio-Visual Scene."

Audio-Omni. [SIGGRAPH 2026] Repository of Audio-Omni

SAGE-GRPO. Official Implementation of SAGE-GRPO:Manifold-Aware Exploration for Reinforcement Learning in Video Generation

T2A-bench. [ICLR 2026] A two-stage evaluation benchmark for Text-to-Audio generation, assessing category, count, ordering, and timestamp accuracy with Gemini 2.5 Pro.

skills. Allow your 🦞 bot to Shout, Speak, with "human" vibe

Capybara. Python

Speech-Resources. 语音方向实验室/公司/资源/实习等，欢迎推荐或自荐

Awesome-World-Models. A comprehensive list of papers for the definition of World Models and using World Models for General Video Generation, Embodied AI, and Autonomous Driving, including papers, codes, and related websites.

lingbot-world. Advancing Open-source World Models

AudioEditingCode. Python

LongVideoAgent. Python

Diff-Foley. Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models

Vision-to-Audio-and-Beyond. ICML 2024 "From Vision to Audio and Beyond: A Unified Model for Audio-Visual Representation and Generation"

Audeo. Python

xRIR_code. [CVPR 2025] Pytorch implementation of the paper "Hearing Anywhere in Any Environment"

video-to-audio-through-text. [NeurIPS 2024] Code, Dataset, Samples for the VATT paper “ Tell What You Hear From What You See - Video to Audio Generation Through Text”

ScaleCUA. [ICLR 2026 Oral] ScaleCUA is the open-sourced computer use agents that can operate on cross-platform environments (Windows, macOS, Ubuntu, Android).

WeTok. [ICLR2026] WeTok: Powerful Discrete Tokenization for High-Fidelity Visual Reconstruction

Awesome-Vison2Audio. A curated list of Vision (video/image) to Audio Generation

Vlogger. [CVPR2024] Make Your Dream A Vlog

Video-GPT. [ICLR2026] Video-GPT via Next Clip Diffusion.

AudioX. [ICLR 2026] Repository of AudioX

VideoGen-of-Thought. [Neurips 2025 NextVid Workshop Oral✨] Official Implementation of VideoGen-of-Thought: Step-by-step generating multi-shot video with minimal manual intervention

Awesome-System2-Reasoning-LLM. Latest Advances on System-2 Reasoning

Audio-FLAN. Audio-FLAN

VideoTuna. Let's finetune video generation models!

LibQPEP. TRO 2022 - QPEP: A C++/MATLAB library for solving generalized quadratic pose estimation problems and related uncertainty description

VidMuse. [CVPR 2025] Repository of VidMuse

Law_of_Vision_Representation_in_MLLMs. [COLM'25] Official implementation of the Law of Vision Representation in MLLMs

MultiTarget_WiFi_DFL. Jupyter Notebook

conditional-flow-matching. TorchCFM: a Conditional Flow Matching library

stable-audio-tools. Generative models for conditional audio generation

MMTrail. [Arxiv 2024] Official code for MMTrail: A Multimodal Trailer Video Dataset with Language and Music Descriptions

suno-api. Use API to call the music generation AI of suno.ai, and easily integrate it into agents like GPTs.

lp-music-caps. LP-MusicCaps: LLM-Based Pseudo Music Captioning [ISMIR23]

audioset_tagging_cnn. Python

DiffSHEG. [CVPR'24] DiffSHEG: A Diffusion-Based Approach for Real-Time Speech-driven Holistic 3D Expression and Gesture Generation

ai-audio-startups. Community list of startups working with AI in audio and music technology

ChatMusician. Python

Seeing-and-Hearing. [CVPR 2024] Seeing and Hearing: Open-domain Visual-Audio Generation with Diffusion Latent Aligners

Awesome-LLMs-meet-Multimodal-Generation. 🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).

wav2clip-changed. Python

Stable-Diffusion. FLUX, Stable Diffusion, SDXL, SD3, LoRA, Fine Tuning, DreamBooth, Training, Automatic1111, Forge WebUI, SwarmUI, DeepFake, TTS, Animation, Text To Video, Tutorials, Guides, Lectures, Courses, ComfyUI, Google Colab, RunPod, Kaggle, NoteBooks, ControlNet, TTS, Voice Cloning, AI, AI News, ML, ML News, News, Tech, Tech News, Kohya, Midjourney, RunPod

bark. 🔊 Text-Prompted Generative Audio Model

Conference-Accepted-Paper-List. Some Conferences' accepted paper lists (including AI, ML, Robotic)

GenAI_LLM_timeline. ChatGPT, GenerativeAI and LLMs Timeline

open-musiclm. Implementation of MusicLM, a text to music model published by Google Research, with a few modifications.

denoising-diffusion-pytorch. Implementation of Denoising Diffusion Probabilistic Model in Pytorch

FollowYourPose. [AAAI 2024] Follow-Your-Pose: This repo is the official implementation of "Follow-Your-Pose : Pose-Guided Text-to-Video Generation using Pose-Free Videos"

video-bgm-generation. [ACM MM 2021 Best Paper Award] Video Background Music Generation with Controllable Music Transformer

FateZero. [ICCV 2023 Oral] "FateZero: Fusing Attentions for Zero-shot Text-based Video Editing"

HFGI3D. Jupyter Notebook

All-In-One-Deflicker. [CVPR2023] Blind Video Deflickering by Neural Filtering with a Flawed Atlas