liuruoze

FramePack. Lets make video diffusion practical!

cleanrl. High-quality single file implementation of Deep Reinforcement Learning algorithms with research-friendly features (PPO, DQN, C51, DDPG, TD3, SAC, PPG)

ppo-implementation-details. The source code for the blog post The 37 Implementation Details of Proximal Policy Optimization

invalid-action-masking. Source Code for A Closer Look at Invalid Action Masking in Policy Gradient Algorithms

grok-1. Grok open release

NSFC-application-template-latex. 国家自然科学基金申请书正文（面上项目）LaTeX 模板（非官方）

AnimateAnyone. Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animation

magic-animate. [CVPR 2024] Official repository for "MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Model"

generative_agents. Generative Agents: Interactive Simulacra of Human Behavior

audiocraft. Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.

mamba. This code accompanies the paper "Scalable Multi-Agent Model-Based Reinforcement Learning".

jax. Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

xformers. Hackable and optimized Transformers building blocks, supporting a composable construction.

llama. Inference code for Llama models

dreamerv3. Mastering Diverse Domains through World Models

so-vits-svc. SoftVC VITS Singing Voice Conversion

street-fighter-ai. This is an AI agent for Street Fighter II Champion Edition.

DeepSpeed. DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

gpt_academic. 为GPT/GLM等LLM大语言模型提供实用化交互接口，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持Python和C++等项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持chatglm3等本地模型。接入通义千问, deepseekcoder, 讯飞星火, 文心一言, llama2, rwkv, claude2, moss等。

nju-thesis. 南京大学学位论文XeLaTeX模板

NLP-Tutorials. Simple implementations of NLP models. Tutorials are written in Chinese on my website https://mofanpy.com

continual-learning-papers. Continual Learning papers list, curated by ContinualAI

LawRefBook. 中华人民共和国法律手册

mujoco. Multi-Joint dynamics with Contact. A general purpose physics simulator.

objgraph. Visually explore Python object graphs

alphafold. Open source code for AlphaFold 2.

rlpyt. Reinforcement Learning in PyTorch

RLzoo. A Comprehensive Reinforcement Learning Zoo for Simple Usage 🚀

Deep-Reinforcement-Learning-Algorithms-with-PyTorch. PyTorch implementations of deep reinforcement learning algorithms and environments

QuantumExplorer. A quantum reinforcement learning framework based on PyTorch and PennyLane.

awesome-offline-rl. An index of algorithms for offline reinforcement learning (offline-rl)

GitHubDaily. 坚持分享 GitHub 上高质量、有趣实用的开源技术教程、开发者工具、编程网站、技术资讯。A list cool, interesting projects of GitHub.

glide-text2im. GLIDE: a diffusion-based text-conditional image synthesis model

Useful-Big-Resources. Provide data, gif images, and other big resources for other projects of mine.

liuruoze. My presonal repository

HierNet-SC2. (AAAI'2019) The codes, models, logs, and data for an extended paper of the original paper "On Reinforcement Learning for Full-length Game of StarCraft". AAAI = AAAI Conference on Artificial Intelligence.

PySnooper. Never use print for debugging again

PrefixSpan-py. Data mining algorithm PrefixSpan based on Python/数据挖掘算法PrefixSpan的简单Python实现

PrefixSpan-py. The shortest yet efficient Python implementation of the sequential pattern mining algorithm PrefixSpan, closed sequential pattern mining algorithm BIDE, and generator sequential pattern mining algorithm FEAT.

pytorch-a2c-ppo-acktr-gail. PyTorch implementation of Advantage Actor Critic (A2C), Proximal Policy Optimization (PPO), Scalable trust-region method for deep reinforcement learning using Kronecker-factored approximation (ACKTR) and Generative Adversarial Imitation Learning (GAIL).

pytorch-distributed. A quickstart and benchmark for pytorch distributed training.

envpool. C++-based high-performance parallel environment execution engine (vectorized env) for general RL environments.

TiKick. Learning-based agent for Google Research Football (足球游戏智能体)

pytorch-multigpu. Multi GPU Training Code for Deep Learning with PyTorch

K-Net. [NeurIPS2021] Code Release of K-Net: Towards Unified Image Segmentation

Soft-Actor-Critic-and-Extensions. PyTorch implementation of Soft-Actor-Critic and Prioritized Experience Replay (PER) + Emphasizing Recent Experience (ERE) + Munchausen RL + D2RL and parallel Environments.

DI-star. An artificial intelligence platform for the StarCraft II with large-scale distributed training and grand-master agents.

AlphaStar_Implementation. This project is implementation code of AlphaStar

yzhao062.

pypeln. Concurrent data pipelines in Python >>>

gin-config. Gin provides a lightweight configuration framework for Python

Raw-vs-Human-in-AlphaStar. (TG'2023) Official code for the paper "Revisiting of AlphaStar" (previously called "Rethinking of AlphaStar"). It compares the raw interface with the human interface in the architecture of AlphsStar. TG = Transactions on Games

BetaStar. (SSCAIT'2019) BetaStar is a StarCraft AI, written by a team at Nanjing University. It is written for StarCraft I. SSCAIT=Student StarCraft AI Tournament.

sc2_imitation_learning. StarCraft 2 Imitation Learning

seed_rl. SEED RL: Scalable and Efficient Deep-RL with Accelerated Central Inference. Implements IMPALA and R2D2 algorithms in TF2 with SEED's architecture.

paper.

AirSim. Open source simulator for autonomous vehicles built on Unreal Engine / Unity, from Microsoft AI & Research

DefogGAN. Python

Transfer-Learning-Library. Transfer Learning Library for Domain Adaptation, Task Adaptation, and Domain Generalization

SMARTS. Scalable Multi-Agent RL Training School for Autonomous Driving

ModelRepo. reproduce some RL or Multi-Agent models

deepmind_MAS_enviroment. some Multiagent enviroment in 《Multi-agent Reinforcement Learning in Sequential Social Dilemmas》 and 《Value-Decomposition Networks For Cooperative Multi-Agent Learning》

LastOrder-Dota2. Dota2 AI bot

rainbow-is-all-you-need. Rainbow is all you need! A step-by-step tutorial from DQN to Rainbow

yolort. yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.

BackgroundMattingV2. Real-Time High-Resolution Background Matting

ResnetGPT. 用Resnet101+GPT搭建一个玩王者荣耀的AI

recommenders. Best Practices on Recommendation Systems

minirts. We release dataset collected for our research, code that implement neural network models described in the paper, and scripts to reproduce all of our results, and visualization tool for visualize dataset.

deep-rts. A Real-Time-Strategy game for Deep Learning research

rl-starter-files. RL starter files in order to immediately train, visualize and evaluate an agent without writing any line of code

gym-carla. An OpenAI gym wrapper for CARLA simulator

slimevolleygym. A simple OpenAI Gym environment for single and multi-agent reinforcement learning

HighwayEnv. A collection of environments for autonomous driving and tactical decision-making tasks

gym-anytrading. The most simple, flexible, and comprehensive OpenAI Gym trading environment (Approved by OpenAI Gym)

Miniworld. Simple and easily configurable 3D FPS-game-like environments for reinforcement learning

Minigrid. Simple and easily configurable grid world environments for reinforcement learning

gym-maze. A basic 2D maze environment where an agent start from the top left corner and try to find its way to the bottom left corner.

retro. Retro Games in Gym

procgen. Procgen Benchmark: Procedurally-Generated Game-Like Gym-Environments

FishSchoolSim. JavaScript

summarize-from-feedback. Code for "Learning to summarize from human feedback"

muzero-general. MuZero

StarCraft. Implementations of QMIX, VDN, COMA, QTRAN, MAVEN, CommNet, DyMA-CL, and G2ANet on SMAC, the decentralised micromanagement scenario of StarCraft II

mini-AlphaStar. (JAIR'2022) A mini-scale reproduction code of the AlphaStar program. Note: the original AlphaStar is the AI proposed by DeepMind to play StarCraft II. JAIR = Journal of Artificial Intelligence Research.

TRGPPO. Python

MARL-Algorithms. Implementations of IQL, QMIX, VDN, COMA, QTRAN, MAVEN, CommNet, DyMA-CL, and G2ANet on SMAC, the decentralised micromanagement scenario of StarCraft II

QTRAN. There will be updates later

overcooked_ai. A benchmark environment for fully cooperative human-AI performance.

opponent. Implementation for ICML 16 paper "Deep reinforcement learning with opponent modeling"

lstms.pth. PyTorch implementations of LSTM Variants (Dropout + Layer Norm)

Balanced-DataParallel. 这里是改进了pytorch的DataParallel, 用来平衡第一个GPU的显存使用量

transformer-xl. Python

Interaction-networks_tensorflow. Tensorflow Implementation of Interaction Networks for Learning about Objects, Relations and Physics

stable-baselines3. PyTorch version of Stable Baselines, reliable implementations of reinforcement learning algorithms.

trfl. TensorFlow Reinforcement Learning

scalable_agent. A TensorFlow implementation of Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures.

t5_in_bert4keras. 整理一下在keras中使用T5模型的要点

multilingual-t5. Python

pytorch-tabular. Some examples of using PyTorch for tabular data

AdaNorm. Code for "Understanding and Improving Layer Normalization"

TCN. Sequence modeling benchmarks and temporal convolutional networks

IBN-Net. Instance-Batch Normalization Networks (ECCV2018)

tutorials. PyTorch tutorials.

CollaQ. A code implementation for our arXiv paper "Multi-agent Adhoc Team Play using Decompositional Q function"

Thought-SC2. (TG'2021) Code for paper "Efficient Reinforcement Learning for StarCraft by Abstract Forward Models and Transfer Learning". TG = Transactions on Games.

Reinforcement-Implementation. Implementation of benchmark RL algorithms

ResNeXt-Tensorflow. Simple Tensorflow implementation of ResNeXt using Cifar10

ResNet-Tensorflow. Simple Tensorflow implementation of pre-activation ResNet18, 34, 50, 101, 152

UGATIT. Official Tensorflow implementation of U-GAT-IT: Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation (ICLR 2020)

tensorflow2-deep-reinforcement-learning. Code accompanying the blog post "Deep Reinforcement Learning with TensorFlow 2.1"

reaver. Reaver: Modular Deep Reinforcement Learning Framework. Focused on StarCraft II. Supports Gym, Atari, and MuJoCo.

atari-reset. Code for the blog post "Learning Montezuma’s Revenge from a Single Demonstration"

GymGo. An environment of the board game Go using OpenAI's Gym API

evolution-strategies-starter. Code for the paper "Evolution Strategies as a Scalable Alternative to Reinforcement Learning"

RL_TSP_4static. Deep Reinforcement Learning for Multiobjective Optimization. Code for this paper

MORL. Multi-Objective Reinforcement Learning

WorldModelsExperiments. World Models Experiments

alphastar. A* algorithm implementation in Python

SC2AI. 星际2 AI中文教程 StarCraft2 AI with python-sc2/pysc2 API

muzero-general. MuZero

MarioZero. Testing MuZero from deepmind with Super Mario Bros

muzero-pytorch. Pytorch Implementation of MuZero

muzero. A simple implementation of MuZero algorithm for connect4 game

MuZero. A structured implementation of MuZero

TrulyPPO. Python

pymarl. Python Multi-Agent Reinforcement Learning framework

MadBot. Starcraft 2 Bot written in Python using the python-sc2 libary

PurpleWave. StarCraft: Brood War AI in Scala

SAIDA_RL. C++

nndl. 邱锡鹏《神经网络与深度学习》（蒲公英书）理论书 v2 与通识版

MSC. MSC: A Dataset for Macro-Management in StarCraft II

smac. SMAC: The StarCraft Multi-Agent Challenge

MARL-Papers. Paper list of multi-agent reinforcement learning (MARL)

nsfw_data_scraper. Collection of scripts to aggregate image data for the purposes of training an NSFW Image Classifier

paper-gestalt. Deep Paper Gestalt

softlearning. Softlearning is a reinforcement learning framework for training maximum entropy policies in continuous domains. Includes the official implementation of the Soft Actor-Critic algorithm.

mcts. An implementation of Monte Carlo Tree Search in python

homework. Assignments for CS294-112.

baselines-rudder. RUDDER for ATARI games with delayed rewards in OpenAI Baselines package

Locutus. AI for StarCraft: Brood War

bluebluesky. C++

SAIDA.

TorchCraft. Connecting Torch to StarCraft

large-scale-curiosity. Code for the paper "Large-Scale Study of Curiosity-Driven Learning"

random-network-distillation. Code for the paper "Exploration by Random Network Distillation"

bert. TensorFlow code and pre-trained models for BERT

oneDNN. oneAPI Deep Neural Network Library (oneDNN)

pytorch-scripts. A few Windows specific scripts for PyTorch

ELF. ELF: a platform for game research with AlphaGoZero/AlphaZero reimplementation

ddp-gym. Differential Dynamic Programming controller operating in OpenAI Gym environment.

iLQR-REINFORCE-DAGGER. Python

IRCNN. Learning Deep CNN Denoiser Prior for Image Restoration (CVPR, 2017) (Matlab)

alpr-unconstrained. License Plate Detection and Recognition in Unconstrained Scenarios

Detectron.pytorch. A pytorch implementation of Detectron. Both training from scratch and inferring directly from pretrained Detectron weights are available.

Distributed-TensorFlow-Guide. Distributed TensorFlow basics and examples of training algorithms

stanford-tensorflow-tutorials. This repository contains code examples for the Stanford's course: TensorFlow for Deep Learning Research.

tensorflow-value-iteration-networks. TensorFlow implementation of the Value Iteration Networks (NIPS '16) paper

VIN. Value Iteration Networks

crnn. Convolutional Recurrent Neural Network (CRNN) for image-based sequence recognition.

License-Plate-Detect-Recognition-via-Deep-Neural-Networks-accuracy-up-to-99.9. works in real-time with detection and recognition accuracy up to 99.8% for Chinese license plates: 100 ms/plate

clarity-analyzer. JavaFX-Application to interactively visualize the raw data of a Dota 2, CSGO, CS2 or Deadlock replay.

dota2dqn. This is a deep Q-network (reinforcement learning) AI for Dota 2

dota2Bots. God like lina

Dota2-FullOverwrite. Work in progress for a full-overwrite Dota 2 bot framework

TSCL. Teacher-Student Curriculum Learning code

gym-minecraft. Minecraft environment for Open AI Gym, based on Microsoft's Malmo.

dota2ai. Ranked Matchmaking AI: An improved Dota2 AI based on Valve's default AI. Has more than 3 million subscribers on Steam.

gps. Guided Policy Search

Dota2_ai_bot. The infrastructure and the reinforcement learning algorithm for training a Dota 2 AI bot

dota2ai. Dota2 AI Framework

pydota2_archive. Dota 2 Python AI

Dota2_DPPO_bots. Python

genetics. A python library for genetic algorithms

deap. Distributed Evolutionary Algorithms in Python

wargus. Importer and scripts for Warcraft II: Tides of Darkness, the expansion Beyond the Dark Portal, and Aleonas Tales

high-speed-downloader. 已不再维护

SNNs. Tutorials and implementations for "Self-normalizing networks"

ml-agents. The Unity Machine Learning Agents Toolkit (ML-Agents) is an open-source project that enables games and simulations to serve as environments for training intelligent agents using deep reinforcement learning and imitation learning.

scikit-optimize. Sequential model-based optimization with a `scipy.optimize` interface

gail_ppo_tf. Tensorflow implementation of Generative Adversarial Imitation Learning(GAIL) with discrete action

sc2aibot. Implementing reinforcement-learning algorithms for pysc2 -environment

Tensorflow-Tutorial. Some interesting TensorFlow tutorials for beginners.

InfoGAN. Code for reproducing key results in the paper "InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets"

imitation. Code for the paper "Generative Adversarial Imitation Learning"

gail-tf. Tensorflow implementation of generative adversarial imitation learning

PyTorch-RL. PyTorch implementation of Deep Reinforcement Learning: Policy Gradient methods (TRPO, PPO, A2C) and Generative Adversarial Imitation Learning (GAIL). Fast Fisher vector product TRPO.

ADNet. Action-Decision Networks for Visual Tracking with Deep Reinforcement Learning (CVPR 2017)

dpcluster. Efficient Dirichlet process clustering

gmm. Gaussian Mixture Models in Python

irl_rocks. Cool Inverse Reinforcement Learning Papers

tsc-dl. Visual Transition State Clustering

tsc. Implements experiments to evaluate transition state clustering

hierarchical-deep-RL. Hierarchical Deep Reinforcement Learning: Integrating Temporal Abstractions and Intrinsic Motivation

hierarchical_IL_RL. Code for hierarchical imitation learning and reinforcement learning

reinforcement_learning. Implementation of selected reinforcement learning algorithms in Tensorflow. A3C, DDPG, REINFORCE, DQN, etc.

irl-imitation. Implementation of Inverse Reinforcement Learning (IRL) algorithms in Python/Tensorflow. Deep MaxEnt, MaxEnt, LPIRL

Inverse-Reinforcement-Learning. Implementations of selected inverse reinforcement learning algorithms.

XX-Net. A proxy tool to bypass GFW.

event-driven-rllab. Extending rllab to event-driven multiagent environments