Yan Zeng

agents. An Open-source Framework for Data-centric, Self-evolving Autonomous Language Agents

Awesome-Video-Diffusion. A curated list of recent diffusion models for video generation, editing, and various other applications.

imagen-pytorch. Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch

lynx-llm. paper: https://arxiv.org/abs/2307.02469 page: https://lynx-llm.github.io/

ovad-benchmark-code. OVAD: Open-vocabulary Attribute Detection code

diffusers. 🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.

fine-grained-evals. [ACL 2023] Code and data for our paper "Measuring Progress in Fine-grained Vision-and-Language Understanding"

teco. Python

Tune-A-Video. [ICCV 2023] Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation

Make-A-Protagonist. Make-A-Protagonist: Generic Video Editing with An Ensemble of Experts

DirecT2V. Python

instruction-datasets. Datasets for Instruction Tuning of Large Language Models

peft. 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Alpaca-CoT. We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tuning) together for easy use. We welcome open-source enthusiasts to initiate any meaningful PR on this repo and integrate as many LLM related technologies as possible. 我们打造了方便研究人员上手和使用大模型等微调平台，我们欢迎开源爱好者发起任何有意义的pr！

EVA. EVA Series: Visual Representation Fantasies from BAAI

unnatural-instructions.

llama. Inference code for Llama models

TaskMatrix. Python

unilm. Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

flamingo-pytorch. Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch

VLUE. This repo contains codes and instructions for baselines in the VLUE benchmark.

metaseq. Repo for external large-scale work

adapters. A Unified Library for Parameter-Efficient and Modular Transfer Learning

rebiber. A simple tool to update bib entries with their official information (e.g., DBLP or the ACL anthology).

MaskGIT-pytorch. Pytorch implementation of MaskGIT: Masked Generative Image Transformer (https://arxiv.org/pdf/2202.04200.pdf)

awesome-MIM. Reading list for research topics in Masked Image Modeling

X-VLM. X-VLM: Multi-Grained Vision Language Pre-Training (ICML 2022)

UC2. CVPR 2021 Official Pytorch Code for UC2: Universal Cross-lingual Cross-modal Vision-and-Language Pre-training

iglue. [ICML 2022] Code and data for our paper "IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and Languages"

MultiT-C-Dialog. A multi-task learning approach for conditioned response generation (NAACL 2021)

Transformer-DST. A Generative Dialogue State Tracking Model

VGCN-BERT. Python