Yuchen Ren

CENO. Python

ceno.github.io. HTML

smp-ppi. Online server: https://zhanggroup.org/SMP-PPI

smp-docking. Online server: https://zhanggroup.org/SMP-docking

smp-contact. Online server: https://zhanggroup.org/SMP-contact

Awesome-Scientific-Datasets-and-LLMs. A curated collection of papers, datasets, and resources on Scientific Datasets and Large Language Models (LLMs)

Intern-S1. A Scientific Multimodal Foundation Model

alphagenome. This API provides programmatic access to the AlphaGenome model developed by Google DeepMind.

Cross-MolecularBenchmark. Source code of "A Comprehensive Cross-Molecular Benchmark for Language Model Evaluation and Tasks in Biological Sequence Understanding".

golitex. Litex: The Language Where Mathematics Verifies Itself.

audio-ai-hub. The hub for audio AI research: papers, open models, benchmarks & datasets across audio LLMs, speech recognition, TTS, music & audio generation.

ProDMM. Source code of ProDMM. The paper is titled with "Unveiling Protein-DNA Interdependency: Harnessing Unified Multimodal Sequence Modeling, Understanding and Generation".

BiRefNet. [CAAI AIR'24] Bilateral Reference for High-Resolution Dichotomous Image Segmentation

Genomics-FM. Genomics-FM

chai-lab. Chai-1, SOTA model for biomolecular structure prediction

LucaOne. The resources of LucaOne, including: the model code, training scripts, embedding inference code, and trained checkpoints.

esm. Jupyter Notebook

LucaOneTasks. The project of the downstream tasks based on LucaOne's Embedding.

RNABenchmark. [NeurIPS 2024] BEACON: Benchmark for Comprehensive RNA Tasks and Language Models

evo. Biological foundation modeling from molecular to genome scale

unilm. Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

ImageBind. ImageBind One Embedding Space to Bind Them All

Audio-visual-sound-localization. Audio-visual sound localization

ER-SAN. Implementation of our IJCAI2022 oral paper, ER-SAN: Enhanced-Adaptive Relation Self-Attention Network for Image Captioning.

notears. DAGs with NO TEARS: Continuous Optimization for Structure Learning

VolumetricCapture. A multi-sensor capture system for free viewpoint video.

yolov5. Ultralytics YOLOv5 in PyTorch for object detection, instance segmentation, classification, training, and export.

OmegaFold. OmegaFold Release Code

mmdetection3d. OpenMMLab's next-generation platform for general 3D object detection.

BalancedMSE. [CVPR 2022 Oral] Balanced MSE for Imbalanced Visual Regression https://arxiv.org/abs/2203.16427

DIPS-Plus. The Enhanced Database of Interacting Protein Structures for Interface Prediction

Awesome-CLIP. Awesome list for research on CLIP (Contrastive Language-Image Pre-Training).

ClipCap-Chinese. 基于ClipCap的看图说话Image Caption模型

DeepInteract. A geometric deep learning framework (Geometric Transformers) for predicting protein interface contacts. (ICLR 2022)

hh-suite. Remote protein homology detection suite.

Awesome-Multimodal-Pretraining.

Awesome-Transformer-Attention. An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

Paper-Writing-Tips. MLNLP社区用来帮助大家避免论文投稿小错误的整理仓库。 Paper Writing Tips

transformers. 🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

esm. Evolutionary Scale Modeling (esm): Pretrained language models for proteins

OntoProtein. [ICLR 2022] OntoProtein: Protein Pretraining With Gene Ontology Embedding

CBTrans. Python

HowToCook. Programmer's guide about how to cook at home.

ABINet-PP. ABINet++: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Spotting

Awesome-Captioning. A curated list of Multimodal Captioning related research(including image captioning, video captioning, and text captioning)

ColabFold. Making Protein folding accessible to all!

Uni-Fold. Python

ABINet. Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognition

Talking-Face_PC-AVS. Code for Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representation (CVPR 2021)

mmf. A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)

meshed-memory-transformer. Meshed-Memory Transformer for Image Captioning. CVPR 2020

grid-feats-vqa. Grid features pre-training code for visual question answering

collaborative-experts. Video embeddings for retrieval with natural language queries

Oscar. Oscar and VinVL

Discriminative-Sounding-Objects-Localization. Code for Discriminative Sounding Objects Localization (NeurIPS 2020)

neuraltalk2. Efficient Image Captioning code in Torch, runs on GPU

neuraltalk. NeuralTalk is a Python+numpy project for learning Multimodal Recurrent Neural Networks that describe images with sentences.

awesome-audio-visual. A curated list of different papers and datasets in various areas of audio-visual processing

Revisit-MMT. Python

Awesome-Visual-Captioning. This repository focus on Image Captioning & Video Captioning & Seq-to-Seq Learning & NLP

self-critical.pytorch. Unofficial pytorch implementation for Self-critical Sequence Training for Image Captioning. and others.

fairseq-zh-en. NMT for chinese-english using fairseq

DeepRL. Deep Reinforcement Learning Lab, a platform designed to make DRL technology and fun for everyone