AI researcher & builder
lookahead.pytorch. lookahead optimizer (Lookahead Optimizer: k steps forward, 1 step back) for pytorch
336proxifier_code. several free registration code for PROXIFIER
273darts.pytorch1.1. Implementation with latest PyTorch (v1.1) for multi-gpu differentiable architecture search https://arxiv.org/abs/1806.09055
83R1. 🚀enhanced GRPO with more verifiable rewards and real-time evaluators
37mobi_ebooks. personal taste mobi books for kindle, mainly in Chinese version. welcome rp/ fork/ star ...
31Neural-Machine-Translation. Several basic neural machine translation models implemented by PyTorch & TensorFlow
29OOP-eval. The first Object-Oriented Programming (OOP) Evaluation Benchmark for LLMs
27SafeLLM_with_IntentionAnalysis. Towards Safe LLM with our simple-yet-highly-effective Intention Analysis Prompting
21self-attention. Transformer
11corpus_filter. Scripts for machine translation corpora filtering/ 机器翻译平行语料过滤的脚本
9inspiring_papers. Papers related to Machine Translation (continuously updating & welcome Star/Fork/PR)
7EasyBLEU. An effective and simple tool to calculate SacreBLEU, Token-BLEU, BLEU w/ compound splitting for fairseq
7LCNAT. LCNAT: Lexical choice in NAT - ICLR 2021
7keywords_extract. Python
7CodeGen-USCD. Code Gen with "Uncertainty Aware Selective Contrastive Decoding"
6RLFW-NAT. RLFW-NAT: Rejuvenating low-frequency words (parallel data) - ACL 2021
5LanguageAware_Tuning. language-aware tuning for building accurate cross-lingual LLMs
4NMT-MultiModel-EnsembleDecoder. Extended multi-model ensemble decoding function based on ONMT
4GD-optimization-algorithms. gradient descent optimization algorithms
3RLFW-NAT.mono. RLFW-NAT.mono: Redistributing low-frequency words (monolingual data) - ACL 2022
3DeepLearning-500-questions. 深度学习500问,以问答形式对常用的概率知识、线性代数、机器学习、深度学习、计算机视觉等热点问题进行阐述,以帮助自己及有需要的读者。 全书分为18个章节,50余万字。由于水平有限,书中不妥之处恳请广大读者批评指正。 未完待续............ 如有意合作,联系scutjy2015@163.com 版权所有,违权必究 Tan 2018.06
3VRNN.tensorflow. A novel RNN cell named VRNN, which consumes less parameters and training time but gain comparable performance as LSTM/GRU
3pyltp. pyltp: the python extension for LTP
2SafeVLM_with_AMIA. Towards Safe LVM with Automatic Masking and Joint Intention Analysis
2Dive-into-DL-PyTorch. 本项目将《动手学深度学习》(Dive into Deep Learning)原书中的MXNet实现改为PyTorch实现。
1awesome-ensemble-learning. Ensemble learning related books, papers, videos, and toolboxes
1CMU-CS11-747. hw for CMU cs11-747, neural networks for NLP
1MT-scorer. several evaluation metrics for Machine Translation
1WMT_scripts. Some helpful scripts for the WMT
1rapid-adaptation. Reproduction instructions for "Rapid Adaptation of Neural Machine Translation to New Languages"
1Awesome-LLM-Compression. Awesome LLM compression research papers and tools.
1AlignLLMHumanSurvey. Aligning Large Language Models with Human: A Survey
1sentence_prob_lstm. Calculating the sentence probability through lstm language model
1deep_learning_curriculum. Language model alignment-focused deep learning curriculum
1graph-generation. GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Models
1PyTorch-BigGraph. Software used for generating embeddings from large-scale graph-structured data.
1llm-course. Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
1Efficient-LLMs-Survey. Efficient Large Language Models: A Survey
1Awesome-Knowledge-Distillation-of-LLMs. This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". It includes KD Algorithms (Labeling, Self-Knowledge, Self-Rewarding, SFT, etc.) leveraging data augmentation or synthesis for getting knowledge, Skill Distillation (e.g. instruction following), and specialized applications (law, healthcare).
1arxiv-sanity-preserver. Web interface for browsing, search and filtering recent arxiv submissions
1cakechat. CakeChat: Emotional Generative Dialog System
1text2sql-data. A collection of datasets that pair questions with SQL queries.
1deeplearningbook-chinese. Deep Learning Book Chinese Translation
1