Liam Liang Ding

lookahead.pytorch. lookahead optimizer (Lookahead Optimizer: k steps forward, 1 step back) for pytorch

proxifier_code. several free registration code for PROXIFIER

darts.pytorch1.1. Implementation with latest PyTorch (v1.1) for multi-gpu differentiable architecture search https://arxiv.org/abs/1806.09055

R1. 🚀enhanced GRPO with more verifiable rewards and real-time evaluators

mobi_ebooks. personal taste mobi books for kindle, mainly in Chinese version. welcome rp/ fork/ star ...

Neural-Machine-Translation. Several basic neural machine translation models implemented by PyTorch & TensorFlow

OOP-eval. The first Object-Oriented Programming (OOP) Evaluation Benchmark for LLMs

SafeLLM_with_IntentionAnalysis. Towards Safe LLM with our simple-yet-highly-effective Intention Analysis Prompting

self-attention. Transformer

corpus_filter. Scripts for machine translation corpora filtering/ 机器翻译平行语料过滤的脚本

inspiring_papers. Papers related to Machine Translation (continuously updating & welcome Star/Fork/PR)

EasyBLEU. An effective and simple tool to calculate SacreBLEU, Token-BLEU, BLEU w/ compound splitting for fairseq

LCNAT. LCNAT: Lexical choice in NAT - ICLR 2021

keywords_extract. Python

CodeGen-USCD. Code Gen with "Uncertainty Aware Selective Contrastive Decoding"

RLFW-NAT. RLFW-NAT: Rejuvenating low-frequency words (parallel data) - ACL 2021

LanguageAware_Tuning. language-aware tuning for building accurate cross-lingual LLMs

NMT-MultiModel-EnsembleDecoder. Extended multi-model ensemble decoding function based on ONMT

GD-optimization-algorithms. gradient descent optimization algorithms

RLFW-NAT.mono. RLFW-NAT.mono: Redistributing low-frequency words (monolingual data) - ACL 2022

DeepLearning-500-questions. 深度学习500问，以问答形式对常用的概率知识、线性代数、机器学习、深度学习、计算机视觉等热点问题进行阐述，以帮助自己及有需要的读者。 全书分为18个章节，50余万字。由于水平有限，书中不妥之处恳请广大读者批评指正。 未完待续............ 如有意合作，联系scutjy2015@163.com 版权所有，违权必究 Tan 2018.06

VRNN.tensorflow. A novel RNN cell named VRNN, which consumes less parameters and training time but gain comparable performance as LSTM/GRU

pyltp. pyltp: the python extension for LTP

SafeVLM_with_AMIA. Towards Safe LVM with Automatic Masking and Joint Intention Analysis

Dive-into-DL-PyTorch. 本项目将《动手学深度学习》(Dive into Deep Learning)原书中的MXNet实现改为PyTorch实现。

awesome-ensemble-learning. Ensemble learning related books, papers, videos, and toolboxes

CMU-CS11-747. hw for CMU cs11-747, neural networks for NLP

MT-scorer. several evaluation metrics for Machine Translation

WMT_scripts. Some helpful scripts for the WMT

rapid-adaptation. Reproduction instructions for "Rapid Adaptation of Neural Machine Translation to New Languages"

Awesome-LLM-Compression. Awesome LLM compression research papers and tools.

AlignLLMHumanSurvey. Aligning Large Language Models with Human: A Survey

sentence_prob_lstm. Calculating the sentence probability through lstm language model

deep_learning_curriculum. Language model alignment-focused deep learning curriculum

graph-generation. GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Models

PyTorch-BigGraph. Software used for generating embeddings from large-scale graph-structured data.

llm-course. Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

Efficient-LLMs-Survey. Efficient Large Language Models: A Survey

Awesome-Knowledge-Distillation-of-LLMs. This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". It includes KD Algorithms (Labeling, Self-Knowledge, Self-Rewarding, SFT, etc.) leveraging data augmentation or synthesis for getting knowledge, Skill Distillation (e.g. instruction following), and specialized applications (law, healthcare).

arxiv-sanity-preserver. Web interface for browsing, search and filtering recent arxiv submissions

cakechat. CakeChat: Emotional Generative Dialog System

text2sql-data. A collection of datasets that pair questions with SQL queries.

deeplearningbook-chinese. Deep Learning Book Chinese Translation