Илья Козиев

NLP_Datasets. My NLP datasets for Russian language

chatbot. Русскоязычный генеративный чатбот с профилем и фактами

GrammarEngine. Грамматический Словарь Русского Языка (+ английский, японский, etc)

rulemma. Лемматизатор для русскоязычных текстов

MNIST_Boosting. Comparison of XGBoost, LightGBM and CatBoost on MNIST classification problem

verslibre. Using transformers to generate Russian poetry

rusyllab. Simple Python package for breaking Russian words into syllables

rupostagger. Part-of-Speech Tagger for Russian language

rutokenizer. Russian text segmenter and tokenizer

LM-finetune. Код для файнтюна LM (rugpt, LLaMa, FRED T5) средствами transformers + deepspeed + LoRa

pushkin. Генеративные текстовые модели

StressModel. Neural model for prediction of stress position in Russian words

paraphraser. Поэтический перефразировщик

RussianDictionary. Russian Lexicon and Syntax Rules

MLBootCampV. http://mlbootcamp.ru/round/12/sandbox/

WordRepresentations. Сравнение нескольких способов представления слов для построения языковых моделей

Rifma. Dataset with annotation of Russian-language poems

ruword2tags. Морфологический анализатор слов для русского языка

CorpusSearch. Полнотекстовый поиск по текстовому корпусу с помощью Lucene.NET

vector2text. Generate Russian text using GPT model given LaBSE text embedding vector

RussianPoetryScansionTool. Detection of poetic meter, rhyme, and stress placement in the texts of Russian accentual-syllabic poems and songs.

NGrams. Работа с n-граммами: сбор и использование для оценки текста

transcriber. Model to convert text to phonetic transcription and vice versa

LM-pretrain. Char-level language model pretraining code and scripts

Word2Vec. Continuous word representation tools

mamba. Python

word2lemma. Эксперименты с лемматизацией

word_embedders. Character-level autoencoder models for words

Spellchecker. Rule- and dictionary-based spellchecker with emphasize on precision over recall

rupostagger2. Простая нейросетевая модель для частеречной разметки

sent_embedders. Experiments with sentence embedding models

QuoraQuestionPairs. Deep learning models for Kaggle NLP competition 'Quora Question Pairs'

math. Conversational data generator

SentimentAnalysis. C# and Python tools and models for review sentiment analysis

character-tokenizer. A character tokenizer for HuggingFace Transformers

ruchunker. NP chunker for Russian language

MorphoRuEval2017. Part-of-speech tagger and lemmatizer for MorphoRuEval2017

arithmetic_robustness. Evaluating How Whitespace Distortions in Prompts Affect Large Language Models' Arithmetic Problem-Solving Accuracy

ML-Challenge-3. Jupyter Notebook

NLP_Comp. Solutions for NLP competitions

word_is_noun. Binary classification of Russian wordforms using RNN/LSTM character language model

MLBootCampIII. http://mlbootcamp.ru/championship/10/