Publications

Be the first to try a brand new demo of DeepPavlov Library!

Let's try

DEEPPAVLOV PRODUCTS

DEEPPAVLOV
- DeepPavlov
- Demo
- Docs
- Github
- Nvidia NGC
- Docker Hub
- Releases
AGENT
- Agent
- Docs
- Github
DREAM
DFF
- DFF
- Github
DATASETS
- DeepPavlov Topics

challenges

Publications

We present our achievements at the leading conferences and take part in different competitions.

2022

A review of neural architecture search

Dilyara Baymurzinaa, Eugene Golikov, MikhailBurtsev 🔗
Complexity of Symbolic Representation in Working
Memory of Transformer Correlates with the Complexity of a Task

Alsu Sagirova and Mikhail Burtsev🔗
Controllable Multi-attribute Dialog Generation with PALs and Grounding Knowledge

Dmitry Evseev, Nagovitsin Mark, Denis Kuznetsov🔗
Lightweight and accurate system for entity extraction and linking

Dmitry Evseev🔗
Knowledge Distillation of Russian Language Models with Reduction of Vocabulary

Alina Kolesnikova, Yury Kuratov, Vasily Konovalov, Mikhail Burtsev 🔗
Multilingual Case-insensitive Named Entity Recognition

Anastasia Chizhikova, Vasily Konovalov, Mikhail Burtsev 🔗
Is language acquisition similar in language models and humans? A chronological probing study.

Oleg Serikov🔗
Emergent Structures and Training Dynamics in Large Language Models

Oleg Serikov🔗
LowResourceEval2021: a shared task on speech processing for lowresource languages

Anastasia Chizhikova, Sanzhar Murzakhmetov, Oleg Serikov, Tatiana Shavrina, Mikhail Burtsev🔗
Razmecheno: Named Entity Recognition from Digital Archive of Diaries "Prozhito"

Oleg Serikov🔗
Corpus with Speech Function Annotation: Challenges, Advantages, and Limitations

Lidia Ostyakova, Maria Molchanova, Ksenia Petukhova, Veronika Smilga, Daniel Kornev, Mikhail Burtsev🔗
Global Memory Transformer for Processing Long Documents

Arij Al Adel 🔗
Recurrent Memory Transformer

Aydar Bulatov, Yury Kuratov, Mikhail Burtsev 🔗
Explain My Surprise: Learning Efficient Long-Term Memory by Predicting Uncertain Outcomes

Artyom Sorokin, Nazar Buzun, Leonid Pugachev, Mikhail Burtsev🔗

2021

DREAM Technical Report for the Alexa Prize 4

Dilyara Baymurzina, Denis Kuznetsov, Dmitry Evseev, Dmitry Karpov, Alsu Sagirova, Anton Peganov, Fedor Ignatov, Elena Ermakova, Daniil Cherniavskii, Sergey Kumeyko, Oleg Serikov, Yury Kuratov, Lidiya Ostyakova, Daniel Kornev, Mikhail Burtsev. Alexa Prize Proceedings. – 2021
🔗
Investigating the robustness of reading difficulty models for Russian educational texts

Ulyana Isaeva, Alexey Sorokin. AINL 2020 Supplementary Volume, CCIS 1367. 2021
🔗
Morph Call: Probing Morphosyntactic Content of Multilingual Transformers

Vladislav Mikhailov, Oleg Serikov, Ekaterina Artemova. NAACL 2021 workshop, 2021.
🔗
Data pseudo-labeling while adapting BERT for multi-task approaches

Dmitry Karpov, Mikhail Burtsev. Proceedings of the International Conference "Dialogue 2021", 2021
Generation of SPARQL queries to answer complex questions in Russian using a syntactic parser

Dmitry Evseev. Artificial intelligence and decision-making, 2021
Evaluation of Conversational Skills for Commonsense

Dilyara Baymurzina, Yuri Kuratov, Denis Kuznetsov, Daniel Kornev, Mikhail Burtsev. Proceedings of the International Conference "Dialogue 2021", 2021
Extending Transformer Decoder with Working Memory for Sequence to Sequence Tasks

Alsu Sagirova, Mikhail Burtsev.International Conference on Neuroinformatics, 253-260, Advances in Neural Computation, Machine Learning, and Cognitive Research V, 2021
🔗
Short Text Clustering with Transformers

Pugachev Leonid, Burtsev Mikhail. Proceedings of the International Conference "Dialogue 2021", 2021
🔗
LowResourceEval2021: a shared task on speech processing for lowresource languages

Klyachko Elena, Grebenkin Daniil, Nosenko Daria, Serikov Oleg. Proceedings of the International Conference "Dialogue 2021", 2021
SemSketches2021: experimenting with the machine processing of the pilot semantic sketches corpus

Ponomareva Maria, Petrova Maria, Detkova Julia, Serikov Oleg, Yarova Maria. Proceedings of the International Conference "Dialogue 2021", 2021
Teaching a Massive Open Online Course on Natural Language Processing

Ekaterina Artemova, Murat Apishev, Denis Kirianov, Veronica Sarkisyan, Sergey Aksenov, Oleg Serikov. NAACL|TeachingNLP, 2021
🔗
SIGTYP 2021 Shared Task: Robust Spoken Language Identification

Elizabeth Salesky, Badr M. Abdullah, Sabrina Mielke, Elena Klyachko, Oleg Serikov, Edoardo Maria Ponti, Ritesh Kumar, Ryan Cotterell, Ekaterina Vylomova. NAACL|SigTYP, 2021
🔗
Building and Evaluating Open-Domain Dialogue Corpora with Clarifying Questions

Mohammad Aliannejadi, Julia Kiseleva, Aleksandr Chuklin, Jeffrey Dalton, Mikhail Burtsev. EMNLP 2021
🔗
Memory transformer with hierarchical attention for long document processing

Arij Al Adel and Mikhail Burtsev. En&T Conference IEEE 2021
🔗
Discourse-Driven Integrated Dialogue Development Environment for Open-Domain Dialogue Systems

Denis Kuznetsov, Dmitry Evseev, Lidia Ostyakova, Oleg Serikov, Daniel Kornev, Mikhail Burtsev. EMNLP 2021 Proceedings of the 2nd Workshop on Computational Approaches to Discourse, 2021
🔗
DREAM Dialog system in the Alexa Prize Challenge 2019

Y. M. Kuratov, I. F. Yusupov, D. R. Baymurzina, D. P. Kuznetsov, D. V. Chernyavsky, A. Dmitrievsky, E. S. Ermakova, F. S. Ignatov, A. Karpov, D. A. Kornev, T. A. Le, P.Y. Pugin, M. S. Burtsev, 2021
🔗

2020

DREAM technical report for the Alexa Prize 2019

Yuri Kuratov, Idris Yusupov, Dilyara Baymurzina, Denis Kuznetsov, Daniil Cherniavskii, Alexander Dmitrievskiy, Elena Ermakova, Fedor Ignatov, Dmitry Karpov, Daniel Kornev, The Anh Le, Pavel Pugin, Mikhail Burtsev. Alexa Prize Proceedings. – 2020
🔗
Conversational Intelligence Challenge: Accelerating Research with Crowd Science and Open Source

Burtsev, M., & Logacheva, V. AI Magazine, 41(3), 18-27. 2020
🔗
Towards a General Theory of Infinite-Width Limits of Neural Classifiers

Eugene A. Golikov. Proceedings of the 37th International Conference on Machine Learning, PMLR 119, 2020.
🔗 🔗
Sequence Labeling Approach to the Task of Sentence Boundary Detection

The Anh Le. ICMLSC 2020: Proceedings of the 4th International Conference on Machine Learning and Soft Computing, 2020
🔗 🔗
Goal-Oriented Multi-Task BERT-Based Dialogue State Tracker

Pavel Gulyaev, Eugenia Elistratova, Vasily Konovalov, Yuri Kuratov, Leonid Pugachev, Mikhail Burtsev. AAAI - 20, 2020
🔗 🔗
Exploring the BERT Cross-Lingual Transferability: a Case Study in Reading Comprehension

Konovalov V. P., Gulyaev P. A., Sorokin A. A., Kuratov Y. M., Burtsev M. S. Proceedings of the International Conference "Dialogue 2020", 2020
🔗
Tagging and Parsing of Multidomain Collections

Alexey Sorokin, Ivan Smurov, Denis Kirianov. Proceedings of the International Conference "Dialogue 2020", 2020
🔗 🔗
SPARQL Query Generation for Complex Question Answering with BERT and BiLSTM-Based Model

Evseev D. A., Arkhipov M. Yu. Proceedings of the International Conference "Dialogue 2020", 2020
🔗 🔗
Summary Construction Strategies for Headline Generation in the Russian

Malykh V., Cherniavskii D., Valukov A., Proceedings of the International Conference "Dialogue 2020", 2020
🔗
Cyclic Shift on Multi-component Grammars

Alexander Okhotin, Alexey Sorokin. Language and Automata Theory and Applications. LATA 2020. Lecture Notes in Computer Science, vol 12038. Springer, Cham
Neural Entity Linking: A Survey of Models based on Deep Learning

Ozge Sevgili, Artem Shelmanov, Mikhail Arkhipov, Alexander Panchenko, Chris Biemann. 2020
🔗
Getting More Data for Low-resource Morphological Inflection: Language Models and Data Augmentation

A. Sorokin. Proceedings of The 12th Language Resources and Evaluation Conference, 3978-3983, 2020
🔗
ConvAI3: Generating Clarifying Questions for Open-Domain Dialogue Systems (ClariQ)

Aliannejadi, M., Kiseleva, J., Chuklin, A., Dalton, J., & Burtsev, M. EMNLP workshop, 2020
🔗

2019

A Deep Neural Network Model for the Task of Named Entity Recognition

Anh Le, Mikhail S. Burtsev. International Journal of Machine Learning and Computing vol. 9, no. 1, pp. 8-13, 2019
🔗
Tuning Multilingual Transformers for Named Entity Recognition on Slavic Languages

Mikhail Arkhipov, Maria Trofimova, Yuri Kuratov, Alexey Sorokin. ACL-2019, Balto-Slavic Natural Language Processing workshop, 2019
🔗 🔗
Sentence Level Representation and Language Models in the task of Coreference Resolution for Russian

Le T. A., Kuratov Y. M. , Petrov M. A., Burtsev M. S. Proceedings of the International Conference "Dialogue 2019", 2019
🔗
Language Model Embeddings Improve Sentiment Analysis in Russian

Baymurzina D. R., Kuznetsov D. P., Burtsev M. S. Proceedings of the International Conference "Dialogue 2019", 2019
🔗
Adaptation of Deep Bidirectional Multilingual Transformers for Russian Language

Kuratov Yuri, Arkhipov Mikhail. Proceedings of the International Conference "Dialogue 2019", 2019
🔗 🔗
Filling the Gaps with Rules and Networks

Alexey Sorokin. Proceedings of the International Conference "Dialogue 2019", 2019
🔗 🔗
Morphological Parsing of Low Resource Languages

Alexey Sorokin. Proceedings of the International Conference "Dialogue 2019", 2019
🔗 🔗
Continual and Multi-task Reinforcement Learning With Shared Episodic Memory

Artyom Y. Sorokin, Mikhail S. Burtsev. Presented at the Task-Agnostic Reinforcement Learning Workshop at ICLR, 2019
🔗
Convolutional neural networks for low-resource morpheme segmentation: baseline or state-of-the-art?

Alexey Sorokin. Proceedings of the 16th Workshop on Computational Research in Phonetics, Phonology, and Morphology, ACL, 2019
🔗 🔗
Loss Landscape Sightseeing with Multi-Point Optimization

Ivan Skorokhodov, Mikhail Burtsev. Presented at Workshop at NeurIPS, 2019
🔗 🔗
The Second Conversational Intelligence Challenge (ConvAI2)

Dinan E., Logacheva V., Malykh V., Burtsev M.et al. (2020) In: Escalera S., Herbrich R. (eds) The NeurIPS '18 Competition. The Springer Series on Challenges in Machine Learning. Springer, Cham 2019
🔗
ConvAI2 Dataset of Non-goal-Oriented Human-to-Bot Dialogues

Logacheva V., Malykh V., Litinsky A., Burtsev M. The NeurIPS '18 Competition. The Springer Series on Challenges in Machine Learning. Springer, Cham 2019
🔗

2018

DeepPavlov: Open-Source Library for Dialogue Systems

Mikhail Burtsev, Alexander Seliverstov, Rafael Airapetyan, Mikhail Arkhipov, Dilyara Baymurzina, Nickolay Bushkov, Olga Gureenkova, Taras Khakhulin, Yuri Kuratov, Denis Kuznetsov, Alexey Litinsky, Varvara Logacheva, Alexey Lymar, Valentin Malykh, Maxim Petrov, Vadim Polulyakh, Leonid Pugachev, Alexey Sorokin, Maria Vikhreva, Marat Zaynutdinov. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics-System Demonstrations, pages 122–127, 2018
🔗
What can we gain from language models for morphological inflection?

Sorokin Alexey. Proceedings of the CoNLL–SIGMORPHON 2018 Shared Task: Universal Morphological Reinflection, 2018
🔗
Improving neural morphological Tagging using Language Models

Sorokin Alexey. Proceedings of the International Conference "Dialogue 2018", 2018
🔗
Deep Convolutional Networks for Supervised Morpheme Segmentation of Russian Language

Alexey Sorokin, Anastasia Kravtsova. Artificial Intelligence and Natural Language. AINL 2018. Communications in Computer and Information Science, vol 930. Springer, Cham, 2018
🔗
Embedding-reparameterization procedure for manifold-valued latent variables in generative models

Maksim Kretov, Eugene Golikov. Presented at Bayesian Deep Learning workshop NeurIPS - 2018, 2018
🔗

2017

Application of a Hybrid Bi-LSTM-CRF model to the task of Russian Named Entity Recognition

Anh L. T., Arkhipov M. Y., Burtsev M. S. Artificial Intelligence and Natural Language Conference, 2017
🔗
Generalizable Architecture for Robust Word Vectors Tested by Noisy Paraphrases

V. Malykh. Supplementary Proceedings of the Sixth International Conference on Analysis, AIST, 2017
🔗
Competition on Automatic Evaluation of Dialogue Quality

Burtsev M., Logacheva V., Malykh V., Poluliakh V., Seliverstov A. Workshop "OPT'17: optimization in machine learning" in 31st Conference on Neural Information Processing Systems, 2017
🔗
Using stochastic computation graphs formalism for optimization of sequence-to-sequence model

Golikov E., Zhukov V., Kretov M. Workshop "OPT'17: optimization in machine learning" in 31st Conference on Neural Information Processing Systems, 2017
🔗
The First Conversation Intelligence Challenge

Mikhail Burtsev, Varvara Logacheva, Valentin Malykh, Iulian Serban, Ryan Lowe,Shrimai Prabhumoye, Alan W Black, Alexander Rudnicky, Yoshua Bengio. The NIPS '17 Competition: Building Intelligent Systems, 2017
🔗
ConvAI Dataset of Topic-Oriented Human-to-Chatbot Dialogues

Varvara Logacheva, Mikhail Burtsev, Valentin Malykh, Vadim Polulyakh, Aleksandr Seliverstov. The NIPS '17 Competition: Building Intelligent Systems, 2017
🔗

2016

Reproducing Russian NER Baseline Quality without Additional Data

V Malykh, A Ozerin. CDUD@ CLA, 54-59, 2016
🔗