DEEPPAVLOV PRODUCTS
DeepPavlov journey at Google Summer of Code for Summer in 2021!
Close
 
Research at deeppavlov
At DeepPavlov, we conduct research that bridges the linguistic divide between people and machines to make communicating with computers as natural as speaking with
family and friends.
OUR Research Areas
Multiskill AI Assistants

Common NLU Components
Chit-Chat Systems
Goal-Oriented Systems
Other Skill Frameworks
Dialog Orchestration
Language Models
Neural Architecture Search

Knowledge Graphs
Models with Memory
CURRENT RESEARCH PROJECTS
Evolutionary Neural Architecture Search
Knowledge Graph-Based Dialogue Generation
Transformer With Inner Classification Of Memory Tokens In Decoder
Evolutionary Neural Architecture Search
We propose an application of evolutionary algorithm to Neural Architecture Search for image and text classification tasks on PyTorch. One of the main issues of evolutionary search is high resource consumption, so one of our main priority is optimisation of the model evaluation.
Knowledge Graph-Based Dialogue Generation
Responses can be more meaningful compared to chit-chat generated responses thanks to usage of facts coming from a knowledge base like Wikidata. The system consists of three components:
  1. extraction of triplets from Wikidata for entities from the user's utterance;
  2. triplets ranking (choosing the triplet which is the most appropriate to use for generation of the response utterance);
  3. generation of the response utterance.
    Transformer With Inner Classification Of Memory Tokens In Decoder
    During decoding in Transformer, we simultaneously predict the next token and its type: memory or sequence. Memory tokens provide space to store global representations of the input context.
    PAST RESEARCH PROJECTS
    Entity Linking & Disambiguation for Russian & English Languages
    Detection of Factual Errors In Historical Essays in Russian
    Entity Linking & Disambiguation for Russian & English Languages
    Disambiguation of candidate entities for extracted entities is performed using
    1. prior probabilities of mention and entity correspondence;
    2. context (the sentence in the text which contains the mentioned entity) and description of the entity in Wikidata;
    3. global disambiguation (joint disambiguation of all entities in the text using connections of the entities in Wikidata knowledge graph).
    Detection of Factual Errors In Historical Essays in Russian
    We detect errors in dates and causal relationship. We collected databases of dates and causal relationship of historic events. For date checking we extracted tokens in the text which refer to historic events using syntactic parser, then linked it to the event in database using TF-IDF and matched the date in text with the date in the database.
      Opportunities for Interns
      Opportunities for Full-Time Researchers
      OUR NEWS