The Seminar of the International Center for Analysis and Choice of Decisions

On Wednesday, April 7, the National Research University Higher School of Economics hosted the Seminar of the International Center for Analysis and Choice of Decisions

Theme: «Comparative analysis of knowledge transfer methods for training neural network models for vectorization of scientific and technical texts»
Speaker: Bakhtin P.D. (NRU HSE, Sberbank)

Annotation :
The report presents a number of methods for training neural network models for vectorization of scientific and technical texts based on knowledge transfer. In particular, a method is proposed for transferring knowledge from the citation graph of scientific articles to the SciBERT language model. The quality of the models is assessed both on the own benchmark of the research fronts, and on the foreign benchmark SciDocs.