Sergey Edunov

RESEARCH ENGINEERING MANAGER | MENLO PARK, UNITED STATES

Sergey is a Research Engineering Manager at Facebook AI Research. He works on natural language processing and speech. Previously he worked on distributed graph analytics and was a part of the Apache Giraph team. He earned a MS degree in Physics in 2005 in the Moscow Institute of Physics and Technology.

Sergey's Publications

September 27, 2023

NLP

Effective Long-Context Scaling of Foundation Models

Wenhan Xiong, Igor Molybog, Hejia Zhang, Praj Bhargava, Rui Hou, Louis Martin, Rashi Rungta, Karthik Abinav Sankararaman, Barlas Oguz, Madian Khabsa, Han Fang, Yashar Mehdad, Sharan Narang, Kshitiz Malik, Angela Fan, Shruti Bhosale, Sergey Edunov, Mike Lewis, Sinong Wang, Hao Ma, Jingyu Liu

September 27, 2023

July 18, 2023

CONVERSATIONAL AI

NLP

Llama 2: Open Foundation and Fine-Tuned Chat Models

Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Praj Bhargava, Shruti Bhosale, Dan Bikel, Lukas Blecher, Cristian Canton Ferrer, Moya Chen, Guillem Cucurull, David Esiobu, Jude Fernandes, Jeremy Fu, Wenyin Fu, Brian Fuller, Cynthia Gao, Vedanuj Goswami, Naman Goyal, Anthony Hartshorn, Saghar Hosseini, Rui Hou, Hakan Inan, Marcin Kardas, Viktor Kerkez, Madian Khabsa, Isabel Kloumann, Artem Korenev, Punit Singh Koura, Marie-Anne Lachaux, Thibaut Lavril, Jenya Lee, Diana Liskovich, Yinghai Lu, Yuning Mao, Xavier Martinet, Todor Mihaylov, Pushkar Mishra, Igor Molybog, Yixin Nie, Andrew Poulton, Jeremy Reizenstein, Rashi Rungta, Kalyan Saladi, Alan Schelten, Ruan Silva, Eric Michael Smith, Ranjan Subramanian, Xiaoqing Ellen Tan, Binh Tang, Ross Taylor, Adina Williams, Andrew Kuan, Puxin Xu, Zheng Yan, Iliyan Zarov, Yuchen Zhang, Angela Fan, Melanie Kambadur, Sharan Narang, Aurelien Rodriguez, Robert Stojnic, Sergey Edunov, Thomas Scialom

July 18, 2023

July 06, 2022

No Language Left Behind: Scaling Human-Centered Machine Translation

Marta Costa-jussa, James Cross, Onur Çelebi, Maha Elbayad, Kenneth Heafield, Kevin Heffernan, Elahe Kalbassi, Janice Lam, Daniel Licht, Jean Maillard, Anna Sun, Skyler Wang, Guillaume Wenzek, Al Youngblood, Bapi Akula, Loic Barrault, Gabriel Mejia Gonzalez, Kae Hansanti, John Hoffman, Semarley Jarrett, Kaushik Ram Sadagopan, Dirk Rowe, Shannon Spruit, Chau Tran, Pierre Andrews, Necip Fazil Ayan, Shruti Bhosale, Sergey Edunov, Angela Fan, Cynthia Gao, Vedanuj Goswami, Francisco Guzmán, Philipp Koehn, Alex Mourachko, Christophe Ropers, Safiyyah Saleem, Holger Schwenk, Jeff Wang (PM - AI)

July 06, 2022

November 18, 2020

RESEARCH

NLP

Language Models not just for Pre-training: Fast Online Neural Noisy Channel Modeling

Michael Auli, Sergey Edunov, Shruti Bhosale, Kyra Yee

November 18, 2020

October 23, 2019

RESEARCH

SPEECH & AUDIO

Cloze-driven Pretraining of Self-attention Networks

Michael Auli, Alexei Baevski, Luke Zettlemoyer, Sergey Edunov, Yinhan Liu

October 23, 2019

May 27, 2019

RESEARCH

SPEECH & AUDIO

fairseq: A Fast, Extensible Toolkit for Sequence Modeling

Michael Auli, Alexei Baevski, Angela Fan, Myle Ott, Nathan Ng, Sam Gross, Sergey Edunov, David Grangier

May 27, 2019

October 31, 2018

RESEARCH

SPEECH & AUDIO

Understanding Back-Translation at Scale

Michael Auli, Myle Ott, Sergey Edunov, David Grangier

October 31, 2018

October 30, 2018

RESEARCH

Scaling Neural Machine Translation

Michael Auli, Myle Ott, Sergey Edunov, David Grangier

October 30, 2018