Latest News
Open-Source AI Tools
We share our open source frameworks, tools, libraries, and models for everything from research exploration to large-scale production deployment.
Open-Source AI Research
We're advancing the state-of-the-art in artificial intelligence through fundamental and applied research in open collaboration with the community.
Notable Papers
RESEARCH
ML APPLICATIONS
GrokNet: Unified Computer Vision Model Trunk and Embeddings For Commerce
Sean Bell
Yiqun Liu
Sami Alsheikh
Yina Tang...
KDD
COMPUTER VISION
Live Face De-Identification in Video
Oran Gafni
Lior Wolf
Yaniv Taigman
International Conference on Computer Vision (ICCV)
RESEARCH
Single-Network Whole-Body Pose Estimation
Gines Hidalgo
Yaadhav Raaj
Haroon Idrees
Donglai Xiang...
International Conference on Computer Vision (ICCV)
SPEECH & AUDIO
A Universal Music Translation Network
Noam Mor
Lior Wolf
Adam Polyak
Yaniv Taigman
International Conference on Learning Representations (ICLR)
Latest Publications
October 01, 2021
COMPUTER VISION
CONVERSATIONAL AI
DVD: A Diagnostic Dataset for Multi-step Reasoning in Video Grounded Dialogue
A video-grounded dialogue system is required to understand both dialogue, which contains semantic dependencies from turn to turn …
Hung Le, Chinnadhurai Sankar, Seungwhan Moon, Ahmad Beiram, Alborz Geramifard, Satwik Kottur
October 01, 2021
August 30, 2021
NLP
SUPERB: Speech processing Universal PERformance Benchmark
Self-supervised learning (SSL) has proven vital for advancing research in natural language processing (NLP) and computer vision (CV). …
Shu-wen Yang, Po-Han Chi, Yung-Sung Chuang, Cheng-I Jeff Lai, Kushal Lakhotia, Yist Y. Lin, Andy T. Liu, Jiatong Shi, Xuankai Chang, Guan-Ting Lin, Tzu-Hsien Huang, Wei-Cheng Tseng, Ko-tik Lee, Da-Rong Liu, Zili Huang, Shuyan Dong, Shang-Wen, Shinji Watanabe, Abdelrahman Mohamed, Hung-yi Lee
August 30, 2021
August 29, 2021
NLP
Many-Speakers Single Channel Speech Separation with Optimal Permutation Training
Single channel speech separation has experienced great progress in the last few years …
Shaked Dovrat,Eliya Nachmani, Lior Wolf
August 29, 2021
August 09, 2021
COMPUTER VISION
GRAPHICS
Deep Relightable Appearance Models for Animatable Faces
We present a method for building high-fidelity animatable 3D face models that can be posed and rendered with novel lighting environments in real-time. …
Sai Bi, Stephen Lombardi,Shunsuke Saito, Tomas Simon, Shih-en Wei, Kevyn McPhail, Ravi Ramamoorthi, Yaser Sheikh, Jason Saragih
August 09, 2021
Help Us Pioneer the Future of AI
We share our open source frameworks, tools, libraries, and models for everything from research exploration to large-scale production deployment.
