Bringing the world closer together by advancing AI

DensePose

Bringing the world closer together by advancing AI

AI for Commerce

Bringing the world closer together by advancing AI

Deepfake Detection

Bringing the world closer together by advancing AI

DensePose

Bringing the world closer together by advancing AI

AI for Commerce

Bringing the world closer together by advancing AI

Deepfake Detection

Open-Source AI Tools

We share our open source frameworks, tools, libraries, and models for everything from research exploration to large-scale production deployment.

Open-Source AI Research

We're advancing the state-of-the-art in artificial intelligence through fundamental and applied research in open collaboration with the community.

Notable Papers

RESEARCH

ML APPLICATIONS

GrokNet: Unified Computer Vision Model Trunk and Embeddings For Commerce

Sean Bell

Yiqun Liu

Sami Alsheikh

Yina Tang...

KDD

COMPUTER VISION

Live Face De-Identification in Video

Oran Gafni

Lior Wolf

Yaniv Taigman

International Conference on Computer Vision (ICCV)

RESEARCH

Single-Network Whole-Body Pose Estimation

Gines Hidalgo

Yaadhav Raaj

Haroon Idrees

Donglai Xiang...

International Conference on Computer Vision (ICCV)

SPEECH & AUDIO

A Universal Music Translation Network

Noam Mor

Lior Wolf

Adam Polyak

Yaniv Taigman

International Conference on Learning Representations (ICLR)

Latest Publications

October 01, 2021

COMPUTER VISION

CONVERSATIONAL AI

DVD: A Diagnostic Dataset for Multi-step Reasoning in Video Grounded Dialogue

A video-grounded dialogue system is required to understand both dialogue, which contains semantic dependencies from turn to turn …

Hung Le, Chinnadhurai Sankar, Seungwhan Moon, Ahmad Beiram, Alborz Geramifard, Satwik Kottur

October 01, 2021

August 30, 2021

NLP

SUPERB: Speech processing Universal PERformance Benchmark

Self-supervised learning (SSL) has proven vital for advancing research in natural language processing (NLP) and computer vision (CV). …

Shu-wen Yang, Po-Han Chi, Yung-Sung Chuang, Cheng-I Jeff Lai, Kushal Lakhotia, Yist Y. Lin, Andy T. Liu, Jiatong Shi, Xuankai Chang, Guan-Ting Lin, Tzu-Hsien Huang, Wei-Cheng Tseng, Ko-tik Lee, Da-Rong Liu, Zili Huang, Shuyan Dong, Shang-Wen, Shinji Watanabe, Abdelrahman Mohamed, Hung-yi Lee

August 30, 2021

August 29, 2021

NLP

Many-Speakers Single Channel Speech Separation with Optimal Permutation Training

Single channel speech separation has experienced great progress in the last few years …

Shaked Dovrat,Eliya Nachmani, Lior Wolf

August 29, 2021

August 09, 2021

COMPUTER VISION

GRAPHICS

Deep Relightable Appearance Models for Animatable Faces

We present a method for building high-fidelity animatable 3D face models that can be posed and rendered with novel lighting environments in real-time. …

Sai Bi, Stephen Lombardi,Shunsuke Saito, Tomas Simon, Shih-en Wei, Kevyn McPhail, Ravi Ramamoorthi, Yaser Sheikh, Jason Saragih

August 09, 2021

Help Us Pioneer the Future of AI

We share our open source frameworks, tools, libraries, and models for everything from research exploration to large-scale production deployment.