Spencer Poff

Spencer is a Research Engineer at Facebook AI Research. He holds a BS in Mechanical Engineer from UC Berkeley and worked as a Software Engineer on Messenger for 3 years before FAIR.

Spencer's Publications

May 14, 2021

RESEARCH

Not All Memories are Created Equal: Learning to Forget by Expiring

Attention mechanisms have shown promising results in sequence modeling tasks that require longterm memory. However, not all content in the past is equally important to remember. We propose Expire-Span, a method that learns to retain the most important information and expire the irrelevant information.…

Sainbayar Sukhbaatar, Da Ju, Spencer Poff, Stephen Roller, Arthur Szlam, Jason Weston, Angela Fan

May 14, 2021