Sho Yaida

Sho is a research scientist at Facebook AI Research (FAIR), focusing on the physics of machine learning. He studied black holes while earning his Ph.D. at Stanford University, before shifting to cracking the glass problem during postdoc work at MIT and Duke University.

Sho's Publications

April 07, 2020

RESEARCH

NLP

Fluctuation-dissipation relations for stochastic gradient descent

The notion of the stationary equilibrium ensemble has played a central role in statistical mechanics. In machine learning as well, training serves as generalized equilibration that drives the probability distribution of model parameters toward…

Sho Yaida,

April 07, 2020