Quasi-Global Momentum:
Accelerating Decentralized Deep Learning on Heterogeneous Data
Tao Lin 1 Sai Praneeth Karimireddy 1 Sebastian U. Stich 1 Martin Jaggi 1
Abstract is kept locally (never transmitted during training).
Decentralized training of deep learning models A key challenge—in particular in the second scenario—is
is a key element for enabling data privacy and the large heterogeneity (non-i.i.d.-ness) in the data present
...


雷达卡




京公网安备 11010802022788号







