ScaleCom: Scalable Sparsified Gradient Compression
for Communication-Efficient Distributed Training
Chia-Yu Chen1 , Jiamin Ni2 , Songtao Lu2 , Xiaodong Cui1 , Pin-Yu Chen2
Xiao Sun1 , Naigang Wang1 , Swagath Venkataramani2
Vijayalakshmi Srinivasan1 , Wei Zhang1 , Kailash Gopalakrishnan1
IBM T. J. Watson Research Center
Yorktown Heights, NY 10598, USA
1
{cchen, cuix, xsun, nwang, viji, weiz, kailash}@us.ibm.com
2
{ji ...


雷达卡



京公网安备 11010802022788号







