SAC: Accelerating and Structuring Self-Attention via
Sparse Adaptive Connection
Xiaoya Li* , Yuxian Meng* , Mingxin Zhou , Qinghong Han , Fei Wu and Jiwei Li
Computer Science Department, Zhejiang University
Shannon.AI
{xiaoya_li,yuxian_meng,mingxin_zhou,qinghong_han,jiwei_li}@shannonai.com
Abstract
While the self-attention mechanism has been widely used in a wide variety of ta ...


雷达卡


京公网安备 11010802022788号







