ICML-Synthesizer Rethinking Self-Attention for Transformer Models

是 否 +2 论坛币

k人 参与回答

经管之家送您一份

应届毕业生专属福利!

求职就业群

赵安豆老师微信：zhaoandou666

经管之家联合CDA

送您一个全额奖学金名额~ !

立即领取

感谢您参与论坛问题回答

经管之家送您两个论坛币！

+2 论坛币

Synthesizer: Rethinking Self-Attention for Transformer Models

        Yi Tay 1 Dara Bahri 1 Donald Metzler 1 Da-Cheng Juan 1 Zhe Zhao 1 Che Zheng 1

             Abstract                widely attributed to this self-attention mechanism since fully
                                 connected token graphs, which are able to model long-range
   The dot product self-attention is known to be cen-
                                 dependencies, provide a robust inductive bias.
   tral and indispensabl ...

扫码加我 拉你入群

请注明：姓名-公司-职位

以便审核进群资格，未注明则拒绝

分享0 收藏0 回帖

关键词：Rethinking transform Attention Thinking rethink