Decoding 'Attention Is All You Need': Scaled Dot-Product & Multi-Head Mechanisms
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, Illia Polosukhin
•NeurIPS 2017
Technical breakdowns of research papers.