Thank you for attention: A survey on attention-based artificial neural networks for automatic speech recognition

• DOI: 10.1016/j.iswa.2024.200406
• Publication Date: 2024-06-12T05:33:26Z
• Authors: Priyabrata Karmakar; Shyh Wei Teng; Guojun Lu
• Keywords: Sequence (biology)

Attention is a very popular and effective mechanism in artificial neural network-based sequence-to-sequence models. In this survey paper, comprehensive review of the different attention models used developing automatic speech recognition systems provided. The paper focuses on how have grown changed for offline streaming recurrent networks Transformer-based systems.