Using Multisensory Content to Impact the Quality of Experience of Reading Digital Books

• DOI: 10.1145/3458676
• Publication Date: 2021-11-12T21:16:06Z
• Authors: Ellen P. Silva; Natália Vieira; Glauco Amorim; Renata Mousinho; Gustavo Guedes; Gheorghita Ghinea; Joel A. F. Dos Sa...
• Keywords: 4. Education; 0202 electrical engineering, electronic engineering, information engineering; 02 engineering and technology

Multisensorial books enrich a story with either traditional multimedia content or sensorial effects. The main idea is to increase children’s interest in reading by enhancing their QoE while reading. Studies on enriched and/or augmented e-books also propose synchronizing additional content with text. However, they usually focus on audio, vídeo, images, or haptic feedback. In this work, we presentMBook, a tool for presenting multisensorial books. It decouples the book’s textual content from the additional content, as well as its synchronization, and rendering. Thus, a change in the additional content or its synchronization does not require changes to the book’s content. To enable fine-grained synchronization,MBookcaptures the reading position using an eye-tracker. Experimental results with students within the 13- to 19-year-old age group point toMBookbeing able to provide good usability.