Crossmodal associations may arise at neurological, perceptual, cognitive, or emotional levels of brain processing. Higher-level modal correspondences between musical timbre and visual colour have been previously investigated, though with limited sets colour. We developed a novel response method that employs tablet interface to navigate the CIE Lab space. The was used in an experiment where 27 film music excerpts were presented participants (n = 22) who continuously manipulated size on-screen...

The coronavirus disease 2019 (COVID-19) lockdown meant a greatly reduced social and economic activity. Sound is of major importance to people’s perception the environment, some remarked that soundscape was changing for better. But are these anecdotal reports based in truth? Has traffic noise from cars airplanes really gone down, so more birdsong can be heard? Have socially distanced people quietened down? This article presents case study human environmental sounds an urban neighborhood...

New conference formats are emerging in response to COVID-19 and climate change. Virtual conferences sustainable inclusive regardless of participant mobility (financial means, caring commitments, disability), but lack face-to-face contact. Hybrid (physical meetings with additional virtual presentations) tend discriminate against non-fliers encourage unsustainable flying. Multi-hub mix real interactions during talks social breaks distributed across nominally equal hubs. We propose a global...

Restaurants are complex environments engaging all our senses. More or less designable sound sources, such as background music, voices, and kitchen noises, influence the overall perception of soundscape. Previous research suggested typologies sounds in some environmental contexts, urban parks offices, but there is no detailed account that relevant to restaurants. We collected on-site data 40 restaurants (n = 393), including perceptual ratings, free-form annotations characteristic whether they...

There have been few empirical investigations of how individual differences influence the perception sonic environment. The present study included Big Five traits and noise sensitivity as personality factors in two listening experiments (n = 43, n 45). Recordings urban restaurant soundscapes that had selected based on their type were rated for Pleasantness Eventfulness using Swedish Soundscape Quality Protocol. Multivariate multiple regression analysis showed ratings depended loudness both...

Noise has become integral to contemporary music aesthetics. In this paper, we define noise as sound that is high in auditory roughness, and examine the effect of on cross-modal mapping between visual shape participants. order preserve ecological validity aesthetics, developed Rama, a novel interface, for presenting experimentally controlled blocks form part design multimedia performance with live musicians, also allows data be actively collected from audience interaction. Audience members...

The smellscape is the olfactory environment as perceived and understood, consisting of odours scents from multiple smell sources. To what extent can audiovisual information evoke smells a real, complex, multimodal environment? investigate imagination, we compared results two studies. In first, onsite participants (N = 15) made sensory walk through seven locations an open-air market. second, online 53) virtual same reproduced with audio video recordings. Responses in form free-form verbal...

Human-machine communication has evolved from one-to-one to multi-agent systems where the interplay between machines themselves interacts with human perception and behavior, complicated by unconstrained emotion-based variables in social systems. To investigate Human-Robot Robot-Robot-Human interaction while constraining a rule-based system, we developed an artistic intervention using competitive game performance robotic arms. Two robots play chess each other expressively making gestures like...

To work flexibly with the sound design for The Locust Wrath, a multimedia dance performance on topic of climate change, author developed software interactive sonification data. An open-ended approach to parameter mapping allowed tweaking and improvisation during rehearsals, resulting in large range musical expression. sonifications represented weather systems pushing through Southeast Asia complex patterns. was rendered as piece electroacoustic music, whose compositional form—gesture,...

Abstract The hospital soundscape is known for high noise levels and a perception of chaos, leading to concerns about its impact on patients, families, professionals, other staff. This study investigates the relationship between sound, A nnoyance, sleep quality in multi-patient neurology ward. mixed-methods approach was employed. Interviews were conducted with medical staff ( n = 7) understand their experiences sound. Questionnaires tracking devices 20) assessed patient nnoyance caused by...

The sensory cultural heritage creates identity and cohesion in a community. Multimodal Hong Kong (MMHK) started January 2023 aims to build database of soundscape smellscape at culturally significant sites. This paper will introduce the project its objectives, present results from pilot survey, describe development field work methodology. Data collection methods include Ambisonics audio, 360 video, 'smellprints', together with on-site observations based on Soundscape Indices survey protocol...

In prior research on Hong Kong's acoustic environment, noise has been the primary focus, highlighting its diverse sources and detrimental impact physical mental health. However, there is still limited exploration of multi-sensory perspectives in Kong. Mong Kok one world's most densely populated areas, with a density 130,000 people per square kilometre. Amid bustling urban life, interactions activities residents, tourists, vendors contribute to complex soundscape. The area offers array...

Despite the importance of soundscape and smellscape in intangible cultural heritage, little is known about multisensory interactions. To explore impact multiple senses on environmental perception, present study focused six stalls at Shek Kip Mei wet market Hong Kong. In first part study, an online survey collected perceptual ratings whole, auditory, visual quality, as well free-form responses imaginations smell. Participants (N = 36) were presented with 12 audiovisual captures where audio...