Toward Spatial Temporal Consistency of Joint Visual Tactile Perception in VR Applications

• DOI: 10.48550/arxiv.2312.16391
• Publication Date: 2023-01-01
• Authors: Fuqiang Zhao; Kehan Zhang; Qian Liu; Zhuoyi Lyu
• Keywords: Tactile Perception; Texture (cosmology)

With the development of VR technology, especially emergence metaverse concept, integration visual and tactile perception has become an expected experience in human-machine interaction. Therefore, achieving spatial-temporal consistency information applications a necessary factor for realizing this experience. The state-of-the-art vibrotactile datasets generally contain temporal-level collected by randomly sliding on surface object, along with corresponding image material/texture. However, they lack position/spatial that corresponds to signal acquisition, making it difficult achieve spatiotemporal alignment visual-tactile data. we develop new data acquisition system paper which can collect signals different textures/materials spatial temporal consistency. In addition, VR-based application call "V-Touching" leveraging dataset generated system, provide pixel-to-taxel joint when over objects virtual environment distinct feedback textures/materials.