- Virtual Reality Applications and Impacts
- Interactive and Immersive Displays
- Augmented Reality Applications
- Tactile and Sensory Interactions
- Teleoperation and Haptic Systems
- Color perception and design
- Multisensory perception and integration
- Architecture and Computational Design
University of Auckland
2021-2024
Augmented Reality (AR) and Virtual (VR) techniques are widely used for people to experience interact with 3D digital content. However, the user has choose either AR or VR separately different devices interaction modalities. This work presents ARinVR, a novel concept that seamlessly synchronously integrates handheld mobile head-worn allow users see an augmented scenario on phone screen in space at same time. We developed prototype system enabled operate smartphone observe scenarios...
Mainstream Virtual Reality (VR) devices on the market nowadays mostly use symmetric interaction design for input, yet common practice by artists suggests asymmetric using different input tools in each hand could be a better alternative 3D modeling tasks VR. In this paper, we explore performance and usability of tool-based method object selection task VR compare it with interface. The interface uses two identical handheld controllers to select points sphere, while controller stylus. We...
Virtual Reality (VR) can be used for design and artistic applications. However, traditional symmetrical input devices are not specifically designed as creative tools may fully meet artist needs. In this demonstration, we present a variety of tool-based asymmetric VR interfaces to assist artists create artwork with better performance easier effort. These interaction methods allow hold different in their hands, such wearing data glove on the left hand holding stylus right-hand. We demonstrate...
This research investigates fast and precise Virtual Reality (VR) sketching methods with different tool-based asymmetric interfaces. In traditional real-world drawing, artists commonly employ an interaction system where each hand holds tools, facilitating diverse nuanced artistic expressions. However, in virtual reality (VR), users are typically limited to using identical tools both hands for drawing. To bridge this gap, we aim introduce specifically designed VR that replicate the varied tool...
This study explores the multi-dynamic gestural interaction system using VR headsets and wearable devices, for enhancing painting with pressure control, gesture recognition, haptic feedback. Testing demonstrated novel visual expressions through hand gestures, suggesting potential more nuanced dynamic interactions in art beyond.
In this demo, we present FusionNexus, an asymmetric collaboration experience where a virtual-world player needs to guide real-world make certain actions. A machine learning algorithm was used do the pose detection of player. We collect player's heartbeat control drum beats in background music played convey emotional status demonstration, two players will collaborate accomplish time task.