For complex cases, preoperative surgical planning is a standard procedure to ensure patient safety and keep the surgery time minimum. Based on available information, such as MRI or CT images, prior anatomical knowledge surgeons create their own mental 3D model of organ interest. This challenging, requires years training an inherent uncertainty remains even for experienced surgeons.Virtual reality (VR) by nature excellent in showing spatial relationships through its stereoscopic displays....

Providing haptic feedback in virtual reality to make the experience more realistic has become a strong focus of research recent years. The resulting systems differ greatly their technologies, possibilities, and overall realism making it challenging compare different systems. We propose Haptic Fidelity Framework providing means describe, understand framework locates system spectrum or abstract using dimension. It comprises 14 criteria that either describe foundational limiting factors. A...

During the Covid-19 pandemic, online meetings became common for daily teamwork in home office. To understand opportunities and challenges of meeting virtual reality (VR) compared to video conferences, we conducted weekly team our human-computer interaction research lab on five off-the-shelf platforms over four months. After each 12 meetings, asked participants (N = 32) share their experiences, resulting 200 completed questionnaires. We evaluated ratings overall experience an exploratory...

Professionals in domains like film, theater, or architecture often rely on physical models to visualize spaces. With virtual reality (VR) new tools are available providing immersive experiences with correct perceptions of depth and scale. However, these lack the tangibility models. Using tangible objects VR can close this gap but creates challenges producing suitable interacting them only visible. This work addresses by evaluating tangibles three haptic fidelities: equal disc-shaped for all...

Computer-assisted surgery has pervaded the operating room (OR). While display and imaging technologies advance rapidly, keyboard mouse are still dominant input devices, even though they cause sterility problems. We present an interactive virtual (IVOR), intended as a tool to develop study interaction methods for OR, two novel touch-free techniques using hand foot gestures. All was developed evaluated with 20 surgeons. The results show that our can be used minimal learning time no significant...

Background Digital public health (DiPH) interventions may help us tackle substantial challenges and reach historically underserved populations, in addition to presenting valuable opportunities improve complement existing services. However, DiPH are often triggered through technological advancements rather than needs. To develop evaluate designed serve needs, a comprehensive framework is needed that systematically covers all aspects with relevance for health. This includes considering the...

Neurofeedback training can reduce symptoms related to epileptic seizures, attention deficits, and Asperger's Syndrome, often uses games motivate participation over the long term needed see improvements. Most neurofeedback use negative reinforcement guide players -- i.e., a barrier progressing in game is removed when achieve desirable state which considered be less effective than reinforcing behaviour through positive feedback do well. We investigate whether using more successful design...

Immersive technologies such as virtual reality (VR) and augmented (AR), in combination with advanced image segmentation visualization, have considerable potential to improve support a surgeon's work. We demonstrate solution help surgeons plan perform surgeries educate future medical staff using VR, AR, tangibles. A VR planning tool improves spatial understanding of an individual's anatomy, tangible organ model allows for intuitive interaction, AR gives contactless access images the operating...

Connecting digital information with the physical is one of essential ideas tangible user interfaces. The design representation important especially for specialised domains like surgery planning, because surgeons rely heavily on their tactile senses. Therefore, this research work investigates effect a soft and hard 3D model as an interaction device virtual reality surgical planning. A study 13 reveals clear preference softer, more realistic material significantly higher haptic experience...

Supporting remote collaboration through augmented reality facilitates the experience of co-presence by presenting collaborator’s avatar in user’s physical environment. While visual user representations are continuously researched and advanced, audio configuration – especially combination with different visualizations is rarely considered. In a study (n = 48, 24 dyads), we evaluate two (Simple vs. Rich Avatar) auditory (Mono Spatial Audio) representations, to investigate their impact on...

During interventions, surgeons often need to review medical imaging data, e.g., CT scans. Usually, rely on an assistant browse the images because of sterility requirements. Communication with a substitute operator is tedious and error-prone if does not have equal level professional experience might interrupt workflow. We present sensor-integrated shoe allowing manipulate 2D image data by foot movement. It portable wearable. The uses optical sensor taken from off-the-shelf computer mouse for...

ABSTRACTRhythm is essential in early music education. To acquire rhythm abilities, the synchronisation between body and patterns fundamental. Extensive research has shown link auditory-motor system acquisition; however, other sensorimotor systems also improve skills. Rhythm acquisition can be trained using new technologies, such as video games; most of these use mainly auditory stimuli to it. Therefore, this work, we explore tactile skills a game how visual elements affect perception...

Virtual reality (VR) is, by nature, excellent in showing spatial relationships, e.g. for viewing medical 3D data. In this work, we propose a VR system to view and manipulate images of livers combination with printed liver models as controllers. We investigate whether users benefit from controller the shape if size matters using three different sizes (50 %, 75 100 %). user study 14 surgeons, focused on presence, workload qualitative feedback such preference. While neither differences nor VIVE...

Medical images and navigation systems support physicians during needle-based interventions. As the information is primarily displayed on monitors, physician's attention drawn away from patient's body. To address this issue, we explore additional use of a vibration wristband that directs movements for operations via different patterns operator's arm. We conducted first user study comparing combination tactile visual guidance versus visual-only feedback with 12 participants to investigate...

Medical images contain important information for diagnosis and preoperative planning in modern medicine. Interacting with these still happens mostly a mouse, abstract gestures or handles. In focus group five surgeons, we evaluate the possibilities of 3D printed organ models interaction VR use case surgery planning. The surgeons rate approach as highly useful highlighted advantage easier grasping space relations, which would greatly improve phase surgery.

Tubular continuum robots can follow complex curvilinear paths to reach restricted areas within the body. Using teleoperation, these help minimize incisions and reduce trauma. However, drawbacks include lack of haptic feedback a limited view situs, often due camera occlusion. This work presents novel auditory display enhance interaction with such increase accuracy path-following efficiency cognitive workload. We recreate typical use case test environment that simulates transnasal intervention...

Abstract Medical apps, i.e. apps that fall under the EU Device Regulation (MDR), are increasingly becoming a relevant part of healthcare in European countries. This is particularly evident numerous partnerships between app vendors and insurers as well launches national reimbursement programs. However, when it comes to enabling many patients possible benefit from medical advantages associated with use these funding only one equation. It up develop barrier-free user interfaces so people -...

Background The integration of advanced technologies such as augmented reality (AR) and virtual (VR) into surgical procedures has garnered significant attention. However, the introduction these innovations requires thorough evaluation in context human-machine interaction. Despite their potential benefits, new can complicate tasks increase cognitive load on surgeons, potentially offsetting intended advantages. It is crucial to evaluate not only for functional improvements but also impact...

<sec> <title>UNSTRUCTURED</title> Surgical lighting systems provide optimal conditions for the operating room personnel. Current are mainly adjusted by hand, where surgeons either accommodate light themselves or communicate their requirements to an assistant ensure surgical conditions. This poses challenges maintaining sterility, proper accessibility, illumination, and potential collision problems. Furthermore, personnel may not have deep medical knowledge equipment expertise. work...

Informed by modern imaging techniques, current medical navigation systems support physicians during a variety of interventions, such as needle-based operations. During these, an abundance information is often displayed on monitors placed in positions that are uncomfortable for the operator to view. In this article, we address these issues with concept and prototype customized flexible display patient’s body provide essential at just right location. We present empirical evaluation comparing...

Needle-guiding templates are used for a variety of minimally invasive medical interventions. While physically supporting needle placement with grid holes, they lack integrated information where needles need to be inserted. Physicians must manually determine the correct holes based on output planning software - workflow that is error-prone and lengthy. We address these issues by embedding display into template using electroluminescence (EL) screen printing. The EL connected illuminates hole....

Virtual (VR) and Augmented reality (AR)  represent  excellent tools for surgeons to understand spatial relationships, train their workflow improve surgery results. By providing realistic haptic feedback, implementing 3D-printed organ phantoms those tools, benefit gets even more compelling, increasing immersion. In this work investigates the realism of regarding physical hardness, touch feel. a user study with 12  surgeons, we evaluated casted liver in 50 %, scale actual size. Results from...