- Virtual Reality Applications and Impacts
- Tactile and Sensory Interactions
- Human-Automation Interaction and Safety
- Advanced Vision and Imaging
- Safety Warnings and Signage
- Speech and dialogue systems
- Image Processing Techniques and Applications
- Stroke Rehabilitation and Recovery
- Digital Transformation in Industry
- Advanced Optical Imaging Technologies
- Gaze Tracking and Assistive Technology
- Teleoperation and Haptic Systems
- Usability and User Interface Design
- Interactive and Immersive Displays
- Human Pose and Action Recognition
- IoT and Edge/Fog Computing
- Robot Manipulation and Learning
- Advanced Neural Network Applications
- Flow Experience in Various Fields
- Visual Attention and Saliency Detection
- Anomaly Detection Techniques and Applications
- Optical measurement and interference techniques
- Digital Innovation in Industries
- Spatial Cognition and Navigation
- Augmented Reality Applications
Fraunhofer Institute for Telecommunications, Heinrich Hertz Institute
1998-2023
Hand tracking enables controller-free interaction with virtual environments, which can, compared to traditional handheld controllers, make reality (VR) experiences more natural and immersive. As naturalness hinges on both technological user-based features, fine-tuning the former while assessing latter can be used increase usability. For a grab-and-place use case in immersive VR, we prototype of camera-based hand interface (Leap Motion) customized design elements standard Leap Motion...
The continued advancement in user interfaces comes to the era of virtual reality that requires a better understanding how users will interact with 3D buttons mid-air. Although owns high levels expressiveness and demonstrates ability simulate daily objects physical environment, most fundamental issue designing is surprisingly ignored. To this end, paper presents four variants buttons, considering two design dimensions key representations multi-modal cues (audio, visual, haptic). We conduct...
Hand tracking enables controller-free interaction with virtual environments, which can, compared to traditional handheld controllers, make reality (VR) experiences more natural and immersive. As naturalness hinges on both technological user-based features, fine-tuning the former while assessing latter can be used increase usability. For a grab-and-place use case in immersive VR, we prototype of camera-based hand interface (Leap Motion) customized design elements standard Leap Motion...
The development of tracked 3D displays is based on real-time technologies providing precise and robust eye location detection. paper focuses tracking approaches which have been developed within the European HELIUM3D project. A first system uses multiple common video cameras a second approach combining high resolution depth camera technology. Flexible scalable software has supporting such different hardware implementations. Beside descriptions will focus performance evaluations accomplished...
This paper describes recent advances in the field of autostereoscopic display development and introduces an appropriate integration a novel user interaction technology. Beside technical aspects developed technology, includes topics our video-based technique promising applications single displays. Based on results European ATTEST project, Fraunhofer Institute for Telecommunications (HHI) has <i>Free2C</i> 3D which provides free positioning viewer. The optics displays is designed such that...
In line with the current trend towards local, private 5G networks, on-premise edge clouds are becoming increasingly important for real-time, secure, robust and low-latency communication in production plants. While this is a proven means larger manufacturing companies to implement private/proprietary, real-time capable data processing infrastructure their facilities, small medium-sized enterprises (SMEs) cannot afford such infrastructures due high acquisition costs. Therefore, an off-premise...
Multimodal user interfaces hold the promise to enable natural and intuitive means of human-machine interaction. But is effort using many sensors rewarded by users - or a single modality sufficient? For an industrial use case weld seam inspection workstation we study three independent (augmented spatial button interaction on (1) workpiece (2) worktable through (3) speech commands) their combination (4). While preferred augmented when comparing modalities, they used all in multimodal...
We investigate an edge-computing scenario for robot control, where two similar neural networks are running on one computational node. test the feasibility of using a single object-detection model (YOLOv5) with benefit reduced resources against potentially more accurate independent and specialized models. Our results show that convolutional network (for object detection hand-gesture classification) instead separate ones can reduce resource usage by almost 50%. For many classes, we observed...
To provide a natural locomotion for virtual supermarket in cognitive rehabilitation application we compare three walk place (WIP) approaches (WIP; WIP + Bar stability support; steering and support). We use tracked knee bending with without handlebar as real correspondent to of shopping cart. For shoulder or rotation. present an evaluation the influence physical fixed reference postural aid on cybersickness user satisfaction. Our preliminary results indicate advantages via handlebar....
This paper describes a novel cooperative procedure for the segmentation of multiview image sequences exploiting multiple sources information. Compared to other approaches, no priori information is needed about structure and arrangement objects in scene. Three cameras particular unsymmetrical set-up are used system. The color distribution object contours constituent 2-D images, disparity stereo pairs, as well motion subsequent analyzed evaluated get reliable results. scene decomposed into...
Being self-represented through an avatar increases embodiment and the feeling of presence in virtual reality. Nevertheless, currently users VR are typically represented only by their hands, as not enough tracking data is available for full body self-representation. In our use case VR-based diagnostics cognitive rehabilitation stroke patients, we aim self-representation order to increase therapeutic effectivity treatment. To solve this problem, Inverse Kinematics (IK) can be used pose...
Accurate and reliable gesture recognition is a central problem in human-computer interaction (HCI). Many applications that make use of call for mobile devices with reduced power consumption, weight form factors. Recent advances computer vision were particularly brought by deep neural networks come at the cost high computational complexity hinders employment on devices. In this study, we evaluate usability low-cost Raspberry Pi 4B amended Coral USB Accelerator, or Neural Compute Stick 2,...
Multimodal user interfaces promise a natural and intuitive human machine interactions. But is the extra effort for development of complex multi-sensor system justified, or can users also be satisfied with one input modality already? This study investigates interactions in an industrial weld inspection workstation. Three unimodal interfaces, including spatial interaction buttons augmented on workpiece worktable, speech commands, were tested individually multimodal combination. Within...
Multimodal user interfaces promise natural and intuitive human–machine interactions. However, is the extra effort for development of a complex multisensor system justified, or can users also be satisfied with only one input modality? This study investigates interactions in an industrial weld inspection workstation. Three unimodal interfaces, including spatial interaction buttons augmented on workpiece worktable, speech commands, were tested individually multimodal combination. Within...
The paper introduces a new open laboratory, the F5G OpenLab, which aims at fostering advancement of fiber-based solutions for everything. OpenLab intends to aid in creating sustainable and eco-friendly ICT industry accelerate digital transformation through autonomous networking that are secure trustworthy. In particular, purpose is establish an ecosystem validation optical facilitate twin transition, provide vendor-neutral platform assessment vertical use cases, enable development solutions....
In this poster, we discuss the main challenges that need to be addressed make immersive virtual reality (VR) assessment and training tools valid usable for neuropsychological applications clinical uses. We especially argue importance of enabling natural, easy use precise interaction in order tap into full potential VR advantages. then address some identified propose solutions approaches contact-free, hand-object manipulations applications. Our experiences are based on our research...
No abstract available.