A5046622803- Surgical Simulation and Training
- Augmented Reality Applications
- Soft Robotics and Applications
- Tactile and Sensory Interactions
- Image and Video Stabilization
- Advanced Sensor and Energy Harvesting Materials
- Teleoperation and Haptic Systems
- Anatomy and Medical Technology
- Artificial Intelligence in Healthcare and Education
- Multisensory perception and integration
- Hand Gesture Recognition Systems
- Musculoskeletal pain and rehabilitation
- Airway Management and Intubation Techniques
- Hearing Impairment and Communication
- Simulation-Based Education in Healthcare
- Advanced Optical Imaging Technologies
- Obstructive Sleep Apnea Research
- Ergonomics and Musculoskeletal Disorders
- Virtual Reality Applications and Impacts
- Robot Manipulation and Learning
Max Planck Institute for Intelligent Systems
2024
Purdue University West Lafayette
2018-2020
Universidad de Los Andes
2017
Telementoring platforms can help transfer surgical expertise remotely. However, most telementoring are not designed to assist in austere, pre-hospital settings. This paper evaluates the system for with augmented reality (STAR), a portable and self-contained platform based on an head-mounted display (ARHMD). The is austere scenarios: stabilized first-person view of operating field sent remote expert, who creates instructions that local first responder wearing ARHMD visualize as...
Abstract By focusing on vibrations, current wearable haptic devices underutilize the skin's perceptual capabilities. Devices that provide richer stimuli, including contact feedback and/or variable pressure, are typically heavy and bulky due to underlying actuator technology low sensitivity of hairy skin, which covers most body. This article presents a system architecture for compact deliver salient pleasant broad‐bandwidth cues: Cutaneous Electrohydraulic (CUTE) combine custom materials...
Datasets are an essential component for training effective machine learning models. In particular, surgical robotic datasets have been key to many advances in semi-autonomous surgeries, skill assessment, and training. Simulated environments can enhance the data collection process by making it faster, simpler cheaper than real systems. addition, combining from multiple domains provide rich diverse transfer algorithms. this paper, we present DESK (DExterous Surgical SKills) dataset. It...
ABSTRACT Introduction Point-of-injury (POI) care requires immediate specialized assistance but delays and expertise lapses can lead to complications. In such scenarios, telementoring benefit health practitioners by transmitting guidance from remote specialists. However, current systems are not appropriate for POI care. This article clinically evaluates our System Telementoring with Augmented Reality (STAR), a novel system based on an augmented reality head-mounted display. The is portable,...
In the future, deployable, teleoperated surgical robots can save lives of critically injured patients in battlefield environments. These robotic systems will need to have autonomous capabilities take over during communication delays and unexpected environmental conditions critical phases procedure. Understanding predicting next actions (referred as "surgemes") is essential for surgery. Most approaches surgeme recognition cannot cope with high variability associated austere environments...
Teleoperated surgical robots can provide immediate medical assistance in austere and hostile environments. However, such scenarios are time-sensitive require high-bandwidth low-latency communication links that might be unavailable. The system presented this paper has a standard teleoperation interface, which provides surgeons with an environment they trained. In our semi-autonomous robotic framework, high-level instructions inferred from the surgeon's actions then executed semi-autonomously...
This work demonstrates the adaptation of an industrial robotic system to affordable and accessible open platform for education research through rapid prototyping techniques. The ABB YuMi collaborative robot is controlled using a virtual reality teleoperation adapted low-cost gripper extension surgical tools. design assessment three tools used in two mock procedures are showcased this paper. It was found that perpendicular scalpel tool surpassed others performance time. Scissors were more...
Augmented Reality (AR) benefits telementoring by enhancing the communication between mentee and remote mentor with authored graphical annotations that are directly integrated into mentee's view of workspace. An important problem is conveying workspace to effectively, such they can provide adequate guidance. AR headsets now incorporate a frontfacing video camera, which be used acquire However, simply providing this acquired from first-person inadequate. As moves their head, mentor's...
User's intentions may be expressed through spontaneous gesturing, which have been seen only a few times or never before. Recognizing such gestures involves one shot gesture learning. While most research has focused on the recognition of themselves, recently new approaches were proposed to deal with perception and production as part problem. The framework presented in this work focuses learning process that leads generation, rather than treating outcomes stochastic only. This is achieved by...
Augmented Reality (AR) benefits telementoring by enhancing the communication between mentee and remote mentor with authored graphical annotations that are directly integrated into mentee's view of workspace. An important problem is conveying workspace to effectively, such they can provide adequate guidance. AR headsets now incorporate a frontfacing video camera, which be used acquire However, simply providing this acquired from first-person inadequate. As moves their head, mentor's...
Datasets are an essential component for training effective machine learning models. In particular, surgical robotic datasets have been key to many advances in semi-autonomous surgeries, skill assessment, and training. Simulated environments can enhance the data collection process by making it faster, simpler cheaper than real systems. addition, combining from multiple domains provide rich diverse transfer algorithms. this paper, we present DESK (Dexterous Surgical Skill) dataset. It...
This poster presents the design, implementation, and evaluation of a method for robust high-level stabilization mentees first-person video in augmented reality (AR) telementoring. is captured by front-facing built-in camera an AR headset stabilized rendering from stationary view planar proxy workspace projectively texture mapped with feed. The result stable, complete, up to date, continuous, distortion free, rendered mentee's default viewpoint. was evaluated two user studies, context number...