A5035161500- Surgical Simulation and Training
- Augmented Reality Applications
- Anatomy and Medical Technology
- Soft Robotics and Applications
- 3D Shape Modeling and Analysis
- Hemodynamic Monitoring and Therapy
- Computer Graphics and Visualization Techniques
- Manufacturing Process and Optimization
- Gaze Tracking and Assistive Technology
- Healthcare Technology and Patient Monitoring
- Airway Management and Intubation Techniques
- Cerebrovascular and Carotid Artery Diseases
- Medical Imaging and Analysis
- Obstructive Sleep Apnea Research
- Cardiac, Anesthesia and Surgical Outcomes
- Digital Transformation in Industry
- Human-Automation Interaction and Safety
Johns Hopkins University
2023-2024
Materials Science & Engineering
2024
Purdue University West Lafayette
2020-2023
Telementoring platforms can help transfer surgical expertise remotely. However, most telementoring are not designed to assist in austere, pre-hospital settings. This paper evaluates the system for with augmented reality (STAR), a portable and self-contained platform based on an head-mounted display (ARHMD). The is austere scenarios: stabilized first-person view of operating field sent remote expert, who creates instructions that local first responder wearing ARHMD visualize as...
The introduction of image-guided surgical navigation (IGSN) has greatly benefited technically demanding procedures by providing real-time support and guidance to the surgeon during surgery. To develop effective IGSN, a careful selection information medium present this is needed. However, not trivial task due broad array available options. address problem, we have developed an open-source library that facilitates development multimodal systems in wide range relying on medical imaging data....
Previous studies in robotic-assisted surgery (RAS) have studied cognitive workload by modulating surgical task difficulty, and many of these relied on self-reported measurements. However, contributors to their effects are complex may not be sufficiently summarized changes difficulty alone. This study aims understand how multi-task requirement contributes the prediction load RAS under different difficulties. Multimodal physiological signals (EEG, eye-tracking, HRV) were collected as...
Blood suction and irrigation are among the most critical support tasks in robotic-assisted minimally invasive surgery (RMIS). Usually, suction/irrigation tools controlled by a surgical assistant to maintain clear view of field. Thus, assistant's contribution other emergency is limited. Similarly, when not available perform blood suction, leading surgeon must take over this task, which complex procedure can result an unnecessary increment cognitive load. To alleviate problem, we have...
This study developed and evaluated a mental workload-based adaptive automation (MWL-AA) that monitors surgeon cognitive load assist during cognitively demanding tasks assists surgeons in robotic-assisted surgery (RAS).
Adoption of robotic-assisted surgery has steadily increased as it improves the surgeon's dexterity and visualization. Despite these advantages, success a robotic procedure is highly dependent on availability proficient surgical assistant that can collaborate with surgeon. With introduction novel medical devices, surgeon taken over some assistant's tasks to increase their independence. This, however, also resulted in surgeons experiencing higher levels cognitive demands lead reduced...
OBJECTIVES/GOALS: Patient-specific definition of extent surgical excision is foundational to the safety offered by computer assisted interventions. Consequently, this study aims develop a pipeline for automated segmentation bone removed during cortical mastoidectomy, technically complex otologic surgery. METHODS/STUDY POPULATION: A simulator, previously developed in our lab, allows fully immersive simulation mastoidectomy using segmented temporal bones generated from CT data. Using one...
Automation in surgical robotics has the potential to improve patient safety and efficiency, but it is difficult achieve due need for robust perception algorithms. In particular, 6D pose estimation of instruments critical enable automatic execution maneuvers based on visual feedback. recent years, supervised deep learning algorithms have shown increasingly better performance at tasks; yet, their success depends availability large amounts annotated data. household industrial settings,...
The development of algorithms for automation subtasks during robotic surgery can be accelerated by the availability realistic simulation environments. In this work, we focus on one aspect realism a surgical simulator, which is positional accuracy robot. current simulators, robots have perfect or near-perfect accuracy, not representative their physical counterparts. We therefore propose pair neural networks, trained data collected from robot, to estimate both controller error and kinematic...
Interactive dynamic simulators are an accelerator for developing novel robotic control algorithms and complex systems involving humans robots. In user training synthetic data generation applications, a high-fidelity visualization of the simulation is essential. Visual fidelity dependent on quality computer graphics used to render simulated scene. Furthermore, rendering must be implemented processing unit (GPU) achieve real-time performance, requiring use application programming interface...
Large language model-based (LLM) agents are emerging as a powerful enabler of robust embodied intelligence due to their capability planning complex action sequences. Sound ability is necessary for automation in many task domains, but especially surgical automation. These rely on highly detailed natural representation the scene. Thus, leverage emergent capabilities LLM planning, developing similarly and perception algorithms derive scene environment from visual input. Previous research has...
Telesurgery is an effective way to deliver service from expert surgeons areas without immediate access specialized resources. However, many of these areas, such as rural districts or battlefields, might be subject different problems in communication, especially latency and intermittent periods communication outage. This challenge motivates the use a digital twin for surgical system, where simulation would mirror robot hardware environment real world. The surgeon then able interact with...
The introduction of image-guided surgical navigation (IGSN) has greatly benefited technically demanding procedures by providing real-time support and guidance to the surgeon during surgery. \hi{To develop effective IGSN, a careful selection information medium present this is needed. However, not trivial task due broad array available options.} To address problem, we have developed an open-source library that facilitates development multimodal systems in wide range relying on medical imaging...
Abstract Adoption of Robotic-Assisted Surgery has steadily increased as it improves the surgeon’s dexterity and visualization. Despite these advantages, success a robotic procedure is highly dependent on availability proficient surgical assistant that can collaborate with surgeon. With introduction novel medical devices, surgeon taken over some assistant’s tasks to increase their independence. This, however, also resulted in surgeons experiencing higher levels cognitive demands lead reduced...