- Robot Manipulation and Learning
- Social Robot Interaction and HRI
- Human-Automation Interaction and Safety
- AI-based Problem Solving and Planning
- Reinforcement Learning in Robotics
- Robotic Path Planning Algorithms
- Robotics and Automated Systems
- Teleoperation and Haptic Systems
- Explainable Artificial Intelligence (XAI)
- AI in Service Interactions
- Ethics and Social Impacts of AI
- Anomaly Detection Techniques and Applications
- Gaze Tracking and Assistive Technology
- Multi-Agent Systems and Negotiation
- Context-Aware Activity Recognition Systems
- Face Recognition and Perception
- Software Engineering Research
- Psychology of Moral and Emotional Judgment
- Data Stream Mining Techniques
- Adversarial Robustness in Machine Learning
- Assembly Line Balancing Optimization
- Scheduling and Optimization Algorithms
- Death Anxiety and Social Exclusion
- Balance, Gait, and Falls Prevention
- Fault Detection and Control Systems
University of Colorado Boulder
2017-2024
University of Colorado System
2020-2024
Christchurch Hospital
2022-2023
Canterbury District Health Board
2022-2023
Yale University
2013-2020
Massachusetts Institute of Technology
2016-2018
Shared expectations and mutual understanding are critical facets of teamwork. Achieving these in human-robot collaborative contexts can be especially challenging, as humans robots unlikely to share a common language convey intentions, plans, or justifications. Even cases where human co-workers inspect robot's control code, particularly when statistical methods used encode policies, there is no guarantee that meaningful insights into behavior derived will able efficiently isolate the...
Collaboration between humans and robots requires solutions to an array of challenging problems, including multi-agent planning, state estimation, goal inference. There already exist feasible for many these challenges, but they depend upon having rich task models. In this work we detail a novel type Hierarchical Task Network call Clique/Chain HTN (CC-HTN), alongside algorithm autonomously constructing them from topological properties derived graphical representations. As the presented method...
We conducted a study to investigate trust in and dependence upon robotic decision support among nurses doctors on labor delivery floor. There is evidence that suggestions provided by embodied agents engender inappropriate degrees of reliance humans. This concern represents critical barrier must be addressed before fielding intelligent hospital service robots take initiative coordinate patient care. our experiment with physicians, evaluated the subjects’ levels high- low-quality...
For robots to effectively collaborate with humans, it is critical establish a shared mental model amongst teammates. In the case of incongruous models, catastrophic failures may occur unless mitigating steps are taken. To identify and remedy these potential issues, we propose novel mechanism for enabling an autonomous system detect disparity between itself human collaborator, infer source disagreement within model, evaluate consequences this error, finally, provide human-interpretable...
Nonverbal behaviors increase task efficiency and improve collaboration between people robots. In this paper, we introduce a model for generating nonverbal behavior investigate whether the usefulness of changes based on difficulty. First, detail robot that accounts top-down bottom-up features scene when deciding how to perform deictic references (looking or pointing). Then, analyze robot's affects people's performance memorization under differing difficulty levels. We manipulate in two ways:...
Effective robot collaborators that work with humans require an understanding of the underlying constraint network any joint task to be performed. Discovering this allows agent more effectively plan around co-worker actions or unexpected changes in its environment. To maximize practicality collaborative robots real-world scenarios, should not assumed have abundance either time, patience, prior insight into structure a when relied upon provide training required impart proficiency and...
Gathering the most informative data from humans without overloading them remains an active research area in AI, and is closely coupled with problems of determining how when information should be communicated to others [12]. Current decision support systems (DSS) are still overly simple static, cannot adapt changing environments we expect deploy modern [3], [4], [9], [11]. They intrinsically limited their ability explain rationale versus merely listing future behaviors, limiting a human's...
In this paper, we present Rapid Activity Prediction Through Object-oriented Regression (RAPTOR), a scalable method for performing rapid, real-time activity recognition and prediction that achieves state-of-the-art classification accuracy on both generic human dataset two domain-specific collaborative robotics manufacturing datasets. Our approach is designed to be human-interpretable: able provide explanations its reasoning such non-experts can better understand improve models. We incorporate...
In this work, we present an algorithm for improving collaborator performance on sequential manipulation tasks. Our agent-decoupled, optimization-based, task and motion planning approach merges considerations derived from both symbolic geometric domains. This results in the generation of supportive behaviors enabling a teammate to reduce cognitive kinematic burdens during completion. We describe our alongside representative use cases, with evaluation based solving complex circuit building...
Nonverbal behaviors increase task efficiency and improve collaboration between people robots. In this paper, we introduce a model for generating nonverbal behavior investigate whether the usefulness of changes based on difficulty. First, detail robot that accounts top-down bottom-up features scene when deciding how to perform deictic references (looking or pointing). Then, analyze robot's affects people's performance memorization under differing difficulty levels. We manipulate in two ways:...
Understanding human intentions is critical for safe and effective human-robot collaboration. While state of the art methods goal prediction utilize learned models to account uncertainty motion data, that data inherently stochastic high variance, hindering those models' utility interactions requiring coordination, including safety-critical or close-proximity tasks. Our key insight robot teammates can deliberately configure shared workspaces prior interaction in order reduce variance motion,...
Studies in HRI have shown that people follow and understand robot gaze. However, only a few studies to date examined the time-course of meaningful gaze, none directly investigated what type gaze is best for eliciting perception attention. This paper investigates two types behaviors-short, frequent glances long, less stares - find which behavior better at conveying robot's visual We describe development programmable research platform from MyKeepon toys, use these robots examine effects group...
Learning from Demonstration (LfD) enables novice users to teach robots new skills. However, many LfD methods do not facilitate skill maintenance and adaptation. Changes in task requirements or the environment often reveal lack of resiliency adaptability model. To overcome these limitations, we introduce ARC-LfD: an Augmented Reality (AR) interface for constrained that allows maintain, update, adapt learned This is accomplished through in-situ visualizations skills constraint-based editing...
Robots that engage in social behaviors benefit greatly from possessing tools allow them to manipulate the course of an interaction. Using a non-anthropomorphic robot and simple counting game, we examine effects empathy-generating dialogue has on participant performance across three conditions. In self-directed condition, petitions reduce his or her so can avoid punishment. externally-directed behalf its programmer The control condition does not involve any for empathy. We find show higher...
Learning from demonstration (LfD) has enabled robots to rapidly gain new skills and capabilities by leveraging examples provided novice human operators. While effective, this training mechanism presents the potential for sub-optimal demonstrations negatively impact performance due unintentional operator error. In work we introduce Concept Constrained Demonstration (CC-LfD), a novel algorithm robust skill learning repair that incorporates annotations of conceptually-grounded constraints (in...
Augmenting a robot with the capacity to understand activities of people it collaborates in order then label and segment those allows generate an efficient safe plan for performing its own actions. In this work, we introduce online activity segmentation algorithm that can detect segments by processing partial trajectory. We model transitions through as hidden Markov model, which runs implementing particle-filtering approach infer maximum posteriori estimate sequence. This process is...
Justification is an important facet of policy explanation, a process for describing the behavior autonomous system.In human-robot collaboration, agent can attempt to justify distinctly decisions by offering explanations as why those are right or reasonable, leveraging snapshot its internal reasoning do so.Without sufficient insight into robot's decision-making process, it becomes challenging users trust comply with decisions, especially when they viewed confusing contrary user's expectations...
Studies in HRI have shown that people follow and understand robot gaze. However, only a few studies to date examined the time-course of meaningful gaze, none directly investigated what type gaze is best for eliciting perception attention. This paper investigates two types behaviors---short, frequent glances long, less stares---to find which behavior better at conveying robot's visual We describe development programmable research platform from MyKeepon toys, use these robots examine effects...
No abstract available.
Goal-based navigation in public places is critical for independent mobility and breaking barriers that exist blind or visually impaired (BVI) people a sight-centric society. Through this work we present proof-of-concept system autonomously leverages goal-based assistance perception to identify socially preferred seats safely guide its user towards them unknown indoor environments. The robotic includes camera, an IMU, vibrational motors, white cane, powered via backpack-mounted laptop....
Parkinson's disease (PD) is one of the most common neurodegenerative disorders central nervous system, which predominantly affects patients' motor functions, movement, and stability. Monitoring movement in patients with PD crucial for inferring state fluctuations throughout daily life activities, aids progression analysis assessing how respond to medications over time. In this preliminary study, we examine possibility using smart glasses equipped Inertial Measurement Unit (IMU) sensors...
Task assignment and scheduling algorithms are powerful tools for autonomously coordinating large teams of robotic or AI agents. However, the decisions these system make often rely on components designed by domain experts, which can be difficult non-technical end-users to understand modify their own ends. In this paper we propose a preliminary design flexible natural language interface task system. The goal our approach is both grant users more control over system's decision process, as well...
There is potential for humans and autonomous robots to perform tasks collaboratively as teammates, achieving greater performance than either could on their own. Productive teamwork, however, requires a great deal of coordination, with human robot agents maintaining well-aligned mental models regarding the shared task each agent's role within it. Achieving this live effective communication, especially plans change due shifts in environment knowledge. Our work leverages augmented reality...