- Usability and User Interface Design
- AI-based Problem Solving and Planning
- Interactive and Immersive Displays
- Tactile and Sensory Interactions
- Speech and dialogue systems
- Data Visualization and Analytics
- Semantic Web and Ontologies
- Human-Automation Interaction and Safety
- Robot Manipulation and Learning
- Multi-Agent Systems and Negotiation
- Bayesian Modeling and Causal Inference
- Advanced Database Systems and Queries
- Data Management and Algorithms
- Software Engineering Research
- Augmented Reality Applications
- Personal Information Management and User Behavior
- Logic, Reasoning, and Knowledge
- Cognitive Science and Mapping
- Social Robot Interaction and HRI
- Data Mining Algorithms and Applications
- Model-Driven Software Engineering Techniques
- Teleoperation and Haptic Systems
- Explainable Artificial Intelligence (XAI)
- Gaze Tracking and Assistive Technology
- Time Series Analysis and Forecasting
DEVCOM Army Research Laboratory
2018-2023
United States Army Combat Capabilities Development Command
2022
North Carolina State University
2009-2020
University of Southern California
2005
University of Massachusetts Amherst
1993-2002
Artificial intelligence (AI) and machine learning (ML) have come a long way from the earlier days of conceptual theories, to being an integral part today's technological society. Rapid growth AI/ML their penetration within plethora civilian military applications, while successful, has also opened new challenges obstacles. With almost no human involvement required for some decision-making systems, there is now pressing need gain better insights into how these decisions are made. This given...
We describe concepts to support the analysis of cell phone menu hierarchies, based on cognitive models users and easy-to-use optimization techniques. present an empirical study user performance five simple tasks traversal example phone. Two applied these tasks, GOMS ACT-R, give good predictions behavior. use empirically supported create effective evaluation improvement process for hierarchies. Our work makes three main contributions: a novel timely new, very common HCI task; new versions...
With robotics rapidly advancing, more effective human–robot interaction is increasingly needed to realize the full potential of robots for society. While spoken language must be part solution, our ability provide capabilities still very limited. In this article, based on report an interdisciplinary workshop convened by National Science Foundation, we identify key scientific and engineering advances enable with robotics. We make 25 recommendations, involving eight general themes: putting...
Cell phone interfaces are now ubiquitous. In this paper, we describe concepts to support the analysis of cell menu hierarchies. We present an empirical study user performance on five simple tasks traversal a phone. Two models tested, based GOMS and ACT-R, give very good predictions behavior. use results motivate effective evaluation process for Our work makes several contributions: novel timely new, common HCI task; new accurately predicting performance; development tools such modeling;...
In this paper we describe a specialized keyboard for text entry that maps four rows of standard onto the home row, with different characters encoded via modifier keys and multi-tap input. Use also relies on lexicon-based disambiguation. This design has two motivations: limiting physical space requirements capitalizing user knowledge QWERTY layout. The resulting stick is between 15% 25% size keyboard. preliminary empirical study, users reached half their normal typing speed using...
Abstract This article shows how the concept of affordance in user interface fits into a well-understood artificial intelligence (AI) model acting an environment. In this AI planning research is used to interpret affordances terms costs associated with generation and execution operators plan. motivates approach brief survey literature its connections then explores implications through examples common mechanisms described terms. Despite simplicity, modeling ties together several different...
The VisMap system provides for visual manipulation of arbitrary off-the-shelf applications, through an applications graphical user interface. VisMaps API-independent control has advantages tasks that can benefit from direct access to the functions We describe design goals and architecture system, we discuss two a user-controlled scripting program autonomous solitaire-playing program, which together demonstrate some capabilities limitations approach.
This paper describes the integration of perceptual guidelines from human vision with an AI-based mixed-initiative search strategy. The result is a visualization assistant called ViA, system that collaborates its users to identify perceptually salient visualizations for large, multidimensional datasets. ViA applies knowledge low-level to: (1) evaluate effectiveness particular given dataset and analysis tasks; (2) rapidly direct towards new are most likely offer improvements over those seen...
Models of users are a way to understand and improve the usability computer interfaces.We present here model in ACT-R cognitive-modeling language that interacts with publicly available driving simulation as simple analog for robot interfaces.The unmodified Java interface by incorporating novel use bitmap parsing.The model's structure starts describe knowledge human operator must have.The also indicates some aspects task will be difficult operator.For example, performance makes quantitative...
This article describes progress in providing user models with sufficient visual information and motor control to perform teleoperation an unmodified, physically realized robot. User that are built by extending cognitive interact directly interfaces can provide a theoretical basis for predicting behavior. These help summarizing explaining usability issues domains which conventional testing is too time consuming, demanding of other resources, or dynamic static models. The model consists ACT-R...
The longer a fault remains in the code from time it was injected, more will take to fix fault. Increasingly, automated detection (AFD) tools are providing developers with prompt feedback on recently-introduced faults reduce time. If however, frequency and content of this does not match developer's goals and/or workflow, developer may ignore information. We conducted controlled study 18 explore what factors used by decide whether or address when notified error. findings our lead several...
Abstract Exploratory data analysis (EDA) is as much a matter of strategy selecting specific statistical operations. We have developed knowledge-based planning system, called AIDE, to help users with EDA. AIDE strikes balance between conventional packages, which need guidance for every step in the exploration, and autonomous systems, leave user entirely out decision-making process. AIDE's processing based on artificial intelligence techniques, give us useful means representing some types...
This paper describes a tangible 3D user interface called CAPTIVE, Cube with Augmented Physical Tools, for exploration of information. The design CAPTIVE is founded on the concept tool use, in which handheld objects are used to modify properties or appearance target objects. holds physical wireframe cube that contains virtual one hand, other pointing device, its tip visually augmented reflect function as tool. On display watches immediate, direct effects actions In current prototype, routines...
article Free AccessProgramming by example: visual generalization in programming example Authors: Robert St. Amant North Carolina State Univ., Raleigh RaleighView Profile , Henry Lieberman Massachusetts Institute of Technology, Cambridge CambridgeView Richard Potter Japan Science and Technology Corp., Tokyo, JapanView Luke Zettlemoyer Authors Info & Claims Communications the ACMVolume 43Issue 301 March 2000pp 107–114https://doi.org/10.1145/330534.330549Published:01 2000Publication History...
This paper describes an automated visualized assistant called ViA. ViA is designed to help users construct perceptually optical visualizations represent, explore, and analyze large, complex, multidimensional datasets. We have approached this problem by studying what known about the control of human visual attention. By harnessing low-level system, we can support our dual goals rapid accurate visualization. Perceptual guidelines that built using psychophysical experiments form basis for uses...
The intelligent use of tools is a general and important human competence that AI research has not yet examined in depth. Other fields have studied the topic, however, with results we can compile into broad characterization habile (tool-using) agents. In this paper give an overview on physical tools, using information to motivate set requirements for building artificial We describe design robot, based Aibo platform, pick up stick it as tool reach objects otherwise out its range. argue...