- Augmented Reality Applications
- Interactive and Immersive Displays
- Virtual Reality Applications and Impacts
- Data Visualization and Analytics
- Multimedia Communication and Technology
- Tactile and Sensory Interactions
- Video Analysis and Summarization
- Computer Graphics and Visualization Techniques
- Human Motion and Animation
- Spatial Cognition and Navigation
- Semantic Web and Ontologies
- 3D Surveying and Cultural Heritage
- Teleoperation and Haptic Systems
- Electronic Health Records Systems
- Robotics and Sensor-Based Localization
- Gaze Tracking and Assistive Technology
- Usability and User Interface Design
- Healthcare Systems and Technology
- 3D Shape Modeling and Analysis
- Advanced Optical Imaging Technologies
- Visual Attention and Saliency Detection
- Advanced Vision and Imaging
- Speech and dialogue systems
- Surgical Simulation and Training
- Smart Agriculture and AI
Columbia University
2015-2024
TU Wien
2019-2020
Medical University of Vienna
2020
Johnson Space Center
2018
Interface (United States)
2005-2016
New York Hospital Queens
2013
New York Proton Center
2013
Laboratoire d'Informatique de Paris-Nord
2012
City University of Seattle
2012
Vassar College
1998
In 1997, Azuma published a survey on augmented reality (AR). Our goal is to complement, rather than replace, the original by presenting representative examples of new advances. We refer one for descriptions potential applications (such as medical visualization, maintenance and repair complex equipment, annotation, path planning); summaries AR system characteristics advantages disadvantages optical video approaches blending virtual real, problems in display focus contrast, portability); an...
article Free Access Share on Knowledge-based augmented reality Authors: Steven Feiner Columbia Univ., New York, NY NYView Profile , Blair Macintyre Dorée Seligmann AT&T Bell Labs, Holmdel, NJ NJView Authors Info & Claims Communications of the ACMVolume 36Issue 7July 1993pp 53–62https://doi.org/10.1145/159544.159587Published:01 July 1993Publication History 624citation10,490DownloadsMetricsTotal Citations624Total Downloads10,490Last 12 Months588Last 6 weeks55 Get Citation AlertsNew Alert...
We explore the development of an experimental augmented reality application that provides benefits to professional mechanics performing maintenance and repair tasks in a field setting. developed prototype supports military conducting routine inside armored vehicle turret, evaluated it with user study. Our uses tracked headworn display augment mechanic's natural view text, labels, arrows, animated sequences designed facilitate task comprehension, localization, execution. A within-subject...
We describe an experimental mobile augmented reality system (MARS) testbed that employs different user interfaces to allow outdoor and indoor users access manage information is spatially registered with the real world. Outdoor can experience spatialized multimedia presentations are presented on a head-tracked, see-through, head-worn display used in conjunction hand-held pen-based computer. Indoor get overview of scene communicate through desktop interface or head- hand-tracked immersive interface.
This paper provides a classification of perceptual issues in augmented reality, created with visual processing and interpretation pipeline mind. We organize into ones related to the environment, capturing, augmentation, display, individual user differences. also illuminate associated more recent platforms such as handhelds or projector-camera systems. Throughout, we describe current approaches addressing these problems, suggest directions for future research.
Virtual Reality (VR) sickness can cause intense discomfort, shorten the duration of a VR experience, and create an aversion to further use VR. High-quality tracking systems minimize mismatch between user's visual perception virtual environment (VE) response their vestibular system, diminishing for moving users. However, this does not help users who do or cannot move physically way they virtually, because preference physical limitations such as disability. It has been noted that decreasing...
We present the design, implementation, and user testing of a prototype augmented reality application to support military mechanics conducting routine maintenance tasks inside an armored vehicle turret. Our uses tracked head-worn display augment mechanic's natural view with text, labels, arrows, animated sequences designed facilitate task comprehension, location, execution. A within-subject controlled study examined professional using our system complete 18 common under field conditions....
Eye contact plays a crucial role in our everyday social interactions. The ability of device to reliably detect when person is looking at it can lead powerful human-object interfaces. Today, most gaze-based interactive systems rely on gaze tracking technology. Unfortunately, current techniques require active infrared illumination, calibration, or are sensitive distance and pose. In this work, we propose different solution-a passive, appearance-based approach for sensing eye an image. By...
Procedural tasks are common to many domains, ranging from maintenance and repair, medicine, the arts. We describe evaluate a prototype augmented reality (AR) user interface designed assist users in relatively under-explored psychomotor phase of procedural tasks. In this phase, begins physical manipulations, thus alters aspects underlying task environment. Our tracks multiple components typical assembly task, provides dynamic, prescriptive, overlaid instructions on see-through head-worn...
We describe a view-management component for interactive 3D user interfaces. By view management, we mean maintaining visual constraints on the projections of objects plane, such as locating related near each other, or preventing from occluding other. Our accomplishes this by modifying selected object properties, including position, size, and transparency, which are tagged to indicate their constraints. For example, some may have geometric properties that determined entirely physical...
Article Free Access Share on Windows the world: 2D windows for 3D augmented reality Authors: Steven Feiner Department of Computer Science, Columbia University, New York, NY NYView Profile , Blair MacIntyre Marcus Haupt Eliot Solomon Authors Info & Claims UIST '93: Proceedings 6th annual ACM symposium User interface software and technologyDecember 1993Pages 145–155https://doi.org/10.1145/168642.168657Published:01 December 1993Publication History 182citation2,909DownloadsMetricsTotal...
We describe a prototype system that combines together the overlaid 3D graphics of augmented reality with untethered freedom mobile computing. The goal is to explore how these two technologies might make possible wearable computer systems can support users in their everyday interactions world. introduce an application presents information about our university's campus, using head-tracked, see-through, head-worn, display, and untracked, opaque, handheld, 2D display stylus trackpad. provide...
n-Vision is a testbed for exploring n-dimensional worlds containing functions of an arbitrary number variables. Although our interaction devices and display hardware are inherently 3D, we demonstrate how they can be used to support with these higher-dimensional objects. We introduce new metaphor developed the system, which call “worlds within worlds”: nested heterogeneous coordinate systems that allow user view manipulate functions. Objects in world may explored set tools. describe example...
Article Free Access Share on Visual task characterization for automated visual discourse synthesis Authors: Michelle X. Zhou Department of Computer Science, Columbia University, 500 West 120th St., 450 CS Building, New York, NY NYView Profile , Steven K. Feiner Authors Info & Claims CHI '98: Proceedings the SIGCHI Conference Human Factors in Computing SystemsJanuary 1998 Pages 392–399https://doi.org/10.1145/274644.274698Online:01 January 1998Publication History...
Augmented reality is a potentially powerful paradigm for annotating the (real) environment with computer-generated material. These benefits will be even greater when augmented systems become mobile and wearable. However, to minimize problem of clutter maximize effectiveness display, algorithms must developed select only most important information user. In this paper, we describe region-based filtering algorithm. The algorithm takes account state user (location intent) individual objects...
In many complex tasks, a remote subject-matter expert may need to assist local user guide actions on objects in the user's environment. However, effective spatial referencing and action demonstration physical environment can be challenging. We introduce two approaches that use Virtual Reality (VR) or Augmented (AR) for expert, AR user, each wearing stereo head-worn display. Both allow create manipulate virtual replicas of refer parts those indicate them. This especially useful are occluded...
Urban designers and urban planners often conduct site visits prior to a design activity search for patterns or better understand existing conditions. We introduce SiteLens, an experimental system set of techniques supporting by visualizing relevant virtual data directly in the context physical site, which we call situated visualization. address alternative visualization representations collection, curation, discovery, comparison, manipulation, provenance. A real use scenario is presented two...
We describe an approach to 3D multimodal interaction in immersive augmented and virtual reality environments that accounts for the uncertain nature of information sources. The resulting system fuses symbolic statistical from a set gesture, spoken language, referential agents. agents employ visible or invisible volumes can be attached trackers environment, which use time-stamped history objects intersect them derive statistics ranking potential referents. discuss means by supports mutual...