- Interactive and Immersive Displays
- Tactile and Sensory Interactions
- Augmented Reality Applications
- Usability and User Interface Design
- Gaze Tracking and Assistive Technology
- Data Visualization and Analytics
- Virtual Reality Applications and Impacts
- Video Analysis and Summarization
- Human Motion and Animation
- Computer Graphics and Visualization Techniques
- ICT in Developing Communities
- Innovative Human-Technology Interaction
- Hand Gesture Recognition Systems
- Advanced Optical Imaging Technologies
- Personal Information Management and User Behavior
- Multimedia Communication and Technology
- Teleoperation and Haptic Systems
- Advanced Vision and Imaging
- Visual perception and processing mechanisms
- Mobile Crowdsensing and Crowdsourcing
- Robotics and Sensor-Based Localization
- Child Development and Digital Technology
- Caching and Content Delivery
- Music and Audio Processing
- Music Technology and Sound Studies
University of Toronto
2014-2023
Bharathidasan University
2018
Canada Research Chairs
2015-2016
Microsoft Research (India)
2009
Microsoft (United States)
2008
Microsoft Research (United Kingdom)
2008
Mitsubishi Electric (United States)
2005
INSEAD
2004
Wavefront Research (United States)
2001
Simon Fraser University
1999
We develop design principles and an interaction framework for sharable, interactive public ambient displays that support the transition from implicit to explicit with both personal information. A prototype system implementation embodies these is described. use novel display techniques such as simple hand gestures touch screen input contextual body orientation position cues interaction. Techniques are presented subtle notification, self-revealing help, privacy controls, shared by multiple...
We present the bubble cursor - a new target acquisition technique based on area cursors. The improves upon cursors by dynamically resizing its activation depending proximity of surrounding targets, such that only one is selectable at any time. also two controlled experiments evaluate performance in 1D and 2D tasks, complex situations with multiple targets varying layout densities. Results show significantly outperforms point object pointing [7], can be accurately modeled predicted using Fitts' law.
Recent advances in sensing technology have enabled a new generation of tabletop displays that can sense multiple points input from several users simultaneously. However, apart few demonstration techniques [17], current user interfaces do not take advantage this increased bandwidth. We present variety multifinger and whole hand gestural interaction for these leverage extend the types actions people perform when interacting on real physical tabletops. Apart techniques, we also explore...
We explore the design space of freehand pointing and clicking interaction with very large high resolution displays from a distance. Three techniques for gestural two are developed evaluated. In addition, we present subtle auditory visual feedback to compensate lack kinesthetic in interaction, promote learning use appropriate postures.
We investigate the differences -- in terms of bothquantitative performance and subjective preference between direct-touch mouse input for unimanual andbimanual tasks on tabletop displays. The results twoexperiments show that bimanual performed ontabletops, users benefit from input. However,our also indicate may be moreappropriate a single user working tasksrequiring only single-point interaction.
Previous work has demonstrated the viability of applying offline analysis to interpret forearm electromyography (EMG) and classify finger gestures on a physical surface. We extend those results bring us closer using muscle-computer interfaces for always-available input in real-world applications. leverage existing taxonomies natural human grips develop gesture set covering interaction free space even when hands are busy with other objects. present system that classifies these real-time we...
We present ILoveSketch, a 3D curve sketching system that captures some of the affordances pen and paper for professional designers, allowing them to iterate directly on concept models. The coherently integrates existing techniques sketch-based interaction with number novel enhanced features. Novel contributions include automatic view rotation improve sketchability, an axis widget sketch surface selection, implicitly inferred changes between techniques. also ideas such as virtual sketchbook,...
We explore the feasibility of muscle-computer interfaces (muCIs): an interaction methodology that directly senses and decodes human muscular activity rather than relying on physical device actuation or user actions are externally visible audible. As a first step towards realizing mu-CI concept, we conducted experiment to potential exploiting sensing processing technologies for muCIs. present results demonstrating accurate gesture classification with off-the-shelf electromyography (EMG)...
ABSTRACT We theoretically and empirically examine the impact of control display (CD) gain on mouse pointing performance. Two techniques for modifying CD are considered: constant (CG) where is uniformly adjusted by a multiplier, pointer acceleration (PA) using nonuniform function depending movement characteristics. Both CG PA evaluated at various levels relationship between cursor movement: from low levels, which have near one-to-one mapping, through to high that aggressively amplify...
Current user interface widgets typically assume that the input device can only provide x-y position and binary button press information. Other inputs such as continuous pressure data provided by styluses on tablets are rarely used. We explore design space of using sensing capabilities to operate multi-state widgets. present results a controlled experiment investigates human ability perform discrete target selection tasks varying stylus' pressure, with full or partial visual feedback. The...
We explore making virtual desktops behave in a more physically realistic manner by adding physics simulation and using piling instead of filing as the fundamental organizational structure. Objects can be casually dragged tossed around, influenced physical characteristics such friction mass, much like we would manipulate lightweight objects real world. present prototype, called BumpTop, that coherently integrates variety interaction visualization techniques optimized for pen input have...
This article reports the results from three experimental studies of reaching behavior in a head-coupled stereo display system with hand-tracking subsystem for object selection. It is found that lag head-tracking relatively unimportant predicting performance, whereas critical. The effect hand can be modeled by means variation on Fitts' Law measured introduced as multiplicative variable to index difficulty. small lags cause considerable degradation performance if targets are small. Another...
There exist several user interface widgets that dynamically grow in size response to the user's focus of attention. Some these, such as icons toolbars, expand facilitate their selection - allowing for a reduced initial an attempt optimize screen space use. However, performance may be degraded by this decreased widget size. We describe experiment which explores effects varying parameters expansion techniques task. Our results suggest Fitts' law can model and predict tasks. They also indicate...
Volumetric displays, which display imagery in true 3D space, are a promising platform for the and manipulation of data. To fully leverage their capabilities, appropriate user interfaces interaction techniques must be designed. In this paper, we explore selection volumetric displays. first experiment, find ray cursor to superior point single target environment. address difficulties associated with dense environments design four new provide disambiguation mechanisms multiple intersected...
TiltText, a new technique for entering text into mobile phone is described. The standard 12-button entry keypad of forces ambiguity when the 26- letter Roman alphabet mapped in traditional manner onto keys 2-9. TiltText uses orientation to resolve this ambiguity, by tilting one four directions choose which character on particular key enter. We first discuss implementation strategies, and then present results controlled experiment comparing MultiTap, most common technique. included 10...
We present the design and evaluation of earPod: an eyes-free menu technique using touch input reactive auditory feedback. Studies comparing earPod with iPod-like visual on reasonably-sized static menus indicate that they are comparable in accuracy. In terms efficiency (speed), is initially slower, but outperforms within 30 minutes practice. Our results potentially a reasonable for general use, particularly exciting use mobile device interfaces.
Recent research on handheld projector interaction has expanded the display and space of devices by projecting information onto physical environment around user, but mainly focused single-user scenarios. We extend this prior to co-located multi-user using multiple projectors. present a set techniques for supporting collaboration with projectors, discuss application scenarios enabled them.
Many traditional techniques for "looking inside" volumetric data involve removing portions of the data, example using various cutting tools, to reveal interior. This allows user see hidden parts but has disadvantage potentially important surrounding contextual information. We explore an alternate strategy browsing that uses deformations, where can cut into and open up, spread apart, or peel away volume in real time, making interior visible while still retaining context. consider deformation...
Freehand gestural interaction with direct-touch computation surfaces has been the focus of significant research activity. While many interesting techniques have proposed, their design mostly ad-hoc and not presented within a constructive framework. In this paper, we develop articulate set principles for constructing - in systematic extensible manner multi-hand gestures on touch that can sense multiple points shapes, also accommodate conventional point-based input. To illustrate generality...
Recently, there has been renewed interest in techniques for facilitating the selection of user interface widgets or other on-screen targets with a pointing device. We report research into using target expansion selection. Widgets that expand grow response to user's focus attention allow reduced initial size which can help optimize screen space use and may be easier select than do not expand. However, performance could plausibly suffer from decreased widget size. describe an experiment users...
Sphere is a multi-user, multi-touch-sensitive spherical display in which an infrared camera used for touch sensing shares the same optical path with projector display. This novel configuration permits: (1) enclosure of both projection and mechanism base device, (2) easy 360-degree access multiple users, high degree interactivity without shadowing or occlusion. In addition to hardware software solution, we present set multi-touch interaction techniques interface concepts that facilitate...
We present a method for browsing videos by directly dragging their content. This brings the benefits of direct manipulation to an activity typically mediated widgets. support this new type interactivity by: 1) automatically extracting motion data from videos; and 2) technique called relative flow that lets users control video playback moving objects interest along visual trajectory. show can outperform traditional seeker bar in tasks focus on content rather than time.
Global crowdsourcing platforms could offer new employment opportunities to low-income workers in developing countries. However, the impact date has been limited because poor communities usually lack access computers and Internet.