This paper presents Soli , a new, robust, high-resolution, low-power, miniature gesture sensing technology for human-computer interaction based on millimeter-wave radar. We describe new approach to developing radar-based sensor optimized interaction, building the architecture from ground up with inclusion of radar design principles, high temporal resolution tracking, hardware abstraction layer (HAL), solid-state chip and system architecture, models vocabularies, recognition. demonstrate that...

The Go-Go immersive interaction technique uses the metaphor of interactively growing user’s arm and non-linear mapping for reaching manipulating distant objects. Unlike others, our allows seamless direct manipulation both nearby objects those at a distance.

We present a new technology for enhancing touch interfaces with tactile feedback. The proposed is based on the electrovibration principle, does not use any moving parts and provides wide range of feedback sensations to fingers across surface. When combined an interactive display input, it enables design variety that allow user feel virtual elements through touch. principles operation implementation technology. also report results three controlled psychophysical experiments subjective...

The MagicBook project is an early attempt to explore how we can use a physical object smoothly transport users between reality and virtuality. Young children often fantasize about flying into the pages of fairy tale becoming part story. makes this fantasy using normal book as main interface object. People turn book, look at pictures, read text without any additional technology. However, if person looks through augmented display, they see 3D virtual models appearing out pages. appear attached...

We address the problems of virtual object interaction and user tracking in a table-top augmented reality (AR) interface. In this setting there is need for very accurate registration techniques an intuitive useful This especially true AR interfaces supporting face to collaboration where users be able easily cooperate with each other. describe vision-based method environments tangible interface (TUI) based on that allow manipulate objects natural manner. Our approach robust, allowing cover...

This paper proposes a novel machine learning architecture, specifically designed for radio-frequency based gesture recognition. We focus on high-frequency (60]GHz), short-range radar sensing, in particular Google's Soli sensor. The signal has unique properties such as resolving motion at very fine level and allowing segmentation range velocity spaces rather than image space. enables recognition of new types inputs but poses significant difficulties the design input algorithms. proposed...

Touché proposes a novel Swept Frequency Capacitive Sensing technique that can not only detect touch event, but also recognize complex configurations of the human hands and body. Such contextual information significantly enhances interaction in broad range applications, from conventional touchscreens to unique contexts materials. For example, our explorations we add gesture sensitivity body liquids. We demonstrate rich capabilities with five example setups different application domains...

Tactile Brush is an algorithm that produces smooth, two-dimensional tactile moving strokes with varying frequency, intensity, velocity and direction of motion. The design the derived from results psychophysical investigations two illusions -- apparent mo-tion phantom sensations. Combined together they allow for high-density displays using sparse vibrotactile arrays. In a series experiments evaluations we demonstrate robust can reliably generate wide variety sensations broad range applications.

We present an approach to 3D printing custom optical elements for interactive devices labelled Printed Optics. Optics enable sensing, display, and illumination be directly embedded in the casing or mechanical structure of device. Using these elements, unique display surfaces, novel techniques, sensors, optoelectronic components can digitally fabricated rapid, high fidelity, highly customized devices. is part our long term vision that are printed their entirety. In this paper we explore...

Project Jacquard presents manufacturing technologies that enable deploying invisible ubiquitous interactivity at scale. We propose novel interactive textile materials can be manufactured inexpensively using existing weaving technology and equipment.

AIREAL is a novel haptic technology that delivers effective and expressive tactile sensations in free air, without requiring the user to wear physical device. Combined with interactive computers graphics, enables users feel virtual 3D objects, experience air textures receive feedback on gestures performed space. relies vortex generation directed by an actuated flexible nozzle provide 75 degrees field of view, within 8.5cm resolution at 1 meter. scalable, inexpensive practical can be used...

This paper explores the role dynamic textile displays play in relation to personal style: What does it mean wear computationally responsive clothing and why would one be motivated do so? We developed a novel display technology, called Ebb, created several woven crochet fabric swatches that explored clothing-specific design possibilities. engaged fashion designers non-designers imagining how Ebb integrate into their practice or style of dressing. Participants evaluated appeal utility...

This paper investigates the sense of touch as a channel for communicating with miniature handheld devices. We embedded PDA TouchEngineTM --- thin, lower-power tactile actuator that we have designed specifically to use in mobile interfaces (Figure 1). Unlike previous actuators, TouchEngine is universal display can produce wide variety feelings from simple clicks complex vibrotactile patterns. Using TouchEngine, began exploring design space interactive feedback computers. Here, investigated...

Three-dimensional user interface design is a critical component of any virtual environment (VE) application. In this paper, we present broad overview 3-D interaction and interfaces. We discuss the effect common VE hardware devices on interaction, as well techniques for generic tasks use traditional 2-D styles in environments. divide most user-interaction into three categories: navigation, selection/manipulation, system control. Throughout our focus presenting not only available but also...

The acceptance of virtual environment (VE) technology requires scrupulous optimization the most basic interactions in order to maximize user performance and provide efficient enjoyable interfaces. Motivated by insufficient understanding human factors design implications interaction techniques tools for interfaces, this paper presents results a formal study that compared two metaphors egocentric direct manipulation VEs, hand pointer, object selection positioning experiments. goals were...

We present the design, implementation, and informal evaluation of tactile interfaces for small touch screens used in mobile devices. embedded a apparatus Sony PDA screen enhanced its basic GUI elements with feedback. Instead observing response interface controls, users can feel it their fingers as they press screen. In evaluations, feedback was greeted enthusiasm. believe that will become next step design standard feature future

Gummi is an interaction technique and device concept based on physical deformation of a handheld device. The consists several layers flexible electronic components, including sensors measuring the Users interact with this by combination bending 2D position control. explores techniques screen interfaces for such Its graphical user interface facilitates wide range tasks, focused browsing visual information. We implemented both hardware software prototypes to explore evaluate proposed...

In the last decade, vision of future interfaces has shifted from virtual reality to augmented and tangible user (UI) where physical (or "bits atoms") co-exist in harmony. Recently, a growing number designers researchers have been taking next logical step: creating physical, elements are not merely dynamically coupled digital attributes information, but themselves dynamic, self-reconfigurable devices that can change their properties depending on state interfaces, user, or environment.A...

This work presents a highly integrated 57-64 GHz 4-channel receiver 2-channel transmitter chip targeting short range sensing and large bandwidth communications. The is housed in an embedded wafer level ball grid array package. package includes 6 patch antennas realized with metal redistribution layer. have combined antenna gain of ≈10 dBi while each has ≈6 dBi. features wide tuning VCO measured phase noise lower than -80 dBc/Hz at 100 kHz offset. Each the differential channels shows output...

We present a tactile-rendering algorithm for simulating 3D geometric features, such as bumps, on touch screen surfaces. This is achieved by modulating friction forces between the user's finger and screen, instead of physically moving surface. proposed that percept bump created when local gradients rendered virtual surface are mapped to lateral forces. To validate this approach, we first establish psychophysical model relates perceived force controlled voltage applied tactile feedback device....

REVEL is an augmented reality (AR) tactile technology that allows for change to the feeling of real objects by augmenting them with virtual textures using a device worn user. Unlike previous attempts enhance AR environments haptics, we neither physically actuate or use any force- tactile-feedback devices, nor require users wear gloves other apparatus on their hands. Instead, employ principle reverse electrovibration where inject weak electrical signal anywhere user body creating oscillating...

This paper explores the social meaning of clothing-based displays biosignals. How do friends make sense their own and each other's skin conductance display in context a conversation? We developed Hint, dynamic thermochromic t-shirt whose ambiguous pattern changes color when its wearer's increases, an indication sudden arousal. investigated how pairs wearing shirt conversed interpreted display. Participants shared broad range interpretations; e.g., joy embarrassment were associated with...

Gestures are a promising candidate as an input modality for ambient computing where conventional modalities such touchscreens not available. Existing works have focused on gesture recognition using image sensors. However, their cost, high battery consumption, and privacy concerns made cameras challenging always-on solution. This paper introduces efficient technique miniaturized 60 GHz radar sensor. The recognizes four directional swipes omni-swipe chip (6.5 × 5.0 mm) integrated into mobile...