- Green IT and Sustainability
- Mobile Crowdsensing and Crowdsourcing
- Innovative Human-Technology Interaction
- Context-Aware Activity Recognition Systems
- Tactile and Sensory Interactions
- Interactive and Immersive Displays
- Speech and dialogue systems
- Language Development and Disorders
- Educational Games and Gamification
- ECG Monitoring and Analysis
- Personal Information Management and User Behavior
- Hand Gesture Recognition Systems
- Augmented Reality Applications
- Gaze Tracking and Assistive Technology
- Child Development and Digital Technology
- Human Mobility and Location-Based Analysis
- Technology Use by Older Adults
- IoT and Edge/Fog Computing
- Image and Signal Denoising Methods
- AI in Service Interactions
- Evacuation and Crowd Dynamics
- Family and Disability Support Research
- Social Robot Interaction and HRI
- Robotic Path Planning Algorithms
- Heart Rate Variability and Autonomic Control
IBM Research - Austin
2019-2020
IBM (United States)
2020
Korea Advanced Institute of Science and Technology
2011-2018
Kootenay Association for Science & Technology
2014-2015
Gesture is a promising mobile User Interface modality that enables eyes-free interaction without stopping or impeding movement. In this paper, we present the design, implementation, and evaluation of E-Gesture, an energy-efficient gesture recognition system using hand-worn sensor device smartphone. E-gesture employs novel architecture carefully crafted by studying sporadic occurrence patterns gestures in continuous data streams analyzing energy consumption characteristics both sensors...
In this paper, we propose SocioPhone, a novel initiative to build mobile platform for face-to-face interaction monitoring. Face-to-face interaction, especially conversation, is fundamental part of everyday life. Interaction-aware applications aimed at facilitating group conversations have been proposed, but not proliferated yet. Useful contexts capture and support interactions need be explored more deeply. More important, recognizing delicate conversational with commodity devices requires...
As an emerging wearable device, a number of commercial smartwatches have been released and widely used. While many people concerns about the battery life smartwatch, there is no systematic study for main usage its life, or discharging recharging patterns real smartwatch users. Accordingly, we know little current practices use management smartwatches. To address this, conduct online survey to examine behaviors 59 users in-depth analysis on data from 17 Android Wear We investigate unique...
Language delay is a developmental problem of children who do not acquire language as expected for their chronological ages. Without timely intervention, can act lifelong risk factor. Speech-language pathologists highlight that effective parent participation in everyday parent-child conversation important to treat children's delay. For roles, however, parents need alter own lifelong-established habits, requiring extensive period conscious effort and staying alert. In this paper, we present...
This paper presents a novel customer malling behavior modeling framework for an urban shopping mall. As automated computing using smartphones, it is designed to provide comprehensive understanding of behavior. We prototype the in real-world Development consists three steps; data collection, trace extraction, and model analysis. extract traces from collection 701-hour sensor 195 in-situ customers who installed our logging application at Android Market. The practical created real traces. It...
Today's smartphone application (hereinafter 'app') markets miss a key piece of information, power consumption apps. This causes severe problem for continuous sensing apps as they consume significant without users' awareness. Users have no choice but to repeatedly install one app after another and experience their use. To break such an exhaustive cycle, we propose PowerForecaster, system that provides users with use at pre-installation time. Such advanced estimation is extremely challenging...
We envision that diverse social exercising games, or exergames, will emerge, featuring much richer interactivity with immersive game play experiences. Further, the recent advances of mobile devices and wireless networking make such engagement more pervasive - people carry portable exergame (e.g., jump ropes) interact remote users anytime, anywhere. Towards this goal, we explore potential using heterogeneous exercise as controllers for a multi-player exergame; e.g., playing boat paddling two...
We propose novel interpersonal assistants, a next-generation conversational agent which is always-on, unobtrusively serving natural human-to-human conversations. deepen the motivation and design insights with real practices in language delays parent–child conflicts. then present common platform initiative to effectively support rapid development of assistant applications, highlight on key functional element turn isolations technical microstructural dynamics.
This paper discusses an approach for transforming solitary exercises into social exergames. We frame our discussion by highlighting the relation between original and game interactions, analyzing example exergame which is successfully transformed from its exercise. present a user study of that evaluates need holistic transformation strategies
Emerging continuous sensing apps introduce new major factors governing phones' overall battery consumption behaviors: (1) added nontrivial persistent drain, and more importantly (2) different drain rate depending on the user's mobility condition. In this paper, we address impacting significant enough to outdate users' existing model in real life. We explore an initial approach help users understand cause effect between their physical activity To end, present Sandra, a novel mobility-aware...
Driven to create intuitive computing interfaces throughout our everyday space, various state-of-the-art technologies have been proposed for near-surface localization of a user's finger input such as hover or touch. However, these works require specialized hardware not commonly available, limiting the adoption technologies. We present SymmetriSense, technology enabling 3-dimensional fingertip above arbitrary glossy surfaces using single commodity camera device smartphone. SymmetriSense...
In this paper, we propose Sinabro, an opportunistic and unobtrusive mobile electrocardiogram (ECG) monitoring system that monitors the user's ECG opportunistically during daily smartphone use. Daily will open up unprecedented opportunity for pervasive healthcare applications. It enable detection prevention of heart problems also allow inferences about stress, emotion, even sleep quality. Despite its huge potential, still has not become reality due to obtrusiveness. first study potential...
No abstract available.
While having a child is real blessing, raising the may require parents to continuously resolve day-to-day conflicts with their child. In this paper, we examine possibility of mobile service help deal moment conflict in peaceful way. Through consultation five psychotherapists, understand presence and severity parent-child daily lives today's therapeutic practices. Based on understanding, propose concept I See You that enables instantly put themselves second-person's view, i.e., child's at...
A parent's capacity to understand the mental states of both him/herself and child is considered play a significant role in various aspects parent-child relationship-e.g., lowering parental stress supporting cognitive development child. We propose Dyadic Mirror, wearable smart mirror which designed foster aforementioned everyday interaction. Its key feature provide parent with second-person live-view from child, i.e., own face as seen by during their face-to-face Mirror serves straightforward...
We demonstrate E-Gesture, a collaborative architecture for energy-efficient gesture recognition on hand-worn sensor device and an off-the-shelf smartphone that greatly reduces energy consumption while achieving high accuracy under dynamic mobile situations. E-gesture employs novel segmentation classification carefully crafted by studying sporadic occurrence patterns of gestures in continuous data streams analyzing characteristics both smartphone.
Imagine a densely packed crowd that gathers to convey common message, such as people in candlelight vigil or protest. We envision an innovation through mobile computing technologies empower by enabling them simply hold their phones up and create massive collective visualization on top of them. propose Card-stunt Service (CaaS). CaaS is service instantly visualize symbols using devices server-side service. The key challenge toward realizing instant how achieve instant, infrastructure-free,...
Lifelogging services are emerging as promising mobile applications, pursuing to build a user's autobiographical memories. To date, initial attempts of lifelogging have been proposed, capturing what I see, hear, meet, and visit. These empirical environmental contexts, surrounding may help user reminisce about the past. On other hand, we focus on an important key feature which has unexplored so far, i.e., appearance context. The context is one's facial expression, body image, gaze, posture,...
Heart rate variability (HRV) is known to be one of the representative ECG-derived features that are useful for diverse pervasive healthcare applications. The advancement in daily physiological monitoring technology enabling HRV people's everyday lives. In this study, we evaluate feasibility measuring such as HRV, only using smartphone-integrated ECG sensors system named Sinabro. We conducted evaluation with 13 subjects five predetermined smartphone use cases. result shows potential...
In this paper, we propose Healthopia, a full-fledged health monitoring platform. With the prevalence of smartphones and wearable sensors, sensor-enabled mobile well-being applications emerge, for instance, calorie monitor [13], fall detector [11], pollution detector, heartbeat [1][4]. Despite importance usefulness such applications, it is significantly challenging to develop applications; developers should concern about many complicated issues, as accurate data analysis inferring,...
Excerpted from "PowerForecaster: Predicting Smartphone Power Impact of Continuous Sensing Applications at Pre-Installation Time" Proceedings the 13th ACM Conference on Embedded Networked Sensor Systems with permission. http://dx.doi.org/10.1145/2809695.2809728 © 2015.
Excerpted from "Card-stunt as a Service: Empowering Massively Packed Crowd for Instant Collective Expressiveness" MobiSys 2017, Proceedings of the 15th Annual ACM International Conference on Mobile Systems, Applications, and Services, with permission. https://dl.acm.org/ citation.cfm?id=3081357 © 2017. Imagine densely packed crowd common voice, such people in candlelight vigil or protest. We envision an innovation through mobile computing technologies to empower crowds. present Card-stunt...
Today's smartphone application (hereinafter `app') markets do not provide information on power consumption of apps, which is essential for users. Continuous sensing apps make this problem more severe because significant consumed without the users' awareness. We propose PowerForecaster to break through such an exhaustive cycle. It provides users with personalized estimation apps' cost at pre-installation time. challenging in advance actual a app varies depending user behavior as physical...