- Interactive and Immersive Displays
- Innovative Human-Technology Interaction
- Tactile and Sensory Interactions
- Virtual Reality Applications and Impacts
- Augmented Reality Applications
- Advanced Sensor and Energy Harvesting Materials
- Data Visualization and Analytics
- Creativity in Education and Neuroscience
- 3D Shape Modeling and Analysis
- AI in Service Interactions
- Usability and User Interface Design
- Human Motion and Animation
- Modular Robots and Swarm Intelligence
- Mobile Crowdsensing and Crowdsourcing
- Scientific Computing and Data Management
- Optimism, Hope, and Well-being
- Mind wandering and attention
- Grit, Self-Efficacy, and Motivation
- Technology Use by Older Adults
- Media Influence and Health
- Education, Achievement, and Giftedness
- Generative Adversarial Networks and Image Synthesis
- Heart Rate Variability and Autonomic Control
- Climate Change, Adaptation, Migration
- Reinforcement Learning in Robotics
Human Media
2021-2025
Autodesk (Canada)
2025
University of Toronto
2025
Massachusetts Institute of Technology
2019-2024
Microsoft (United States)
2024
University of Applied Sciences Upper Austria
2015-2018
University of Waterloo
2014-2015
Chinese University of Hong Kong
2003
University of Hong Kong
2003
Advancements in machine learning have recently enabled the hyper-realistic synthesis of prose, images, audio and video data, what is referred to as artificial intelligence (AI)-generated media. These techniques offer novel opportunities for creating interactions with digital portrayals individuals that can inspire intrigue us. AI-generated characters feature synthesized faces, bodies voices anyone, from a fictional character historical figure, or even deceased family member. Although...
We present RESi (Resistive tExtile Sensor Interfaces), a novel sensing approach enabling new kind of yarn-based, resistive pressure sensing. The core builds on newly designed yarn, which features conductive and properties. run technical study to characterize the behaviour yarn determine principle. demonstrate how can be used as sensor discuss specific issues, such connecting soft textile with rigid electronics solved. In addition, we platform-independent API that allows rapid prototyping. To...
Fostering students' interests in learning is considered to have many positive downstream effects. Large language models opened up new horizons for generating content tuned one's interests, yet it unclear what ways and extent this customization could effects on learning. To explore novel dimension, we conducted a between-subjects online study (n=272) featuring different variations of generative AI vocabulary app that enables users personalize their examples. Participants were randomly...
The increased interest in interactive soft materials, such as smart clothing and responsive furniture, means that there is a need for flexible deformable electronics. In this paper, we focus on stitch-based elastic sensors, which have the benefit of being manufacturable with textile craft tools been used homes centuries. We contribute to understanding stretch sensors through four experiments one user study investigate conductive yarns from technical perspectives, analyze impact different...
Today's commercially available prosthetic limbs lack tactile sensation and feedback. Recent research in this domain focuses on sensor technologies designed to be directly embedded into future prostheses. We present a novel concept prototype of prosthetic-sensing wearable that offers non-invasive, self-applicable customizable approach for the sensory augmentation present-day low mid-range priced lower-limb prosthetics. From consultation with eight amputees, we investigated design space...
We introduce HERMITS, a modular interaction architecture for self-propelled Tangible User Interfaces (TUIs) that incorporates physical add-ons, referred to as mechanical shells. The shell add-ons are intended be dynamically reconfigured by utilizing the locomotion capability of TUIs (e.g. wheeled TUIs, swarm UIs). developed proof-of-concept system demonstrates this novel using two-wheeled robots and variety examples. These passive attatchments extend primitive interactivities shape, motion...
This paper presents the results of a study with 134 participants to explore effects learning from an AI-generated virtual instructor that resembles person one likes or admires. Given important role instructors play in shaping experiences, as well recent surge demand for online education, we investigate potential motivate learning. Recent advances generative AI have made it easy create based on likeness present-day, historical fictional person, thereby enabling customization video material,...
Imagine being able to send a personalized embodied agent meetings you are unable attend. This paper explores the idea of Ditto —an that visually resembles person, sounds like them, possesses knowledge about and can represent them in meetings. reports on results from two empirical investigations: 1) focus group sessions with six groups (n=24) 2) Wizard Oz (WOz) study 10 (n=39) recruited within large technology company. Results provide insights what contexts appropriate for Dittos, issues...
Introducing interactive components into furniture has proven difficult due to the different lifespans of and digital devices. We present Foxels, a modular, smart concept that allows users create their own on demand by simply snapping together individual building blocks. The modular design makes system flexible accommodate variety setups, making it particularly well-suited for re-configurable spaces. Considering trade-off between ease-of-use high versatility, we explored number interaction...
(Dis)Appearables is an approach for actuated Tangible User Interfaces (TUIs) to appear and disappear. This technique supported by Stages: physical platforms inspired theatrical stages. Self-propelled TUI's autonomously move between front back stage allowing them dynamically disappear from users' attention. platform opens up a novel interaction design space expressive displays with dynamic affordances.
Faced with public speaking anxiety, one common piece of advice is to picture the audience in a new light, using your mind's eye. With Augmented Reality (AR) face filters, it becomes possible literally change how sees oneself or others. In this paper, we explore privately applied AR filters during online speaking. Private means that these effects are only visible speaker. To investigate possibly controversial concept, conducted an survey 100 respondents gather diverse set initial impressions,...
The arrival of new generative AI tools is creating waves. Here are some ideas for how we could channel them supporting self-development and learning.
AI generated characters, i.e., realistic renderings of human faces, voices, and mannerisms that appear authentic to a being [7] are made possible through advancements in generative machine learning. In addition character creation, neural networks have recently also been used for the hyper-realistic synthesis modification prose, images, audio, video data.
Structuring and rearranging free-hand sketches on large interactive surfaces typically requires making multiple stroke selections. This can be both time-consuming fatiguing in the absence of well-designed selection tools. Investigating concept automated clustering, we conducted a background study which highlighted fact that people have varying perspectives how elements should grouped. In response to these diverse user expectations, present cLuster, flexible, domain-independent clustering...
Constructive assemblies are tangible user interfaces (TUIs) that involve the interconnection of modular parts. As such, they offer a unique means to support us in our various and diverse activities. However, little information is available for understanding intricacies taking modular, constructive assembly approach TUI design. Based on an analysis extensive data collected from interviews with eight world-class experts, we propose descriptive, conceptual framework facilitate systematic...
Ambient light is starting to be commercially used enhance the viewing experience for watching TV. We believe that ambient can add value in meeting and control rooms use large vertical interactive surfaces. Therefore, we equipped a whiteboard with peripheral display explored its utility different scenarios by conducting two controlled experiments. In first experiment, investigated how notifications, perception influenced user's position type of work they are engaged in. The second experiment...
We present a novel non-contact photoplethysmographic (PPG) imaging system based on high-resolution video recordings of ambient reflectance human bodies that compensates for body motion and takes advantage skin erythema fluctuations to improve measurement reliability the purpose remote heart rate monitoring. A single location recording is automatically identified an individual, determined over time via tracking. Based information motion-compensated measurements at different wavelengths can be...
Virtual representations of ourselves can influence the way we feel and behave. While this phenomenon has been explored heavily in realms virtual reality gaming, little is known about level impact increasingly pervasive real-time camera filters have on how people feel, think, The prevalence popularity these technologies surged, coupled with greater usage online communication tools. Motivated by a desire for self-improvement an age regular video-based communication, conducted user study to...
In this paper, we introduce SociaBowl, a dynamic table centerpiece to promote positive social dynamics in 2-way cooperative conversations. A such as bowl of food, decorative flower arrangement, or container writing tools, is commonly placed on around which people have We explore the design space for an augmented and influence how may interact with one another. present initial functional prototype different choices materiality feedback, interaction styles, animation motion patterns. These...
We propose a novel fabrication method for 3D objects based on the principle of spooling. By wrapping off-the-shelf materials such as thread, ribbon, tape or wire onto core structure, new can be created and existing augmented with desired aesthetic functional qualities. Our system, WraPr, enables gesture-based modelling controlled thread deposition. outline explore design space this approach. Various examples are fabricated to demonstrate possibility attain range physical properties. The...
Structuring and rearranging free-hand sketches on large interactive surfaces typically requires making multiple stroke selections. Without well-designed selection tools, this can be both time-consuming fatiguing. Investigating the concept of automated clustering, we conducted a background study to understand varying perspectives how elements in grouped. In response these diverse user expectations, present cLuster, flexible, domain-independent clustering approach for sketches. Our is designed...
Ubiquitous computing encapsulates the idea for technology to be interwoven into fabric of everyday life. As blends physical artifacts, powerful opportunities open up social connection. Prior connected media objects span a broad spectrum design combinations. Such diversity suggests that people have varying needs and preferences staying one another. However, since these designs largely been studied in isolation, we do not holistic understanding around how would configure behave within...