Joanne Leong

ORCID: 0000-0001-5422-1018
Publications
Citations
Views
---
Saved
---
About
Contact & Profiles
Research Areas
  • Interactive and Immersive Displays
  • Innovative Human-Technology Interaction
  • Tactile and Sensory Interactions
  • Virtual Reality Applications and Impacts
  • Augmented Reality Applications
  • Advanced Sensor and Energy Harvesting Materials
  • Data Visualization and Analytics
  • Creativity in Education and Neuroscience
  • 3D Shape Modeling and Analysis
  • AI in Service Interactions
  • Usability and User Interface Design
  • Human Motion and Animation
  • Modular Robots and Swarm Intelligence
  • Mobile Crowdsensing and Crowdsourcing
  • Scientific Computing and Data Management
  • Optimism, Hope, and Well-being
  • Mind wandering and attention
  • Grit, Self-Efficacy, and Motivation
  • Technology Use by Older Adults
  • Media Influence and Health
  • Education, Achievement, and Giftedness
  • Generative Adversarial Networks and Image Synthesis
  • Heart Rate Variability and Autonomic Control
  • Climate Change, Adaptation, Migration
  • Reinforcement Learning in Robotics

Human Media
2021-2025

Autodesk (Canada)
2025

University of Toronto
2025

Massachusetts Institute of Technology
2019-2024

Microsoft (United States)
2024

University of Applied Sciences Upper Austria
2015-2018

University of Waterloo
2014-2015

Chinese University of Hong Kong
2003

University of Hong Kong
2003

Advancements in machine learning have recently enabled the hyper-realistic synthesis of prose, images, audio and video data, what is referred to as artificial intelligence (AI)-generated media. These techniques offer novel opportunities for creating interactions with digital portrayals individuals that can inspire intrigue us. AI-generated characters feature synthesized faces, bodies voices anyone, from a fictional character historical figure, or even deceased family member. Although...

10.1038/s42256-021-00417-9 article EN public-domain Nature Machine Intelligence 2021-12-15

We present RESi (Resistive tExtile Sensor Interfaces), a novel sensing approach enabling new kind of yarn-based, resistive pressure sensing. The core builds on newly designed yarn, which features conductive and properties. run technical study to characterize the behaviour yarn determine principle. demonstrate how can be used as sensor discuss specific issues, such connecting soft textile with rigid electronics solved. In addition, we platform-independent API that allows rapid prototyping. To...

10.1145/3242587.3242664 article EN 2018-10-11

Fostering students' interests in learning is considered to have many positive downstream effects. Large language models opened up new horizons for generating content tuned one's interests, yet it unclear what ways and extent this customization could effects on learning. To explore novel dimension, we conducted a between-subjects online study (n=272) featuring different variations of generative AI vocabulary app that enables users personalize their examples. Participants were randomly...

10.1145/3613904.3642393 article EN cc-by-nc 2024-05-11

The increased interest in interactive soft materials, such as smart clothing and responsive furniture, means that there is a need for flexible deformable electronics. In this paper, we focus on stitch-based elastic sensors, which have the benefit of being manufacturable with textile craft tools been used homes centuries. We contribute to understanding stretch sensors through four experiments one user study investigate conductive yarns from technical perspectives, analyze impact different...

10.1145/3025453.3025938 article EN 2017-05-02

Today's commercially available prosthetic limbs lack tactile sensation and feedback. Recent research in this domain focuses on sensor technologies designed to be directly embedded into future prostheses. We present a novel concept prototype of prosthetic-sensing wearable that offers non-invasive, self-applicable customizable approach for the sensory augmentation present-day low mid-range priced lower-limb prosthetics. From consultation with eight amputees, we investigated design space...

10.1145/2984511.2984572 article EN 2016-10-16

We introduce HERMITS, a modular interaction architecture for self-propelled Tangible User Interfaces (TUIs) that incorporates physical add-ons, referred to as mechanical shells. The shell add-ons are intended be dynamically reconfigured by utilizing the locomotion capability of TUIs (e.g. wheeled TUIs, swarm UIs). developed proof-of-concept system demonstrates this novel using two-wheeled robots and variety examples. These passive attatchments extend primitive interactivities shape, motion...

10.1145/3379337.3415831 article EN 2020-10-16

This paper presents the results of a study with 134 participants to explore effects learning from an AI-generated virtual instructor that resembles person one likes or admires. Given important role instructors play in shaping experiences, as well recent surge demand for online education, we investigate potential motivate learning. Recent advances generative AI have made it easy create based on likeness present-day, historical fictional person, thereby enabling customization video material,...

10.1109/fie56618.2022.9962478 article EN 2021 IEEE Frontiers in Education Conference (FIE) 2022-10-08

Imagine being able to send a personalized embodied agent meetings you are unable attend. This paper explores the idea of Ditto —an that visually resembles person, sounds like them, possesses knowledge about and can represent them in meetings. reports on results from two empirical investigations: 1) focus group sessions with six groups (n=24) 2) Wizard Oz (WOz) study 10 (n=39) recruited within large technology company. Results provide insights what contexts appropriate for Dittos, issues...

10.1145/3687033 article EN cc-by-nc Proceedings of the ACM on Human-Computer Interaction 2024-11-07

Introducing interactive components into furniture has proven difficult due to the different lifespans of and digital devices. We present Foxels, a modular, smart concept that allows users create their own on demand by simply snapping together individual building blocks. The modular design makes system flexible accommodate variety setups, making it particularly well-suited for re-configurable spaces. Considering trade-off between ease-of-use high versatility, we explored number interaction...

10.1145/3374920.3374935 article EN 2020-02-05

(Dis)Appearables is an approach for actuated Tangible User Interfaces (TUIs) to appear and disappear. This technique supported by Stages: physical platforms inspired theatrical stages. Self-propelled TUI's autonomously move between front back stage allowing them dynamically disappear from users' attention. platform opens up a novel interaction design space expressive displays with dynamic affordances.

10.1145/3491102.3501906 article EN CHI Conference on Human Factors in Computing Systems 2022-04-28

Faced with public speaking anxiety, one common piece of advice is to picture the audience in a new light, using your mind's eye. With Augmented Reality (AR) face filters, it becomes possible literally change how sees oneself or others. In this paper, we explore privately applied AR filters during online speaking. Private means that these effects are only visible speaker. To investigate possibly controversial concept, conducted an survey 100 respondents gather diverse set initial impressions,...

10.1145/3544548.3581039 article EN 2023-04-19

The arrival of new generative AI tools is creating waves. Here are some ideas for how we could channel them supporting self-development and learning.

10.1145/3589659 article EN cc-by-nc XRDS Crossroads The ACM Magazine for Students 2023-03-01

AI generated characters, i.e., realistic renderings of human faces, voices, and mannerisms that appear authentic to a being [7] are made possible through advancements in generative machine learning. In addition character creation, neural networks have recently also been used for the hyper-realistic synthesis modification prose, images, audio, video data.

10.1145/3491101.3503736 article EN CHI Conference on Human Factors in Computing Systems Extended Abstracts 2022-04-27

Structuring and rearranging free-hand sketches on large interactive surfaces typically requires making multiple stroke selections. This can be both time-consuming fatiguing in the absence of well-designed selection tools. Investigating concept automated clustering, we conducted a background study which highlighted fact that people have varying perspectives how elements should grouped. In response to these diverse user expectations, present cLuster, flexible, domain-independent clustering...

10.1145/2807442.2807455 article EN 2015-11-05

Constructive assemblies are tangible user interfaces (TUIs) that involve the interconnection of modular parts. As such, they offer a unique means to support us in our various and diverse activities. However, little information is available for understanding intricacies taking modular, constructive assembly approach TUI design. Based on an analysis extensive data collected from interviews with eight world-class experts, we propose descriptive, conceptual framework facilitate systematic...

10.1145/3024969.3024985 article EN 2017-03-20

Ambient light is starting to be commercially used enhance the viewing experience for watching TV. We believe that ambient can add value in meeting and control rooms use large vertical interactive surfaces. Therefore, we equipped a whiteboard with peripheral display explored its utility different scenarios by conducting two controlled experiments. In first experiment, investigated how notifications, perception influenced user's position type of work they are engaged in. The second experiment...

10.1145/2858036.2858524 article EN 2016-05-05

We present a novel non-contact photoplethysmographic (PPG) imaging system based on high-resolution video recordings of ambient reflectance human bodies that compensates for body motion and takes advantage skin erythema fluctuations to improve measurement reliability the purpose remote heart rate monitoring. A single location recording is automatically identified an individual, determined over time via tracking. Based information motion-compensated measurements at different wavelengths can be...

10.1117/12.2078397 article EN Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE 2015-03-05

Virtual representations of ourselves can influence the way we feel and behave. While this phenomenon has been explored heavily in realms virtual reality gaming, little is known about level impact increasingly pervasive real-time camera filters have on how people feel, think, The prevalence popularity these technologies surged, coupled with greater usage online communication tools. Motivated by a desire for self-improvement an age regular video-based communication, conducted user study to...

10.1145/3411763.3451696 article EN 2021-05-08

In this paper, we introduce SociaBowl, a dynamic table centerpiece to promote positive social dynamics in 2-way cooperative conversations. A such as bowl of food, decorative flower arrangement, or container writing tools, is commonly placed on around which people have We explore the design space for an augmented and influence how may interact with one another. present initial functional prototype different choices materiality feedback, interaction styles, animation motion patterns. These...

10.1145/3290607.3312775 article EN 2019-04-30

We propose a novel fabrication method for 3D objects based on the principle of spooling. By wrapping off-the-shelf materials such as thread, ribbon, tape or wire onto core structure, new can be created and existing augmented with desired aesthetic functional qualities. Our system, WraPr, enables gesture-based modelling controlled thread deposition. outline explore design space this approach. Various examples are fabricated to demonstrate possibility attain range physical properties. The...

10.1145/3374920.3374990 article EN 2020-02-05

Structuring and rearranging free-hand sketches on large interactive surfaces typically requires making multiple stroke selections. Without well-designed selection tools, this can be both time-consuming fatiguing. Investigating the concept of automated clustering, we conducted a background study to understand varying perspectives how elements in grouped. In response these diverse user expectations, present cLuster, flexible, domain-independent clustering approach for sketches. Our is designed...

10.1145/2818052.2874331 article EN 2016-02-27

Ubiquitous computing encapsulates the idea for technology to be interwoven into fabric of everyday life. As blends physical artifacts, powerful opportunities open up social connection. Prior connected media objects span a broad spectrum design combinations. Such diversity suggests that people have varying needs and preferences staying one another. However, since these designs largely been studied in isolation, we do not holistic understanding around how would configure behave within...

10.1145/3610208 article EN cc-by Proceedings of the ACM on Human-Computer Interaction 2023-09-28
Coming Soon ...