Obtaining information about audience engagement in presentations is a valuable asset for presenters many domains. Prior literature mostly utilized explicit methods of collecting feedback which induce distractions, add workload on and do not provide objective to presenters. We present EngageMeter - system that allows fine-grained be obtained implicitly from multiple brain-computer interfaces (BCI) fed back real time post-hoc access. Through evaluation during an HCI conference (Naudience=11,...

We propose a multimodal scheme, GazeTouchPass, that combines gaze and touch for shoulder-surfing resistant user authentication on mobile devices. GazeTouchPass allows passwords with multiple switches between input modalities during authentication. This requires attackers to simultaneously observe the device screen user's eyes find password. evaluate security usability of in two studies. Our findings show is usable significantly more secure than single-modal against basic even advanced attacks.

Textual communication via mobile phones suffers from a lack of context and emotional awareness. We present chat application, HeartChat, which integrates heart rate as cue to increase awareness empathy. Through literature review focus group, we identified design dimensions important for augmented chats. created three concepts showing per message, in real-time, or sending it explicitly. tested our system two week in-the-wild study with 14 participants (7 pairs). Interviews questionnaires...

Although mobile devices provide access to a plethora of sensitive data, most users still only protect them with PINs or patterns, which are vulnerable side-channel attacks (e.g., shoulder surfing). How-ever, prior research has shown that privacy-aware willing take further steps their private data. We propose GazeTouchPIN, novel secure authentication scheme for combines gaze and touch input. Our multimodal approach complicates shoulder-surfing by requiring attackers ob-serve the screen as...

The human body reveals emotional and bodily states through measurable signals, such as language electroencephalography. However, manifestations are difficult to communicate others remotely. We propose EmotionActuator, a proof-of-concept system investigate the transmission of in which recipient performs gestures understand interpret state sender.We call this kind communication embodied feedback, present prototype implementation. To realize our concept we chose four states: amused, sad, angry,...

A common objective for context-aware computing systems is to predict how user interfaces impact performance regarding their cognitive capabilities. Existing approaches such as questionnaires or pupil dilation measurements either only allow subjective assessments are susceptible environmental influences and physiology. We address these challenges by exploiting the fact that workload smooth pursuit eye movements. compared three trajectories two speeds under different levels of within a study...

Many user interfaces involve attention shifts between primary and secondary tasks, e.g., when changing a mode in menu, which detracts the from their main task. In this work, we investigate how eye gaze input affords exploiting to enhance interaction with handheld menus. We assess three techniques for menu selection: dwell time, button, cursor. Each represents different multimodal balance manual input. present study that compares against two baselines (dunk brush, pointer) compound colour...

Common user authentication methods on smartphones, such as lock patterns, PINs, or passwords, impose a trade-off between security and password memorability. Image-based passwords were proposed secure usable alternative. As of today, however, it remains unclear how schemes are used in the wild. We present first study to investigate image-based over long periods time real world. Our analyses based data from 2318 unique devices collected more than one year using custom application released...

Cognition-aware systems acquire physiological data to derive implications about physical and mental states. Pupil dilation has recently attracted attention in the HCI community as an indicator for workload. The impact of workload on pupillary behavior been extensively examined. However, making use these measurements alleviate have scarcely evaluated. Our work investigates expediency task complexity adaption based real-time. By conducting math tasks with different complexities, we calibrate a...

Bio-sensing wearables are currently advancing to provide users with a lot of information about their physiological and affective states. However, relatively little is known users' interest in acquiring, sharing receiving this through which channels modalities. To close gap, we report on the results an online survey (N=109) exploring principle aspects design space such as data types, contexts, feedback modalities behaviors. Results show that interested obtaining physiological, emotional...

Communicating uncertainty has been shown to provide positive effects on user understanding and decision-making. Surprisingly however, most personal health tracking applications fail disclose the accuracy of their measurements predictions. In case fertility (FTAs), inaccurate predictions have already led numerous unwanted pregnancies law suits. However, integrating into FTAs is challenging: Prediction hard understand communicate, its effect users' trust behavior not well understood. We...

Mobile text messaging is one of the most important communication channels today, but it suffers from lack expressiveness, context and emotional awareness, compared to face-to-face communication. We address this problem by augmenting with information about users contexts. present reflect on lessons learned three field studies, in which we deployed augmentation concepts as prototype chat apps users’ daily lives. studied (1) subtly conveying via dynamic font personalisation ( TapScript ), (2)...

A rich museum experience is one that engaging, educating and enjoyable to the visitors, such experiences can only be achieved by personalizing enriching according visitor's state. Neural signals from brain provide information about affective cognitive state of person implicitly. With rise commercial Brain-Computer Interface devices, this technology utilized in extracting adapt various person. We propose a concept preliminary study which uses grade (BCI) devices implicitly detect visitors'...

Today's workplaces are dynamic and complex. Digital data sources such as email video conferencing aim to support workers but also add their burden of multitasking. Psychophysiological sensors Electroencephalography (EEG) can provide users with cues about cognitive state. We introduce BrainAtWork, a workplace engagement task logger which shows state while working on different tasks. In lab study eleven participants own real-world tasks, we gathered 16 hours EEG PC logs were labeled into three...

Text selection is a frequent task we do everyday to edit, modify or delete text. Selecting word requires not only precision but also switching between selections and typing which influences both speed error rates. In this paper, evaluate novel concept that extends text editing with an additional modality, gaze. We present user study (N=16) where explore how, the concepts called GazeButton can improve by comparing it touch based selection. addition, tested effect of size on techniques two...

Recognizing and summarizing persons' activities have proven to be effective for increasing self-awareness enable improve habits. Reading improves one's language skills periodic relaxing health. these conveying the time spent would ensure that users read relax an adequate time. Most previous attempts in activity recognition deduce mental by requiring expensive/bulky hardware or monitoring behavior from outside. Not all can, however, recognized If a person is sleeping, relaxing, intensively...

Smart textiles have been researched in the lab over last 20 years. However, gap between research and available mass-market products is huge. We identify challenges that are core reasons for this gap. To tackle these challenges, we present our work towards a multipurpose smart textile with different sensing modalities. It separates concern of developing textiles, electronics, infrastructure, applications. Furthermore, it uses similar application model as current smart-phones allowing...

Exploiting emotions for user interface evaluation became an increasingly important research objective in Human-Computer Interaction. Emotions are usually assessed through surveys that do not allow information to be collected real-time. In our work, we suggest the use of smartphones mobile emotion assessment. We front-facing smartphone camera as a tool detection based on facial expressions. Such can used reflect emotional states or provide emotion-aware adaptation. expressions along with app...

Among mental health diseases, depression is one of the most severe, as it often leads to suicide which fourth leading cause death in Middle East. In East, Egypt has highest percentage suicidal deaths; due this, important identify and ideation. Arabic culture, there a lack awareness regarding importance diagnosing living with diseases. However, noted for last couple years people all over world, including Arab citizens, tend express their feelings openly on social media. Twitter popular...

Immersive Virtual Reality (IVR) does not afford social cues for communication, such as sweaty palms to indicate stress, users can only see an avatar of their collaborator. Prior work has shown that this data is necessary successful collaboration, which why we propose augment IVR communication by (1) real-time capturing physiological senses and (2) leveraging the unlimited virtual space display these. We present results a focus group (N=7) preliminary study (N=32) investigate how may be...