- Mobile Crowdsensing and Crowdsourcing
- Psychological and Educational Research Studies
- AI in Service Interactions
- Music and Audio Processing
- Social Robot Interaction and HRI
- Species Distribution and Climate Change
- Innovative Teaching and Learning Methods
- Data Stream Mining Techniques
- Personal Information Management and User Behavior
- Music Technology and Sound Studies
- Teaching and Learning Programming
- Child Development and Digital Technology
- Auction Theory and Applications
- Educational Games and Gamification
- Human-Automation Interaction and Safety
- Intelligent Tutoring Systems and Adaptive Learning
- Speech and dialogue systems
- Scientific Computing and Data Management
- EEG and Brain-Computer Interfaces
- Multi-Agent Systems and Negotiation
- Child and Animal Learning Development
- Autonomous Vehicle Technology and Safety
- Robotics and Automated Systems
- Context-Aware Activity Recognition Systems
- Epilepsy research and treatment
University of Waterloo
2016-2024
Regional Municipality of Waterloo
2023
Harvard University
2013
Harvard University Press
2013
Carnegie Mellon University
2009-2012
Glasgow Caledonian University
2009
University of British Columbia
2000
National Academies of Sciences, Engineering, and Medicine
2000
Brighton General Hospital
1918
Bausch Health (United Kingdom)
1918
Since its introduction at CHI 2004, the ESP Game has inspired many similar games that share goal of gathering data from players. This paper introduces a new mechanism for collecting labeled using "games with purpose." In this mechanism, players are provided either same or different object, and asked to describe object each other. Based on other's descriptions, must decide whether they have not. We explain why is superior input certain characteristics, introduce an enjoyable game called...
An important class of tasks that are underexplored in current human computation systems complex with global constraints. One example such a task is itinerary planning, where solutions consist sequence activities meet requirements specified by the requester. In this paper, we focus on crowdsourcing plans as case study constraint-based and introduce collaborative planning system called Mobi illustrates novel crowdware paradigm. presents single interface enables crowd participants to view...
Phenology is a key biological trait that can determine an organism's survival and provides one of the clearest indicators effects recent climatic change. Long time-series observations plant phenology collected at continental scales could clarify latitudinal regional patterns responses illuminate drivers variation, but few such datasets exist. Here, we use web tool CrowdCurio to crowdsource phenological data from over 7000 herbarium specimens representing 30 diverse flowering species...
Crowdsourcing systems are designed to elicit help from humans accomplish tasks that still difficult for computers. How motivate workers stay longer and/or perform better in crowdsourcing is a critical question designers. Previous work have explored different motivational frameworks, both extrinsic and intrinsic. In this work, we examine the potential curiosity as new type of intrinsic driver incentivize crowd workers. We design task interfaces explicitly incorporate mechanisms induce conduct...
Human computation is a new and evolving research area that centers around harnessing human intelligence to solve computational problems are beyond the scope of existing Artificial Intelligence (AI) algorithms. With growth Web, systems can now leverage abilities an unprecedented number people via Web perform complex computation. There various genres applications exist today. Games with purpose (e.g., ESP Game) specifically target online gamers who generate useful data image tags) while...
Autonomous vehicles have been rapidly progressing towards full autonomy using fixed driving styles, which may differ from individual passenger preferences. Violating these preferences lead to discomfort or anxiety. We studied responses different style parameters in a physical autonomous vehicle. collected galvanic skin response, heart rate, and eye-movement patterns 20 participants, along with self-reported comfort anxiety scores. Our results show that the presence proximity of vehicle not...
Phenology is a key aspect of plant success. Recent research has demonstrated that herbarium specimens can provide important information on phenology. Massive digitization efforts have the potential to greatly expand herbarium-based phenological research, but also pose serious challenge regarding efficient data collection. Here, we introduce CrowdCurio, crowdsourcing tool for collection from specimens. We test its utility by having workers collect (number flower buds, open flowers and fruits)...
Numerous crowdsourcing platforms are now available to support research as well commercial goals. However, is not yet widely adopted by researchers for generating, processing or analyzing data. This study develops a deeper understanding of the circumstances under which useful, feasible desirable tool research, factors that may influence researchers' decisions around adopting technology. We conducted semi-structured interviews with 18 in diverse disciplines, spanning humanities and sciences,...
Audio annotation is key to developing machine-listening systems; yet, effective ways accurately and rapidly obtain crowdsourced audio annotations understudied. In this work, we seek quantify the reliability/redundancy trade-off in soundscape annotation, investigate how visualizations affect accuracy efficiency, characterize performance varies as a function of characteristics. Using controlled experiment, varied sound complexity soundscapes presented human annotators. Results show that more...
Crowdsourced classification of data typically assumes that objects can be unambiguously classified into categories. In practice, many tasks are ambiguous due to various forms disagreement. Prior work shows exchanging verbal justifications significantly improve answer accuracy over aggregation techniques. this work, we study how worker deliberation affects resolvability and using case studies with both an objective a subjective task. Results show depends on factors, including the level...
Crowdworkers regularly support their work with scripts, extensions, and software to enhance productivity. Despite evident significance, little is understood regarding how these tools affect crowdworkers' quality of life work. In this study, we report findings from an interview study (N=21) aimed at exploring the tooling practices used by full-time crowdworkers on Amazon Mechanical Turk. Our data suggests that utilized (1) strongly contributes fragmentation microwork enabling task switching...
Previous studies have highlighted the benefits of pedagogical conversational agents using socially-oriented conversation with students. In this work, we examine effects a agent's use affiliative and self-defeating humour -- considered conducive to social well-being enhancing interpersonal relationships on learners' perception agent attitudes towards task. Using between-subjects protocol, 58 participants taught about rock classification learning-by-teaching platform, Curiosity Notebook. While...
Recent work demonstrated how we can design and use coding strips, a form of comic strips with corresponding code, to enhance teaching learning in programming. However, creating is creative, time-consuming process. Creators have generate stories from code (code->story) comics (story->comic). We contribute CodeToon, authoring tool that facilitates this code-driven storytelling process two mechanisms: (1) story ideation using metaphor (2) automatic generation the story. conducted two-part user...
Social robots are increasingly being designed for use in educational contexts, including the role of a tutee. However, little is known about how robot behavior affects children's learning-through-teaching. We examined whether frequency and type mistakes affected teaching behaviors (basic advanced), subsequent learning, when social robot. Eight to 11-year-olds ( N = 114) taught novel classification scheme humanoid Children that either made no mistakes, typical (errors on untaught material;...
Curiosity-the intrinsic desire for new information-can enhance learning, memory, and exploration. Therefore, understanding how to elicit curiosity can inform the design of educational technologies. In this work, we investigate a social peer robot's verbal expression is perceived, whether it affect emotional feeling behavioural in students, impacts learning. between-subjects experiment, 30 participants played game LinkIt!, designed teaching rock classification, with robot verbally expressing:...
Expert disagreement is pervasive in clinical decision making and collective adjudication a useful approach for resolving divergent assessments. Prior work shows that expert can arise due to diverse factors including background, the quality presentation of data, guideline clarity. In this work, we study how these predict initial discrepancies context medical time series analysis, examining why certain disagreements persist after adjudication, impacts decisions. Results from case with 36...
Artificial intelligence (AI) assistants for clinical decision making show increasing promise in medicine. However, medical assessments can be contentious, leading to expert disagreement. This raises the question of how AI should designed handle classification ambiguous cases. Our study compared two that provide labels time series data along with quantitative uncertainty estimates: conventional vs. ambiguity-aware. We simulated our ambiguity-aware based on real-world discussions highlight...
Question asking is an important tool for constructing academic knowledge, and a self-reinforcing driver of curiosity. However, research has found that question infrequent in the classroom children's questions are often superficial, lacking deep reasoning. In this work, we developed pedagogical agent encourages children to ask divergent-thinking questions, more complex form associated with We conducted study 95 fifth grade students, who interacted either convergent-thinking or questions....
Wickett et al., 2014), but, due to the sheer size of angiosperm clade (~220,000-400,000 spp., reviewed by Scotland and Wortley, 2003), two even greater challenges will be (1) producing a comprehensive understanding species-level relationships across flowering plants (2) pairing this tree with phenotypic traits geographic data.Even best-sampled clades have coverage only slightly better than 30% (e.g., Saxifragales, 2400 species; Soltis 2013;de Casas 2016), sampling typically resulting from...