- Natural Language Processing Techniques
- Topic Modeling
- Text Readability and Simplification
- Social Media and Politics
- Misinformation and Its Impacts
- Mobile Crowdsensing and Crowdsourcing
- Impact of Technology on Adolescents
- Digital Marketing and Social Media
- AI in Service Interactions
- Innovative Human-Technology Interaction
- Wikis in Education and Collaboration
- Artificial Intelligence in Law
- Semantic Web and Ontologies
- Personal Information Management and User Behavior
- Legal Education and Practice Innovations
- Intelligent Tutoring Systems and Adaptive Learning
- Software Engineering Research
- Discourse Analysis in Language Studies
- Comparative and International Law Studies
- Advanced Text Analysis Techniques
- Digital Humanities and Scholarship
- Information Retrieval and Search Behavior
- Health Literacy and Information Accessibility
- Mental Health via Writing
- Color perception and design
University of Washington
2018-2024
Allen Institute
2024
Allen Institute for Artificial Intelligence
2024
University of Illinois Urbana-Champaign
2024
Elizabeth Clark, Tal August, Sofia Serrano, Nikita Haduong, Suchin Gururangan, Noah A. Smith. Proceedings of the 59th Annual Meeting Association for Computational Linguistics and 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). 2021.
In our era of rapid technological advancement, the research landscape for writing assistants has become increasingly fragmented across various communities. We seek to address this challenge by proposing a design space as structured way examine and explore multidimensional intelligent interactive assistants. Through large community collaboration, we five aspects assistants: task, user, technology, interaction, ecosystem. Within each aspect, define dimensions (i.e., fundamental components an...
When seeking information not covered in patient-friendly documents, healthcare consumers may turn to the research literature. Reading medical papers, however, can be a challenging experience. To improve access we explore four features enabled by natural language processing: definitions of unfamiliar terms, in-situ plain section summaries, collection key questions that guides readers answering passages, and summaries those passages. We embody these into prototype system, Paper Plain ....
Many people struggling with mental health issues are unable to access adequate care due high costs and a shortage of professionals, leading global crisis. Online communities can help mitigate this crisis by offering scalable, easily accessible alternative in-person sessions therapists or support groups. However, seeking emotional psychological online may be especially vulnerable the kinds antisocial behavior that sometimes occur in discussions. Moderation improve discourse quality, but we...
When seeking information not covered in patient-friendly documents, like medical pamphlets, healthcare consumers may turn to the research literature. Reading papers, however, can be a challenging experience. To improve access we introduce novel interactive interface-Paper Plain-with four features powered by natural language processing: definitions of unfamiliar terms, in-situ plain section summaries, collection key questions that guide readers answering passages, and summaries passages. We...
Unfamiliar terminology and complex language can present barriers to understanding science. Natural processing stands help address these issues by automatically defining unfamiliar terms. We introduce a new task dataset for scientific terms controlling the complexity of generated definitions as way adapting specific reader's background knowledge. test four definition generation methods this task, finding that sequence-to-sequence approach is most successful. then explore version in which are...
As an online community for discussing research findings, r/science has the potential to contribute science outreach and communication with a broad audience. Yet previous work suggests that most of active contributors on are science-educated people rather than lay general public. One reason is might use different, more specialized language used in other subreddits. To investigate this possibility, we analyzed 68 million posts comments from 12 subreddits 2018. We show uses distinct Transient...
Scholarly publications are key to the transfer of knowledge from scholars others. However, research papers information-dense, and as volume scientific literature grows, need for new technology support reading process grows. In contrast finding papers, which has been transformed by Internet technology, experience changed little in decades. The PDF format sharing is widely used due its portability, but it significant downsides including: static content, poor accessibility low-vision readers,...
Communicating complex scientific ideas without misleading or overwhelming the public is challenging. While science communication guides exist, they rarely offer empirical evidence for how their strategies are used in practice. Writing that can be automatically recognized could greatly support efforts by enabling tools to detect and suggest writers. We compile a set of writing drawn from wide range prescriptive sources develop an annotation scheme allowing humans recognize them. collect...
Strong end-user security practices benefit both the user and hosting platform, but it is not well understood how companies communicate with their users to encourage these practices. This paper explores whether web platforms use different levels of language formality in communications tests hypothesis that higher leads users' increased intention comply. We contribute a dataset systematic analysis 1,817 English strings privacy interfaces across 13 platforms, showing strong variations language....
Participant engagement in online studies is key to collecting reliable data, yet achieving it remains an often discussed challenge the research community. One factor that might impact formality of language used communicate with participants throughout study. Prior work has found can convey social cues and power hierarchies, affecting people's responses actions. We explore how influences engagement, measured by attention, dropout, time spent on study participant performance, 369 Mechanical...
We conducted an online study with 165 participants in which we tested their search efficiency and information recall. confirm that the visual complexity of a website has significant negative effect on However, those who preferred simple websites was more negatively affected by highly complex than high complexity. Our results suggest diverse preferences need to be accounted for when assessing response time recall HCI experiments, testing software, or A/B tests.
Making legal knowledge accessible to non-experts is crucial for enhancing general literacy and encouraging civic participation in democracy. However, documents are often challenging understand people without backgrounds. In this paper, we present a novel application of large language models (LLMs) education help learn intricate concepts through storytelling, an effective pedagogical tool conveying complex abstract concepts. We also introduce new dataset LegalStories, which consists 295...
Scholarly publications are key to the transfer of knowledge from scholars others. However, research papers information-dense, and as volume scientific literature grows, greater need for new technology support scholars. In contrast process finding papers, which has been transformed by Internet technology, experience reading changed little in decades. For instance, PDF format sharing remains widely used due its portability but significant downsides, inter alia, static content poor...
Adapting the visual designs of websites to a local target audience can be beneficial, because such design localization increases users' appeal, trust, and work efficiency. Yet designers often find it difficult decide when adapt how designs, mainly there are currently no guidelines that describe common website in various countries. We contribute first large-scale analysis 80,901 across 44 countries, made available via an interactive web-based catalog. Using computational image metrics compare...
Online experimentation with volunteers relies on participants' non-financial motivations to complete a study, such as altruistically support science or compare oneself others. Researchers rely these attract study participants and often use incentives, like performance comparisons, encourage participation. Often, incentives are advertised using slogan (e.g., "What is your thinking style?''). Research framing effects suggests that advertisement slogans people varying demographics motivations....
Prior work in cross-cultural psychology and neuroscience has shown robust variations visual attention patterns. People from East Asian societies, which a holistic thinking style predominates, have been found to attend contextual information scenes more than Westerners, whose tendency think analytically expresses itself greater foreground objects. This paper applies these findings website design, using an online study evaluate whether Japanese (N=65) remember are faster at finding US...
While there has been significant development of models for Plain Language Summarization (PLS), evaluation remains a challenge. PLS lacks dedicated assessment metric, and the suitability text generation metrics is unclear due to unique transformations involved (e.g., adding background explanations, removing jargon). To address these questions, our study introduces granular meta-evaluation testbed, APPLS, designed evaluate PLS. We identify four criteria from previous work-informativeness,...
Human evaluations are typically considered the gold standard in natural language generation, but as models' fluency improves, how well can evaluators detect and judge machine-generated text? We run a study assessing non-experts' ability to distinguish between human- machine-authored text (GPT2 GPT3) three domains (stories, news articles, recipes). find that, without training, distinguished GPT3- human-authored at random chance level. explore approaches for quickly training better identify...
Large language models have introduced exciting new opportunities and challenges in designing developing AI-assisted writing support tools. Recent work has shown that leveraging this technology can transform many scenarios such as ideation during creative writing, editing support, summarization. However, AI-supported expository writing--including real-world tasks like scholars literature reviews or doctors progress notes--is relatively understudied. In position paper, we argue AI supports for...
While there has been significant development of models for Plain Language Summarization (PLS), evaluation remains a challenge. PLS lacks dedicated assessment metric, and the suitability text generation metrics is unclear due to unique transformations involved (e.g., adding background explanations, removing specialized terminology). To address these concerns, our study presents granular meta-evaluation testbed, APPLS, designed evaluate PLS. We define set perturbations along four criteria...
Navigating the vast scientific literature often starts with browsing a paper's abstract. However, when reader seeks additional information, not present in abstract, they face costly cognitive chasm during their dive into full text. To bridge this gap, we introduce recursively expandable abstracts, novel interaction paradigm that dynamically expands abstracts by progressively incorporating information from papers' This lightweight allows scholars to specify needs quickly brushing over...
Scientific jargon can impede researchers when they read materials from other domains. Current methods of identification mainly use corpus-level familiarity indicators (e.g., Simple Wikipedia represents plain language). However, researchers' a term vary greatly based on their own background. We collect dataset over 10K annotations 11 computer science for terms drawn 100 paper abstracts. Analysis this data reveals that and information needs widely across annotators, even within the same...