Abstract Recent advances in web survey methodology were motivated by the observation that respondents increasingly use mobile devices, such as smartphones and tablets, to participate surveys. Even though we do not doubt this general observation, argue claim is lacking a solid empirical basis. Most research on increasing device surveys covers limited periods of time and/or analyzes data from only one study or panel. There surprising lack comprehensive overviews magnitude In present study,...

Measuring attitudes and opinions employing agree/disagree (A/D) questions is a common method in social research because it appears to be possible measure different constructs with identical response scales. However, theoretical considerations suggest that A/D require considerable cognitive processing. Item-specific (IS) questions, contrast, offer content-related categories, implying less To investigate the respective effort quality associated IS we conducted web-based experiment 1,005...

In recent years, the number of surveys, especially online has increased dramatically. Due to absence interviewers in this survey mode (who can motivate respondents continue answering), some researchers and practitioners argue that surveys should not be longer than 20 min. However, so far, there been little research investigating how long think or could be. study, we therefore asked two panels Germany (one probability-based panel one nonprobability panel) about their opinions on ideal maximum...

The effect of the response scale direction on behavior is a well-known phenomenon in survey research. While there are several approaches to explaining how such order effects occur, literature reports mixed evidence. Furthermore, different question formats seem vary their susceptibility these effects. We therefore investigate occurrence Agree/Disagree (A/D) and Item-Specific (IS) questions. conducted an experiment among n = 930 students which we varied (decremental vs. incremental) within A/D...

Web surveys are commonly used in social research because they usually cheaper, faster, and simpler to conduct than other modes. They also enable researchers capture paradata such as response times. Particularly, the determination of proper values define outliers time analyses has proven be an intricate challenge. In fact, a certain degree, determine them arbitrarily. this study, we use “SurveyFocus (SF)”—a tool that records activity web-survey pages—to assess outlier definitions based on...

The increasing volume of “Big Data” produced by sensors and smart devices can transform the social behavioral sciences. Several successful studies used digital data to provide new insights into reality. This special issue argues that true power these for sciences lies in connecting sources with surveys. While are rich volume, they seldomly cover full population nor do individuals’ feelings, motivations, attitudes. Conversely, survey data, while well suited measuring people’s internal states,...

The smartphone increase in web surveys, coupled with technological developments, provides novel opportunities for measuring attitudes. For example, smartphones allow the collection of voice instead text answers by using built-in microphone. This may facilitate answering questions open answer formats resulting richer information and higher data quality. So far, there is only a little body research investigating to questions. In this study, we therefore compare linguistic content...

Abstract The rapid increase in smartphone surveys and technological developments open novel opportunities for collecting survey answers. One of these is the use open-ended questions with requests oral instead written answers, which may facilitate answer process result more in-depth unfiltered information. Whereas it now possible to collect answers on smartphones, we still lack studies impact this format characteristics respondents' In study, compare linguistic content versus political...

Advances in information and communication technology, coupled with a smartphone increase web surveys, provide new avenues for collecting answers from respondents. Specifically, the microphones of smartphones facilitate collection voice instead text to open questions. Speech-to-text transcriptions through Automatic Speech Recognition (ASR) systems pose an efficient way make accessible text-as-data methods. However, there is little evidence on transcription performance ASR when it comes...

In empirical social research, using questions with an agreement scale, also known as agree/disagree (A/D) questions, is a popular technique for measuring attitudes and opinions. Methodological considerations, however, suggest that such require effortful cognitive processing are prone to response bias, acquiescence. Therefore, many researchers recommend the use of item-specific (IS) which based on tailored categories seem imply less burden. this study, we investigate A/D IS in web surveys,...

Response order effects are a well-known phenomenon that can occur when answering survey questions with multiple response categories. Although various theoretical explanations exist, the empirical evidence is contradictory. Moreover, different scale types produce effect sizes. In current study, we investigate occurrence and causes of in horizontal vertical rating scales by means eye tracking. We conducted an experiment (n = 84) two groups varied direction so either ran from agree to disagree...

Abstract Cognitive interviewing in the form of probing is key for developing methodologically sound survey questions. For a long time, was tied to laboratory setting, making it difficult achieve large sample sizes and creating time-intensive undertaking both researchers participants. Web surveys paved way administering questions over Internet time- cost-efficient manner. In so-called web studies, respondents first answer question then they receive one or more open-ended about their response...

Abstract. The use of agree/disagree (A/D) questions is a common technique to measure attitudes. For instance, this question format employed frequently in the Eurobarometer and International Social Survey Programme (ISSP). Theoretical considerations, however, suggest that A/D require complex processing. Therefore, many survey researchers have recommended item-specific (IS) questions, since they seem be less burdensome. Parallel methodological discussion around mobile devices for responding...

Abstract Political knowledge can affect measures obtained in public opinion research and political science. When asked questions, some respondents look up the answers online, inflating scores. This response behavior is detectable web surveys using paradata. study investigates whether to what extent switch away from survey search for online JavaScript OnBlur functions. Respondents were randomly assigned device types (PC or smartphone) formats (open closed) answered a self-report question. The...

In social science research, unipolar and bipolar scales are commonly used methods in measuring respondents’ attitudes opinions. Compared to other rating scale characteristics, polarity (unipolar bipolar) its effects on response behavior have rarely been addressed previous research. To fill this gap the literature, we investigate whether what extent fully verbalized influence by analyzing observed latent distributions thresholds of categories. For purpose, conducted a survey experiment...

The rise of smartphone surveys, coupled with technological advancements, provide new ways for measuring respondents' political attitudes. use open questions requests voice answers instead text may simplify the answer process and nuanced information. So far, research comparing measurement quality is scarce. We therefore conducted an experiment in a survey (N = 2,402) to investigate criterion validity answers. Voice were collected using JavaScript- PHP-based recording tool that resembles...

Participation in web surveys via smartphones increased continuously recent years. The reasons for this increase are a growing proportion of smartphone owners and an mobile Internet access. However, research has shown that respondents frequently distracted and/or multitasking, which might affect completion response behavior negative way. We propose 'SurveyMotion (SMotion)', JavaScript-based tool devices can gather information about respondents' motions during survey by using sensor data....

Technological advancements and changes in online survey participation pave the way for new data collection methods. Particularly, increasing smartphone rate surveys facilitates a re-consideration of prevailing communication channels to, instance, naturalize process between researchers respondents to collect more in-depth high-quality data. However, so far, there is lack information on whether are willing undergo change channels. In this study, I therefore investigate respondents' willingness...

Self-administered web surveys provide respondents only limited opportunities for feedback. Therefore, many include so-called “final comment questions” (FCQs) that allow to elaborate on the survey in general and questions particular. Typing open answers text boxes is burdensome – especially via smartphones with virtual on-screen keypads so frequently short or no at all. In this study, we make use of new technological advancements methodology investigate FCQs requests written oral answers. For...

Abstract The effects of scale direction on response behavior are well known in the survey literature, where a variety theoretical approaches discussed, and mixed empirical findings reported. In addition, different types completion devices seem to vary their susceptibility effects. this study, we therefore investigate effect device type PC smartphone surveys. To do so, conducted web experiment German non-probability access panel (N = 3,401) using two-step split-ballot design with four groups...