An Anchored Open-Ended Survey Approach in Multiple Case Study Analysis

• DOI: 10.18260/p.26566
• Publication Date: 2016-07-07T17:03:52Z
• Authors: Walter Lee; Benjamin Lutz
• Keywords: 05 social sciences; 0503 education

Survey questions are typically presented in one of two formats: closed-ended or open-ended. Despite the widespread use of open-ended survey questions in educational research, making sense of the answers to such questions remains a challenge. Whereas closed-ended questions lend themselves to well-known quantitative data-analysis techniques, open-ended questions have a tendency to illicit responses that are more difficult to analyze. Open-ended survey questions are advantageous because they allow researchers to explore responses when 1) answers to a question are not known in advance or 2) narrative responses are more useful. Open-ended survey questions are also used as “catch-all” or venting questions, giving respondents an opportunity to discuss topics that may not have been addressed by closed-ended questions. Given the varied use of the open-ended question format, researchers are often unsure how to use the results, if at all: survey research literature does not provide sufficient examples illustrating suitable data-analysis procedures for this question format. This challenge is further exacerbated when the respondents are reflecting on different contexts, such as different cases or research sites. The purpose of this paper is to present an anchored open-ended survey approach as a solution for combating the disadvantages of open-ended survey questions while preserving the capacity to explore new or unanticipated responses. The approach uses closed-ended questions to anchor the responses to open-ended questions. An example of an anchored open-ended question is prompting students to indicate whether their interactions with faculty/staff were impacted positively, negatively, or neutrally by a student support center before asking them to provide specific examples of how their experience interacting with faculty/staff was influenced by a student support center. In this paper, we illustrate the use of anchored open-ended survey questions as a method for multiple case study analysis. First, we present an overview of ...