Survey Design For Quality Data – Part 1

|

Last week, Dobility founder and CEO Dr. Christopher Robert presented on how to design surveys for quality data in the TechChange course “Technology for Data Collection and Survey Design.” We thought it would be fun to share highlights from his talk with the larger community of mobile data collection users (while also showing off some of the cool ways that SurveyCTO can help you design smart surveys from day one).

design_for_quality

Lesson 1: Design For the People Actually Delivering Your Survey 

Enumerators have tough jobs. Imagine traveling for hours in extreme weather just to find respondents, who then have to be convinced to complete a survey that may take as long as three hours. Multiply this by your sample size and you can understand why your enumerators might be tempted to fake interviews or auto-answer questions.

One of the first steps in survey design is to be empathetic toward your field staff. Creating a survey that makes it easier for them to do their jobs while simultaneously making it harder to cut corners benefits everyone.

Lesson 2: Take Advantage of Relevance and Constraints 

Mobile data collection platforms can make survey design significantly easier than if you were creating a comparable paper-based survey. If a series of questions isn’t relevant, your survey can automatically skip them. You can also program your survey to ensure that the responses you get are more likely to be accurate. (Compare this to a paper-based survey where you often have to flip between sections and it’s all too easy to enter your data in the wrong section – or to fail to enter any data at all.)

Example 1: Relevance
As highlighted below, you can program your survey to display a question only if the respondent is female and older than 10. This might be useful if you have a series of questions on pregnancy – why waste time asking men if they’re pregnant? Not to mention, how would you log their responses if they DID say they were pregnant?

It’s always best to avoid collecting bad data in the first place rather than to worry about cleaning it up later.

Sample relevance field:
relevance

 

 

Example 2: Constraints
Let’s say you only want to interview people older than 18. With SurveyCTO, you can indicate a minimum value and a maximum value, you can make exceptions, and you can even create an error message that will display if the constraint is violated. Additionally, an enumerator won’t be able to progress in the survey until the question is answered properly.

Sample constraint field:
constraint

 

Final Thoughts

Taking the time to build in relevance, constraints, and some of the features we’ll discuss in our next post may feel daunting, especially if you’re pressed for time and trying to get a complex project off the ground. But as Chris likes to point out:

It’s worth it! Thoughtful survey design will return quality data that you can trust.

This article was originally posted on the SurveyCTO blog

About the Author
Alexis Ditkowsky is the community and business strategy lead for Dobility, the company behind SurveyCTO. Her experience spans social entrepreneurship, international education policy, higher education, and the arts. She holds a Master of Education from the Harvard Graduate School of Education.

headshot_alexis

Also on TechChange Main

2014 TechChange team-photo
State of TechChange 2014

So long, 2014! Building on our annual posts in 2013 and 2012 (as well as a repeat performance at FailFest 2014!), we wanted...

Partner Spotlight: Katherine Raphaelson, SID-US

SID-US (formerly SID-Washington) is the largest and most active chapter of the Society for International Development (SID), an international network...

eLearning, Emerging Technology, and Social Good: UNICEF’s Partnership with TechChange

TechChange and UNICEF are proud to announce the release of 2 landmark eLearning courses: one on the intersection between frontier...