Survey Development Using a Design Thinking Approach with Sheila Robinson

Survey Design with Sheila Robinson

Interview with Sheila Robinson Ed.D. about survey development and use by James Pann, Ph.D.




00:00 – Introduction
01:34 – Creating surveys with a “Respondent-Centered Approach”
04:53 – Insightful tips to create better surveys
08:47 – Making sure respondents understand questions as intended
11:03 – Example of misleading results due to poorly created survey
13:25 – Biases that show up when surveys are used in program evaluations. Biases show up when survey designer inputs their own beliefs or demographic in the creation of the survey
18:00 – Using either an existing survey or creating a new one depending on what needs to be measured 22:41 – When would a survey would not be the right tool to measure data
26:02 – Choosing a survey software
29:30 – Direction or tips for new survey creators
33:00 – How to connect with Sheila





Please reach out with comments and feedback! Thanks!



Watch the video recording of our interview here:


James Pann smiling at the camera, sitting in front of green trees

James Pann, Ph.D. is a Professor at Nova Southeast University and a highly experienced psychologist and evaluator with nearly 25 years of experience. He conducts research and evaluation projects with non-profit organizations in the fields of health, human services, and education, and has received funding from multiple government agencies.

James holds multiple degrees including a Ph.D. in Counseling Psychology, an M.S. Ed. from the University of Miami, and a BBA in Accounting from the University of Texas at Austin. He is also the host of the EvalNetwork podcast, a frequent conference presenter, and has published several peer-reviewed research articles and co-authored a book. James currently resides in Miami, Florida with his family and enjoys backpacking trips. Find out more about his work here.


Retrospective pretest designs

The Power of Retrospective Pretests to Address Common Survey Research Challenges

James Pann interviews Melanie Hwalek, Ph.D., a program evaluation consultant, to discuss the retrospective pretest (RPT) design, focusing on its practical applications and the findings from her recent research detailed in the paper, “Designing a Questionnaire with Retrospective PrePost Items: Format Matters.” RPT is particularly useful for evaluating changes in participants’ perceptions or self-assessments following

Read More »
Empowerment Evaluation

Empowering Change: David Fetterman on Using Evaluation to Build a Better World

David Fetterman is a leading expert in empowerment evaluation, an approach that emphasizes collaboration, participation, and capacity building. He has written extensively on the topic, and his work has been used in a wide range of settings, including government agencies, non-profit organizations, and businesses. David focuses on helping people evaluate their programs and initiatives. Moreover,

Read More »