Learning from Evaluation Mistakes with Kylie Hutchinson

Kylie Hutchinson Learning from Evaluation Mistakes episode on EvalNetwork Podcast

Kylie is the 2020 recipient of the Canadian Evaluation Society’s Award for Contribution to Evaluation in Canada. She has spent the past thirty years working in the not-for-profit sector as a consultant, trainer, program manager, board member, and volunteer. 

There are many valuable nuggets from this video. We discuss the following during the interview:

– Reasons why Kylie loves evaluation.

– Why evaluation is relevant for health and human services students who are not necessarily interested in research or evaluation.

– Why she wrote Evaluation Failures: 22 Tales of Mistakes Made and Lessons Learned.  She highlights some of the most important  lessons from the book.

– Kylie talks about how everyone makes mistakes and the key is learning from them.

– She reviews specific strategies for engaging project stakeholders in an evaluation.

– Kylie provides her favorite resources regarding program design.

– How mindfulness factors into her work and how it can inform the work of evaluators.

– Books she recommends.

You can connect with Kylie through https://communitysolutions.ca or @EvaluationMaven at Twitter.

Watch the video recording of our interview here:

Share

James Pann, program evaluation consultant, smiling in front of greenery, representing his expertise in improving program outcomes through evaluation.

James Pann, Ph.D. is Principal Consultant at EvalNetwork with more than 25 years of experience in program evaluation, research, and applied psychology. He is also a Professor and licensed psychologist. James partners with health, human services, and education nonprofits to design evaluations that strengthen programs and demonstrate impact.

He holds a Ph.D. in Counseling Psychology and an M.S. Ed. from the University of Miami, and a BBA in Accounting from the University of Texas at Austin. He has published peer-reviewed research, co-authored a book on mental health and criminal justice, and presents at conferences on evaluation and related topics. Learn more about EvalNetwork.

Related

Retrospective pretest designs in program evaluation to overcome response shift bias.

The Power of Retrospective Pretests to Address Common Survey Research Challenges

James Pann interviews Melanie Hwalek, Ph.D., an evaluation researcher and consultant, to discuss the retrospective pretest (RPT) design, focusing on its practical applications and the findings from her recent research detailed in the paper, “Designing a Questionnaire with Retrospective PrePost Items: Format Matters.” Below, I break down what a retrospective pretest is, when it works

Read More »
David Fetterman discussing Empowerment Evaluation for building a better world.

What Is Empowerment Evaluation? A Guide with David Fetterman

Empowerment evaluation is an approach that puts evaluation in the hands of the people who run and participate in a program. An external evaluator does not design the study, collect the data, and deliver a report alone. Program staff and community members lead the evaluation, and the evaluator works as a coach. David Fetterman developed

Read More »