Dancing Your Way through Program Evaluation with the CDC 6-Step Evaluation Framework MaryCatherine Jones, MPH, Public Health Consultant, CVH Team Zarina Fershteyn, MPH, Director of Program Evaluation, NACDD Learning Objectives To identify the steps associated with the CDC
Framework for Evaluation To discuss the intersection between logic models and the framework To engage peers in discussing common roadblocks and solutions in evaluating chronic disease and health promotion programs Course Overview
What we will accomplish Getting Started with Evaluation Common types of evaluation in public health Implementation Effectiveness Efficiency Cost Effectiveness
Attribution Others What is the value in evaluation? What is the CDC 6 Step Evaluation Framework?
Your Evaluation Team An evaluation team ensures that you have a variety of skills and perspectives that will make your evaluation useable and ensure that your results drive action. Evaluation team members can include: Program staff Partners Funders
Policymakers Community members Subject matter experts Others Your Lead Evaluator Able to work with a variety of stakeholders Able to balance potentially competing needs of
stakeholders Able to prioritize and deliver in the face of limited resources Able to innovate Why Are Stakeholders Important? Stakeholder Roles
Evaluation Team (planning and implementing the evaluation) Dissemination of evaluation findings Contributing data Analyzing and drawing conclusions from data Considerations for Stakeholder Engagement
Standard Utility Feasibility Propriety Accuracy Questions
Who will use these results? How much time and effort can we expect from the stakeholders? How much time/effort do we have to engage them? Which stakeholders can help our evaluation to be ethical? How broadly do we need to engage stakeholders to paint an accurate picture of
the program? Describing the Program Considerations for Your Description
Need Target Population
Outcomes Activities Outputs Resources/Inputs Relationship of activities and outcomes Stage of development Context/environmental factors
Sample Logic Model Format Investment Inputs Activities Outcomes Outputs
Short-Term Intermediate Term Long Term
Considerations for Your Program Description Standard Questions Utility
Is the level of detail appropriate for the intended use? Are the activities and at least some of the outcomes within the programs control? Does the description include enough detail to examine strengths and weaknesses of the program?
Is the program description comprehensive? Are likely influences on the program identified? Feasibility Propriety Accuracy
Case Study and Small Group Activity ? Group Discussion Focusing the Evaluation Design
Types of Evaluation Implementation/Process Effectiveness/Outcome Focusing the Evaluation Design Considerations for Design WHO HOW
WHAT (we can reasonably evaluate) Big Details for Your Evaluation Plan Availability of data
Timing of data collection Data analysis (who, when, how) Types of conclusions we can make Case Study (Continued) ?
Overcoming Trouble Spots UmmSorry, this made sense until I started explaining it. Summary
Worksheets adapted from U.S. Department of Health and Human Services Centers for Disease Control and Prevention. Office of the Director, Office of Strategy and Innovation. Introduction to program evaluation for public health programs: A self-study guide. Atlanta, GA: Centers for Disease Control and Prevention, 2011. Visit the self-study guide for worksheets related to the other Steps! Our Challenge to You
Our contact information MaryCatherine Jones, [email protected] Zarina Fershteyn, [email protected]
