Dancing Your Way through Program Evaluation with the

Dancing Your Way through Program Evaluation with the CDC 6-Step Evaluation Framework MaryCatherine Jones, MPH, Public Health Consultant, CVH Team Zarina Fershteyn, MPH, Director of Program Evaluation, NACDD Learning Objectives To identify the steps associated with the CDC

Framework for Evaluation To discuss the intersection between logic models and the framework To engage peers in discussing common roadblocks and solutions in evaluating chronic disease and health promotion programs Course Overview

What we will accomplish Getting Started with Evaluation Common types of evaluation in public health Implementation Effectiveness Efficiency Cost Effectiveness

Attribution Others What is the value in evaluation? What is the CDC 6 Step Evaluation Framework?

Your Evaluation Team An evaluation team ensures that you have a variety of skills and perspectives that will make your evaluation useable and ensure that your results drive action. Evaluation team members can include: Program staff Partners Funders

Policymakers Community members Subject matter experts Others Your Lead Evaluator Able to work with a variety of stakeholders Able to balance potentially competing needs of

stakeholders Able to prioritize and deliver in the face of limited resources Able to innovate Why Are Stakeholders Important? Stakeholder Roles

Evaluation Team (planning and implementing the evaluation) Dissemination of evaluation findings Contributing data Analyzing and drawing conclusions from data Considerations for Stakeholder Engagement

Standard Utility Feasibility Propriety Accuracy Questions

Who will use these results? How much time and effort can we expect from the stakeholders? How much time/effort do we have to engage them? Which stakeholders can help our evaluation to be ethical? How broadly do we need to engage stakeholders to paint an accurate picture of

the program? Describing the Program Considerations for Your Description

Need Target Population

Outcomes Activities Outputs Resources/Inputs Relationship of activities and outcomes Stage of development Context/environmental factors

Sample Logic Model Format Investment Inputs Activities Outcomes Outputs

Short-Term Intermediate Term Long Term

Considerations for Your Program Description Standard Questions Utility

Is the level of detail appropriate for the intended use? Are the activities and at least some of the outcomes within the programs control? Does the description include enough detail to examine strengths and weaknesses of the program?

Is the program description comprehensive? Are likely influences on the program identified? Feasibility Propriety Accuracy

Case Study and Small Group Activity ? Group Discussion Focusing the Evaluation Design

Types of Evaluation Implementation/Process Effectiveness/Outcome Focusing the Evaluation Design Considerations for Design WHO HOW

WHAT (we can reasonably evaluate) Big Details for Your Evaluation Plan Availability of data

Timing of data collection Data analysis (who, when, how) Types of conclusions we can make Case Study (Continued) ?

Overcoming Trouble Spots UmmSorry, this made sense until I started explaining it. Summary

Worksheets adapted from U.S. Department of Health and Human Services Centers for Disease Control and Prevention. Office of the Director, Office of Strategy and Innovation. Introduction to program evaluation for public health programs: A self-study guide. Atlanta, GA: Centers for Disease Control and Prevention, 2011. Visit the self-study guide for worksheets related to the other Steps! Our Challenge to You

Our contact information MaryCatherine Jones, [email protected] Zarina Fershteyn, [email protected]

Recently Viewed Presentations

  • Welcome Parents to

    Welcome Parents to

    Change the subject from Maurizio Io… Change the subject from Maurizio Tu Change the subject from Maurizio Tu e Maria Presente Indicativo dei Verbi Regolari Present Indicative Tense of Regular Verbs Presente Forms There are 3 conjugations of Italian verbs:...
  • Google Scholar - St. John Fisher College

    Google Scholar - St. John Fisher College

    What's in Google Scholar? These resources are gathered from "academic publishers, professional societies, online repositories, universities and other web sites."1. A 2009 study found Google Scholar, on average, 17.6 percent more scholarly than materials found only in library databases.2This is...
  • Why does Canada look this way?

    Why does Canada look this way?

    Climate and Weather Weather: The day-to-day characteristics of temperature, rain, cloud cover and wind Climate: Long-term patterns of weather … Canada's Weather Canada's Climate Canada has 8 climate regions Arctic Taiga Cordilleran Pacific Maritime Boreal Prairie Southeastern Atlantic Maritime Canada's...
  • Estimate Activity Times - athena.ecs.csus.edu

    Estimate Activity Times - athena.ecs.csus.edu

    Estimate Activity Times Weeks are a commonly used unit of time for activity completion, but any consistent unit of time can be used. A distinguishing feature of PERT is its ability to deal with uncertainty in activity completion times.
  • Maintenance Management Center Monthly CG Brief 18 October 2017

    Maintenance Management Center Monthly CG Brief 18 October 2017

    were corrected by Rockwell Automation in spring 2019 and released as Arena v16.00.01. The new version is a free upgrade from the . company. 18 Jun 2019: Arena v15.1 is approved; however, the license manager required to run . Arena...
  • Vibration Monitoring and Machine Protection Systems 1010 E.

    Vibration Monitoring and Machine Protection Systems 1010 E.

    The measurement is made with an Eddy Current Probe, mounted in a vertical direction, directly viewing the rod. The preferred installation would have a probe bracket adapted to the packing gland plate, mounted internal to the distance piece. ... Typical...
  • + Chapter 1: Exploring Data Introduction Data Analysis:

    + Chapter 1: Exploring Data Introduction Data Analysis:

    Add numerical summaries. Data Analysis. Examine each variable by itself. Then study relationships among the variables. Start with a graph or graphs. How to Explore Data. Check your understanding. Jake is a car buff who wants to find out more...
  • Online Privacy Issues Overview

    Online Privacy Issues Overview

    Privacy Week 5 What is privacy? What does privacy mean to you? How would you define privacy? What does it meant to you for something to be private?