Chapter 13: Experiential Learning Project: Completion and Evaluation
Important Course Information
-
Evaluating Outcomes of Action Plans and Interventions
13.1 Evaluating Outcomes of Action Plans and Interventions
Evaluation of community programs occurs throughout implementation and at the conclusion of a program to improve processes and outcomes. The evaluation provides evidence for decisions regarding the program, such as whether the program should continue, if revisions are needed, or if the program should be discontinued.
The program team develops a plan for evaluation during the planning phases of community health programming, determining the evaluation methods before beginning intervention activities. Using a systematic process ensures all components of the program are evaluated in an evidence-based way. No matter the process and methods used, the program team evaluates whether goals and objectives of the program are met.
Evaluating Outcomes of Action Plans and Interventions
A community health program’s outcomes should always be evaluated to determine if program goals and objectives have been met. Data regarding program interventions and activities should be evaluated and analyzed individually and as a whole.
Data collection techniques include questionnaires to measure knowledge, attitudes, or behavior; observation; interviews; focus groups; and epidemiologic data. The team may collect data from participants, staff, volunteers, and community partners. Participants should always be evaluated to determine knowledge, attitude, or behavior changes. The team may collect pre-implementation or baseline data from epidemiological data, community health assessments, and participant surveys prior to program interventions.
Short-term objectives are often measured immediately following program intervention. Intermediate objectives are measured within a few months following the program, usually within 3 to 6 months. Long-term objectives are usually measured at least one year following the program. The team evaluates impact using community health data. Most often, the nurse and program team use annual epidemiological data or community health assessment data, which is collected at minimum every three years. Benchmarks help determine the impact of programs. For example, in Planning Health Promotion and Disease Prevention Interventions, the nurse and Kenton Hardin County Family Bike Program (KHCFBP) team determined evaluation questions and data techniques from the outcome and impact sections of the logic model. Table 13.1 describes the outcome evaluation of the program.
| Outcome as Stated on the Logic Model | Evaluation Question | Data Collection Technique |
|---|---|---|
| Short term—Increase participant bike safety knowledge post-program | What was the effect of the KHCFBP on participants’ bike safety knowledge? |
|
| Short term—Increase participant bike helmet use 30 days post-program | What was the effect of the KHCFBP on participants’ report of bike helmet use? |
|
| Short term—Increase participant biking frequency 30 days post-program | What was the effect of the KHCFBP on participants’ report of bike riding? |
|
| Long term—Increase incidence of biking in Hardin County over the next 5 years | Did incidence of bike riding increase in Hardin County? |
|
| Impact—Increase physical activity of Hardin County residents | Did physical activity of Hardin County residents increase? |
|
The program team analyzes data after collection. Pre-implementation and post-implementation data are compared. Program evaluation data are also compared to similar program evaluations and national benchmarks. The program team uses this information to evaluate the program’s strengths and weaknesses, determines if it has achieved desired outcomes, and examines its efficacy, effectiveness, and efficiency. The program team develops recommendations regarding the program and shares findings and recommendations with community members and partners. Ongoing evaluation of community health programs is necessary to ensure program success, program continuation, and that community needs are being met.
References
Hunsicker, J. (2020). Evaluation of the Kenton Hardin County Family Bike Program [Doctoral dissertation, Case Western Reserve University]. OhioLINK Electronic Theses and Dissertations Center. http://rave.ohiolink.edu/etdc/view?acc_num=casednp1571153144525499
