Analyzing Impacts of Extension Programs

This publication presents a framework, guidelines, strategy, and methods for evaluating Extension education programs. Extension programs are viewed in terms of seven levels of objectives and evaluative evidence: (1) inputs, (2) activities, (3) people involvement, (4) reactions, (5) change of knowledge, attitudes, skills, and/or aspirations (KASA), (6) practice change, and (7) end results. Levels 1 and 2 characterize Extension's efforts. Level 3 includes the people involved by Extension and the nature of their involvement; levels 4 through 7 cover the responses by these people and others. Responses range from the immediate and direct to the long-term and indirect consequences of Extension's actions. The foregoing levels vary in: (a) the extent to which they can provide evidence of Extension's impact and (b) the amount of resources required for obtaining evidence. Evidence of Extension program impact becomes stronger in ascending the levels. However, obtaining evidence at higher levels generally requires more evaluative resources. The level (s) of evidence chosen for a particular program evaluation will vary with the decisions it is to assist, the nature of the program, and the circumstances of its evaluation. Proxy indicators are suggested, in order to maximize strength of evidence in lower cost assessments of Extension's effectiveness. Program evaluations may be relied upon to assist decisionmaking to the extent that they provide high-quality evidence of accomplishment of program objectives and identify Extension's extent of contribution to such accomplishments.