Program evaluation models and related theories amee guide. Cipp evaluation model developed by stufflebeam and shinkfield in 1985. We recognize this as a simple systems model the connection of interdependent parts that together make up the whole\it is a\. Developing and implementing such an evaluation system has many benefits including helping you to. Types of evaluation centers for disease control and. Program evaluation some myths about program evaluation. Program evaluation can include any or a variety of at least 35 different types of evaluation, such as for needs assessments, accreditation, costbenefit analysis, effectiveness, efficiency, formative, summative, goal. The systematic and objective assessment of an ongoing or completed project or programme, its design, implementation and results. An evaluation framework for community health programs can be used by communitybased organizations and community health workers to enhance their understanding of evaluation and to build their capacity to more actively and aggressively participate in evaluation efforts of their programs. Additional resources developing evaluation questions. Dms 53855 programdevelopment evaluation model fact sheet1.
At the end of the process, a specific programme logic model and associated implementation plan should be written for every public health programme. The research regarding programs and project evaluation models developed. There are many types of logic model which can be used in planning programmes and implementing activities. The evaluation results may contribute to the modification or formation of the curriculum for example, results of formative evaluation may help in 1. Understanding different types of program evaluation brad. Two of the approaches, reflecting the political realities of evaluation, are often used illegitimately to falsely characterize a program s value and are labeled pseudo. Curriculum evaluation should be cyclic, but not linear. One purpose of conducting a theorybased evaluation is to test the model hypothesized to explain the program and. Once youve determined which program activities in your logic model should be.
Example of logic models use in evaluation planning. An evaluation is a purposeful, systematic, and careful collection and analysis of information used for the purpose of documenting the effectiveness and impact of programs, establishing. Table 2 considerations in developing credible evaluations. In this article, well explore kirkpatricks model and how to apply it. Types of evaluation once youve determined which program activities in your logic model should be evaluated, you can begin to identify the types of evaluation you can conduct. These approaches, in varying degrees, are unique and cover most program evaluation efforts. The cipp model is a social systems model applied to program evaluation. Using programme theory to evaluate 31 this distinction seemed to provide a particularly useful orienting framework for evaluation patton, 2003 and has obvious implications for programme theory evaluation. Logic models for program design, implementation, and evaluation. Project programme monitoring and evaluation guide 2.
The model described and recommended in this manual is based on the projectprogramme cycle, which depicts the management of an intervention through a sequence of inter. You design your program with evaluation in mind, collect data on an ongoing basis, and use these data to continuously improve your program. Jan 20, 2016 learning evaluation models you will find useful there are dozens of learning evaluation models currently in practice. Programme evaluation and strategic reporting a logic model presents programme information and progress towards goals in ways that inform programme stakeholders and advocate for a particular programme approach. Glynn sharpe nipissing university 100 college drive box 5002, north bay, ontario. Outcomeeffectiveness evaluation measures program effects in the target. Curriculum evaluation is shaped with the questions of an evaluation specialist, and the philosophy taken as a basis has an immediate effect on the evaluation doll. All human service programs are designed to make a difference in the lives of people or to. Educational evaluation models were not developed with education theories in mind. Context evaluation input evaluation process evaluation product evaluation these components are or can be viewed as separate forms of evaluation, but they can also be viewed as steps or stages in a comprehensive evaluation. This logic model workshop toolkit is designed to help practitioners learn the overall purpose of a logic model, the different elements of a logic model. Logic models reveal the relationships among program resources, activities, outputs, and short, mid, and longterm outcomes. Logic models and program evaluation edward monaghan, ome preeti choudhary, ome.
Rr11 overview of the framework cdc pdf provides 3page key points from framework. Logic models can be useful planning tools during this phase. Evaluation literally means the assessment of value or worth. It helps identify what is necessary to achieve desired outcomes in a planning mode and serves to. The assessment of the evaluation model metaevaluation is a critical step in evaluation, as it is at the basis of a successful program project evaluation. Programme operations, unicef, new york, revised may 2003, pp.
Models of program evaluation many evaluation models were developed in the 1970s and 1980s. Evaluation modelsabstract western michigan university. Programme managers training course for ntds targeted for control or elimination by preventive chemotherapy interventions module 6. The relationships among program components are usually represented in a logic model by arrows that show. References to program evaluation methods frequently include the phrase qualitative and quantitative methods, as if the mention of one method demands the inclusion of the other. Many people believe evaluation is a useless activity that generates lots of boring data with useless conclusions.
The aim is to determine the relevanc e and fulfillment of objectives, development efficiency. Evaluation models 11 program evaluation defined in characterizing and assessing evaluation approaches, the various kinds of activities conducted in the name of program evaluation were classified on. Program theory and logic models evaluation resources from wilder research. Using programme theory to evaluate complicated and. Using programme theory to evaluate complicated and complex. Making evaluation an integral part of your program means evaluation is a part of everything you do. Evaluation planning ll 73737373 using your logic model to plan for evaluation t hinking through program evaluation questions in terms of the logic model components you have developed can provide the framework for your evaluation plan. Typically, program evaluations are used to measure progress in achieving obje prove program implementation, provide accountability information to stakeholders. Stufflebeams ipp evaluation model defining evaluation. Program evaluation methods treasury board of canada. You can use it to objectively analyze the impact of training, to work out how well your team members learned, and to improve their learning in the future. Modification of programme elements summative evaluation at its conclusion. Many timehonored evaluation models remain available for that limited but important purpose.
Evaluation models for evaluating educational programs. The task is complicated by the many specific evaluation issues that may require attention, by the numerous methods that could be used to gather and examine information given the resources and time available, and by the need to ensure that all relevant issues are examined. Gfe, in program evaluation, is a model in which the official or stated program goals and objectives are withheld or screened from the evaluator. Models may not take unexpected consequences into account models may not account for conflict, power, control issues theory or model assumes the model is correct. Evaluation models 11 program evaluation defined in characterizing and assessing evaluation approaches, the various kinds of activities conducted in the name of program evaluation. At different points in your program cycle, you may need to use different types of evaluation designs. The mission of the office of migrant education is to provide excellent leadership, technical assistance, and financial support to improve the educational opportunities and academic success. The breadth of an evaluation will always be limited by the resources available, but note that a welldesigned, simple evaluation can be as powerful as a more complex and costly one. Purposes can range from a mechanical compliance with a funders reporting requirements, to the genuine desire by program managers and stakeholder to learn are we making a difference. What is evaluation use the program theory or logic model to come up with evaluation questions does the program have a positive outcome.
Evaluation is the systematic process of delineating, obtaining, reporting, and applying descriptive and. Generally all good training and development programmes start with identification of training and development needs and ends with evaluation of training gopal, 2009. It would simply mean the act of judging whether or not the activity to be evaluated is worthwhile in terms of set criteria. Know what a logic model is, and how it can be useful to your daily program operations identify the key components of a logic model. Any attempt to obtain information feedback on the effects of training programme. Using programme theory to evaluate 33 the remainder of the article presents and discusses examples of programme theory evaluations that address each of these issues through the type of logic model developed and how it was used for the evaluation. If you have the pills, then you can take the pills, if you take the pills, then headache will go away. Logic model a planning and evaluation tool page 6 of 11 larger, more complex programs can utilize a nested model to better manage program details. Glynn sharpe nipissing university 100 college drive box 5002, north bay, ontario canada abstract the paper explores and defines what program theory entails and when and why it is appropriate to develop a program theory. This paper reveals a new evaluation model, which enables educational program and project managers to evaluate their programs with a.
Also, beyond covering both creditable and noncreditable approaches, some authors of evaluation approaches say that the term model. Evaluation models values in studying alternative program evaluation approaches are to discover their strengths and weaknesses, decide. Formative evaluation ensures that a program or program activity is feasible, appropriate, and acceptable before it is fully implemented. Evaluation of training and development is the most essential aspect of training programme. Exploratory evaluation study designs can help you at the beginning of your program to. Evaluating and improving criminal justice training final report september 2007 submitted to national institute of justice prepared by kelly bradley edward connors institute for law and justice. The evaluation context is used to give a rational reason a selected program or curriculum to be. Program evaluation models and related theories unc school of. You can think of evaluation designs in three main categories.
A program evaluation is conducted every three to five years for our longterm community development programs, and every year to two years for our grantfunded projects, to measure change over time. Framework for program evaluation in public health cdc pdf mmwr 1999. Projectprogramme monitoring and evaluation guide 2. Evaluation measures the extent to which programs, processes, or tools achieve the. For many years evaluation experts focused on simply measuring program outcomes patton, 2011. We then focus on several commonly used program evaluation models in the context of those theoretical bases. Use program theory and logic models, but be flexible, and open to. Understanding different types of program evaluation program evaluations are conducted for a variety of reasons.
A generic programme logic model ministry of health. These models establish the evaluation purposes, strategies, activities, and the people that participate in the assessment process, as well as method choices, and roles and responsibilities of. Evaluating educational programs yael fisher achva academic college, telaviv 69121, israel abstract. The guide describes a generic programme logic model and checklist that are designed to guide people through the steps of developing a thorough public health programme. Models are linear, programs are complex, interactive models are static, programs may change over time. It links the intervention programme activities to programme goals and objectives.
This approach often generated extensive data from which very carefully. Methodology a threepart search was undertaken to explore how these issues had been ad. It concludes by propos ing a comprehensive and eclectic process that can be used to evaluate a field of study, which is perhaps the most difficult curricular element that evaluators face. Basic guide to program evaluation university of new mexico. This approach focuses on the degree to which the objectives of a program, product, or process have been achieved. On the two extremes, their design models, process, methods, and types of information may indeed differ. A logic model can also help maintain focus and accountability, reveal assumptions, guide and focus work, and supportcontinuous improvement.
Taba 1962 and varis 1996 particularly emphasize the interaction between the components of a curriculum. Figure 4 model of the effect of an excise tax 101 table 1 basic program evaluation issues 4 table 2 considerations in developing credible evaluations 22 table 3 example of descriptive statistics 84 table 4 further descriptive data 87 table 5 example of descriptive statistics 89. Theories that inform educational program evaluation models 4. Kirkpatricks fourlevel training evaluation model can help you to answer questions like these. There are several types of evaluations that can be. Chapter 12 curriculum evaluation sage publications. Using these types of evaluation can help your program deliver better results and have a greater impact, all while reducing costs. Program theory and logic models 1 wilder research, august 2009 wilder research.
There are several types of evaluations that can be conducted. Choose a program evaluation model that allows you to. However, the most commonly used is the context, input, process, output cipp evaluation models. The major question guiding this kind of evaluation is, is the program. Qualitative research methods in program evaluation. Major types of program evaluation evaluating program processes, goals, outcomes. Bdi logic models can also improve the evaluation of community programs and initiatives. This article provides a quick overview of 4 evaluation models youll find most useful. There are many models of evaluation that can be used to evaluate a program. Educators can be more confident when choosing an appropriate evaluation model if they first consider the models theoretical basis against their program s complexity and their own evaluation needs. Project and programme evaluations guidelines 1 evaluation. Program evaluation models and related theories 3 in this guide, we first briefly define program evaluation, discuss reasons for conducting educational program evaluation, and outline some theoretical bases for evaluation models.
Evaluation models and approaches the following models and approaches are frequently mentioned in the evaluation literature. Is the program working the way it was intended to work. This logic model workshop toolkit is designed to help practitioners learn the overall purpose of a logic model, the different elements of a logic model, and. The evaluation of simple interventions is intended to either develop or test the recipe that others can then follow. Educational program evaluation using cipp model neliti. Evaluation models have not always supported such a range of needs. Application of context input process and product model in. This was a problem with evaluations in the past when program evaluation methods were chosen largely on the basis of achieving complete scientific accuracy, reliability and. Logic models for program design, implementation, and. Years of experience helped us develop our program implementation model.
Models of curriculum evaluation university of kwazulunatal. An evaluation framework for community health programs. Evaluation models and approaches the monograph uses the term evaluation approach rather than evaluation model because the former is broad enough to cover illicit as well as laudatory practices. How to evaluate the programme world health organization. Basic guide to program evaluation including many additional.
Educators can be more confident when choosing an appropriate evaluation model if they first consider the model s theoretical basis against their programs complexity and their own evaluation needs. Introduction results framework the results framework is your ntdp roadmap. In 1980 when tom first began teaching a graduate level class in program evaluation, he asked the students to give him their perspective on why there is so much resistance to program evaluation of human service. Effective program evaluation is a carefully planned and systematic approach to. Training evaluation ensures that whether candidates are able to.
A logic model shows a series of linkages thatare expected to accomplish the program goals. The aim is to determine the relevanc e and fulfillment of objectives, development efficiency, effectiveness, impact and sustainability. Evaluating and improving criminal justice training final report september 2007 submitted to national institute of justice prepared by kelly bradley edward connors institute for. Although methodological diversity in evaluation is widely accepted, and even recommended by.
1194 451 434 451 1036 167 1462 1562 1588 1500 1407 60 384 797 814 1084 925 442 284 424 1186 353 1436 591 29 196 944 132 287 935 571