 |
Welcome to EvalWeb!
To better analyze performance, USAID has initiated several key efforts to strengthen the evaluation capacity in the Agency. First, in June 2008, USAID organized two separate evaluation working groups, one internal and one Foreign Affairs Evaluation Working Group (teaming with the Department of State and the Department of Foreign Assistance [DFA]). Next, the Agency is collaborating with DFA to develop and implement a new distance learning course as well as instructor–led classes. Finally, the Agency is developing, (jointly with DFA and RM) new Standards and Guidelines for Evaluating Foreign Assistance and a new Evaluation Glossary.
In addition, the Agency is re-energizing its central evaluation function, as approved by the Administrator on July 25, 2008. Functional statements and position descriptions for the new evaluation division are being drafted, and the agency is planning a visible public “launch” of the new evaluation unit early in 2009. An initial agenda of studies for the central evaluation function is also being created.
What is an evaluation?
An evaluation is defined as a systematic and objective assessment of an on-going or completed project, program or policy. Evaluations are undertaken to: - improve the performance of existing interventions or policies,
- assess their effects and impacts,
- inform decisions about future programming
Evaluations are formal analytical endeavors involving systematic collection and analysis of qualitative and quantitative information. This definition includes any evaluation-like activity such as a review, assessment, study, etc. Please note that an evaluation can be either internal or external. — Definition from FY 2008 Performance Plan and Report Guidance
Evaluation is an analytical effort undertaken to answer specific program management questions and provides a systematic way to gain insights and reach conclusions about the effectiveness of specific activities, validity of a development hypothesis, utility of performance monitoring efforts, factors in the development context that may have an impact on the achievement of results, and the types of actions that need to be taken to improve performance (from ADS 203.3.6)
Why Evaluate?
USAID wants evaluations to be driven by a real need for information; information which management then uses to improve programs and policies. In addition, evaluations serve as a valuable tool through which international organizations learn and improve.
Evaluation answers the “why” or “why not” of performance, as well as the “what else” question. It is used on a periodic basis to identify the reasons for success or lack of it, to assess effects and impacts, or to indicate which, among a range of program or project/activity alternatives, is the most efficient and effective. It may also be used to draw lessons for future interventions (from ADS 203.3.2).
How to evaluate?
According to the Office of Management and Budget Circular A-136 OMB (pdf),
"… evaluations identified should have been performed with sufficient scope, quality, and independence as defined in guidance for the Program Assessment Rating Tool (PART). Pursuant to Executive Order 13450, the Performance Improvement Officer, or his or her representative, should determine whether evaluations meet PART criteria for scope, quality and independence. Although agencies may cite rigorous evaluations commissioned independently by organizations such as the Government Accountability Office, Office of the Inspector General, or other groups, these evaluations should not completely supplant rigorous evaluations commissioned by the agencies themselves."
Successful evaluations have four qualities:
- Making the decision to evaluate.
- The Scope of Work is well thought-out.
- The team is capable.
- The results are used.
Ten Steps to a Results-Based Monitoring and Evaluation System:
- Conducting a Readiness Assessment
- Agreeing on Outcomes to Monitor and Evaluate
- Selecting Key Indicators to Monitor Outcomes
- Baseline Data on Indicators – Where are we Today?
- Planning for Improvement – Selecting Results Targets
- Monitoring for Results
- Role of Evaluations
- Reporting Findings
- Using Findings
- Sustaining the M&E System within the Organisation
Source citation: Ten Steps to a Results-Based Monitoring and Evaluation System
(PDF)
Back
to Top ^ |
