Part One: Policy Framework for IFAD's Independent Evaluation The policy framework describes the purpose of independent evaluation
and its stakeholders, the evaluation principles and the operational policies
to be used by IFAD I. Purpose of Independent Evaluation and its Stakeholders A. Purpose and Role of Independent Evaluation in IFAD IFAD sees evaluation as an important contributor to its strategy for rural poverty reduction. The Strategic Framework for IFAD 2002-2006 identifies IFAD’s mission as enabling the rural poor to overcome their poverty. It elaborates on this, stating, “Poverty reduction is not something that governments, development institutions or non-governmental organizations can do for the poor. They can forge partnerships and help promote the conditions in which the poor can use their own skills and talents to work their way out of poverty.” IFAD’s catalytic role in poverty reduction is also of great importance, as reflected in the emphasis the framework gives to advocacy, policy dialogue, learning and the dissemination of knowledge. Independent evaluation contributes to IFAD’s strategy by bringing an independent perspective to the assessment of progress in relation to IFAD’s mission and catalytic role, and contributing feedback for learning. The main purpose of the independent evaluation function at IFAD is to promote accountability and learning in order to improve the performance of the Fund’s operations and policies. Evaluations provide a basis for accountability by assessing the impact of IFAD-supported operations and policies. They are expected to give an accurate analysis of successes and shortcomings, i.e. “to tell it the way it is”. This feedback helps the Fund improve its performance. Accountability is thus a key step in a learning process that, if followed through in partnership with those who are being evaluated, deepens IFAD’s and its partners’ understanding of the causes of and solutions to rural poverty. IFAD uses this knowledge to develop better pro-poor instruments and policies to enable the rural poor to empower themselves and overcome their poverty. IFAD’s evaluation approach reflects and is harmonized with internationally accepted evaluation norms and principles.1 It also takes into account the specific features that make IFAD different from most other development agencies, in particular, the evolving but not yet fully effective system of self-assessment of IFAD operations and IFAD-supported projects, the absence of a field presence and the limited resources available for project supervision and learning from operations. This defining logic has various implications for the independent evaluation function at IFAD. In particular, and perhaps more so than central evaluation offices elsewhere, OE must ground its evaluation in extensive fieldwork and generate much of the evaluation-based knowledge that IFAD requires to learn from past operational experiences. Furthermore, OE provides guidelines and technical inputs for enhancing the capacity of IFAD operational units and IFAD-assisted projects to undertake self-assessment. These inputs are rendered through evaluation of the self-assessment system and through technical advice aimed at improving the system. In relation to the latter, OE, together with other partners in and outside IFAD, has developed A Guide for Project Monitoring and Evaluation: Managing for Impact in Rural Development and provides assistance in customizing this for different regions and countries. B. Evolution of the Evaluation Function at IFAD IFAD established an evaluation function shortly after it began operations in 1978. At that time, however, evaluation was combined with monitoring as part of the Monitoring and Evaluation Division, which reported to the Assistant President, Economic Policy Department. In 1994, as a result of recommendations made by the rapid external assessment of IFAD during the negotiation of the Fourth Replenishment of IFAD’s Resources, the evaluation function was separated from monitoring and a unit independent of operations, called the Office of Evaluation and Studies, was established. The Director of OE started reporting directly to the President, and OE was then incorporated into the Office of the President.2 In accordance with the evaluation policy proposed in this document, OE will now operate as an IFAD organizational unit that is independent of IFAD management in the conduct of the evaluations that it undertakes.3 The OE Director will be directly responsible to the Executive Board, who will oversee OE’s work. The Executive Board has established its own Evaluation Committee to assist it in considering evaluation issues. Furthermore, OE will be renamed the Office of Evaluation.4
II. Evaluation Principles and Operational Policies In accordance with the proposed evaluation policy, the evaluation function at IFAD will operate in line with internationally accepted principles for the evaluation of development assistance. Foremost among these is the principle that the evaluation process should be impartial and independent from both the policy-making process and the delivery and management of development assistance. Independence is best achieved where evaluation activities are independent from managers who have an interest in showing accomplishment and good performance, or any other decision-makers for whom evaluation raises a conflict of interest. This means that the evaluation function should be separate from and not report to IFAD’s management, which is responsible for planning and managing development assistance. A separate budget for evaluation is another important dimension of independence. In this connection, a review of development agencies’ procedures by the Organisation for Economic Co-Operation and Development/Development Assistance Committee (OECD/DAC)5 notes, “Access to, and control over, financial resources and evaluation programming is an important sign of independence.” The evaluation budget is closely related to the work programme; and authority to select projects, programmes and policies for evaluation and formulate the work programme is also a key measure of independence. Authority to select evaluators and consultants, formulate and approve their TORs and manage the human resources employed in evaluation is also important as these factors affect the independence of the process and the results of evaluation. So too is the authority to revise and finalize reports after discussion with the relevant partners. The operational policies and procedures set down in this document incorporate all of these aspects of independence:
IFAD recognizes that a main purpose of evaluation is to provide a basis for accountability, including the disclosure and dissemination of information to the public. Accountability in this context refers to the assessment of developmental results, the impact of development assistance and the performance of the parties involved. This is different from accountability for the use of public funds in financial and legal terms, usually the responsibility of auditors and legal specialists. IFAD considers accountability as a necessary first step in the learning process. Systematic independent evaluation of completed projects and past and ongoing policies and strategies is indispensable if IFAD is to learn from its experience, both positive and negative, and improve its future effectiveness. Accountability through evaluation analysis requires a rigorous methodology for the assessment of developmental results and impacts and the performance of the partners concerned. It also requires that successes, unexpected results, shortcomings and failures highlighted during the evaluation be disclosed to relevant stakeholders and the general public without interference from any vested interest. Moreover, the accountability of an international development organization
as a whole is facilitated if the results of individual evaluations can
be aggregated and consolidated at the organizational level. This allows
a better analysis of the effectiveness of a given development organization
and of the cross-cutting issues that impinge on its overall performance.
Establishing a constructive partnership between OE and other relevant stakeholders is essential both for generating evaluation recommendations and for ensuring their uptake and ownership. Fostering such partnership takes time and effort, and depends crucially on the attitude and behaviour of those conducting the evaluation. Meaningful partnership also requires, inter alia, that evaluations are perceived by stakeholders as being useful, well informed, relevant and timely, and are clearly and concisely presented. Given the value of partnership, OE intends to make respect for the partners whose performance it is called upon to evaluate a main starting point of its evaluation work. IFAD evaluation policies and instruments aim at the appropriate engagement of stakeholders in the evaluation process, while safeguarding the independent role of OE. OE remains, however, solely responsible for producing the evaluation report and its findings. In particular, the following existing policies and practices will retain their validity:
Establishing effective feedback loops from evaluation to policy-makers, operational staff and the general public is essential if evaluation lessons are to be learned. The recognition that feedback that stakeholders understand and find useful is a key output of evaluation has led OE to nurture partnerships with stakeholders to ensure that evaluation recommendations are adopted and lead to the required changes and performance improvements. OE recognizes, in particular, that often evaluation reports, by their very nature, cannot propose the kind of clear-cut operational recommendations that implementers need. Similarly, OE recognizes that evaluation results need to be communicated through user-friendly products. It will pursue this objective through the following existing policies:
While OE has a key role to play in generating and communicating evaluation lessons, responsibility for uptake and learning extends beyond OE and requires the commitment of IFAD management, the Executive Board and country stakeholders to follow up and act on lessons learned. In response to this need, IFAD will institute the following policies for establishing effective feedback loops:
1/ As set down in the Organisation for Economic Co-operation and Development (OECD)/Development Assistance Committee (DAC), Principles for Evaluation of Development Assistance, OECD, Paris, 1998. 2/ Annex II summarizes the significant milestones associated with the evaluation function at IFAD. 3/ Operational arrangements required for ensuring the independence of OE from IFAD management will be given effect through a bulletin issued by the President of IFAD after the Executive Board decision on a new policy and as required by such a policy. 4/ It is proposed that the words “and Studies” be dropped from the name of the Office in order to describe more accurately OE’s core business and bring its name in line with the evaluation offices of other international financial institutions. 5/ OECD/DAC, Review by DAC Principles for Evaluation of Development Assistance, OECD, Paris, 1998, page 24. 6/ In the event that IFAD operations do not meet the requirements to include an interim evaluation in OE’s work programme, then it is the responsibility of IFAD’s management to provide the necessary justification to the Board. |
 |
 |
 |