Self-
evaluation

At design, the Development Effectiveness Matrix (DEM+) is used to review and enhance evaluability at entry. To this purpose, the operation’s theory of change and logical framework are reviewed, including impact, outcome and output indicators, together with their baseline and target values.
During implementation, project teams prepare the annual Supervision Report by describing progress achieved and identifying the main challenges encountered during execution. They also update progress data against logframe indicators and targets, and rate project performance according to a set of pre-defined criteria.
At the end of the operation execution period, the Project Completion Report (PCR) is prepared. Through the PCR, project teams (or under previous practice, government actors/the PMU) rate the operation development effectiveness according to the standard OECD-DAC criteria, as well as additional ones in line with IFAD strategies, including: rural poverty impact, environment and natural resource management, climate change adaptation and gender equality.
In addition, IFAD conducts rigorous impact assessments on approximately 15% of the project portfolio. Impact assessments are used in a meta-analysis and aggregation exercise to extrapolate results to the overall portfolio and to measure attributable impact at the corporate level.
The descriptors for rating for the different dimensions in the DEM+ are the following:
A broad pattern of serious deficiencies or unrealism make achievement of the stated Development Objectives unlikely, or pose serious issues of non-compliance with IFAD policies and procedures. Risks far outweigh potential rewards.
Significant deficiencies in several key areas need corrections that are likely to be difficult or time-consuming to resolve. Delay further processing until real progress is made.
Significant deficiencies in one or two key areas, which affect responsiveness to the client’s needs and/or may affect prospects of reaching stated Development Objectives, or compliance with IFAD policies and procedures.
Satisfactory on all key areas, but some deficiencies and missed opportunities to respond effectively to the client’s needs: additional work is needed to increase prospects of reaching stated Development Objectives, or to comply more fully with IFAD’s policies and procedures.
Satisfactory or better on all key areas – an effective response to the clients’ needs and likely to meet the stated Development Objectives.
An exemplary project design demonstrating good practice in several areas, which responds very well to the client’s needs and has a high probability of meeting the stated Development Objectives.
The DEM+ is organized around four main high-level review areas (project approach, technical aspects, compliance and operational aspects) and 20 related specific sub-sections. This section defines the various dimensions.
Performance indicators are an integral part of all supervision reports and must be submitted for all IFAD projects that have been under implementation for more than six months. Performance indicators on project performance have been grouped into four areas: (i) Development Effectiveness and Developmental Focus; (ii) Sustainability and Scaling-up; (iii) Project Management; and (iv) Financial Management and Execution. Within the four areas are 28 indicators.
While each individual indicator utilizes different criteria, all ratings of project performance criteria follow the same general rating system below:
Targets/requirements met or exceeded. Considered as best practice.
Targets/requirements met with only minor delays or setbacks.
Most targets/requirements met but delays or setbacks experienced.
Some targets/requirements met but issues/constraints have negatively affected implementation.
Few targets/requirements met. Issues/constraints remain unresolved. Delays have seriously undermined implementation.
Almost no targets/requirements met. Consideration should be given to cancellation/suspension.
The project completion review is a process undertaken by the Borrower in close coordination with IFAD at the end of the project implementation cycle in order to report on the results achieved through the project interventions. The purpose of the completion review process is to promote accountability, reflect on performance and elicit lessons learned to inform new project design and to define an appropriate post-project strategy. These ratings are important inputs for the RIDE.
Performance indicators on project completion have been grouped into four areas: (i) Project Performance; (ii) Rural Poverty impact; (iii) Additional evaluation criteria; and (iv) Partners performance. Within the four areas are 19 indicators.
While each individual indicator utilizes different criteria, all ratings of project performance criteria follow the same general rating system below:
Targets/requirements met or exceeded. Considered as best practice.
Targets/requirements met with only minor delays or setbacks.
Most targets/requirements met but delays or setbacks experienced.
Some targets/requirements met but issues/constraints have negatively affected implementation.
Few targets/requirements met. Issues/constraints remain unresolved. Delays have seriously undermined implementation.
Almost no targets/ requirements met. Consideration should be given to cancellation/suspension.
IFAD is the only international financial institution that measures impact of its investments by systematically conducting impact assessments on a sample of about 15% of projects purposively selected among those that close during each replenishment period. Impact assessments are used in a meta-analysis and aggregation exercise to extrapolate results to the overall portfolio to measure impact at the corporate level.
These assessments help enhance capacities at IFAD and the country level to both manage for results and make better-informed decisions based on timely and reliable data and evidence. Impact assessments are also used for accountability, learning and as part of IFAD’s efforts to communicate its results.
To know more on the impact assessment methodology, please visit the IFAD Impact
Assessment Report 2019-2021.