Annex 1
Review of Work Programme for 1998-9
The chart below details the variety of evaluations.
| Project
Evaluations |
Type |
Region |
Number |
| |
Mid-term |
Africa |
3 |
| |
|
Near East/North
Africa |
2 |
| |
Interim |
West &
Central Africa |
2 |
| |
|
Latin America
& Caribbean |
2 |
| |
Completion |
Asia |
3 |
| |
|
Africa |
3 |
| |
|
Latin America
& Caribbean |
1 |
| TAG |
|
Latin America
& Caribbean |
2 |
| Thematic
Studies |
|
|
8 |
| |
|
|
|
| Total Evaluations |
|
|
25 |
We finalised three thematic evaluations/studies on:
Small Island Developing States;
Marketing in Central America (to be finalised in January 2000); and
The IFAD/NGO Extended Co-operation Programme.
And completed the first phase of another two studies:
IFAD’s approach to Water Users Associations, and
Rainfed Agriculture in the Near East and North Africa Region.
We organised a number of workshops to discuss, validate and seek adoption
of evaluation results with stakeholders, and participated in various missions
and workshops to support the establishment of M&E mechanisms in projects.
In addition to that we provided support for the development of new terms
of reference and rules of procedures for the Evaluation Committee.
Annex 2
OE Work Programme 2000
| Area
of Work |
Identification
|
Start
Date |
Expected
Finish |
Responsible
Persons |
| 1. Evaluation
Work |
|
|
|
|
| 1.1 Thematic
E/S |
Assessment
of IFAD’s Performance on Promoting Replicable Innovations |
1/2000
|
12/2000
|
*
|
| |
Phase II
of Water Users Association: Participatory Irrigation |
7/2000
|
1/2001
|
*Rahman/ Pedersen
|
| |
Agricultural
Extension Interventions in West & Central Africa |
|
|
*Kingsbury/ Jatta
|
| |
Marketing
and Prices in Tanzania |
2/2000
|
6/2000
|
*/Faisal
|
| |
Community
Ownership of Food & Nutrition Security Intervention tools |
8/1999
|
6/2001
|
*
|
| |
Privatisation
of Project Services & Management in LAC |
10/2000
|
7/2001
|
*/Quijandría
|
| |
Rural Financial
Services in China |
3/2000
|
12/2000
|
*/Martens
|
| 1.2 Country
Programme Evaluations |
Syria |
1/2000
|
9/2000
|
*/Abdouli
|
| |
Papua New
Guinea |
2/2000
|
9/2000
|
*/Baldwin
|
| |
Vietnam |
3/2000
|
8/2000
|
*/Prayer
Galletti |
| 1.3 Project
Evaluations |
|
|
|
|
| 1.3.1 IEs |
Ghana: Rural
Enterprise Project |
7/2000
|
12/2000
|
*/Saint
Ange |
| |
Guinea: Smallholder
Developing the Forest Region |
6/2000
|
10/2000
|
*/Marzin
|
| |
Mauritania:
Maghama Improved Flood Recession Farming Project |
|
|
*/Ben
Senia |
| |
Uganda: Masindi
District Integrated Community Development Project |
1/2000
|
6/2000
|
*/Yayock- Lemmons
|
| |
Mozambique:
Nampula Artisanal Fisheries Project |
9/2000
|
2/2001
|
*/Heinemann
|
| |
Madagascar:
Upper Mandrare Basin Development |
|
|
*/David
e Silva |
| |
Mongolia:
Arhangai Rural Poverty Alleviation Project |
|
|
*/Martens
|
| |
El Salvador:
Rehabilitation and Development Project for War-torn Areas in the Department
of Chalantenango |
3/2000
|
10/2000
|
*/Vargas
Lundius |
| |
Honduras:
Agricultural Development Programme for the Western Region |
5/2000
|
12/2000
|
*/Murguia
|
|
Panama:
Ngobe Bugle Communities Rural Development Project |
9/2000
|
3/2001
|
*/
|
|
St.
Vincent & Grenadines: Smallholder Crop Improvement and Marketing
Project |
5/2000
|
11/2000
|
*/
Vargas Lundius |
| 1.3.2 Mid-term
Evaluations |
Jordan: Jordan
Agricultural Resource Management Project |
10/2000
|
12/2000
|
*/Abdouli
|
| 1.3.3 Completion
Evaluations |
Niger: Augie
Rural Development Project |
To
be determined |
12/2000
|
*/Manssouri
|
| |
India: Andhra
Pradesh Tribal Development Project |
7/2000
|
12/2000
|
*/Khadka
|
| 1.4 M&E
support |
PL/PREVAL
2 |
1/2000
|
12/2000
|
*/Bettink
|
| |
PI/Bangladesh |
|
|
|
| |
PI/India |
1/2000
|
4/2000
|
*/Khadka
|
| |
PI/Sri Lanka |
1/2000
|
4/2000
|
*/Baldwin
|
| |
PF/Tanzania-Mauritius |
3/2000
|
7/2000
|
*/Faisal
|
| 1.5 PDT/TRC/OSC |
(to be determined) |
|
|
|
| 2. Policy
& Strategy Dev. |
|
|
|
|
| 2.1 Reorganisation
of OE |
|
1/2000
|
2/2000
|
|
| 2.2 Dissemination
& Communication Strategy |
|
3/2000
|
6/2000
|
*
|
| 2.3 Developing
Strategic Direction identified in 1999 |
|
|
|
*
|
| |
COSOP Inputs |
3/2000
|
3/2000
|
*
|
| |
Improve EKSYST
|
3/2000
|
6/2000
|
*
|
| |
Knowledge
by the poor |
1/2000
|
3/2000
|
*
|
| 2.4 Follow
up on new Evaluation Products |
Communication
and discussion with PMD |
1/2000
|
12/2000
|
*
|
| 2.5 Work
Programme 2001 |
Mid-term
Review |
6/2000
|
6/2000
|
*
|
| |
Preparation
of WP 2001 |
11/2000
|
11/2000
|
*
|
| 3. Methodological
work |
Performance
Assessment |
10/1999
|
2/2000
|
*
|
| |
Participatory
Evaluation Study Phase I |
12/1999
|
11/2000
|
|
| |
M&E System
Support Study |
12/1999
|
3/2000
|
*
|
| |
PA/Guinea:
Village Communities Support Project |
2/2000
|
12/2001
|
*/Marzin
|
| |
PA/Mali:
Sahelian Area Development Fund Programme |
12/1999
|
12/2001
|
*/Jatta
|
* The responsible person(s) at OE will be determined in January within
the framework of OE reorganisation.
Annex 3
OE Work 2000 Programme Evaluations by Regions
PA (AFRICA I DIVISION)
| Type
of
Evaluation
Work
Required |
Country/
Name of
Project
(No.) |
Justific-
ation |
Desired/
Expected
Outcome |
Do
Partners
Know
of or
Agree? |
Period
You
Prefer |
| 1. Project Evaluations |
|
|
|
|
|
| Interim
Evaluation |
GHANA
/ Rural Enterprise Project (REP) (SRS-038-GH) |
PA
is considering a second phase of this project on a larger scale and
with emphasis on the most promising aspects. |
Lessons
and recommendations which answer the following questions: (i) Should
more emphasis be placed on micro-enterprises and income generating
activities at the village level, or should rural enterprise development
continue to promote peri-urban training and business advisory centres,
or should both be promoted? (ii) What are the operational tools
or approaches that favour maximum participation of poor rural women
in microenterprise development? (iii) What are the environmental
and occupational hazards of rural and microenterprise development?
(iv) Which institutional framework is more conducive to the further
development and diffusion of appropriate rural technologies?
|
|
First
Semester |
| |
GUINEA
/ Smallholder Dev. in the Forest Region (PDPEF, 313-GU) |
PA
considers that some activities carried out in the Project are promising
and should most likely be continued (FSAs, support to CBOs and women).
There is strong rationale for some kind of second phase of the PDPEF
and therefore for an IE. Moreover, there is a new issue emerging in
the Guinea Portfolio regarding the optimal complementarity between
area-
based projects (as the PDPEF) and the new country-wide programme in
support of decentralisation (PACV) co-financed with the WB (this issue
has regional relevance). |
Assessment
of PDPEF impact and sustainability. Recommendations for the design
of a new intervention in the forest region (taking into account
the now effective PACV programme). Lessons and recommendations on
the development of FSAs and CBOs in Guinea. |
Yes |
Sept. |
Interim
Evaluation
(cont.) |
MAURITANIA
/ Maghama Improved Flood Recession Farming Project (MR-318)
|
Flood
recession farming improvement appears as one of the most promising
agricultural development interventions in the Sahelian drylands.
In Maghama there is need for a second phase intervention, for the
"software" aspects (sustainable management of the scheme,
agricultural extension, institutional issues, etc.), therefore PA
requests an IE. In terms of knowledge generation, it will be particularly
interesting to assess the innovative participatory approach adopted
by the project for initial land-rights reallocation (which could
be replicated elsewhere in the country). |
Assessment
of the project approach, results and emerging impact. Analysis of
conditions for sustainability. Recommendations for the design of
a second phase (including on the institutional set-up). Lessons
on how to handle land-tenure issues in this type of intervention.
|
|
First
semester |
| Completion
Evaluation |
NIGER
/ Augié Rural Dev. Project (292-NG) |
PA
considers that this project yielded promising results in areas of
strategic importance for IFAD's intervention in Niger (natural resources
management and rainfed ag. development in dry land, CBOs development,
agriculture orientated micro-finance framework). The innovative and
positive interaction with the ICRAF TAG for agro-forestry research
could also be a replicable model. The objective of the CE would be
to assess and learn from these experiences in order to provide guidance
for future interventions in the country and elsewhere in the Sahel. |
An
assessment of project approaches, results and emerging impact. A
set of lessons and operational recommendations for future IFAD involvement
in support of natural resource management in the country.
|
|
Second
Semester |
| 2. CPE |
|
|
|
|
|
| 3.
TE/TS |
PA
region /Agricultural Extension interventions in West and Central
Africa |
PA
needs an assessment of past and present experience in this major area
of intervention as input to a (re) formulation of its strategy. There
has not been any serious in-house reflection on this issue for many
years. Other donors, including the World Bank, are in the process
of re-orienting their approach (from the T&V model to demand-led
privatised extension services). It is the right time to contribute
in the debate with our own poverty focus. |
A
documented assessment of past and present IFAD (and others’)
approaches to agricultural extension (particularly in marginal areas),
and inputs ‘lessons and recommendations’) in the formulation
of our strategy and policy dialogue with governments and the donors
community (including Neuchatel initiative). |
|
Should
start in 2000 |
| 4.
M&E Framework/ methodologies |
Guinea
/Village Communities Support Project (487-GN) |
OE
has already committed itself to support the M&E function in this
12-year, decentralisation support programme. There is a series of
other such programmes that IFAD is cofinancing with the World Bank
in the region (Ghana, Senegal and Burkina Faso). Hence this support
could have a multiplier effect. |
Methodological
support to the design of the M&E system for the Programme, including
the necessary bridges with the related IFAD-financed parallel pilot
initiative. |
Yes |
January |
| |
Mali/Sahelian
Areas Development Fund Programme (488-ML) |
SADEF
is a directly supervised/ innovative FLM programme. There has already
been an agreement on input from OE for the design and follow-up of
a participatory M&E system. |
1.An
efficient and participatory M&E system in the field facilitating
programme management and inter-phases decision making.
2. A replicable M&E
model for other FLMs in WCA region. |
Yes |
Starts
in Dec. 99 and could last as long as 2/3 years. Probably 1 or 2 missions
in 2000. |
| 5.
PDTs |
Selected
participation by Evaluators |
PF (AFRICA II DIVISION)
| Type
of
Evaluation
Work
Required |
Country/
Name of
Project
(No.) |
Justific-
ation |
Desired/
Expected
Outcome |
Do
Partners
Know
of or
Agree? |
Period
You
Prefer |
| 1. Project
Evaluations |
|
|
|
|
|
| Mid-term
Evaluation |
|
|
|
|
|
| Interim
Evaluation |
UGANDA
/ Masindi District Integrated Community Dev. Project (BSF-15) |
Sustainability
of community development in decentralised context/ Effectiveness
of community control mechanisms |
Contribution
to knowledge of operational issues in decentralisa-
tion in E. Africa/ Possible recommenda-
tion for 2nd stage. |
GOU
and BSF have requested |
First
quarter |
| |
MOZAMBIQUE
/ Nampula Artisanal Fisheries Project (334-MZ) |
Effectiveness
of community resource management (fisheries)/ importance of non-fishery
components for achieving impact |
Identification
of basic issues in income determination plus critical components
in order to develop more focused up-scaling of the project
|
No |
Third
Quarter |
| |
MADAGASCAR
/ Upper Mandrare Basin Development (376-MG) |
Viability
of smallholder infrastructure management and maintenance / impact
on food security and income. |
Input
into design of either a 2nd phase programme or a component
of a co-financed national programme. |
No |
Third
quarter |
Completion
Evaluation |
|
|
|
|
|
| 2. CPE |
|
|
|
|
|
| 3.
TE/TS |
TANZANIA
– Marketing and prices |
Study
the marketing and pricing components of projects and prevailing
environment. |
Recommenda-
tions and lessons learned, also to support the design of next project
in Tanzania, Commerc
-ialisation and Marketing. |
Yes |
Second
quarter |
| 4.
M&E Framework/ methodologies |
TANZANIA/
MAURITIUS |
Streamline
M&E systems, introduce participatory elements, final selection
of indicators, etc. |
Participatory
M&E systems operational, generating useful and essential data.
|
No |
First
quarter |
| 5.
PDTs |
Selected
participation by Evaluators |
PI (ASIA AND THE PACIFIC DIVISION)
| Type
of
Evaluation
Work
Required |
Country/
Name of
Project
(No.) |
Justific-
ation |
Desired/
Expected
Outcome |
Do
Partners
Know
of or
Agree? |
Period
You
Prefer |
| Interim
Evaluation |
MONGOLIA
/ Arhangai Rural Poverty Alleviation Project (412-MN) |
Assess
project approach, institutional set-up and financial services support.
|
Recommenda-
tions and lessons learned for preparing a second-phase project in
mid-2000. |
Yes |
Second
quarter |
Completion
Evaluation |
INDIA
/ Andhra Pradesh Tribal Development Project (282-IN) |
Deepen
IFAD’s understanding of the constraints and opportunities faced
in the advancement of tribal people in India. |
(i)
Assess sustainability of project-promoted activities; (ii) Was
empowerment of tribal people achieved? (iii) Validity of state institutional
set-up. |
Yes |
Second
quarter |
| 2.
CPE |
PAPUA
NEW GUINEA |
First
opportunity IFAD has to document its experience in the Pacific
|
(i)
Establish a repository of knowledge on the country for COSOP formulation;
(ii) draw lessons learned from the decentralized planning process.
|
Yes |
|
| CPR/E |
VIETNAM |
Need
for a country analysis to develop a new generation of area development
projects in the country. |
Lessons
learned and recommendations for a policy dialogue with the Gov.
for a revised COSOP. |
|
|
| 3.
TE/TS |
Indigenous
People |
To
understand better the opportunities, issues and constraints faced
by ethnic minorities and disadvantaged groups at a regional level,
as this is also a major current strategic thrust of the PI region.
|
Development
of lessons learned that could contribute to policy formulation that
would improve operations and activities focused on such groups.
|
|
|
4.
M&E Framework/ methodolo-
gies |
Development
of a consistent methodology on participatory M&E |
Lay
foundations for impact assessment of directly- supervised projects
in PI. |
Test
and adapt participatory M&E systems in three directly-supervised
projects (Bangladesh, India and Sri Lanka) |
Yes |
|
| 5.
PDTs |
Selected
participation by Evaluators |
PL (LATIN AMERICA AND THE CARIBBEAN DIVISION)
| Type
of
Evaluation
Work
Required |
Country/
Name of
Project
(No.) |
Justific-
ation |
Desired/
Expected
Outcome |
Do
Partners
Know
of or
Agree? |
Period
You
Prefer |
| 1. Project
Evaluations |
|
|
|
|
|
| Mid-term
Evaluation |
|
|
|
|
|
| Interim
Evaluation |
EL
SALVADOR / Rehabilitation and Dev. Project for War-torn Areas in the
Department of Chalatenango (PROCHALATE) – (322-SV) |
Need
to evaluate project performance, achievements, weaknesses, constraints
and potentialities. |
An
analytical (non/ descriptive) document which will lay the basis for
discussing a second IFAD intervention. |
Yes |
First
quarter |
| |
HONDURAS
/ Agricultural Development Programme for the Western Region (PLANDERO)
– (336-HN) |
To
analyse the role of the private sector in the provision of technical
services and financing. |
Lessons
learned to be introduced in our project in the country. |
Fully
agree |
April-May |
| |
PANAMA
/ Rural Development Project for Ngobe Communities (331-PA) |
To
evaluate the role of participation and decision making of the indigenous
communities. |
Proposed
a second phase |
Yes |
July-
August |
| |
ST
VINCENT & GRENADINES / Smallholder Crop Improvement and Marketing
Project (295-SG) |
Need
to evaluate project performance, achievements, weaknesses, constraints
and potentialities. |
An
analytical (non- descriptive) document which will lay the basis for
discussing a 2nd IFAD intervention. |
Not
discussed yet. |
Second
quarter |
Completion
Evaluation |
|
|
|
|
|
| 2. CPE |
|
|
|
|
|
| 3.
TE/TS |
Privatization
of project services and management |
All
IFAD loans/ projects since 1994 have been implemented through contracts
(providers of services). |
(a)
Assessment of this new way of implementa-
tion; (b) clarification of the role of the government and (c) pros
and cons of these arrangements. |
|
Last
quarter 2000/ First semester 2001 |
| 4.
M&E Framework/ Methodologies |
Consolidate
and define M&E guidelines and tools; co-manage PREVAL 2 with PL |
Need
to improve the design and implementation of projects’ M&E
systems |
M&E
systems in IFAD projects improved. Regional systematization of experiences
on M&E best practices. |
|
|
| 5.
PDTs |
Selected
participation by Evaluators |
PN (NEAR EAST AND NORTH AFRICA DIVISION)
| Type
of
Evaluation
Work
Required |
Country/
Name of
Project
(No.) |
Justific-
ation |
Desired/
Expected
Outcome |
Do
Partners
Know
of or
Agree? |
Period
You
Prefer |
| 1. Project
Evaluations |
|
|
|
|
|
| Mid-term
Evaluation |
JORDAN
/ Jordan Agricultural Resource Management Project (392-JO) |
The
project embodies an innovative design feature in the socio-economic
context of Jordan (Participatory Watershed Management). An in-depth
independent assessment is required at half term. The evaluation
will be expected to (i) assess whether the approach is effective
and has been adopted as a strategy for sustainability (ii) potential
for replicating this approach and (iii) beneficiaries assessment
of project effects and emerging impacts. |
Lessons
learned to be applied both for improving the implementation of this
project and for shaping the implementation strategy of the newly
approved 509-JO, Yarmouk Ag. Resource Project |
Yes.
The Co-operating institution will be invited to join the mission. |
Second
half |
| Interim
Evaluation |
|
|
|
|
|
| Completion
Evaluation
|
|
|
|
|
|
| 2.
CPE |
SYRIA
(in total 5 projects, 1 completed and 4 ongoing) |
PN
is planning a COSOP during the second half of 2000. Only one project
evaluation has been undertaken so far for Syria’s portfolio.
Little stock of lessons learned from evaluation is available for
the country. There is a need to assess approaches to poverty alleviation
in the rainfed areas and the Badia region as well as the changing
policy and institutional environment. |
Direct
input into the articulation of IFAD’s country strategy in Syria
based on assessment of approaches to poverty alleviation in the
rainfed areas and the Badia region as well as the changing policy
and institutional environment. |
Yes |
First
half |
| 3.
TE/TS |
Participatory
Irrigation Management – A sample of IFAD projects in Yemen,
Egypt, Albania, Armenia, Tunisia, Morocco, Lebanon. Part
of Phase II of OE’s Thematic Study on Water Users’ Association.
|
In
PN supported irrigation projects, the transfer of the responsibility
of the O&M of irrigation infrastructure to WUAs is increasingly
being used as a strong tool for sustainability. We have a major
knowledge gap as to what works, under what circumstances. The issues
involved are legal, organizational, governance, regulatory and financial.
|
Lessons
learned from successes and failures as a basis for policy formulation
and enhanced design. |
Yes |
June
2000/ Dec 2001 |
| 4. M&E
Framework/ Methodologies |
|
|
|
|
|
| 5.
PDTs |
Selected
participation by Evaluators |
Annex 4
Product Descriptions
Project Evaluations
We provide project level evaluations throughout the implementation cycle.
The varieties of evaluations all share the purpose of improving project
performance - currently and for the future.
Mid-term Evaluations
MTEs are undertaken at around the mid-life of project implementation,
when approximately 50% of the funds have been disbursed.
Interim Evaluation
IEs are compulsory steps before embarking on a second phase of a project
or launching a similar project in the same region. Their findings, conclusions
and recommendations are used as the basis for improving the design of
subsequent interventions.
Completion Evaluation
CEs are conducted after the finalisation of the project completion report
prepared by the Borrower or by the Co-operating Institution; generally
3 to 18 months after the project closing date.
Thematic Evaluation/Studies
TE/S are undertaken to provide building blocks for revisiting
existing or formulating new operational strategy and policy. TE/S are
also designed to assess the effectiveness of IFAD's processes and approaches,
as well as contribute to increasing the Fund's knowledge on specific issues
and subjects. Such evaluations/studies will not only build on the findings
of project evaluations, but also draw on a variety of external sources
and will be supplemented by further investigation. TE/S will be conducted
in close consultation with and agreement of our core partners, in particular
PMD.
Country Programme Evaluation-CPE
CPEs provide direct inputs for establishing effective COSOPs, which are
progressively becoming a more important instrument at IFAD. In particular,
CPEs are expected not only to assist in providing comparative information
on the most essential aspects of project performance, but also contribute
to developing strategic and operational orientation for IFAD's future
project pipeline in a given country. CPEs
will be focused and results-oriented, and conducted in a highly participatory
manner. A further objective of the CPE is to contribute elements to IFAD’s
policy dialogue on poverty alleviation, improve the implementation of
ongoing projects, and contribute to the generation of knowledge on the
country through the distilling of a series of lessons learned.
1/ This strategic work
has been summarised in the document "A New Approach to Evaluation".
2/ See the description
of the New Evaluation Process on page 3.
3/ There were though,
notable exceptions such as in the Western and Central Africa Division
(PA) and the Latin America and the Caribbean Division (PL), where the
evaluation work programme for the year was discussed between the two divisions.
