Annex 1

Review of Work Programme for 1998-9

The chart below details the variety of evaluations.

 

Project Evaluations	Type	Region	Number
	Mid-term	Africa	3
		Near East/North Africa	2
	Interim	West & Central Africa	2
		Latin America & Caribbean	2
	Completion	Asia	3
		Africa	3
		Latin America & Caribbean	1
TAG		Latin America & Caribbean	2
Thematic Studies			8
Total Evaluations			25

We finalised three thematic evaluations/studies on:

Small Island Developing States;

Marketing in Central America (to be finalised in January 2000); and

The IFAD/NGO Extended Co-operation Programme.

And completed the first phase of another two studies:

IFAD’s approach to Water Users Associations, and

Rainfed Agriculture in the Near East and North Africa Region.

We organised a number of workshops to discuss, validate and seek adoption of evaluation results with stakeholders, and participated in various missions and workshops to support the establishment of M&E mechanisms in projects. In addition to that we provided support for the development of new terms of reference and rules of procedures for the Evaluation Committee.

---

Annex 2

OE Work Programme 2000

Area of Work	Identification	Start Date	Expected Finish	Responsible Persons
1. Evaluation Work
1.1 Thematic E/S	Assessment of IFAD’s Performance on Promoting Replicable Innovations	1/2000	12/2000	*
	Phase II of Water Users Association: Participatory Irrigation	7/2000	1/2001	*Rahman/ Pedersen
	Agricultural Extension Interventions in West & Central Africa			*Kingsbury/ Jatta
	Marketing and Prices in Tanzania	2/2000	6/2000	*/Faisal
	Community Ownership of Food & Nutrition Security Intervention tools	8/1999	6/2001	*
	Privatisation of Project Services & Management in LAC	10/2000	7/2001	*/Quijandría
	Rural Financial Services in China	3/2000	12/2000	*/Martens
1.2 Country Programme Evaluations	Syria	1/2000	9/2000	*/Abdouli
	Papua New Guinea	2/2000	9/2000	*/Baldwin
	Vietnam	3/2000	8/2000	*/Prayer Galletti
1.3 Project Evaluations
1.3.1 IEs	Ghana: Rural Enterprise Project	7/2000	12/2000	*/Saint Ange
	Guinea: Smallholder Developing the Forest Region	6/2000	10/2000	*/Marzin
	Mauritania: Maghama Improved Flood Recession Farming Project			*/Ben Senia
	Uganda: Masindi District Integrated Community Development Project	1/2000	6/2000	*/Yayock- Lemmons
	Mozambique: Nampula Artisanal Fisheries Project	9/2000	2/2001	*/Heinemann
	Madagascar: Upper Mandrare Basin Development			*/David e Silva
	Mongolia: Arhangai Rural Poverty Alleviation Project			*/Martens
	El Salvador: Rehabilitation and Development Project for War-torn Areas in the Department of Chalantenango	3/2000	10/2000	*/Vargas Lundius
	Honduras: Agricultural Development Programme for the Western Region	5/2000	12/2000	*/Murguia
	Panama: Ngobe Bugle Communities Rural Development Project	9/2000	3/2001	*/
	St. Vincent & Grenadines: Smallholder Crop Improvement and Marketing Project	5/2000	11/2000	*/ Vargas Lundius
1.3.2 Mid-term Evaluations	Jordan: Jordan Agricultural Resource Management Project	10/2000	12/2000	*/Abdouli
1.3.3 Completion Evaluations	Niger: Augie Rural Development Project	To be determined	12/2000	*/Manssouri
	India: Andhra Pradesh Tribal Development Project	7/2000	12/2000	*/Khadka
1.4 M&E support	PL/PREVAL 2	1/2000	12/2000	*/Bettink
	PI/Bangladesh
	PI/India	1/2000	4/2000	*/Khadka
	PI/Sri Lanka	1/2000	4/2000	*/Baldwin
	PF/Tanzania-Mauritius	3/2000	7/2000	*/Faisal
1.5 PDT/TRC/OSC	(to be determined)
2. Policy & Strategy Dev.
2.1 Reorganisation of OE		1/2000	2/2000
2.2 Dissemination & Communication Strategy		3/2000	6/2000	*
2.3 Developing Strategic Direction identified in 1999				*
	COSOP Inputs	3/2000	3/2000	*
	Improve EKSYST	3/2000	6/2000	*
	Knowledge by the poor	1/2000	3/2000	*
2.4 Follow up on new Evaluation Products	Communication and discussion with PMD	1/2000	12/2000	*
2.5 Work Programme 2001	Mid-term Review	6/2000	6/2000	*
	Preparation of WP 2001	11/2000	11/2000	*
3. Methodological work	Performance Assessment	10/1999	2/2000	*
	Participatory Evaluation Study Phase I	12/1999	11/2000
	M&E System Support Study	12/1999	3/2000	*
	PA/Guinea: Village Communities Support Project	2/2000	12/2001	*/Marzin
	PA/Mali: Sahelian Area Development Fund Programme	12/1999	12/2001	*/Jatta

* The responsible person(s) at OE will be determined in January within the framework of OE reorganisation.

---

Annex 3

OE Work 2000 Programme Evaluations by Regions

PA (AFRICA I DIVISION)

Type of Evaluation Work Required	Country/ Name of Project (No.)	Justific- ation	Desired/ Expected Outcome	Do Partners Know of or Agree?	Period You Prefer
1. Project Evaluations
Interim Evaluation	GHANA / Rural Enterprise Project (REP) (SRS-038-GH)	PA is considering a second phase of this project on a larger scale and with emphasis on the most promising aspects.	Lessons and recommendations which answer the following questions: (i) Should more emphasis be placed on micro-enterprises and income generating activities at the village level, or should rural enterprise development continue to promote peri-urban training and business advisory centres, or should both be promoted? (ii) What are the operational tools or approaches that favour maximum participation of poor rural women in microenterprise development? (iii) What are the environmental and occupational hazards of rural and microenterprise development? (iv) Which institutional framework is more conducive to the further development and diffusion of appropriate rural technologies?		First Semester
	GUINEA / Smallholder Dev. in the Forest Region (PDPEF, 313-GU)	PA considers that some activities carried out in the Project are promising and should most likely be continued (FSAs, support to CBOs and women). There is strong rationale for some kind of second phase of the PDPEF and therefore for an IE. Moreover, there is a new issue emerging in the Guinea Portfolio regarding the optimal complementarity between area- based projects (as the PDPEF) and the new country-wide programme in support of decentralisation (PACV) co-financed with the WB (this issue has regional relevance).	Assessment of PDPEF impact and sustainability. Recommendations for the design of a new intervention in the forest region (taking into account the now effective PACV programme). Lessons and recommendations on the development of FSAs and CBOs in Guinea.	Yes	Sept.
Interim Evaluation (cont.)	MAURITANIA / Maghama Improved Flood Recession Farming Project (MR-318)	Flood recession farming improvement appears as one of the most promising agricultural development interventions in the Sahelian drylands. In Maghama there is need for a second phase intervention, for the "software" aspects (sustainable management of the scheme, agricultural extension, institutional issues, etc.), therefore PA requests an IE. In terms of knowledge generation, it will be particularly interesting to assess the innovative participatory approach adopted by the project for initial land-rights reallocation (which could be replicated elsewhere in the country).	Assessment of the project approach, results and emerging impact. Analysis of conditions for sustainability. Recommendations for the design of a second phase (including on the institutional set-up). Lessons on how to handle land-tenure issues in this type of intervention.		First semester
Completion Evaluation	NIGER / Augié Rural Dev. Project (292-NG)	PA considers that this project yielded promising results in areas of strategic importance for IFAD's intervention in Niger (natural resources management and rainfed ag. development in dry land, CBOs development, agriculture orientated micro-finance framework). The innovative and positive interaction with the ICRAF TAG for agro-forestry research could also be a replicable model. The objective of the CE would be to assess and learn from these experiences in order to provide guidance for future interventions in the country and elsewhere in the Sahel.	An assessment of project approaches, results and emerging impact. A set of lessons and operational recommendations for future IFAD involvement in support of natural resource management in the country.		Second Semester
2. CPE
3. TE/TS	PA region /Agricultural Extension interventions in West and Central Africa	PA needs an assessment of past and present experience in this major area of intervention as input to a (re) formulation of its strategy. There has not been any serious in-house reflection on this issue for many years. Other donors, including the World Bank, are in the process of re-orienting their approach (from the T&V model to demand-led privatised extension services). It is the right time to contribute in the debate with our own poverty focus.	A documented assessment of past and present IFAD (and others’) approaches to agricultural extension (particularly in marginal areas), and inputs ‘lessons and recommendations’) in the formulation of our strategy and policy dialogue with governments and the donors community (including Neuchatel initiative).		Should start in 2000
4. M&E Framework/ methodologies	Guinea /Village Communities Support Project (487-GN)	OE has already committed itself to support the M&E function in this 12-year, decentralisation support programme. There is a series of other such programmes that IFAD is cofinancing with the World Bank in the region (Ghana, Senegal and Burkina Faso). Hence this support could have a multiplier effect.	Methodological support to the design of the M&E system for the Programme, including the necessary bridges with the related IFAD-financed parallel pilot initiative.	Yes	January
	Mali/Sahelian Areas Development Fund Programme (488-ML)	SADEF is a directly supervised/ innovative FLM programme. There has already been an agreement on input from OE for the design and follow-up of a participatory M&E system.	1.An efficient and participatory M&E system in the field facilitating programme management and inter-phases decision making. 2. A replicable M&E model for other FLMs in WCA region.	Yes	Starts in Dec. 99 and could last as long as 2/3 years. Probably 1 or 2 missions in 2000.
5. PDTs	Selected participation by Evaluators

 

PF (AFRICA II DIVISION)

Type of Evaluation Work Required	Country/ Name of Project (No.)	Justific- ation	Desired/ Expected Outcome	Do Partners Know of or Agree?	Period You Prefer
1. Project Evaluations
Mid-term Evaluation
Interim Evaluation	UGANDA / Masindi District Integrated Community Dev. Project (BSF-15)	Sustainability of community development in decentralised context/ Effectiveness of community control mechanisms	Contribution to knowledge of operational issues in decentralisa- tion in E. Africa/ Possible recommenda- tion for 2nd stage.	GOU and BSF have requested	First quarter
	MOZAMBIQUE / Nampula Artisanal Fisheries Project (334-MZ)	Effectiveness of community resource management (fisheries)/ importance of non-fishery components for achieving impact	Identification of basic issues in income determination plus critical components in order to develop more focused up-scaling of the project	No	Third Quarter
	MADAGASCAR / Upper Mandrare Basin Development (376-MG)	Viability of smallholder infrastructure management and maintenance / impact on food security and income.	Input into design of either a 2nd phase programme or a component of a co-financed national programme.	No	Third quarter
Completion Evaluation
2. CPE
3. TE/TS	TANZANIA – Marketing and prices	Study the marketing and pricing components of projects and prevailing environment.	Recommenda- tions and lessons learned, also to support the design of next project in Tanzania, Commerc -ialisation and Marketing.	Yes	Second quarter
4. M&E Framework/ methodologies	TANZANIA/ MAURITIUS	Streamline M&E systems, introduce participatory elements, final selection of indicators, etc.	Participatory M&E systems operational, generating useful and essential data.	No	First quarter
5. PDTs	Selected participation by Evaluators

 

PI (ASIA AND THE PACIFIC DIVISION)

Type of Evaluation Work Required	Country/ Name of Project (No.)	Justific- ation	Desired/ Expected Outcome	Do Partners Know of or Agree?	Period You Prefer
Interim Evaluation	MONGOLIA / Arhangai Rural Poverty Alleviation Project (412-MN)	Assess project approach, institutional set-up and financial services support.	Recommenda- tions and lessons learned for preparing a second-phase project in mid-2000.	Yes	Second quarter
Completion Evaluation	INDIA / Andhra Pradesh Tribal Development Project (282-IN)	Deepen IFAD’s understanding of the constraints and opportunities faced in the advancement of tribal people in India.	(i) Assess sustainability of project-promoted activities; (ii) Was empowerment of tribal people achieved? (iii) Validity of state institutional set-up.	Yes	Second quarter
2. CPE	PAPUA NEW GUINEA	First opportunity IFAD has to document its experience in the Pacific	(i) Establish a repository of knowledge on the country for COSOP formulation; (ii) draw lessons learned from the decentralized planning process.	Yes
CPR/E	VIETNAM	Need for a country analysis to develop a new generation of area development projects in the country.	Lessons learned and recommendations for a policy dialogue with the Gov. for a revised COSOP.
3. TE/TS	Indigenous People	To understand better the opportunities, issues and constraints faced by ethnic minorities and disadvantaged groups at a regional level, as this is also a major current strategic thrust of the PI region.	Development of lessons learned that could contribute to policy formulation that would improve operations and activities focused on such groups.
4. M&E Framework/ methodolo- gies	Development of a consistent methodology on participatory M&E	Lay foundations for impact assessment of directly- supervised projects in PI.	Test and adapt participatory M&E systems in three directly-supervised projects (Bangladesh, India and Sri Lanka)	Yes
5. PDTs	Selected participation by Evaluators

 

PL (LATIN AMERICA AND THE CARIBBEAN DIVISION)

Type of Evaluation Work Required	Country/ Name of Project (No.)	Justific- ation	Desired/ Expected Outcome	Do Partners Know of or Agree?	Period You Prefer
1. Project Evaluations
Mid-term Evaluation
Interim Evaluation	EL SALVADOR / Rehabilitation and Dev. Project for War-torn Areas in the Department of Chalatenango (PROCHALATE) – (322-SV)	Need to evaluate project performance, achievements, weaknesses, constraints and potentialities.	An analytical (non/ descriptive) document which will lay the basis for discussing a second IFAD intervention.	Yes	First quarter
	HONDURAS / Agricultural Development Programme for the Western Region (PLANDERO) – (336-HN)	To analyse the role of the private sector in the provision of technical services and financing.	Lessons learned to be introduced in our project in the country.	Fully agree	April-May
	PANAMA / Rural Development Project for Ngobe Communities (331-PA)	To evaluate the role of participation and decision making of the indigenous communities.	Proposed a second phase	Yes	July- August
	ST VINCENT & GRENADINES / Smallholder Crop Improvement and Marketing Project (295-SG)	Need to evaluate project performance, achievements, weaknesses, constraints and potentialities.	An analytical (non- descriptive) document which will lay the basis for discussing a 2nd IFAD intervention.	Not discussed yet.	Second quarter
Completion Evaluation
2. CPE
3. TE/TS	Privatization of project services and management	All IFAD loans/ projects since 1994 have been implemented through contracts (providers of services).	(a) Assessment of this new way of implementa- tion; (b) clarification of the role of the government and (c) pros and cons of these arrangements.		Last quarter 2000/ First semester 2001
4. M&E Framework/ Methodologies	Consolidate and define M&E guidelines and tools; co-manage PREVAL 2 with PL	Need to improve the design and implementation of projects’ M&E systems	M&E systems in IFAD projects improved. Regional systematization of experiences on M&E best practices.
5. PDTs	Selected participation by Evaluators

 

PN (NEAR EAST AND NORTH AFRICA DIVISION)

Type of Evaluation Work Required	Country/ Name of Project (No.)	Justific- ation	Desired/ Expected Outcome	Do Partners Know of or Agree?	Period You Prefer
1. Project Evaluations
Mid-term Evaluation	JORDAN / Jordan Agricultural Resource Management Project (392-JO)	The project embodies an innovative design feature in the socio-economic context of Jordan (Participatory Watershed Management). An in-depth independent assessment is required at half term. The evaluation will be expected to (i) assess whether the approach is effective and has been adopted as a strategy for sustainability (ii) potential for replicating this approach and (iii) beneficiaries assessment of project effects and emerging impacts.	Lessons learned to be applied both for improving the implementation of this project and for shaping the implementation strategy of the newly approved 509-JO, Yarmouk Ag. Resource Project	Yes. The Co-operating institution will be invited to join the mission.	Second half
Interim Evaluation
Completion Evaluation
2. CPE	SYRIA (in total 5 projects, 1 completed and 4 ongoing)	PN is planning a COSOP during the second half of 2000. Only one project evaluation has been undertaken so far for Syria’s portfolio. Little stock of lessons learned from evaluation is available for the country. There is a need to assess approaches to poverty alleviation in the rainfed areas and the Badia region as well as the changing policy and institutional environment.	Direct input into the articulation of IFAD’s country strategy in Syria based on assessment of approaches to poverty alleviation in the rainfed areas and the Badia region as well as the changing policy and institutional environment.	Yes	First half
3. TE/TS	Participatory Irrigation Management – A sample of IFAD projects in Yemen, Egypt, Albania, Armenia, Tunisia, Morocco, Lebanon. Part of Phase II of OE’s Thematic Study on Water Users’ Association.	In PN supported irrigation projects, the transfer of the responsibility of the O&M of irrigation infrastructure to WUAs is increasingly being used as a strong tool for sustainability. We have a major knowledge gap as to what works, under what circumstances. The issues involved are legal, organizational, governance, regulatory and financial.	Lessons learned from successes and failures as a basis for policy formulation and enhanced design.	Yes	June 2000/ Dec 2001
4. M&E Framework/ Methodologies
5. PDTs	Selected participation by Evaluators

---

Annex 4

Product Descriptions

Project Evaluations

We provide project level evaluations throughout the implementation cycle. The varieties of evaluations all share the purpose of improving project performance - currently and for the future.

Mid-term Evaluations

MTEs are undertaken at around the mid-life of project implementation, when approximately 50% of the funds have been disbursed.

Interim Evaluation

IEs are compulsory steps before embarking on a second phase of a project or launching a similar project in the same region. Their findings, conclusions and recommendations are used as the basis for improving the design of subsequent interventions.

Completion Evaluation

CEs are conducted after the finalisation of the project completion report prepared by the Borrower or by the Co-operating Institution; generally 3 to 18 months after the project closing date.

Thematic Evaluation/Studies

TE/S are undertaken to provide building blocks for revisiting existing or formulating new operational strategy and policy. TE/S are also designed to assess the effectiveness of IFAD's processes and approaches, as well as contribute to increasing the Fund's knowledge on specific issues and subjects. Such evaluations/studies will not only build on the findings of project evaluations, but also draw on a variety of external sources and will be supplemented by further investigation. TE/S will be conducted in close consultation with and agreement of our core partners, in particular PMD.

Country Programme Evaluation-CPE

CPEs provide direct inputs for establishing effective COSOPs, which are progressively becoming a more important instrument at IFAD. In particular, CPEs are expected not only to assist in providing comparative information on the most essential aspects of project performance, but also contribute to developing strategic and operational orientation for IFAD's future project pipeline in a given country. CPEs will be focused and results-oriented, and conducted in a highly participatory manner. A further objective of the CPE is to contribute elements to IFAD’s policy dialogue on poverty alleviation, improve the implementation of ongoing projects, and contribute to the generation of knowledge on the country through the distilling of a series of lessons learned.

---

1/ This strategic work has been summarised in the document "A New Approach to Evaluation".

2/ See the description of the New Evaluation Process on page 3.

3/ There were though, notable exceptions such as in the Western and Central Africa Division (PA) and the Latin America and the Caribbean Division (PL), where the evaluation work programme for the year was discussed between the two divisions.