|
|
|
3.1
An Overview of Linking Project Design, Annual Planning and M&E
When you "manage for impact", project design,
annual planning and M&E become linked processes. Your starting point
for implementation is the initial project design as outlined in the
project appraisal report. But design is an ongoing process for the life
of the project. Continually adapting the project strategy in response
to new understanding and to changing contexts is key in maximising impact
on rural poverty. So, good project design is as important for managers
and M&E staff as for the initial design team.
Key aspects of a project’s design are built into the project
loan agreement. Changing these can be difficult and time consuming.
Thus it is critical that the initial design be as high quality as possible.
In addition, the initial design team must build in flexibility to allow
changes at project start-up when the design is revised. The PROCHALATE
project in El Salvador learned the importance of rethinking the design
the hard way. Staff there estimate that they could have prevented the
loss of two years at the beginning if implementers had had better understanding.
3.1.1 Project Design as an Ongoing
Process
Why is change to the project design necessary? First,
many projects start up to several years after initial design, during
which the context will have changed. The project cycle (see Section
1.4) includes the many steps that lead to start-up, each of which takes
time. Second, the initial design of IFAD-supported projects is undertaken
with limited time and resources. Many of the implementing partners will
not have been identified and so there will have been limited participation
in the process. This means that a comprehensive participatory process
of reviewing and, where necessary, improving project design is critical
at start-up. After start-up, the two main opportunities for improving
the project design are: (1) on an annual basis as part of the annual
progress review and planning process and (2) during the mid-term review
(MTR). Table 3-1 lists the design and adaptation
tasks during the project’s lifetime, showing how (re-) design is ongoing.
Table 3-1. Design and adaptation
tasks at key moments during the project lifetime
| Moment in
Project Life |
Design Tasks
|
| Initial design phase |
- Assess feasibility, scope and
rationale of project.
- Determine the goal and objectives.
- Outline main project outputs and key activities.
- Outline project implementation process and structures.
- Outline the M&E system.
- Develop the budget and specify staffing levels. |
| Start-up phase |
- Develop understanding of project
goals and objectives with key stakeholders.
- Review and revise the initial design.
- Design and plan work in sufficient detail to allow for implementation.
- Develop a detailed operational M&E system. |
| Annual review of the
work plan and budget |
- Check if the outputs,
purpose-level objectives and goal remain relevant; adjust.
- Decide what activities and tasks are necessary to deliver
outputs. |
| Supervision (recurrent)
|
- Discuss overall progress
of the project.
- Decide on changes that should be made in the annual
work plan.
- Assess any potential changes in the overall design
that require loan agreement negotiations. |
| End of the early implementation
phase |
- Review overall project strategy
in light of early implementation experience.
- Develop recommendations for the work plan in the next
phase.
- Negotiate any significant changes to project design
for the next phase. |
| Mid-term review (or
reviews between phases if the project has a flexible lending
mechanism) |
- Review achievement
of outputs and progress towards the purpose(s) and goal.
- Assess appropriateness of the overall strategy.
- Redesign the project as necessary. |
| Beginning of the phase-out period
|
- Identify the priorities of final
activities in order to maximise impact.
- Review and adjust strategies with a view to sustained
impact. |
3.1.2 Good Practices for Project Design
There are six good practices in any design process of
a development intervention. They are critical during formulation and
start-up and when any revision of the project is undertaken, such as
during annual and mid-term reviews.
1. Involve all relevant stakeholders in participatory processes of project
design.
2. Undertake a thorough situation analysis, together with primary stakeholders,
to learn as much as possible about the project context as a basis for
designing a project strategy and implementation processes that are relevant.
3. Develop a logical and feasible project strategy that clearly expresses
what will be achieved (goal and purposes) and how it will be achieved
(outputs and activities).
4. Agree and fous on cross-cutting issues of poverty, gender and participation.
5. Plan for long-term capacity development and sustainability to ensure
that the project contributes to the empowerment and self-reliance of local
people and institutions.
6. Build in opportunities and activities that support learning and enable
adaptation of the project strategy during implementation.
3.1.3 Using the Logical Framework Approach
Since 1998, IFAD has required that projects be designed
using the Logical Framework Approach (LFA). This process was originally
developed in the 1970s to improve the quality and clarity of project design.
The LFA process is based on participation of key stakeholders, including
primary stakeholders. The project design that results from the LFA process
is summarised in a table that is referred to as the logical framework
matrix, or logframe (see Section 3.3.2). While the
LFA has become widely accepted as useful for project planning, it also
has some clearly recognised problems. So the standard LFA planning process
has been improved in different ways over the years. Flexible and critical
use of the LFA means:
- recognising that development is not mechanical by building options
and opportunities for adaptation into the design;
- valuing outcomes (achievements between tangible outputs and long-term
impacts) by making them explicit in the logframe;
- avoiding over-simplification of large projects or programmes by using
multiple purposes, a cascading logframe or a five-layer logframe;
- including people’s visions and aspirations and identifying opportunities
during the planning rather than focusing only on problem analysis;
- recognising that quantifiable indicators and qualitative information,
such as opinions and stories of change, are needed for M&E;
- guarding against bureaucratic control by reporting more on outcomes,
(interim) impacts and planned improvements – and less on activities
and outputs;
- avoiding token use of the logframe matrix by ensuring it represents
the shared vision for the development intervention, by using it as a
management tool and by keeping it updated;
- tracking assumptions as part of M&E to help guide the project
strategy.
Note that a project can be designed well in different ways – and that
the LFA is only one of these ways. Also, using the LFA is certainly no
guarantee of ending up with a good project design. You need to be both
critical and creative to achieve a design process that is appropriate
for the context.
3.1.4 Linking Project Design with the
Annual Work Plan and Budget
The project logframe will show the main activities for
the life of the project. Each year the implementers need to identify which
activities are needed for the coming year and prepare a budget. The logframe
is the basis for the annual work plan and budget (AWPB). For the logframe
to be useful, it must be sufficiently detailed and, in particular, updated
to reflect the current situation of the project. For example, the original
logframe may have included outputs or even components that are no longer
appropriate and have been dropped. How the project appraisal report is
translated into operational plans varies enormously across projects, although
all have annual plans. Some have an overall operational plan with milestones
that look at key implementation over the project’s lifetime, which can
help translate the logframe into annual clusters of activity. Others have
"project implementation manuals" that detail operations. Some
have two- or three-year operational plans, alongside annual plans.
3.1.5 Linking M&E to Project Design
Developing M&E starts long before start-up. Initial
project design strongly influences the ease with which M&E is implemented
later on through, for example:
-
the relationships and commitment established with partners
and local people, particularly the intended primary stakeholders;
-
the logic and feasibility of the project strategy;
-
the resources allocated to M&E (funding, time, expertise);
-
the degree of inbuilt flexibility that allows M&E
findings to have a steering function;
-
any operational details of M&E that might be established
during initial design.
During project formulation, a broad M&E framework should
be developed and included in the formulation and appraisal documents.
This framework provides: a) sufficient detail to enable budgeting and
allocation of technical expertise, b) an overview of how M&E will
be undertaken, and c) some guidance for project staff about how M&E
should be set up during start-up. The M&E framework complements the
highly summarised M&E information that is the logframe (see Section
3.4). Much of what is developed for the M&E system during the
initial project design phase will only be indicative of the final plan
and will need to be revised and refined during start-up.
Back
to Top 
3.2 Designing for Learning,
Empowerment and Sustainability
Designing a good rural development project requires careful
attention to the social processes and institutional development that will
enable learning and the empowerment of primary stakeholders and lead to
sustained benefits.
3.2.1 Involve Stakeholders in Project
Design Processes
Projects without good stakeholder consultation are setting
themselves up for failure. Those that do consult widely increase their
chances of success. Box 3-1 describes a simple case
in Ghana where a participatory process created the opportunity for primary
stakeholders to adjust part of the strategy to make it appropriate to
their situation and thus more likely to meet their real needs. Involving
stakeholders in project design is important specifically for:
- inspiring them to identify, manage and control their own development
aspirations, and so empower themselves;
- ensuring the project goals and objectives will be relevant and, as
a result, meet the real needs of the rural poor;
- ensuring the project strategy is appropriate to local circumstances;
- building the partnerships, ownership and commitment needed for effective
implementation.
Local participation early on can also be cost-effective in the long run.
In Uganda, more time and money were spent to involve primary stakeholders
in a more inclusive formulation process of the District Development Pilot
Project, which was then found to be effective because of local inputs
and ownership and a deeper understanding of the project. If the investment
hadn’t been made up front, much money would have to have been spent later
for one-way information campaigns before and during project implementation.
| |
Box 3-1. Community participation in the
project design process
When the irrigation specialist of Zebilla District, Ghana, shared
his plans for the rehabilitation of the earthen dam and irrigation
network in the village of Saka, the village water users’ association
(WUA) quickly sent him back to the drawing board! Many years before,
when the dam was first constructed and functioning, the village
had established a substantial mango orchard directly below it. Even
though the dam had not been working for the past 17 years, the mangoes
had continued to produce each year. With the start of the IFAD-supported
LACOSREP project, the villagers had formed self-help groups, elected
a WUA and requested their dam to be rehabilitated under the project.
The project’s irrigation specialist then recommended cutting down
most of the mango trees to make room for an expanded irrigation
scheme just below the dam. The community objected, as the mangoes
were valued, especially during the dry season. One older man explained,
"With the mango trees, I know that my children will have something
to eat during the lunch break at school." The villagers suggested
extending the canal beyond the mango orchard instead. This way,
not only would the orchard be saved, but the canal would expand
the amount of cultivable, irrigated land. |
|
The first step in project design is to conduct an initial
stakeholder analysis (see Annex
D for more detail). This requires listing potential stakeholders (individuals,
social groups and organisations), prioritising who must be involved (and
not everyone who it would be nice to involve) and agreeing with them on
how they can best be involved. This is the basis for being able to understand
their needs. Box 3-2 lists questions developed by
a project in Tanzania to guide an analysis of stakeholder needs.
Box 3-2. List
of questions to outline multi-stakeholder-level strategy for the
PIDP project in Tanzania
|
| Farm Household Level
* What is the present situation of the farm household?
* What does the future, improved situation of the farm households
look like?
* What changes have to be undertaken at farm household level?
* What support do farm households need?
* What support do farmers and members of the water users’
association need?
* Who is to provide the support?
Water Users’ Association
(WUA)
* What is the present situation of the WUA?
* What does the future, improved situation of the WUA look like?
* What changes have to be undertaken at the level of the WUA?
* What support do the WUAs need?
* Who is to provide the support?
|
District Councils (DCs)
* What is the present situation of the DCs?
* What does the future, improved situation of the DCs look like
in terms of mandate, structure and services offered?
* What changes have to be undertaken at the level of the
DC and district-level project management unit?
* What support do DCs need?
* Who is to provide the support?
Programme Coordination
Unit (PCU)
* What is the present situation of the PCU?
* What does the future, improved situation of the PCU look like?
* What changes have to be undertaken at the level of the PCU?
* What support does the PCU need?
* Who is to provide the support?
|
Stakeholder participation in design is not limited to working
with local communities or valuing their views above others. The idea
of a "community" that one consults is quite simplistic and
can cause problems. For example, if implementing partners or project
staff consult a community, will all local voices be heard? Which ones
will unintentionally be forgotten or ignored? Also, what is good for
one community is not necessarily good for another or for its region.
So which community will you listen to if they have differing opinions?
Understanding differences within and between local communities means
listening, listening and listening again – and working together. Only
then can you gain insights into local relationships and interests. Some
people think that illiteracy and geographic isolation of target groups
makes participation impossible. But many examples show how including
the poorest, most isolated and illiterate of groups is possible with
some creativity and time (IFAD/AGNGOC/IIRR 2001 publication, see Further
Reading). Good participatory processes involve sharing perspectives
and negotiating differences. Stakeholders can be involved in many ways,
including comprehensive participatory rural appraisal (PRA) processes,
informal discussions and planning workshops. However, people’s physical
presence is not enough. Some very poorly designed projects have included
many local people who did not participate freely. Ensuring high-quality
participation is key and will require creating project structures that
can respond to people’s requests (see Box 3-3).
| |
Box 3-3. New project structures in Colombia
to create space for participation
The PADEMER project in Colombia negotiated several
recommendations when refining the project at start-up: 1) changing
focus from supply to demand, wherein project activities start
with a participatory process of identifying rural microenterprise
demand for services, 2) introducing competition through open tenders
for service delivery, and 3) forming regional groups for selecting
and prioritising projects, with primary stakeholder representatives
invited to assist in selecting and supervising service delivery
contracts. |
|
Good project design requires questioning, sharing and negotiation.
This happens when good information is available and when differing perspectives
between community people, scientists, NGO staff and government officers
are discussed openly and negotiated. Planning workshops with stakeholders
are important, and a good process, understood by all, will help achieve
a valuable outcome. Some projects focus on a single workshop. This creates
pressures; and agreements may be made that do not make much sense afterwards.
It might be tempting to think that, because such outputs came from the
stakeholders during the workshop, they are "correct" and cannot
be changed. However, people learn by participating in dialogue. The
views they held in one meeting might change. The next day, after having
had a chance to reflect and discuss with others at home, they might
see things quite differently. So rather than a one-off workshop, it
is better to hold a sequence of events where people’s ideas can be shared
and merged, and informed agreement can be reached (see Box
3-4).
| |
Box 3-4. A workshop process for participatory
logframe design in Uganda
Ugandan project staff recommend the following workshop
process for developing the logframe. At the beginning, they draw
a diagram that shows the process in terms of steps to be undertaken
through the workshop. This includes scanning the project environment,
developing the vision, mission, goals and purposes (impacts) for
the project, and then filling in the details of outputs and activities.
By referring back to the visual diagram of the workshop process,
participants can see the progress they are making in working through
the LFA steps. The workshop lasts about two to three days. At
the end, participants find they have worked through the whole
logframe matrix themselves. |
|
3.2.2 Be Clear about Cross-Cutting Issues: Poverty,
Gender, Participation
A shared understanding by stakeholders of the concepts
of poverty reduction, gender equity and participation is critical. It
is the only way to secure agreement on how to build these concepts into
the project strategy. Differing understandings can lead to diverging objectives.
For example, in one project in Yemen, concerns were raised about the CACB’s
(Cooperative Agricultural Credit Bank) apparent lack of commitment to
the project target group of small farmers. Then project staff discovered
that the CACB was defining as eligible all small farmers within the project
region. However, the project was targeting only those from 47 specific
villages involved in project shelterbelt activities, as named in the project
design documents. Different definitions had caused frustration and disrupted
monitoring of credit activities. Defining what these three concepts mean
for the intended implementers is the first step. M&E experiences in
India revealed that the intention to target the poorest of the poor was
not always fulfilled because the official criteria for "below poverty
line" (BPL) were inadequate for the project. An NGO there used the
official criteria in "wealth ranking" and "wealth mapping"
methods to check the proportion of village members from poor households
against the status of households who had not joined the self-help groups
(SHG). They found that many households not in the SHGs did not meet the
BPL criteria, yet they were still living in relative poverty.
Agreeing on terms like "poverty" and "basic
necessities" is essential both for good project design and M&E.
Opportunities for reaching agreement need to be created. For example,
the ADIP project in Bangladesh took a group-based extension approach
and kept close ties with NGOs and local agencies in the project
design. This created good opportunities for agreeing on poverty indicators
that guide some M&E.
The same is true for "gender" and "participation"
(see Section 2.7). Even when
everyone agrees on these concepts at the onset, they need to return to
them regularly to limit deviations from a goal in poverty reduction and
equitable development. Nevertheless, differing opinions may remain, as
the activities based on these definitions are implemented in the organisational
context of each stakeholder group (see Box 3-5).
| |
Box 3-5. Definitions in
an organisational context
In one project area in North Africa, the president
of a rural community, who also worked in local government, was involved
in linking project staff and local people. He found it difficult
to justify investing the limited project resources only in poor
households. Instead, he tried to spread out project resources to
as many people as possible, especially those who were motivated
and capable of completing what the project had started. He explained,
"For the land rehabilitation work, we have the resources to
remove stones on one hectare of land per household, so we choose
people with more than one hectare who will be able to remove the
stones from the rest of their land with their own resources."
People with more land and capacities were not the poorest, but the
strategy was understandable. The local government, in which he worked,
had the mandate to organise service delivery for the majority of
citizens rather than to the project target of only the poorest. |
|
3.2.3 Plan for Capacity Development and
Sustainability
Many IFAD-supported projects focus on delivering infrastructure
and public facilities– wells, roads, covered markets, clinics, school
buildings, etc. But it is the people who use and maintain a structure.
A major lesson learned by development agencies over the past 25 years
is that investing in capacities is at least as important as in infrastructure
for sustained poverty reduction. An interesting example of what this may
mean in practice comes from the WUPAP programme in Nepal. Its overall
purpose is "To assist in self-empowerment and in strengthening the
capacity of poor and socially disadvantaged groups of people to: mobilise
and increase their own resources; gain access to external resources; claim
social justice." [Emphasis added.] To ensure this focus, questions
to consider during project design and adaptation are:
1. Whose capacities are being built through the project?
2. Will these capacities reduce rural poverty?
3. If not, what else do we need to do in terms of capacity-building to
have a lasting local impact?
Some people think that capacity development simply requires
counting how many people attend training workshops. But attending a workshop
does not necessarily strengthen capacity. Building capacity requires conscious
effort to share decision-making with primary stakeholders over time (see
Box 3-6).
| |
Box 3-6. Participation and
capacity-building for sustained impact
The Cuchumatanes project in Guatemala worked with
organised farmers: formal organisations, interest groups and communal
banks. In 1998, a primary stakeholder committee was created to strengthen
their participation in project management. It supervised field activities
and collected primary stakeholders’ claims. When the project finished
in 2000, the primary stakeholder committee became an association
called the Association of Organisations of the Cuchumatanes |
|
Monitoring and evaluating capacity-building is not as straightforward
as counting infrastructure changes. "Capacity" is sometimes
difficult to describe clearly in ways that will allow measurable indicators
and may therefore require additional creative thinking. Box
3-7 compares performance indicators for Nepal’s WUPAP rural infrastructure
component with indicators from a similar component in a project in China.
Note that including a capacity-development focus requires a participatory
M&E approach – only the stakeholders themselves can explain if and
how capacity might have been built. For example, capacity is not about
how many kilometres of road have been built, but how stakeholders are
going to ensure that these roads are maintained, used and extended.
Box 3-7. Comparing indicators that
foster capacity development with ones neutral towards it (Note: the
italicised words indicate where capacity development is made explicit.)
| Project Output |
Performance Indicators in the Project
Logframes |
| WUPAP Nepal
Infrastructure programme implemented
- Rural infrastructure schemes identified, constructed and maintained
by disadvantaged groups on a demand-driven basis
- Infrastructure-related policy developed and enforced that
benefits the disadvantaged |
Number of small-scale
or micro irrigation schemes constructed/rehabilitated and maintained
Kilometres of trails and number of bridges constructed/rehabilitated/maintained
Number of community facilities (including storage facilities)
constructed and maintained
Number of water supply and sanitation schemes constructed/rehabilitated
and maintained
Number of disadvantaged groups successfully expanding irrigated
area and the per cent by which the irrigated area increased
Kilometres of rural roads constructed/rehabilitated and maintained:
75
Per cent of labour for earthworks provided by the target group
identified by the communities and social mobilisers: 70 (of
which at least 50% are female)
Number of disadvantaged people employed through component
|
| China project
Rural infrastructure constructed or rehabilitated |
- Number of primary stakeholder households served by new domestic
water supplies: 25,000
- Kilometres of rural road network upgraded to class 4: 198
- Number of villages supplied with electricity: 67
- Number of household biogas systems installed: 22,500
|
Including a capacity-development perspective has implications for policy,
as existing policies can be questioned when local people take more charge
of their own situation. By explicitly linking project activities to
specific policies, the project team has the opportunity to engage and
provide feedback to policy makers. The ADIP project in Bangladesh found
this when it aimed to implement the government’s New Agricultural Extension
Policy. In the process, the project created opportunities for informing
government on the policy itself. This link has two advantages: providing
primary stakeholders with a voice at policy level and ensuring that
local capacity-building stays in tune with the current policy outlook.
Good capacity-building is essential for sustained impact. Three points
need particular consideration.
- A broad base. Capacity-building must include not only primary
stakeholders but also other key stakeholders, particularly local government
(see Box 3-8).
- The plan for phasing-out. Project managers in India have systematic
phasing-out plans that list specific responsibilities to be able to
show sustainable outcomes for their investments in local development.
- Sensitivity in M&E. Tracking and evaluating capacity development
is particularly sensitive because it focuses on people and makes judgements
about their activities.
| |
Box 3-8. From project focus to supporting
local governance
The terms of reference for M&E expertise in Uganda’s
District Development Support Project (DDSP) focused only on the
project. Staff recognised that this could easily be changed to become
a local government M&E framework that benefits the district
as a whole. For the consultant to contribute to the district, and
not just the project, he/she should:
-
know and understand the local government system
in Uganda;
-
work closely with the DDSP team to create a multi-level,
multi-stakeholder M&E system for the planning, allocation
and implementation needs of the local governments. This would
include mentoring the district planning units and other departments
to help their partners/other stakeholders develop their own
indicators for the M&E of local government services;
-
work closely with the efforts of other agencies
in developing M&E systems for local governments;
-
ensure that the roles and responsibilities fit
within existing local government/authority roles and responsibilities
(so as not to create unsustainable committees, organisations
or positions);
-
have documentation and dissemination skills to
assist local governments to develop communication strategies
for meeting their constituencies’ learning and information needs;
for example, assist by documenting the local government’s M&E
framework for wider dissemination and use by other districts
in Uganda.
In this way, there can be a shift in focus from short-term
project learning to the development of longer-term institutional
change. |
|
3.2.4 Plan for Learning and Adaptation
During Implementation
Any project will require many adjustments during its life.
This is guaranteed. Do not overly detail a project strategy, as this hinders
adjustments during implementation. Here are some ideas for a design team
to build learning opportunities and change into the design.
- Design the process, as well as objectives, at the higher levels
(also see next point). Identify the forums and processes that will be
used to involve stakeholders in project review and adaptation, and build
in flexibility to respond to unplanned opportunities. This approach
was used to advantage by the TEPP project in Yemen to involve emerging
stakeholder groups in information-gathering and feedback. Local communities
had a strong sense of group action. When local youths saw what the project
was beginning to develop, they started to participate voluntarily in
certain aspects, lending a hand with seedling protection, community
health and water supplies. The project was able to involve them in implementation
and M&E, and so gained valuable support and informal feedback on
the field situation.
- Focus on clear goals (impacts) and purposes (outcomes), rather
than over-specifying activities and outputs. Project design teams
commonly over-specify activities and spend time on the overall goal,
then they fill the in-between steps with hastily formulated purpose(s)
or outcomes. Yet these interim levels are the most important part of
"managing for impact" so require most of the attention. This
approach can also have secondary benefits, as was seen in Ghana where
the second phase of a project was designed to be less targeted and more
flexible. Project management and the cooperating institution were given
the authority to adjust the components and outputs in the design to
respond to locally expressed targets. This more flexible design also
increased the involvement and ownership of the project by the primary
stakeholders.
- Be explicit about uncertainty. Instead of trying to force specificity,
explain what you simply do not yet know, such as exactly how communities
will want to administer local development funds. Explain what is unknown
and how and when project management should be clear on the issues. This
means suggested targets should be approximate. State quantitative targets
as being approximate and describe how the project could revise them,
if necessary. For example, the logframe of the WUPAP programme in Nepal
explicitly states: "As the programme is demand driven, the output
targets remain highly indicative and in some cases are not specified
in detail… The logframe should be regarded as indicative, as it will
need to be reworked by its stakeholders in the course of implementation."
- Build in mini-research phases at key moments. Not all issues
of relevance to a project can be anticipated ahead of time. List as
an activity and budget for "focused studies" to answer questions
about the project context that may arise. For example, if the project
is testing a new kind of micro-credit scheme, then before this is expanded
a focused and detailed interim evaluation is needed.
- Make it explicit that the project strategy and logframe matrix
should be revised each year. Annual adjustments to the logframe
are increasingly accepted and expected. A project design can indicate
when and with whom this will take place.
- Make "adaptive management" a key function in the terms
of reference for senior management and partner contracts. When hiring
managers and selecting partners, select those who can balance uncertainty
with being clear about poverty reduction goals.
- Budget for experimentation and for the unexpected. If the project
is testing a new approach, then the budget should reflect this and more
money should be allocated to later years when there is more certainty
about expanding the approach. Also leave a portion of the budget and
staff time for activities that do not fit into established categories.
In some companies that must innovate to survive, researchers can spend
10% of their time on activities of their own choosing. This allows them
to respond to unexpected opportunities.
Back
to Top 
3.3 Introducing the
Logical Framework Approach
The logical framework approach (LFA) can be very useful
for guiding project design and implementation. The basic ideas behind
the LFA are simple and common sense for any design process.
- Be as clear as possible about what you are trying to achieve
and how it will be achieved.
- Decide how you will know if you are achieving your objectives and
put in place a monitoring system.
- Make explicit the conditions (assumptions) outside the direct control
of the project that are critical for the project to succeed and assess
the risk for the project if these conditions fail to arise or change.
The LFA also has some limitations. The main criticism is that it can
lead to a rigid and bureaucratically controlled project design that becomes
disconnected from field realities and changing situations. However, the
LFA is easy to use more adaptively, particularly if the original design
is seen, at least in part, as needing future finalization and probably
revision, and project management prioritises annual reviews and logframe
updating. The logframes of IFAD-supported projects vary widely in their
quality, application and terminology. Design teams using the logframe
for IFAD-supported projects commonly experience difficulties. These arise
because IFAD-supported projects are long term, aim at high-level poverty
reduction goals and aim to undertake a wide range of development activities.
These features require a fine balance between too much detail and oversimplification.
So in practice, a summarised logframe will be useful to provide an overview
of the project and for those making decisions about project funding. For
those using the logframe as a management tool, more detail will be needed.
When facilitated well, the LFA is generally seen as very valuable by project
stakeholders (see Box 3-9) and leads to a better quality
and shared understanding of needs, objectives and strategies by all involved.
When possible, try to follow the basic ideas without forcing everyone
to understand the full detail of the logframe matrix. Visually mapping
out the process steps can make them clearer than using the four-column
table format. It may also be a good idea to avoid some official terminology,
finding local words instead. Some people may be scared off by terms like
"logframe" and "objectively verifiable indicators".
These practices all lend to flexible use.
| |
Box 3-9 Usefulness of the logframe, as
seen by primary stakeholders
When members of the water users’ association of the
PIDP project in Tanzania were asked their opinions on the logical
framework approach, they gave the following comments:
- "It makes planning easier."
- "Now we have a plan for the year. It helps us in scheduling
and priorities."
- "With this kind of meeting [LFA process] we get time to
sit together with the technical staff and the farmers to talk
about our problems and the solutions to our problems. It is a
teaching approach to solving problems."
- "It was difficult to understand in the beginning. But
then when you understand, it is easy for planning."
- "Unlike the first projects [previous development projects],
now we have indicators so that we are able to judge our achievements.
The problems from the first project had been continually carried
over until now."
|
|
3.3.1 Key Steps in the Logical Framework Approach
While most people are familiar with the logical framework
matrix, the most important part of the LFA is actually the planning process
that has been developed to improve the quality and clarity of project
design. There are various versions of the steps in the LFA. The one presented
below takes account of the specific nature of IFAD-supported rural development
projects. The key steps to be undertaken – with well-selected and diverse
stakeholders – are:
- establish the general scope or focus of the project;
- agree on the specific planning framework, terminology and design process;
- undertake a detailed situation analysis;
- develop the project strategy (objective hierarchy, implementation
arrangements and resources);
- identify and analyse the assumptions and risks for the chosen strategies,
modifying the project design if assumptions are incorrect or risks are
too high;
- develop the monitoring and evaluation framework.
Each step is discussed in more detail in the next sub-section, with detailed
examples of the logframe matrix in Annex
B and of the M&E matrix in Annex
C.
3.3.2 The Logical Framework Matrix
The written output of the LFA is the logframe matrix.
The standard matrix is a table with four rows and four columns. This matrix
summarises:
- what the project should achieve, from the level of an overall goal
down to specific activities;
- the performance questions and indicators that will be used to monitor
progress and overall achievement;
- how these indicators will be monitored or where the data can be found;
- the assumptions behind the logic of how activities will eventually
contribute to the goal, plus associated risks for the project if assumptions
turn out to be incorrect.
Table 3-2 shows a logical framework matrix appropriate
for IFAD-supported projects and consistent with ideas in this Guide. Alternative,
commonly found terms used in the matrix are given in parentheses. Note
that inputs required for activities to be carried out are written at the
activity level in the second column (Performance Questions and Indicators)
– the column is not for indicators. The table also suggests how to write
the objectives in the hierarchy.
Table 3-2. The logical framework matrix and how
each level is written (alternative common terms in parentheses)
|
Objective
Hierarchy
(Narrative summary, intervention logic) |
Performance Questions
and Indicators
(Objectively verifiable indicators, indicators, targets)
|
Monitoring Mechanisms
(Means of verification, sources of information) |
Assumptions and Risks
|
|
Goal
(Overall objective, development objective)
The long-term objective, change of state or improved
situation towards which the project is making a contribution
How to write it: put the verb in the past
tense, as something already achieved over the long term
|
Performance questions
and Indicators at goal level – high-level impacts |
How necessary
information will be gathered |
For long-term
sustainability of the project |
|
Purpose
(Project development objective)
The immediate project objective, the overall
observable changes in performance, behaviour or resource status
that should occur as a result of the project
How to write it: put the verb in the present
or past tense as if already achieved |
Performance questions
and indicators for each purpose (component) – lower-level impact
and outcome indicators |
How necessary
information will be gathered |
Assumptions in
moving from purposes to goal |
|
Outputs
(Results)
The products, services or results that must be
delivered by the project for the component objectives and purpose
to be achieved
How to write it: put the verb in the present
or past, as if already achieved |
Performance questions
and indicators for each output – output indicators |
How necessary
information will be gathered |
Assumptions in
moving from outputs to purposes |
|
Activities
The actions taken by the project that are required
for delivery of the outputs
How to write it: put the verb in the infinitive,
as something to do |
Note:
the needed inputs go here, not indicators for activities
|
|
Assumptions
in moving from activities to outputs |
When using the logframe flexibly for IFAD-supported projects, two issues
are important: (1) knowing how to use the matrix for large projects
or programmes and (2) making sure outcomes are adequately considered.
Using the Matrix for Large Projects or Programmes
Many IFAD-supported projects involve diverse components,
including health, infrastructure, extension support, irrigation development,
micro-finance, organisational development and social justice. Each of
these different elements could be considered projects in their own right,
although they are often closely linked. So some IFAD "projects"
are more like programmes, in the sense that they involve a diverse range
of loosely-coordinated initiatives being implemented by different groups
for the same overall goal. Three problems occur when large and multidimensional
projects (or programmes) are summarized into a four-by-four logframe matrix.
- The project is oversimplified to such an extent that the matrix provides
insufficient detail for effective management or M&E.
- Outcomes, outputs and activities tend to become confused. For example,
what might be an overall outcome for the irrigation component is written
in the matrix as an output of the project; then, what are really irrigation-related
outputs are included in the matrix as project activities.
- Insufficient detail is given at the purpose level in defining the
outcomes needed to guide the project strategy towards impact (see Section
2.3).
You have three options for overcoming these problems (see Table
3-3).
- Introduce multiple purposes for the project. With projects
that have a number of components, each component then has a separate
purpose. This is commonly done with IFAD-supported projects. (Be aware
that some versions of the LFA only allow one purpose per project). Try
to avoid viewing large project components as outputs. An output is a
specific deliverable product or service, whereas a project component
is broader and is achieved by the delivery of a series of outputs.
- Use the idea of a "cascading logframe". View your
project in terms of one master logframe matrix, with a series of smaller,
linked logframes (or sub-projects).
- Extra level of objectives. Introduce an extra layer into the
logframe matrix between "Outputs" and "Purpose",
which could be called "Component objectives" or "Key
outcomes".1 Many projects already implicitly
or explicitly work with this idea but do not include it in the logframe
matrix.
The most common version of the LFA suggests only one purpose
per project. However, the size, range of components and long timeframe
of IFAD-supported projects means that having a single project goal and
only one project purpose is not helpful. Therefore, many IFAD-supported
projects have moved to using multiple purposes that relate to each of
the major components. It is this model of the logframe matrix that guides
the examples in the Guide.
Another problem of concern in complex projects is the difficulty
of including cross-cutting concerns in a linear objective hierarchy. For
example, you may want to pay particular attention to women’s empowerment
in project activities. Setting up an output layer around gender
equity may isolate gender, when what you want to do is integrate gender
into all activities. Yet you cannot ignore this output as distinct, since
it risks leaving out indicators for assessing performance on the gender
front.
This dilemma can be overcome by including separate cross-cutting
objectives or principles. Sometimes these fit into the logframe in an
integrated manner. If not, they need to be included in the project document
and preferably as an attachment to the matrix. Being explicit about these
cross-cutting objectives or principles is important in order to include
them not only in activities but also in M&E.
Table 3-3. Three options for adjusting
the structure of the logframe matrix
|
Type of Structure
|
Description
|
Advantages
|
Disadvantages
|
|
Standard objective
hierarchy |
Four levels: 1
x goal, 1 x purpose, any number of outputs, any number of activities
per output |
- Is very simple.
- Is commonly used and understood.
|
- Oversimplifies
larger, multi-component projects.
- Does not make project outcomes clear. |
|
Multiple purposes
|
Four levels: 1
x goal, as many purposes as needed, any number of outputs per
purpose, any number of activities per output |
- Maintains the
standard four levels of the logframe matrix. |
- The standard
is one purpose, so this may cause confusion.
- Confusion between purposes and outcomes can still occur.
|
|
Cascading logframes
(objective hierarchies) |
Several interlinked,
standard four-level logframes; each project component written
up in a separate logframe; the purpose level = the component objective
|
- Maintains the
standard four levels of the logframe matrix.
- Enables a focused, "sub-project" approach to management.
|
- Doesn’t give
an overview of cross-cutting objectives.
- Focusing on integrative impact is difficult.
- Is more complex. |
|
Extra layer(s)
|
Five levels: 1
x goal, 1 x purpose, any number of key outcomes (or component
objectives), any number of outputs per outcome, any number of
activities per output |
- Makes a clear
distinction between output, outcome and purpose levels, facilitating
M&E.
- Is consistent with standard LFA.
- Some donors already use it. |
- More detail has
to be included in the logframe matrix. |
Recognising the Importance of Outcomes
Your project may have one output that is formulated as:
"improve the capacity of the agricultural extension service and the
skills of extension workers". Many projects use an indicator such
as "number of extension workers trained". But if you want to
manage for impact, you need to know the extent to which extension staff
are using new skills in the field and, in turn, the extent to which farmers
are developing and adopting improved agricultural practices. These are
outcomes that occur after you have achieved your outputs (number of extension
agents trained) and are necessary in order to have impact (increased productivity
and income for farmers). If your M&E data show that although many
extension workers have been trained, farmers are not adopting improved
practices, then you can question what might be going wrong with your strategy
of improving the extension service through training. This is why monitoring
change at the level of outcomes is so critical in managing for impact.
For IFAD, outcomes are also recognised as lower, purpose-level impacts.
So, for communication and reporting reasons, it is important not to limit
the documentation of impact to only the goal level of the objective hierarchy.
Most people who use the standard LFA and matrix focus on tangible outputs.
Outcomes should be included as indicators at the purpose level, but this
is rarely done well. This is partly because the logframe was originally
designed to focus on controlling the delivery of tangible outputs to be
produced, such as kilometres of road built or area of irrigation scheme
constructed. The three ways of dealing with larger projects, mentioned
above, all help make the outcome level more explicit and detailed and
also easier to monitor and evaluate.
Back
to Top 
3.4 Using the Logical
Framework Approach
3.4.1 Step One: Establish the General
Scope and Focus of the Project
The starting point for any project is to identify the general
situation that will be improved, the likely primary and other stakeholders,
the geographic scope of the project, the range of issues that will be
addressed, and the likely length and expenditure of the project. Also
find out what the community, government and potential funding agencies’
interests are in the project. This initial information provides the starting
point for defining and guiding the detailed situation analysis and design
steps. Some of this information will be outlined in the Country Strategic
Opportunities Paper (COSOP). During this initial step, it is important
to find out if the basic concept underpinning the project is feasible
and if there is sufficient support from key stakeholders for it to be
worthwhile to proceed to the next step.
3.4.2 Step Two: Decide on the Planning
Framework, Terminology and Design Process
As already discussed, there are different planning frameworks
and various approaches to the use of the LFA. In different countries,
people will have had experience with different models and be used to a
particular set of terms. It will help everyone if early on in the design
process there is agreement about the approach to planning that will be
followed, how the logframe will be used and what terminology will be used.
Also define clearly what the design process will be, in terms of who will
be involved, how and at what stage; what information needs to be gathered
and how; and how the final design will be checked with key stakeholders.
Box 3-10 lists key elements of participatory design
based on IFAD experiences in Asia. This "designing the design process"
step is often given very little thought and is the source of many problems
that emerge during design and implementation.
| Box 3-10. Weaving together
a participatory design phase (based on IFAD experiences in Asia)2
- Establish a mentoring team – a group of committed, experienced
and respected nationals who, on a voluntary basis, act as resource
persons to advise the formulation process and champion the goals,
strategies and approaches proposed by the project.
- Undertake a participatory stakeholder analysis through a process
of brainstorming with groups/individuals/institutions, grouping
stakeholders, assessing their interests and impact on project
success, assessing their influence and importance for project
success, and outlining a strategy for their participation.
- Establish the design team with national specialists from different
professional sectors, relevant NGOs and government agency staff.
- Train the design team in the use of diagnostic participatory
tools and in drawing implications for project design from qualitative
discussions with groups of stakeholders.
- Review secondary data and key informant interviews.
- Formulate the study design and analysis plan based on the
information gaps you have identified.
- Divide the project area into study zones, by identifying a
number of relatively homogenous agro-ecological areas.
- Undertake village-level problem identification and needs assessment
through focus-group meetings and household interviews:
- Assess problems: discuss problems, issues and concerns
of villagers; assess causes and effects; identify which
issues could relate to the project being planned; agree
on criteria for prioritising problems; and prioritise problems.
- Analyse options: discuss strategies and options proposed/desired
by the community to overcome the problem situation.
- Analyse alternatives: agree on criteria for comparing
options to overcome problems and realise visions, then identify
and assess alternative strategies/options available to reach
the desired objectives.
- Undertake a cross-cutting analysis, by agro-ecological zone
and socio-economic stratum, to integrate analyses from different
communities.
- Hold design workshops involving different levels of stakeholders
to work together on the logframe matrix:
- Summary of objectives (objective hierarchy): develop project
concept, vision, mission, results and activities.
- Indicators: together identify which indicators capture
and measure the different levels of changes the project
is anticipated to affect.
- Means of verification: agree on the sources of information
to be used for monitoring impact.
- Important assumptions/external factors: discuss the attitudes,
behaviours, processes, trends, natural hazards/disasters,
etc. outside the control of the project that could affect
it positively or negatively.
- Conduct continual surveys of primary stakeholder opinions
to ensure that the consultation process and the interim results
are as good as possible.
- Hold national-level project reality-check and planning workshops
to which a wide range of (primary) stakeholders are invited
and during which initial ideas are presented and debated to
consider different realities.
- Draft the project proposal, based on workshop outputs, with
a team of national and international experts.
- Verify the draft project outline with the key stakeholders,
particularly the intended primary stakeholders, in a series
of discussions or workshops.
|
3.4.3 Step Three: Undertake a Detailed Situation
Analysis
Situation analysis involves learning as much as possible
about the project context and the interests and needs of local people
in order to design a relevant project. This learning is best done with
several groups of stakeholders. Box 3-11 provides
a list of key situation analysis topics, questions and useful methods.
The standard LFA focuses project planning on developing
a problem tree for the situation. A problem tree works well for simple
situations. However, problem-based planning fits with a more mechanical
approach to development where projects are designed to "fix"
problems rather than to facilitate local development processes. Furthermore,
people see their future in terms of visions and aspirations – not just
as problems. Analysing future visions helps identify opportunities for
improvement and of successes that can be further developed. The LACOSREP
water users’ association (WUA) programme in Ghana developed four complementary
visions to describe the ideal WUA that they were aiming to help create.
A good situation analysis will combine information gathering
and analysis about the local context, expert advice and participatory
processes such as participatory appraisals, community meetings and multi-stakeholder
workshops. A creative and learning-oriented situation analysis will combine
several methods (see Annex
D).
One result of a good situation analysis is that stakeholders
have more insights about their situation and have better capacity to design
a solid project. However, this will not be achieved in one community meeting.
People’s perspectives evolve as they debate and listen. After a community
meeting, subsequent discussion in people’s homes might have lead to adjustments
if a meeting were held the following day. Take care that the situation
analysis is designed as a series of events.
Updating the situation analysis is critical for the M&E
system. Note that a situation analysis is not the same as a baseline survey.
Both are information-gathering exercises. But a situation analysis is
more open-ended in terms of the themes and questions that are analysed,
while a baseline survey only includes data that are needed to make impact-related
comparisons. A baseline survey is undertaken after project design has
been completed, while a situation analysis is undertaken as part of design.
| |
Box 3-11. Key themes, questions and methods
(italicised, see Annex D) for a thorough situation analysis with
stakeholders
Stakeholders (stakeholder maps, institutional diagrams,
secondary data)
- Who are the local people likely to benefit from the project?
- Who are the other key stakeholders?
- How do different stakeholder groups interact?
- What are the power relations between different groups?
Problems and Issues (rich picture, conceptual maps, focus
group discussions, historical analyses, secondary data, matrix ranking)
- What problems or issues are central to the focus of the project?
- What are the main problems or concerns of the different stakeholder
groups and how do these relate to the focus of the project?
Visions and Opportunities (rich pictures, role plays)
- What changes would different stakeholder groups like to see
the project bring about?
- Generally, what visions, hopes or dreams do different stakeholders
have and are there implications for the project?
- What opportunities do stakeholders see for realising their visions?
Biophysical Setting (maps, transects, field visits, seasonal
calendars)
- What are geographical characteristics of the project areas?
- What are the climatic conditions?
- What are the main forms of land use?
- What are the environmental problems or risks?
Organisations (institutional diagrams, network diagrams,
flow charts, matrix ranking)
- What are the important government, business and NGO organisations?
- How effectively are these organisations performing?
- How are the different organisations linked together (power relations,
communications, joint work, competitors)?
Infrastructure (resource maps)
- What are the key infrastructure issues for the area?
Law, Policy and Political Institutions (rich pictures,
institutional diagrams, historical analyses, focused interviews,
secondary data)
- What legal factors are significant for the project?
- What government policies and programmes are significant?
- What are the main government and political structures and processes
in the area?
Economic (wellbeing ranking, daily activity charts, seasonal
calendars, livelihood profiles, secondary data)
- What is the economic situation of local people?
- What are the main forms of economic livelihood?
- What are the key characteristics of the local economy?
- What are the market opportunities and constraints?
Social and Cultural (historical analyses, focus group
discussions, SWOT analyses)
- What are the main social and cultural conditions relevant to
the project?
|
|
3.4.4 Step Four: Develop the Project
Strategy
With a good understanding of the situation, you are now
ready to start developing the project strategy. This simply explains clearly
what everyone hopes to achieve and how it will be achieved. A project
strategy includes the objective hierarchy, implementation arrangements
and resources required. This sub-section focuses on the objective hierarchy
– column one of the logframe – central to the strategy. The objective
hierarchy is a tree-type structure that maps out how activities and outputs
contribute to the project purpose(s) and goal (see Figure
2-4 and the method description in Annex
D).
A project strategy will only work well if it is logical.
This means that all the outputs required to achieve a particular purpose
have been correctly identified and, in turn, that all the activities needed
to deliver an output have been identified. For example, you cannot have
as your output "production and certification of seed of improved
varieties", without also including "testing and setting up private
production of seed" and "training of ministry of agriculture
staff for certification" as activities. Once the objective hierarchy
is drafted, the logic needs to be tested (see Table 3-4).
The standard LFA uses a very structured method of converting
a problem tree into an objective tree or hierarchy. When working with
project visions and in more complex situations where the problem tree
becomes unwieldy in size, you could use a more open and iterative approach.
The main steps in developing an objective hierarchy are outlined below
and described in Annex B
with a detailed example.
- Define the project goal. This should reflect the longer-term
and highest-level impact to which the project will contribute.
- Identify the purpose(s). This is what must be achieved by the
project in order to contribute to the goal. The purpose level generally
describes major changes in behaviour or capacity. Because a project
can contribute to the goal in many ways, the stakeholders will need
to decide what is most worthwhile and feasible for this particular project.
It helps to establish criteria to help make these decisions.
It is good practice to include a separate purpose for project management.
Here, key project management tasks can be included as outputs (see next
step), such as staff management, financial management, plant and equipment
maintenance, and M&E.
- Establish necessary outputs. For each purpose, identify what
outputs are necessary for the purpose to be achieved. Think of it a
bit like designing a car. If a key part is left out, like the wheels
or the engine, it will not matter how good the rest of the car is –
it still will not work. Also you do not want tractor wheels on a car
or a motor-bike engine in a big tractor. In other words, make the outputs
fit the real needs and avoid outputs that are not absolutely necessary.
Any purpose can be achieved in several ways. Think creatively and analyse
the advantages and disadvantages of different options before making
a choice.
- Identify activities. Each output is delivered via a
set of activities. At the initial project design stage, the best way
of achieving purposes and outputs may be unclear, so activities may
need future finalization and probably revision.
- Check the logic. Once the objective hierarchy has been
drafted, use the logic testing questions in Table 3-4
for checking and finalisation.
- Allocate resources required for activities and develop an overall
budget.
- Develop a work schedule for the main activities over the life
of the project and establish key milestones.
- Establish the management and operational arrangements,
with key responsibilities and working procedures.
Table 3-4. Logic testing questions
|
Level |
Logic Testing Questions
|
|
Goal |
- Does the goal express some future
desired state or higher-order impact towards which the project
is contributing?
- Does the goal help place the project in a wider context that
provides the rationale for the project?
- Is the goal narrow enough that it is meaningful given the scope
of the project? Avoid goals expressed at an excessively general
level.
- Is the goal something owned and shared by relevant stakeholders?
|
Purpose (if a single
purpose) |
- Is the purpose a succinct statement
of what the project will achieve overall?
-Is the purpose realistic given the resources, time span and
working context of the project? |
Purposes
(if multiple purposes) or
Outcome
or
Component objective
(if an extra level is included) |
- Are the outcomes/component objectives
the set of main outcomes necessary to achieve the purpose? In
other words, if the outcomes/component objectives are achieved
will the project purpose be achieved?
- Do the purposes/outcomes/component objectives reflect the highest-level
achievements of the project for which it can realistically be
accountable?
- Are the purposes/outcomes/component objectives realistic for
the project to achieve during its lifetime?
- Is there a set of practical actions that can be carried out
to achieve each purpose/outcome/component objective?
- Is one of the purposes/outcomes/component objectives dedicated
to effective project management? |
|
Outputs |
- Do the outputs together describe
the set of achievements that must be realised for the outcome/component
objective to be realised? In other words, if the outputs are achieved
will the outcome/component objective be achieved?
- Are any outputs unnecessary to achieve the outcome/component
objective or logically belong under another outcome/component
objective?
- Are the outputs realistic for the project to achieve during
its lifetime?
- Is there a set of practical actions that can be carried out
to achieve each output? |
|
Activities |
- Do the set of activities for each
output reflect the main actions that must occur for the outputs
to be achieved?
- Are any activities included that are unnecessary for achieving
the outputs or that logically belong under another output?
- Are there any activities that need to be split up and partly
allocated to different outputs?
- Are the activities all roughly equivalent in terms of their
level of detail? In other words, are you sure that some activities
are not more at an output level while others are at a task level?
- Is the list of activities manageable (not too long)?
|
|
For all levels |
- Are all levels understandable to
project stakeholders and expressed as plainly and succinctly as
possible?
- Are any unnecessary means of achievement included?
- Are there between three and about seven items for each of the
(outcome/component objective, output and activity) levels?
|
|