This Guide to Evaluating Rural Extension has been developed by the Global Forum for Rural Advisory Services (GFRAS). The purpose is to support those involved in extension evaluation to choose how to conduct more comprehensive, rigorous, credible and useful evaluations. The Guide supports readers to understand different types of evaluation, to make decisions on what is most appropriate for their circumstances, and to access further sources of theoretical and practical information. The Guide is intended to primarily be used by four sets of evaluation stakeholders:

• Those commissioning and managing evaluations
• Professional evaluators and staff responsible for monitoring systems
• Professionals involved in training and educating evaluators
• Researchers looking for ways to synergise their efforts with evaluation initiatives

The process of preparing this Guide began in 2010 with the production of a Review of Literature on Evaluation Methods Relevant to Extension and a Meta-evaluation of Extension Case Studies. These materials, combined with extensive consultation with a range of stakeholders, were then used to as background for the development of a draft version of this Guide. During 2011 the Guide was finalised based on feedback received.

A Synthesis of Actors and Issues

The purpose of this synthesis report is to provide the required background information and analysis that will - together with other ongoing validation activities–enable GFRAS, the Global Forum for Rural Advisory Services, to develop its five-year-strategy and work plan, in order to fulfil its mission and objectives. GFRAS was created to provide a space for advocacy and leadership on pluralistic, demand-driven rural advisory services within the global development agenda that promote sustainable rural growth and help the poor. GFRAS’ four objectives are to (1) provide a voice for advisory services within global policy dialogues, (2) support the development and synthesis of evidence-based approaches and policies for improving the effectiveness of rural advisory services (RAS); (3) facilitate interaction and networking for individual, organisational, and institutional capacity strengthening in RAS; and (4) promote the creation of an enabling environment for improved investment in RAS.

Mapping Long-term Options for GFRAS:

In July 2010, the Global Forum for Rural Advisory Services (GFRAS) requested ETC Foundation to undertake the assignment “Mapping Long-term Options for GFRAS”. The purpose of this assignment was to review a number of existing global networks, initiatives and forums in order to provide GFRAS with criteria and options for developing its long-term set-up, including structure, governance and funding mechanisms.

As required by the ToR, ETC compiled an initial list of 17 possible networks1 that could be included in the review. This list was discussed with GFRAS considering aspects such as usefulness as a model for GFRAS, availability of relevant (internet-based) information and accessibility to key resource persons within the short period of the review. Eight networks which provided the diversity required for the review were selected. The list included networks of global and regional orientation, within and outside the agriculture sector, hosted and non-hosted, with a range of stakeholders and diverse funding arrangements.

This report presents the findings of this review. It begins with a brief outline of the study approach and continues to describe in detail the eight networks reviewed. Key considerations, criteria and options for GFRAS are extracted based on the information gathered through the review. The final chapter formulates a number of general conclusions.

This paper presents an overview of current opportunities and challenges facing efforts to increase the impact of rural and agricultural extension. The starting point for this analysis is in recognition that the days when agricultural extension was synonymous with the work of public sector agencies are over. The ‘‘extension services’’ described here may just as likely consist of an input vendor advising a farmer about what seed to plant, a television station broadcasting a weather forecast, a supermarket advising traders about what standards are required for the vegetables they purchase or a farmer organization lobbying for research that re ects the demands of its members for new technologies. Mobilizing the potential of extension is about enhancing this broad and complex flow of information and advice in the agrifood sector.

This review of literature on evaluation methods, in combination with a meta-evaluation of extension evaluation case studies, is intended to be a resource for extension evaluation. It is envisaged that this review will be of interest to those involved in managing and implementing evaluations of rural advisory services as well as to extension and evaluation specialists

The literature review focuses specifically on approaches and methodologies in evaluation which are relevant for evaluating initiatives in extension or rural advisory services.

The materials reviewed include academic papers, existing evaluation toolboxes and major evaluation guidelines and frameworks. After an introduction and information on the changing orientation of both extension and evaluation, the context and scope of the review are discussed. This is followed by sections addressing the purposes, users and uses of evaluation, evaluation standards and criteria, approaches, rigour, and attribution. The final three sections discuss the principles for evaluation of rural advisory services in highly complex situations; the strengths, weaknesses, and gaps in existing approaches; and the ways forward.

The Global Forum for Rural Advisory Services (GFRAS) has commissioned the Natural Resources Institute to develop a toolkit for the evaluation of extension (projects, programmes, tools and initiatives). This commission has a number of components:

• A meta-evaluation of 15-20 evaluation case studies(presented here)
• A meta-review of the literature relevant to extension evaluation methods
• A workshop with practitioners and experienced evaluators to discuss the findings of a) and b) and to identify an initial set of tools
• A proposal for testing the proposed tools in a second phase of the project
• A brief of the toolkit for policymakers.

The overall purpose of this project is to identify methods for better evaluation of extension through the development of a toolkit for extension evaluation. The meta-evaluation and meta-review will also provide an in-depth basis for the selection of the approaches, methods and tools in the toolkit.

GFRAS Brief #1

GFRAS Brief #1

A brochure introducing GFRAS

GFRAS s'introduit

• Poverty is multidimensional and requires differentiated responses.
• Technology is not enough.
• Access must be improved for women and young people, and an effort must be made to recognize different forms of collective action.
• The State plays a key role.

A Spanish version of this publication is available at the RELASER Website.

• As a promoter of innovation, extension is an important tool for the resolution of problems associated with rural territories.
• In order to be successful, rural extension must satisfy the demands and interests of those who receive innovation.
• Extension that promotes co-design in innovation is a clear road to achieving changes.
• Extension must conceive of innovation as a learning process.

This publication is also available in Spanish on the RELASER website.

• Given the importance of agriculture and the rural medium for countries’ growth and development, policy makers must strengthen the institutional structure of rural extension and increase public and private investment.
• Abundant natural resources, knowledge, technology, and extensionists are not enough. Countries also need policies, institutional frameworks, and solid management that link the local to the national and vice versa for the development of extension.
• The classical function of extension of “extending” knowledge and technologies and mainly working on aspects of production and education is being complemented by other needs and functions that go beyond the agricultural sector. The presence of these inter-sectoral functions merits the development of new institutional structures and skills.
• Institutional innovations for extension in a context of agricultural and rural innovation should consider the micro, meso, and macro levels. Failing to recognize them will lead to incomplete and unsustainable models and innovations.

This publication is also available in Spanish on the RELASER website.

There are three dimensions to sustainable development: social, economic, and environmental. Knowledge sharing is critical to supporting these dimensions, and extension and advisory services are a vital knowledge-sharing institution. Extension is key for linking scientific research, field-level innovations and innovators, markets, education, and other service providers.

Extension services are essential to enable farmers to improve their practices and help them respond to emerging challenges. Knowledge, ideas, and skills gained through extension programmes can help farmers increase their productivity, reduce losses, and gain better access to markets.

The positive impact of extension services is well demonstrated globally. Whether through Farmer Field Schools, marketing training, or by using innovative technologies, knowledge sharing underpins sustainable agricultural practices.

The examples illustrate the importance of participatory processes and farmers’ proactive participation in extension programmes to ensure they meet their needs. The case studies highlight the diversity of issues that can be tackled through extension and advisory services, and the positive impacts these can have on farmers’ livelihoods. In many cases, extension services are an addition to existing structures, such as farmer co-operatives, and are offered as part of a package of services. This helps to ensure that the positive outcomes from extension, such as increased yields, can be translated into positive outcomes for farmers, for example by supporting the marketing of the improved crops.

Extension services enable farmers to take up innovations, improve production, and protect the environment. Extension shows positive effects on knowledge, adoption, and productivity. With studies showing very high (13–500%) rates of return to extension, it is a cost-effective way to improve farmer productivity and income.

Experiences with extension programmes show the positive impact that they have on productivity and farmer incomes. For instance, a programme with cacao farmers in Peru saw productivity rise from 340 to 600 kg per ha in three years.