working paper

Reshaping Monitoring, Evaluation, and Learning for Locally Led Adaptation

Tamara Coger Sarah Corry Robbie Gregorowski
Partners:
Download PDF

2. Key Considerations for Supporting LLA throughout the MEL Cycle

Eight foundational principles outline the basic requirements for finance for adaptation that is accessible to and owned by appropriate local actors, and provide a framework for assessing how MEL practices support locally led adaptation. These principles were developed for the Global Commission on Adaptation by the International Institute for Environment and Development (IIED) in partnership with World Resources Institute (Soanes et al. 2021). They build on a decade of foundational work carried out by IIED, with Slum Dwellers International, Huairou Commission, the International Center for Climate Change and Development, and many others regarding financing for adaptation and resource access in communities vulnerable to climate change. The principles are grounded in the recommendations of the Global Commission on Adaptation’s Adapt Now report to increase the volume of devolved and decentralized funding available to local actors to identify, prioritize, design, implement, monitor, and learn from climate adaptation solutions (Global Commission on Adaptation 2019).

These principles serve a basis for understanding the potential of MEL to support locally led adaptation. Table 1 summarizes the eight principles and is followed by a discussion of overarching considerations for MEL to support these principles of LLA.

Table 1 | Summary of the Eight Principles of Locally Led Adaptation from the Global Commission on Adaptation

Principle 1

Devolution of decision-making to the lowest appropriate level ensures that those most affected by climate change have agency over decisions about adaptation finance and programming that will affect them.

Principle 2

Addressing structural inequalities faced by women, youth, children, disabled, displaced, and excluded ethnic groups entails actively recognizing and redressing the power dynamics, imbalances, and development deficits that create vulnerability, poverty, and marginalization.

Principle 3

Providing patient and predictable funding that can be accessed more easily requires that funding mechanisms be simplified and finance provided over longer, more predictable timescales to enable greater access to funding by local actors, support adaptive management and learning, and adequately strengthen local institutions.

Principle 4

Investing in local institutions to leave institutional legacies means building and strengthening local institutions by building capacity to understand climate risks and uncertainties, capacity to generate resilience solutions, capacity to facilitate and manage adaptation initiatives, and capacity for local fiduciary and management so that these institutions can provide grants and loans to other local actors for local adaptation actions.

Principle 5

Building a robust understanding of climate risk and uncertainty supports locally led adaptation by ensuring that interventions reflect understanding of local climate risks, current resilience-building practices, and uncertainties about direct and indirect climate impacts on local communities, as well as appropriate tools to handle uncertainties.

Principle 6

Flexible programming and learning recognizes that it is important to maintain budget and programmatic flexibility as well as space for adaptive management and learning.

Principle 7

Through transparency and accountability, decision-making and governance structures are made explicit, so it is clear which decisions are made at what level of organization and by whom. Financing flows should also be made transparent and can be publicly tracked, and ultimate accountability should be to local actors themselves.

Principle 8

Coordinated action and investment by donors, aid agencies, and governments recognize the need for multiple levels of coordination, horizontally among communities and across sectors, and vertically across levels of government and policy processes.

Source: Soanes et al. 2021.

Putting these principles of LLA into practice through MEL entails several key considerations, drawn from relevant MEL research and practice. The remainder of this section discusses tenets for supporting LLA that are relevant throughout the stages of MEL: design and planning, monitoring, evaluation, and learning.

Recognizing and addressing how structural inequalities affect MEL reduces bias. Structural inequalities, such as those related to gender, race or ethnicity, and socioeconomic status, can manifest in different ways in MEL. Unequal value may be attributed to the different worldviews and perspectives, biasing outputs of the MEL process toward the worldviews and perspectives of participants with the most power (Segone 2012; Joyce 2020). For example, if a planning workshop does not provide a safe and inviting environment for participants with firsthand adaptation experience to speak up, then the outcomes of the workshop, such as a theory of change or indicator framework, will not reflect a complete understanding of challenges and possible solutions. Structural inequalities may be present between local actors and external actors (such as donors and MEL practitioners), among actors at the local level, between local government and civil society, or between women and men (Morchain et al. 2019). As such, it is important for LLA interventions to deliberately encourage equity.

Steps can be taken throughout the MEL cycle to mitigate the effect of structural inequalities on MEL, including conducting gender and social equity assessments, ensuring balanced and representative decision-making structures, and including indicators to understand the equity of decision-making processes. In applying Oxfam’s Vulnerability and Risk Assessment methodology in Malawi, Botswana, and Namibia, Morchain et al. (2019) acknowledged how their position as academics would bias the outcomes of the assessment. They broadened the framing of the assessment to include development priorities, in addition to climate priorities, and used translators and breakout groups to mitigate the effect of preexisting cultural norms and power dynamics in group discussions (Morchain et al. 2019).

The importance of local agency applies to decisions made through the MEL cycle. For an intervention to be genuinely locally led, local actors must have agency over their priorities and how adaptation takes place. Extended to MEL, local actors would have agency over the priorities of the MEL system and how MEL takes place in support of the intervention. Ensuring local agency in MEL starts with local ownership to help shape the overall purpose of the MEL system and data collection analysis methods and tools, and actively centering learning processes and products on the needs and demands of local actors (Silva Villanueva 2011; Faulkner et al. 2015).

Increasing access to information by tailoring knowledge products and tools to local audiences, and enhancing capacity to engage in MEL, supports local agency. Local universities and civil society organizations have a role to play as climate knowledge brokers, transforming data and information into knowledge for practical adaptation interventions, often working with local actors to coproduce knowledge on adaptation experience. Adaptation at Scale in Semi-arid Regions is a university network consortium that translates the experiences and input of communities on the front lines of climate change, giving them the opportunity to influence adaptation policy responses. Similarly, the University of Arizona’s Cooperative Extension system provides insights on context-specific local adaptation, researching adaptation processes and disseminating knowledge about local adaptation interventions to help both local government and local actors, particularly farmers, make informed decisions about adapting to changing climatic conditions (Brugger and Crimmins 2015). In an example of local government tailoring adaptation knowledge to its constituents, the Planning Institute of Jamaica shared lessons learned about resilient agriculture by tailoring knowledge products and communications to different local audiences to support decision-making, including local farmers and government utility managers (Adaptation Fund 2020b).

MEL is a process for navigating the complexity, uncertainty, and context-specificity of LLA. Given the unpredictable nature of climate change and the complexity of social, economic, and ecological factors that affect adaptation, it can be hard to know what the outcomes of LLA solutions will be. MEL can provide a process for innovation, experimentation, and adaptive learning to help manage this complexity and uncertainty. Developing a participatory theory of change helps generate a shared and iterative understanding of local context and the many different factors that may affect the outcomes of the intervention. In monitoring, it becomes important to develop indicator frameworks that integrate social, environmental, and economic factors (such as those based on socioecological systems), and reflect the connections and feedbacks linking human and natural systems (Olsson and Galaz 2012). At the learning stage there should be a focus on learning from unintended consequences and failures as well as successes by drawing on and combining several sources of knowledge and experience, including expert, scientific, and local or indigenous knowledge (Hulme 2015).

Creating value for local actors avoids extractive MEL. Even participatory MEL processes can be extractive of local actors’ time, knowledge, resources, and expertise if they do not explicitly create value for them (Wilmsen 2008). Mechanisms for downward accountability can be built into MEL processes through local actors’ active participation and enabling them to assess donor performance (Ebrahim 2003; Van Zyl and Claeyé 2019). Indicator frameworks can support mutual accountability by including indicators that reflect local priorities and definitions of resilience, as well as indicators of agency and social inclusion in the adaptation process (Estrella and Gaventa 1998; Fisher 2014) Cocreation of methods can help ensure that evaluations are useful to local actors, donors, and evaluators alike. Tailoring evaluations to locally determined priorities can have the added benefit of incentivizing participation and interest in the evaluation and the adaptation intervention going forward (Dunkley and Franklin 2017; Fitzpatrick 2012). Learning questions and processes are another opportunity to prioritize the learning goals of local actors over those of external actors (Faulkner et al. 2015).

Effective learning processes support effective locally led adaptation outcomes. Learning is essential to embracing and understanding the complexity of adaptation, and is the process linking data and evidence to the resilience outcomes and other changes that adaptation interventions seek to create (Silva Villanueva 2011; STAP 2017). An adaptation strategy in its own right, learning is especially relevant for locally led adaptation because of its role in building adaptive capacity at the local level (Baird et al. 2014). Local actors learn from both successful and failed adaptation interventions through self-determined experimentation with different coping strategies, or through purposeful social learning processes, to prepare adequate responses and coping strategies to climate risks and intervention outcomes (Tschakert and Dietrich 2010). A fit-for-purpose learning process will reflect different learning needs, goals, and ways of learning among stakeholder groups, and legitimize the diverse types of evidence and knowledge that support them (Alessa et al. 2016).

The process of learning, versus knowledge products such as reports or briefs, is therefore a key consideration for LLA and is most effectively embedded throughout the MEL cycle. Supporting adaptive capacity through learning does require resources and time from all local and external partners involved and should be adequately planned and budgeted for (Tschakert and Dietrich 2010).

Applying these key considerations often entails practical constraints and challenges. The benefits of MEL processes that bring in a wider range of participants and introduce new elements may require additional time, resources, and capacity. Oxfam International recommends allocating 10–13 percent of a total budget to MEL (Carmona et al. 2018). Local and external partners alike may feel the burden of additional time, resources, and capacity. A challenge for those responsible for designing the MEL system is to balance the priority of local agency with the risk of overburdening local partners. Surveys or baseline studies that take more time than necessary, for example, can exhaust partners and make them less willing to engage in the MEL process (Flatters 2017). Emphasizing local agency to determine roles and responsibilities in MEL and adhering to the “do no harm” principle are strategies to help mitigate this risk.

Start reading