I’ve been reflecting on the idea of measuring resilience since the conference in Montpellier last month where @vgalaz quipped “Resilience metrics is the new black @resilience2014”. Efforts to measure resilience are well underway while at the same time there are concerns about what exactly is being measured and whether this shift in focus misses the point of what resilience thinking has to offer. My own thinking on this is that it depends on what you are trying to achieve but a deeper understanding of both perspectives is likely to benefit both approaches in the long-term.

Approaching the dialogue from two perspectives
The Resilience 2014 conference aimed to facilitate dialogue among researchers and practitioners from the resilience research community and the development community. To date, resilience has been conceptualized and applied in a variety of ways. Research along the lines of Holling, Gunderson, Folke, and Walker as well as many others in the Resilience Alliance network and beyond, has emerged from a complex adaptive systems’ perspective and in particular, a focus on ecosystems and integrated social-ecological systems. By contrast, development communities tend to approach resilience from a more human-centered perspective with a focus on livelihoods, risk reduction, and human well-being. What both communities hold in common is a desire to operationalize resilience by applying theoretical insights to real world problems and changing the way we manage and interact with the environment for more sustainable and equitable outcomes.

The demand side of resilience in development
The rapid uptake of resilience thinking by development agencies and foundations has forced the issue of resilience implementation and challenged the research community to make the leap from theory to practice to metrics. While resilience practice is not entirely new (see Walker & Salt 2012) and case studies have informed theoretical advances over the years the wide-ranging application of resilience thinking to development issues, is a relatively recent phenomenon. Development programs and projects operate within a different realm and have their own established frameworks, protocols, and practices. Notably, development programs require well-defined mechanisms for evaluating interventions and more specifically, metrics for quantifying and judging the success of their actions and investments. Thus the challenge that presents itself is how to measure resilience, if indeed it can or should be measured? This is a nuanced question, and much like the concept it addresses, there are multiple dimensions and no easy answers but it remains a worthy pursuit.

To measure or not to measure?
There is a concern shared by many that resilience may not live up to its promise for a variety of reasons including the potential for narrow interpretations and a selective or limited understanding of what can be a relatively abstract concept, but also because of a what some have identified as a lack of quantifiable metrics for evaluation purposes. In Luca Alinova’s plenary presentation he spoke of the very real threat of resilience being adopted and applied in name only, whereby others capitalize on the current trendiness of the concept while much of the same ineffective practices continue under the guise of a new name. In his words “there is a big risk of labeling some bad habits with a new name”. Any failures of course, will have a handy scapegoat and an enormous opportunity will have been lost. Similarly, there is a real risk that in the rush to measure resilience and develop quantitative metrics for comparative purposes, what is actually measured may represent the same things that have long been monitored and measured but are now being packaged in the language of resilience to meet the demand.

The fact remains however, that resilience will and already is, being measured.

What exactly is being measured?
If resilience must be measured to be meaningful to the development community, then how best to measure it? Luca Alinovi suggests we need to measure resilience at the household level rather than at an individual level because it is the interactions that are important. He also cautioned though that we are still far away from the dynamic analysis that is needed as well as a general approach for different types of systems.

Much of the discussion at Resilience 2014 around the topic of metrics tended to focus on food security and crisis impacts. Alexis Hoskins presented on the progress being made by the Food and Nutrition Security Resilience Measurement Technical Working Group that has produced a framing paper outlining the challenges in measuring resilience. They have also produced a set of resilience measurement principles that echo Alinovi’s call for dynamic analysis and reflect both systems-based requirements (multi-level interactions, rates of change, inherent volatility) as well as human dimensions (e.g., desirability of system states, people’s perceptions, vulnerability connections). The recommendations and next steps that follow from the measurement principles appear promising because they account for the underlying concepts of complex systems dynamics and cross-scale interactions, while recognizing the need for both quantitative and qualitative data to understand causal mechanisms.

Other presenters similarly advocated for a mixed method approach to measuring resilience, combining qualitative and quantitative data, as well as steps for interpreting data and providing the necessary contextualization that metrics alone cannot fully capture. Yet another type of approach offered by Christophe Bene, was a resilience proxy based on the cost of impacts calculated from the sum of anticipation costs + impact costs + recovery costs. Bene’s postulate being “the more resilient an individual the lower the costs it takes to get through a specific shock”. Assigning monetary values as a means of measuring resilience has many parallels in the ecosystem services literature, which increasingly recognizes the need to also consider nonmonetary values.

What is missing?
There is clearly something to be gained by measuring resilience, but any formula attempting to capture a dynamic system property will inevitably involve tradeoffs for simplifying purposes and something will be lost. Understanding exactly what is missing from resilience metrics or what is potentially lost with a shift in focus from understanding the resilience of a system to measuring the resilience of a system remains to be clearly articulated. In resilience assessment, a main objective of the exercise is to re-conceptualize a system, place, or issue from an alternative perspective, i.e., through a resilience lens and focusing on interactions such that new insights emerge and interventions can be better informed. How a system behaves is not a function of the sum of its parts so it follows that measuring component parts cannot capture what is meaningful about resilience.

To date, most metrics being proposed focus on social variables and the human dimensions of resilience, as opposed to taking an integrated social-ecological systems (SES) approach. Conceptualizing humans as part of nature and placing people within ecosystems, instead of keeping them separate, represents an important advance in resilience research and sustainability science more broadly. Metrics for resilience and more generally, the application of the concept in practice also stands to benefit from taking an SES approach.

Some considerations for developing resilience metrics
It has been said before that resilience is an overarching concept that encompasses many other core concepts. Biggs and colleagues (2012) identify seven principles for building resilience of ecosystem services. Assuming a given bundle of ES is desirable (and knowing for whom it matters), these seven facets can be managed to strengthen and enhance the resilience of the system. They include: maintaining diversity and redundancy, managing connectivity, managing slow variables and feedbacks, fostering complex adaptive systems thinking, encouraging learning, broadening participation, and promoting polycentric governance systems. To the extent resilience metrics can effectively address these seven principles, they would provide valuable information to anyone wanting to characterize and monitor the capacity of the system to maintain a desired set of ecosystem services in the face of continued change or disturbance.

A final consideration is that resilience is not always a good thing. As Brian Walker stated in his plenary presentation, part of the understanding required is knowing where we need to build resilience, and where we need to reduce it to enable transformation. A range of different types of traps characterized by rigid social and ecological processes that are tied to environmental degradation and livelihood impoverishment make change a real challenge (Boonstra and de Boer, 2014). Where traps exist, the goal may be to reduce the resilience of the current state of the system and build transformative capacity, which may require monitoring and measuring a different set of variables.

Measuring resilience should be possible but finding suitable indicators and metrics that retain key attributes of the concept will also need to reflect the fact that resilience is a means and not an end.

REFS:
Biggs et al. 2012. Towards Principles for Enhancing the Resilience of Ecosystem Services. Annu. Rev. Environ. Resour. 37:421-48.

Walker, B. & D. Salt. 2012. Resilience Practice: Building capacity to absorb disturbance and maintain function. Island Press, Washington, D.C.