in

Conventional approaches to indicators and metrics undermine urban climate adaptation

Abstract

Measurement is essential for effective adaptation management and operation, and indicators and metrics (I&M) have a pivotal role. Surprisingly, systematic efforts to assess advances in the provision of adaptation I&M are scarce, and those that do exist often lack in-depth analysis of the types, characteristics, and applicability of the collected information. Here, we analyse 137 publications and 901 I&M sourced in the scientific literature (2007–2022) to measure adaptation to climate change in urban areas where governments are increasingly placing efforts to prepare populations and infrastructures. A lack of common terminology, standardisation, and guidelines has resulted in a field that is complex to track and understand. This complexity has led to a fragmented methodological landscape, marked by diverse, context-dependent, and occasionally conflicting approaches to the development of I&M. We argue that conventional approaches to I&M are largely inadequate and must better emphasise quantifiability, long-term assessment, and alignment with policy objectives.

Data availability

Data generated or analysed during this study are included in this published article (and its Supplementary Information) and online repositories. The information available through online repositories includes the dataset of publications and indicators and connected metadata, which can be found online at DOI [10.5281/zenodo.10663610] (https://doi.org/10.5281/zenodo.10663610).

References

  1. Peters, G. P. et al. Key indicators to track current progress and future ambition of the Paris Agreement. Nat. Clim. Change 7, 118–122 (2017).

    Google Scholar 

  2. New, M. et al. Decision-Making Options for Managing Risk. In Proc. Climate Change 2022: Impacts, Adaptation and Vulnerability. Contribution of Working Group II to the Sixth Assessment Report of the Intergovernmental Panel on Climate Change (eds. Pörtner, H.-O. et al.) 2539–2654 https://doi.org/10.1017/9781009325844.026 (Cambridge University Press, 2022).

  3. Berrang-Ford, L. et al. A systematic global stocktake of evidence on human adaptation to climate change. Nat. Clim. Change 11, 989–1000 (2021).

    Google Scholar 

  4. Eriksen, S. et al. Adaptation interventions and their effect on vulnerability in developing countries: help, hindrance or irrelevance?. World Dev. 141, 105383 (2021).

    Google Scholar 

  5. Sparkes, E. & Werners, S. E. Monitoring, evaluation and learning requirements for climate-resilient development pathways. Curr. Opin. Environ. Sustain. 64, 101329 (2023).

    Google Scholar 

  6. Fisher, S. Much ado about nothing? Why adaptation measurement matters. Clim. Dev. 16, 161–167 (2024).

    Google Scholar 

  7. Goodwin, S., Olazabal, M., Castro, A. J. & Pascual, U. Measuring the contribution of nature-based solutions beyond climate adaptation in cities. Glob. Environ. Change 89, 102939 (2024).

    Google Scholar 

  8. Amorim-Maia, A. T. & Olazabal, M. Beyond adjustment: a new paradigm for climate change adaptation in a complex world. Glob. Environ. Change 93, 103027 (2025).

    Google Scholar 

  9. Nalau, J. & Verrall, B. Mapping the evolution and current trends in climate change adaptation science. Clim. Risk Manag. 100290 https://doi.org/10.1016/j.crm.2021.100290 (2021).

  10. Hale, T. N. et al. Sub- and non-state climate action: a framework to assess progress, implementation and impact. Clim. Policy 21, 406–420 (2021).

    Google Scholar 

  11. Arnott, J. C., Moser, S. C. & Goodrich, K. A. Evaluation that counts: a review of climate change adaptation indicators & metrics using lessons from effective evaluation and science-practice interaction. Environ. Sci. Policy 66, 383–392 (2016).

    Google Scholar 

  12. Goonesekera, S. M. & Olazabal, M. Climate adaptation indicators and metrics: State of local policy practice. Ecol. Indic. 145, 109657 (2022).

    Google Scholar 

  13. Klostermann, J. et al. Towards a framework to assess, compare and develop monitoring and evaluation of climate change adaptation in Europe. Mitig. Adapt. Strateg. Glob. Change 23, 187–209 (2018).

    Google Scholar 

  14. Leiter, T. Do governments track the implementation of national climate change adaptation plans? An evidence-based global stocktake of monitoring and evaluation systems. Environ. Sci. Policy 125, 179–188 (2021).

    Google Scholar 

  15. Beauchamp, E. & Józefiak, I. Next Steps for Defining a Monitoring, Evaluation, and Learning System for the Global Goal on Adaptation by COP 28. https://www.iisd.org/publications/report/global-goal-on-adaptation-monitoring-evaluation-learning-framework-cop-28 (2023).

  16. Canales, N., Klein, R. J. T., Bakhtaoui, I. & Macura, B. Assessing adaptation progress for the global stocktake. Nat. Clim. Change 1–2 https://doi.org/10.1038/s41558-023-01656-x (2023).

  17. Adaptation Committee. Approaches to Reviewing the Overall Progress Made in Achieving the Global Goal on Adaptation. https://unfccc.int/process-and-meetings/bodies/constituted-bodies/adaptation-committee-ac/publications-bulletin-adaptation-committee (2021).

  18. Leiter, T. Too little, too slow? Climate adaptation at the United Nations climate change negotiations since the adoption of the Paris Agreement. Carbon Clim. Law Rev. 16, 243–258 (2023).

    Google Scholar 

  19. Dodman, D. et al. Cities, settlements and key infrastructure supplementary material. In Proc. Climate Change 2022: Impacts, Adaptation, and Vulnerability. Contribution of Working Group II to the Sixth Assessment Report of the Intergovernmental Panel on Climate Change (eds. Pörtner, H.-O. et al.) (IPCC, 2023).

  20. Berrang-Ford, L. et al. Tracking global climate change adaptation among governments. Nat. Clim. Change 9, 440 (2019).

    Google Scholar 

  21. Olazabal, M., Galarraga, I., Ford, J., Sainz de Murieta, E. & Lesnikowski, A. Are local climate adaptation policies credible? A conceptual and operational assessment framework. Int. J. Urban Sustain. Dev. 11, 277–296 (2019).

    Google Scholar 

  22. IPCC. Climate Change 2022: Impacts, Adaptation, and Vulnerability. Contribution of Working Group II to the Sixth Assessment Report of the Intergovernmental Panel on Climate Change (Cambridge University Press, 2023).

  23. Reckien, D. et al. Quality of urban climate adaptation plans over time. npj Urban Sustain 3, 1–14 (2023).

    Google Scholar 

  24. Biesbroek, R. & Lesnikowski, A. Unpacking symbolic policy-making for the first Global Stocktake under the Paris Agreement. npj Clim. Action 2, 1–3 (2023).

    Google Scholar 

  25. Olazabal, M., Ruiz de Gopegui, M., Tompkins, E. L., Venner, K. & Smith, R. A cross-scale worldwide analysis of coastal adaptation planning. Environ. Res. Lett. 14, 124056 (2019).

    Google Scholar 

  26. Solecki, W. & Rosenzweig, C. Indicators and monitoring systems for urban climate resiliency. Clim. Change https://doi.org/10.1007/s10584-020-02947-4 (2020).

  27. Tyler, S. et al. Indicators of urban climate resilience: a contextual approach. Environ. Sci. Policy 66, 420–426 (2016).

    Google Scholar 

  28. Kabisch, N. et al. Nature-based solutions to climate change mitigation and adaptation in urban areas: perspectives on indicators, knowledge gaps, barriers, and opportunities for action. Ecol. Soc. 21, 39 (2016).

    Google Scholar 

  29. Sanchez Martinez, G., von der Pahlen, M. T., Kendrovski, V., Linares, C. & Diaz, J. Indicators to monitor policy progress in health adaptation to climate change: do they really do the job? Eur. J. Public Health 30, Supplement_5 (2020).

  30. Salehi, S. et al. Climate change adaptation: a systematic review on domains and indicators. Nat. Hazards 96, 521–550 (2019).

    Google Scholar 

  31. Feldmeyer, D. et al. Indicators for monitoring urban climate change resilience and adaptation. Sustainability 11, 2931 (2019).

    Google Scholar 

  32. Granceri Bradaschia, M., Longato, D., Maragno, D. & Musco, F. Climate change adaptation mainstreaming through strategic environmental assessments. An in-depth analysis of environmental indicators from spatial plans in Friuli Venezia Giulia Region (Italy). Environ. Impact Assess. Rev. 109, 107650 (2024).

    Google Scholar 

  33. Chmutina, K., Lizarralde, G., von Meding, J. & Bosher, L. Standardised indicators for “resilient cities”: the folly of devising a technical solution to a political problem. Int. J. Disaster Resil. Built Environ. 14, 514–535 (2023).

    Google Scholar 

  34. Pearce-Higgins, J. W. et al. A framework for climate change adaptation indicators for the natural environment. Ecol. Indic. 136, 108690 (2022).

    Google Scholar 

  35. Kuhlicke, C. et al. Spinning in circles? A systematic review on the role of theory in social vulnerability, resilience and adaptation research. Glob. Environ. Change 80, 102672 (2023).

    Google Scholar 

  36. Lindner, R., Hernantes, J. & Jaca, C. Foster the application of ISO standards on climate change adaptation in cities. J. Stand. 3, 1 (2024).

  37. J. B. A. Consulting. Review of Climate Resilience Mainstreaming into Regulatory and Voluntary Standards, National Guidance, and Other Sectoral/Industry Codes of Practice. https://www.ukclimateresilience.org/projects/review-of-standards-guidance-and-codes-of-practice-for-enhancing-climate-resilience/ (2020).

  38. Pringle, P. & Leiter, T. Pitfalls and potential of measuring climate change adaptation through adaptation metrics. In Proc. Adaptation metrics: Perspectives on measuring, aggregating and comparing adaptation results (eds. Christiansen, L., Martinez, G. & Naswa, P.) 29 (UNEP DTU, 2018).

  39. Laurien, F., Martin, J. G. C. & Mehryar, S. Climate and disaster resilience measurement: persistent gaps in multiple hazards, methods, and practicability. Clim. Risk Manag. 37, 100443 (2022).

    Google Scholar 

  40. Vincent, K. & Cundill, G. The evolution of empirical adaptation research in the global South from 2010 to 2020. Clim. Dev. 14, 25–38 (2022).

    Google Scholar 

  41. Zall Kusek, J. & Rist, R. C. Ten Steps to a Results-Based Monitoring and Evaluation System: A Handbook for Development Practitioners (World Bank Group, 2004).

  42. OECD. Measuring Progress in Adapting to a Changing Climate: Insights from OECD Countries. https://doi.org/10.1787/8cfe45af-en (OECD, 2024).

  43. Olazabal, M. & Ruiz De Gopegui, M. Adaptation planning in large cities is unlikely to be effective. Landsc. Urban Plan. 206, 103974 (2021).

    Google Scholar 

  44. Ruiz de Gopegui Aramburu, M., Olazabal, M. & Broto, V. C. Examining climate justice in urban public space adaptation: a thematic synthesis of the literature. J. City Clim. Policy Econ. 2, 271–315 (2024).

    Google Scholar 

  45. Brugnach, M. & Hoek, R. van den. Embracing ambiguity in climate change adaptation for more effective responses to new uncertain shorescapes conditions. Mar. Policy 152, 105626 (2023).

    Google Scholar 

  46. Bartelet, H. A., Barnes, M. L., Bakti, L. A. A. & Cumming, G. S. Operationalizing and measuring climate change adaptation success. Ecol. Soc. 30, 1 (2025).

  47. Revi, A. et al. Transformative adaptation in cities. One Earth 3, 384–387 (2020).

    Google Scholar 

  48. Brooks, N. & Fisher, S. Tracking Adaptation and Measuring Development: A Step-by-Step Guide. http://pubs.iied.org/10100IIED.html (2014).

  49. Dupuits, E., Garcés, A., Llambí, L. D. & Bustamante, M. Strategies for monitoring and evaluation of climate change adaptation: localizing global approaches into Andean realities. npj Clim. Action 3, 19 (2024).

    Google Scholar 

  50. Sainz de Murieta, E., Galarraga, I. & Olazabal, M. How well do climate adaptation policies align with risk-based approaches? An assessment framework for cities. Cities 103018 https://doi.org/10.1016/j.cities.2020.103018 (2020).

  51. Sharifi, A. A critical review of selected tools for assessing community resilience. Ecol. Indic. 69, 629–647 (2016).

    Google Scholar 

  52. Westman, L. et al. Compound urban crises. Ambio 51, 1402–1415 (2022).

    Google Scholar 

  53. Turner, S., Moloney, S., Glover, A. & Fünfgeld, H. A Review of the Monitoring and Evaluation Literature for Climate Change Adaptation (RMIT University Centre for Urban Research, 2014).

Download references

Acknowledgements

MO, AM and WL have been funded by the European Union (ERC, IMAGINE adaptation, 101039429). Their research is also supported by the María de Maeztu Excellence Unit 2023-2027 Ref. CEX2021-001201-M, funded by MCIN/AEI/10.13039/501100011033; and by the Basque Government through the BERC 2022-2025 program. MO would like to acknowledge the support of the grant RYC2022-037585-I funded by MCIU/AEI/10.13039/501100011033 and ESF+. LG, AV and MO are members of the SAREN Research Group funded by the Basque Government IT1619-22 and AV is funded by UPV/EHU PIF 2020 grant. This work was originally conceived during discussions of the Cities Committee of the International Platform of Adaptation Metrics (IPAM), led by MO.

Author information

Authors and Affiliations

Authors

Contributions

M.O. Conceptualisation; methodology; data collection stage 1; Data collection stage 2; data curation; formal analysis; writing—original draft; writing—review and editing; visualisation; supervision; funding acquisition. A.M. Data collection stage 2; data curation; formal analysis; visualisation; writing—review and editing. S.S. Methodology; data collection stage 1; data collection stage 2; formal analysis; writing—review and editing; visualisation. L.H.L. Data collection stage 1; Data collection stage 2; formal analysis; writing—review and editing. M.G. Methodology; data collection stage 1; data collection stage 2; visualisation. A.V. Methodology; data collection stage 1; data collection stage 2; writing—review and editing. L.G. Methodology; data collection stage 1; data collection stage 2; writing—review and editing. P.D.A. Data collection stage 1; data collection stage 2; writing—review and editing. A.S. Data collection stage 1; data collection stage 2; writing—review and editing. O.A. Data collection stage 1; data collection stage 2. P.M. Data collection stage 2; writing—review and editing. W.L. Data curation; writing—review and editing. B.I. Data collection stage 1. E.M. Data collection stage 1. I.F. Data collection stage 2.

Corresponding author

Correspondence to
Marta Olazabal.

Ethics declarations

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

NPJURBANSUSTAIN-01070-T Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Cite this article

Olazabal, M., Mansur, A.V., Sahay, S. et al. Conventional approaches to indicators and metrics undermine urban climate adaptation.
npj Urban Sustain (2025). https://doi.org/10.1038/s42949-025-00310-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1038/s42949-025-00310-z


Source: Ecology - nature.com

Barrier impermeability is associated with migratory ungulate survival rates

High-frequency observations during Adriatic mucilage event reveal unique phytoplankton traits and diversity response

Back to Top