Define the evaluation process

Goal

The main reason to monitor progress in achieving the adaptation goals is to evaluate the performance of the adaptation strategy and to adjust the strategy when the outcomes are not as expected or lagging behind. See also the Frequently Encountered Challenge page on ‘Monitoring & Evaluation‘. Within this step an approach is developed to perform the evaluation and to adjust the adaptation strategy.

Preconditions

Main input for the evaluation process is provided by assessing and scoring indicators. If these haven’t been defined yet, this page provides assistance in doing so. Furthermore, detailed knowledge of the procedures and planning processes within the municipality and of the adaptation strategy itself are required to perform this step.

Outcomes

The outcome of this step is an approach on how to analyze the adaptation strategy using indicators and how to translate the acquired insights into an adjusted adaptation strategy. This approach will be part of the Monitoring and evaluation plan.

Guidelines

Evaluation of the adaptation strategy

Frequent assessment of the indicators provides valuable information in monitoring the progress towards climate resilience. It can show if actual progress is being made and which goals are lagging behind. However, a deeper analysis by administrators and researchers is needed to determine the causes of apparent issues, taking into account that external factors might also prevent or stimulate climate resilience. When these issues and causes have been identified, one can develop possible solutions that would accelerate the achievement of the adaptation goals.

Steps for the evaluation could be:

  • Calculate the indicators  as described in their fact sheets (see the step ‘Define indicators‘)
  • Analyse the outcome of the indicator assessment and determine areas that are progressing better than expected as well as areas that require improvement.
  • Investigate the causes for better/worse results than expected (e.g. external/internal developments, changes in vulnerability/risks)
  • Discuss the insights from the evaluation phase with relevant stakeholders.
  • Define solutions for areas that require improvement, if necessary by consulting experts and stakeholders

Adjustment of the adaptation strategy

The issues and solutions resulting from the evaluation will require adjustments in the adaptation strategy. How these adjustments can be made depends on the planning procedure and planning cycle of the city. The previously approved version of the adaptation strategy would, in all probability, have to be approved again by officials and stakeholders if significant changes are being made. Local administrators, therefore, would have to draw a plan on how and when best to adjust the adaptation strategy.

Steps to adjust the adaptation strategy could be:

  • Check whether the adaptation goals are still relevant and whether the suggested improvements contribute to these goals.
  • Adjust the adaptation strategy and implementation plan accordingly
  • Get the required approval for the renewed adaptation strategy

Experiences

Paris

A spreadsheet has been created to pilot and monitor progress on the Paris Adaptation Strategy (adopted in November 2015). For each of the 30 objectives and 35 actions, the Climate and Energies Department of the City has identified the department or more specific entity that will be in charge of the objective/action, the person in charge within that department/entity, potential contributors, the intended time-frame or time-horizon of the objective/action and some suggested indicators. The detailed content of the objective/action is also presented in bullet points, with different colors to highlight studies that need to be conducted, plans that need to be elaborated and existing documents that need to be amended. Next to this information, the spreadsheet includes a column to write text about the progress of implementation, with a four-level color code: white for “not started”, yellow for “scheduled to start”, green for “started”, and blue for “completed”. In another tab of the spreadsheet, the level of progress is refined: 20 columns are gradually colored to represent completion of 5%, 10%, 15%, etc. of the measure. Finally, a last tab makes separate lists of the studies that need to be conducted, plans that need to be elaborated and existing documents that need to be amended, and displays which of these tasks are started and which are completed.

Supporting tools and methods

No tools or methods found