
Uncertainty and sensitivity analysis: methodological principles
2026-11-13
Note
Une version française de cet article est disponible : Principes méthodologiques de l’analyse d’incertitude et de sensibilité.
Context and scope
Cost-benefit analysis based on avoided damages (CBA) is widely used to appraise flood management projects. In France, it is the recommended approach for appraising flood management projects involving structural measures whose investment exceeds 2.5 million euros, where a global sensitivity analysis is a mandatory step.
Estimating the main CBA indicator — Net Present Value (NPV) — requires chaining several modeling stages:
- hydrological modeling to characterize flood scenarios;
- hydraulic modeling to spatialize flood scenarios;
- digital terrain modeling to represent topography and protection structures;
- GIS processing to locate exposed stakes;
- classification of stakes according to their nature and vulnerability;
- vulnerability modeling via damage functions.
Each stage relies on assumptions and input data that introduce uncertainty into the resulting NPV. Performing a full uncertainty analysis across the entire hydrological-hydraulic-damage chain is computationally prohibitive for routine operational appraisals. However, as formalized in Grelot (2017) (GrelotF2017b), a practical first assessment can be carried out by building a simplified meta-model around the intermediate outputs of the nominal CBA.
From floodam.cba.sa to floodam.cba
Originally implemented in the CBA-DE-AS scripts and later in the standalone package floodam.cba.sa, this meta-model is now integrated directly into floodam.cba (from version 1.3.0.0). It reuses the nominal intermediate quantities already computed in a Case object to perform:
-
Verification of nominal CBA indicators (
npvandbenefit); -
Monte Carlo uncertainty analysis (UA) by sampling uncertain input parameters and evaluating the empirical distribution of
npvandbenefit; -
Global sensitivity analysis (SA) by estimating first-order () and total () Sobol indices using the sensitivity package (by default
sensitivity::sobolmartinez).
Because floodam.cba does not rerun hydraulic simulations or spatial damage intersections (which are handled by upstream tools such as floodam.spatial), uncertainty on spatial hazard and vulnerability is represented through aggregated multipliers at the flood-scenario and stake-type levels.
Meta-model formulation
Net Present Value (npv)
In floodam.cba, the Net Present Value of a project is evaluated over a time horizon from normalized annual schedules of benefit activation and cost disbursements:
where:
-
is the expected annual avoided damage (EAAD, or
benefit) once the project is fully operational; - is the normalized benefit activation ratio in year (derived from the project’s state calendar);
- is the total nominal or sampled cost for cost item (investment or annual maintenance for each project action);
- is the annual disbursement weight for cost item in year (normalized so that );
-
is the discount factor at year for discount rate schedule (computed by
discount_weight()).
Note
In the current implementation (
1.3.0.0), project costs are evaluated assuming zero costs in the counterfactual reference situation (reference). Differential cost accounting betweenprojectandreferenceis planned for a future release.
Expected annual avoided damage (benefit)
Expected annual avoided damage is approximated by trapezoidal integration of avoided damages along exceedance frequency :
where:
- is the set of flood scenarios, ordered by increasing return period ;
-
is the trapezoidal integration weight of scenario computed from the vector of return periods via
calculate_weight(); - is the set of stake categories;
- is the nominal avoided damage for stake and flood scenario between the project’s initial and final states (which may be positive or negative);
- is a multiplicative uncertainty factor on damage estimation for stake (nominal value );
- is a modeling proxy representing uncertainty on the project’s hydraulic efficiency for flood scenario (nominal value ).
Note
If for a specific stake or scenario, the project induces a net disbenefit rather than an avoided damage. This has no effect on , though it can affect benefit-cost ratio interpretations.
Flood scenario weights
Assuming flood scenarios sorted in increasing order of return period (with exceedance frequencies ), the trapezoidal weights are given by:
- for
Because return periods are themselves subject to uncertainty, the weights are recomputed dynamically for each Monte Carlo draw. To preserve the physical ordering , prepare_flood_range() automatically truncates overlapping return-period bounds at the midpoint between adjacent nominal return periods.
Uncertainty modeling and Sobol indices
Uncertainties are assigned to four parameter families:
- Project costs (, investment and maintenance per action);
- Return periods (, per flood scenario);
- Hydraulic efficiency (, per flood scenario);
- Damage estimations (, per stake category).
Each uncertain parameter is modeled as an independent uniform random variable between a lower bound min and an upper bound max (specified either as relative variations around the nominal value or as absolute bounds).
Global sensitivity analysis decomposes the output variance (for or ) into contributions from individual parameters and their interactions:
- First-order Sobol index : fraction of output variance explained by parameter alone;
- Total Sobol index : fraction of output variance explained by including all its interactions with other parameters.
Reference
- Grelot, F. (2017). Méthode simplifiée d’analyse d’incertitude et de sensibilité globale pour les analyses coût-bénéfice des projets de gestion des inondations (
GrelotF2017b).