Match!

Sampling strategies in density-based sensitivity analysis

Published on Dec 1, 2012in Environmental Modelling and Software4.55
· DOI :10.1016/j.envsoft.2012.04.017
W. Castaings3
Estimated H-index: 3
(University of Toulouse),
Emanuele Borgonovo26
Estimated H-index: 26
(Bocconi University)
+ 1 AuthorsStefano Tarantola45
Estimated H-index: 45
Abstract
Decision and policy-makers benefit from the utilization of computer codes in an increasing number of areas and applications. Several authorities and agencies recommend the utilization of proper sensitivity analysis methods in order to confidently entrust model results. In this respect, density-based techniques have recently attracted interest among academicians and practitioners, for their property to characterize uncertainty in terms of the entire distribution of an output variable. However, their estimation is a challenging task and, without a proper methodical approach, errors in the estimates can lead to misleading conclusions. In this work, we propose sampling plans for reducing the computational burden of sensitivity estimates while improving and controlling the accuracy in the estimation. We compare designs based on column substitutions and designs based on permutations. We investigate their behaviour in terms of type I and type II errors. We apply the methods to the Level E model, a computational tool developed by the Nuclear Energy Agency of the OECD for the assessment of nuclear waste disposal sites. Results show that application of the proposed sampling plans allows one to obtain confidence in the sensitivity estimates at a number of model runs several orders of magnitude lower than a brute-force approach. This assessment, based upon the entire distribution of the model output, provides us with ways to effectively reduce uncertainty in the model output, either by prioritizing the model factors that need to be better known or by prioritizing the areas where additional modelling efforts are needed.
  • References (83)
  • Citations (48)
References83
Newest
#1Daniel James (CDU: Charles Darwin University)H-Index: 1
#2James Bruce Lee (CDU: Charles Darwin University)H-Index: 10
Last.Keane Wheeler (QUT: Queensland University of Technology)H-Index: 1
view all 3 authors...
1,377 CitationsSource
#1Thierry A. MaraH-Index: 14
#2Stefano Tarantola (Institute for the Protection and Security of the Citizen)H-Index: 45
114 CitationsSource
#1Emanuele Borgonovo (Bocconi University)H-Index: 26
#2W. Castaings (University of Toulouse)H-Index: 3
Last.Stefano Tarantola (Institute for the Protection and Security of the Citizen)H-Index: 45
view all 3 authors...
104 CitationsSource
#1Jiri Nossent (Vrije Universiteit Brussel)H-Index: 7
#2Pieter Elsen (Vrije Universiteit Brussel)H-Index: 1
Last.Willy Bauwens (Vrije Universiteit Brussel)H-Index: 21
view all 3 authors...
198 CitationsSource
#2William CastaingsH-Index: 1
Last.Stephano Tarantola (Institute for the Protection and Security of the Citizen)H-Index: 1
view all 3 authors...
94 CitationsSource
#1Sharif RahmanH-Index: 1
1,265 Citations
#1Andrea Saltelli (Institute for the Protection and Security of the Citizen)H-Index: 52
#2Paola Annoni (Institute for the Protection and Security of the Citizen)H-Index: 11
462 CitationsSource
#1Marco Ratto (EC: European Commission)H-Index: 10
#2Andrea Pagano (EC: European Commission)H-Index: 1
58 CitationsSource
#1Roberto Confalonieri (Institute for the Protection and Security of the Citizen)H-Index: 28
#2Gianni BellocchiH-Index: 28
Last.Giampiero Genovese (Institute for the Protection and Security of the Citizen)H-Index: 3
view all 6 authors...
63 CitationsSource
#1J. K. Ravalico (University of Adelaide)H-Index: 5
#2Graeme C. Dandy (University of Adelaide)H-Index: 40
Last.Holger R. Maier (University of Adelaide)H-Index: 51
view all 3 authors...
33 CitationsSource
Cited By48
Newest
#1Tatsuya Sakurahara (UIUC: University of Illinois at Urbana–Champaign)H-Index: 5
#2Seyed Reihani (UIUC: University of Illinois at Urbana–Champaign)H-Index: 5
Last.Zahra Mohaghegh (UIUC: University of Illinois at Urbana–Champaign)H-Index: 7
view all 4 authors...
Source
#1Kimoon Um (Stanford University)H-Index: 1
#2Eric Joseph Hall (UMass: University of Massachusetts Amherst)H-Index: 3
Last.Daniel M. Tartakovsky (Stanford University)H-Index: 39
view all 4 authors...
1 CitationsSource
#1Isadora Antoniano-Villalobos (Ca' Foscari University of Venice)H-Index: 3
#2Emanuele Borgonovo (Bocconi University)H-Index: 26
Last.Xuefei Lu (Bocconi University)H-Index: 1
view all 3 authors...
Source
#2Emanuele BorgonovoH-Index: 26
Last.Xuefei LuH-Index: 1
view all 3 authors...
#1Yuwei Qin (UCSB: University of California, Santa Barbara)H-Index: 4
#2Sangwon Suh (UCSB: University of California, Santa Barbara)H-Index: 47
1 CitationsSource
#1Sinan Xiao (NPU: Northwestern Polytechnical University)H-Index: 9
#2Zhenzhou Lu (NPU: Northwestern Polytechnical University)H-Index: 7
Last.Pan Wang (NPU: Northwestern Polytechnical University)H-Index: 9
view all 3 authors...
2 CitationsSource
#1Luk Peeters (CSIRO: Commonwealth Scientific and Industrial Research Organisation)H-Index: 12
#2D. E. Pagendam (CSIRO: Commonwealth Scientific and Industrial Research Organisation)H-Index: 9
Last.Tim R. McVicar (CSIRO: Commonwealth Scientific and Industrial Research Organisation)H-Index: 48
view all 9 authors...
3 CitationsSource
#1Francesca Pianosi (UoB: University of Bristol)H-Index: 21
#2Neil McIntyre (UoB: University of Bristol)H-Index: 62
10 CitationsSource
#1Sinan Xiao (NPU: Northwestern Polytechnical University)H-Index: 9
#2Zhenzhou Lu (NPU: Northwestern Polytechnical University)H-Index: 21
Last.Pan Wang (NPU: Northwestern Polytechnical University)H-Index: 9
view all 3 authors...
24 CitationsSource
#1Changcong Zhou (NPU: Northwestern Polytechnical University)H-Index: 7
#2Fuchao Liu (NPU: Northwestern Polytechnical University)H-Index: 2
Last.Wenxuan Wang (NPU: Northwestern Polytechnical University)H-Index: 3
view all 4 authors...
Source
View next paperA new uncertainty importance measure