Open Platform for Benchmarking Uncertainty Quantification Algorithms
Category
Contribute
Institutions
ETH Zurich
Data type
UQLab benchmark module
Field
Risk, Safety and Uncertainty quantification
Researchers
Bruno Sudret
Description
The Open Platform for Benchmarking Uncertainty Quantification Algorithms (UQBench) aims to establish a standardized framework for evaluating and comparing uncertainty quantification (UQ) methods. UQ methods are essential for predicting the behavior of engineering systems under uncertainty, thus enabling robust decision-making. Despite the development of numerous UQ software tools, there is no consensus on benchmarking their performance. UQBench addresses this gap on two fronts: i. by developing a benchmarking module within the well-established UQLab platform (www.uqlab.com ), and ii. by compiling an open database of selected benchmark problems and data. This initiative enables researchers to assess the performance of new methods against established standards, thereby improving the transparency and reproducibility of UQ research. The project also intends to foster a community-driven approach, encouraging contributions from researchers and practitioners to expand the benchmark repository continuously. By formalizing the benchmarking process, UQBench enhances the adoption and development of advanced UQ methods across various scientific disciplines.
Since the project began, we have successfully implemented a fully automated benchmarking module for surrogate modeling in UQLab. This includes a robust computational backend and a user-friendly interface that maintains the familiar logic of UQLab. The module features comprehensive post-processing capabilities and content-dependent visualization tools, ensuring that results are presented clearly and effectively. The benchmark module is HPC-ready and can dispatch computations to distributed computing facilities, enhancing its scalability. Furthermore, UQBench enables data integration from third-party tools or even pre-existing benchmark analyses, thus facilitating a seamless benchmarking process.