The paper proposes a framework to calibrate multi-agent simulation models from output series using Bayesian optimization.
problem Calibrating multi-agent simulation models from observable output series.
method Novel eligibility set concept, two-sample Kolmogorov-Smirnov test with Bonferroni correction, Bayesian optimization (BO), and trust-region BO (TuRBO).
result Demonstrated the efficiency of the proposed framework using numerical experiments.
New clustering method uses Wasserstein distance to analyze simulation outputs.
problem Analyzing stochastic simulation outputs to uncover relationships and patterns.
method Agglomerative clustering using regularized Wasserstein distance.
result Identifies staffing plans yielding similar performance outcomes.
New method speeds up Bayesian inference for complex simulators.
problem Challenges in Bayesian inference for complex stochastic simulators with intractable likelihood functions.
method Optimization Monte Carlo framework reformulated as deterministic optimization problems with gradient-based methods.
result Accurate posterior inference with reduced runtimes compared to existing methods.
Unified framework for output analysis using Monte Carlo sampling.
problem Accurately assess the quality of estimated values in predictive models.
method Unified output analysis framework through Monte Carlo sampling, leveraging fast iterative bootstrap sampling and higher-order influence functions.
result Clear advantage in building more robust confidence intervals with higher coverage probability.
Proposes BATer for improved adversarial example detection.
problem Detecting adversarial examples in neural networks.
method Introduces a Bayesian adversarial example detector (BATer) using random components in a Bayesian neural network.
result BATer outperforms state-of-the-art detectors in adversarial example detection.
Efficiently predicts high-fidelity PDE solutions using multi-fidelity Gaussian processes.
problem Expensive high-fidelity solutions for PDEs on discretized domains.
method Multi-Fidelity High-Order Gaussian Process (MFHoGP) that integrates multi-fidelity examples and scales to large numbers of outputs.
result Significantly reduces the cost of high-fidelity PDE solutions through efficient Gaussian process modeling.
In this article, we consider a stochastic numerical simulator to assess the impact of some factors on a phenomenon. The simulator is seen as a black box with inputs and outputs. The quality of a simulation, hereafter referred to as fidelity, is assumed to be tunable by means of an additional input of the simulator (e.g…
User Simulators are one of the major tools that enable offline training of task-oriented dialogue systems. For this task the Agenda-Based User Simulator (ABUS) is often used. The ABUS is based on hand-crafted rules and its output is in semantic form. Issues arise from both properties such as limited diversity and the i…
DeepICMGP surrogate models multiple outputs efficiently.
problem Challenges in modeling dependencies between multiple outputs using traditional multi-output GPs.
method Introduces hierarchical coregionalization structures across layers in DGPs.
result Demonstrates competitive performance and active learning strategies.
Approach selects variables and time intervals for comparing high-dimensional time-series data.
problem Comparing high-dimensional time-series data for significant differences.
method Data is split into subintervals, and two-sample tests are performed on each to identify distinguishing variables.
result The approach effectively identifies variables and time intervals where data significantly differs.
This study compares multivariate vs univariate machine learning for multi-output regression.
problem When to use multivariate ensemble techniques over separate univariate models.
method Comparative analysis of different multivariate approaches for multi-output regression.
result Multivariate ensemble techniques outperform separate univariate models in simulations.
Maximal Rate of Stepwise Uncertainty Reduction selects simulations to reduce uncertainty efficiently.
problem Efficiently estimating quantities of interest from multi-fidelity simulations.
method Bayesian sequential strategy that maximizes the ratio of expected uncertainty reduction to simulation cost.
result MR-SUR strategy unifies and provides principled approaches to develop new methods.
Generative Adversarial Networks simulate elevator group control without extensive data.
problem Lack of historical real-world data for system testing.
method Used GANs to generate simulation data for a multi-car elevator system.
result GANs can be used as substitutes for expensive simulation runs, but fine-tuning is needed.
Improving predictive understanding of Earth system variability and change requires data-model integration. Efficient data-model integration for complex models requires surrogate modeling to reduce model evaluation time. However, building a surrogate of a large-scale Earth system model (ESM) with many output variables i…
Unified method for balancing simulation and data collection.
problem Finding optimal solutions with uncertain inputs.
method Bayesian Information Collection and Optimisation (BICO) procedure.
result Algorithm automatically determines optimal balance between optimisation and data collection.
This paper introduces a novel approach to measuring privacy risks in deep computer vision models based on intermediate outputs.
problem The exposure of intermediate results in hidden layers of deep computer vision models poses significant privacy concerns.
method The approach leverages Degrees of Freedom (DoF) to evaluate the amount of information retained in each layer and combines this with the rank of the Jacobian matrix to assess sensitivity to input variations.
result The proposed framework provides deeper insights into privacy risks associated with intermediate representations without requiring adversarial attack simulations.
A new algorithm estimates output ranges for deep neural networks efficiently.
problem Estimating output ranges in deep neural networks with complex non-linearities.
method Integrates Simulated Annealing tailored for constrained domains and global optima.
result Guaranteed convergence and robust performance across various DNN architectures.
We propose a training method for deep neural network (DNN)-based source enhancement to increase objective sound quality assessment (OSQA) scores such as the perceptual evaluation of speech quality (PESQ). In many conventional studies, DNNs have been used as a mapping function to estimate time-frequency masks and traine…
Bayesian Neural Networks improve precision cosmology from simulations.
problem Extracting precise cosmological parameters from complex simulations.
method Using Bayesian Neural Networks on The Quijote simulations.
result Demonstrates BNNs' ability to estimate associated uncertainties and complex output distributions.
New model predicts multiple outputs with missing labels.
problem Missing group labels in multi-output regression.
method Weakly-supervised multi-output model using correlated Gaussian processes.
result Model excels in multi-output settings with missing labels.
Appropriate traffic regulations, e.g. planned road closure, are important in congested events. Crowd simulators have been used to find appropriate regulations by simulating multiple scenarios with different regulations. However, this approach requires multiple simulation runs, which are time-consuming. In this paper, w…
Safe active learning for multi-output Gaussian processes reduces data acquisition costs and ensures safety.
problem Expensive data acquisition and safety concerns in multi-output regression problems.
method Proposes a safe active learning approach considering data informativeness and safety constraints.
result Improved convergence compared to competitors on simulated and real-world datasets.
Constraint-based learning reduces the burden of collecting labels by having users specify general properties of structured outputs, such as constraints imposed by physical laws. We propose a novel framework for simultaneously learning these constraints and using them for supervision, bypassing the difficulty of using d…
Graph Mixture Density Networks model multimodal data on graphs.
problem Challenging conditional density estimation problems with structured data.
method Combining mixture models and graph representation learning.
result Significant improvement in likelihood of epidemic outcomes.
SBI helps scientists match model outputs to data.
problem Tuning simulator parameters to match empirical data is hard.
method Simulation-based inference (SBI) identifies compatible parameter sets.
result SBI quantifies parameter uncertainty by identifying high-probability regions.
DEPLOYERS models multi-country economic systems using ABM.
problem Simulate complex multi-country economic systems with detailed data.
method Agent-based modeling framework with multi-threaded simulation.
result Simulates thousands of individuals and firms in a realistic environment.
A new method quantifies uncertainty in brain injury simulations.
problem High computational cost and high-dimensional inputs/outputs limit traditional UQ methods for biofidelic head models.
method Two-stage, data-driven manifold learning framework using Gaussian kernel-density estimation, diffusion maps, and Grassmannian diffusion maps.
result Surrogate models reduce computational cost while providing highly accurate approximations of the computational model.
A new variable importance measure for DRFs detects broader impacts on output distributions.
problem Estimating full conditional distributions of multivariate outputs given inputs.
method Based on the drop and relearn principle and MMD distance.
result Consistent and high-performing variable importance measure for DRFs.
The dynamic emulation of non-linear deterministic computer codes where the output is a time series, possibly multivariate, is examined. Such computer models simulate the evolution of some real-world phenomenon over time, for example models of the climate or the functioning of the human brain. The models we are interest…
A method for constructing tight prediction intervals for multiple numerical outputs.
problem Constructing tight prediction intervals for multiple related numerical outputs.
method A novel coordinate-wise standardization procedure that makes residuals comparable across output dimensions, estimating suitable scaling parameters using calibration data.
result The method produces tighter prediction intervals than existing baselines while maintaining valid simultaneous coverage.
Topology guidance controls generative model outputs by specifying topological features.
problem Lack of control in generative models for visual analysis.
method Coupling a coordinate-based neural network with a diffusion model to guide sampling.
result Generated fields adhere to specified topological features while staying within the generative distribution.
Paper uses learned summary statistics for Bayesian inference with difficult likelihood functions.
problem Difficult to obtain exact likelihood function for observation data and simulation model.
method Simulation-based inference with learned summary statistics, using Cressie-Read discrepancy criterion.
result Effective inference performed over selected sample sets of observation data.
HECT tests climate model outputs for reproducibility.
problem Ensuring climate models accurately reflect physical processes.
method Probabilistic classifiers for high-dimensional spatio-temporal data.
result A principled way to assess statistical reproducibility of climate models.
A computer code can simulate a system's propagation of variation from random inputs to output measures of quality. Our aim here is to estimate a critical output tail probability or quantile without a large Monte Carlo experiment. Instead, we build a statistical surrogate for the input-output relationship with a modest …
When simulating a complex stochastic system, the behavior of output response depends on input parameters estimated from finite real-world data, and the finiteness of data brings input uncertainty into the system. The quantification of the impact of input uncertainty on output response has been extensively studied. Most…
The paper develops methods to analyze sensitivity in stochastic models using surrogate models.
problem Quantifying the impact of input variability on stochastic simulators with randomness.
method The authors propose using generalized lambda models to emulate response distributions of stochastic simulators and estimate sensitivity indices.
result The proposed method can estimate sensitivity indices even with strong heteroskedasticity and small signal-to-noise ratio.
In this paper, we consider the problem of reducing the bit error rate of flash-based solid state drives (SSDs) when cells are subject to inter-cell interference (ICI). By observing that the outputs of adjacent victim cells can be correlated due to common aggressors, we propose a novel channel model to accurately repres…
The goal of this paper is to assess the utility of Reduced-Order Models (ROMs) developed from 3D physics-based models for predicting transient thermal power output for an enhanced geothermal reservoir while explicitly accounting for uncertainties in the subsurface system and site-specific details. Numerical simulations…
FGBoost boosts gradient boosting for complex data.
problem Gradient boosting struggles with non-Euclidean data.
method Introduces FGBoost for geodesic metric spaces.
result FGBoost performs well on complex data.
A novel ABC method for high-dimensional inverse problems using generative modeling and subset simulation.
problem Solving inverse-problems with high-dimensional inputs and expensive forward mappings.
method Joint deep generative modeling, Approximate Bayesian Computation (ABC) with Subset Simulation, and likelihood-free inference.
result Our method delivers promising performance without prior knowledge of the forward or noise distributions.
Proposes a method to improve multi-output Gaussian process for transfer learning.
problem Negative transfer and domain inconsistency in multi-output Gaussian process.
method Regularized MGP with convolution process and domain adaptation.
result Outperforms state-of-the-art benchmarks in simulation and real-world studies.
Improved ANN-based Monte Carlo simulation for Higgs decay events.
problem Accurate simulation of Higgs boson decay events.
method Monte Carlo simulation using an Artificial Neural Network (ANN) with improved training algorithm.
result The ANN simulation of Higgs decay is within 0.7% of the true value and achieves 26% unweighting efficiency.
Structured prediction provides a general framework to deal with supervised problems where the outputs have semantically rich structure. While classical approaches consider finite, albeit potentially huge, output spaces, in this paper we discuss how structured prediction can be extended to a continuous scenario. Specifi…
E2M predicts metric space outputs using deep learning.
problem Predicting non-Euclidean outputs like distributions and matrices.
method Weighted Fréchet means over learned weights.
result E2M achieves state-of-the-art performance across various outputs.
GANs can approximate SDEs for large time steps.
problem Approximating SDEs for large time steps using GANs.
method Proposed a conditional GAN architecture to enable strong approximation of SDEs.
result Supervised GAN outperformed standard GAN and other schemes in strong error.
Epidemiology simulations have become a fundamental tool in the fight against the epidemics of various infectious diseases like AIDS and malaria. However, the complicated and stochastic nature of these simulators can mean their output is difficult to interpret, which reduces their usefulness to policymakers. In this pap…
Study assesses market simulation metrics to highlight discrepancies between real and simulated markets.
problem Lack of fidelity in market simulation methods leads to discrepancies between real and simulated market data.
method Surveyed and applied a set of reference metrics to real and simulated market data.
result Significant discrepancies remain between real and simulated markets.
The paper develops exact and approximate conformal inference methods for multi-output regression.
problem Uncertainty quantification in multi-output regression predictions.
method Exact derivations and approximations of conformal inference p-values for linear multi-output predictors, and efficient methods for nonlinear predictors.
result Efficient methods for approximating conformal prediction regions for multi-output predictors, both linear and nonlinear.