Develops an SSBO algorithm for global optimization of expensive models.
problem Global optimization of expensive black-box models.
method Asynchronous hybrid-criterion with interval reduction.
result Improves global search ability and local search efficiency.
A new sampling strategy improves reliability and robustness optimization for complex designs.
problem High sample requirements for optimizing reliability and robustness in complex designs.
method Local Latin Hypercube Refinement (LoLHR) for multi-objective design uncertainty optimization.
result LoLHR achieves better results compared to other surrogate-based strategies.
Surrogate-based analysis of interactions via local effect smooths
problem Detecting and characterizing feature interactions in machine learning models
method Surrogate-based analysis using generalized additive models
result Empirical validation of effectiveness for pairwise interactions
Improved ABC method using Gaussian processes for more efficient simulations and uncertainty quantification.
problem Efficiently simulate and quantify uncertainty in ABC methods.
method Batch-sequential Bayesian experimental design, numerical method for uncertainty quantification, improved GP modeling assumptions.
result Improved framework for ABC methods that quantifies uncertainty and parallelizes simulations.
GUESS improves surrogate model accuracy with adaptive sampling.
problem Creating accurate surrogate models with limited data.
method Gradient and Uncertainty Enhanced Sequential Sampling (GUESS) using predictive uncertainty and Taylor expansion.
result GUESS achieved highest sample efficiency compared to other strategies.
Meta-model framework improves efficiency in parameter estimation of dynamical systems.
problem Efficiently estimating parameters of complex dynamical systems with computationally expensive objective functions.
method Dynamic adaptation of surrogate model and substitution strategy using a meta-model framework.
result Significant improvement in optimization efficiency, reducing evaluations by up to 77%.
New attacks bypass authentication models using mouse dynamics data.
problem Adversarial attacks on behavioural mouse authentication.
method Generative approaches to create adversarial mouse trajectories.
result Imitation-based attacks often outperform surrogate-based attacks.
MVRSM optimizes expensive functions with mixed variables, outperforming state-of-the-art methods.
problem Minimizing expensive functions with mixed continuous and integer variables.
method Mixed-Variable ReLU-based Surrogate Modelling (MVRSM) using rectified linear units.
result MVRSM outperforms state-of-the-art methods on synthetic and real-life benchmarks.
UA-SABI uses surrogates to speed up Bayesian inference for expensive models.
problem Inference for computationally expensive models is slow and uncertain.
method Combines surrogate modeling with Amortized Bayesian Inference (ABI) to propagate uncertainties.
result Reliable, fast, and repeated Bayesian inference for expensive models is achieved.
YAHPO Gym introduces a new benchmark for evaluating hyperparameter optimization methods.
problem Evaluating and comparing hyperparameter optimization methods on well-curated benchmark suites.
method Surrogate-based benchmark collection of 14 scenarios, each with multi-fidelity and multi-objective hyperparameter optimization problems.
result Surrogate-based benchmarks produce more faithful results than tabular benchmarks.
The paper proposes a scalable framework for uncertainty quantification and propagation in surrogate-based Bayesian inference.
problem Uncertainty in surrogate models and its impact on inference and decision-making.
method Bayesian inference methods for surrogate models with measurement data.
result Scalable framework for uncertainty quantification and propagation in surrogate models.
Multi-expert L2D underfits more severely, requiring new methods.
problem Underfitting in multi-expert L2D settings.
method PiCCE (Pick the Confident and Correct Expert), a surrogate-based method.
result PiCCE effectively reduces multi-expert L2D to a single-expert-like problem, resolving underfitting.
REMAL: Residual Equilibrium Manifold Active Learning for Surrogate-Based Multidisciplinary Design Analysis
problem Multidisciplinary design analysis of coupled engineering systems requires solving equilibrium states where all disciplinary coupling variables are consistent.
method Residual manifold surrogate modeling framework for coupled systems.
result REMAL learns a surrogate model of the joint residual manifold via multitask Gaussian process models.
Deep learning methods improve subsurface flow modeling efficiency.
problem Efficiently modeling subsurface flow with uncertain parameters.
method Two categories of deep-learning based inverse modeling methods: surrogate-based and direct.
result Deep-learning methods significantly accelerate subsurface flow modeling.
New method for fast exact EHVI calculation in multi-objective optimization.
problem Efficient computation of EHVI for multi-objective optimization problems.
method Combining decomposition algorithms, proposes new exact EHVI calculation methods.
result Proposed algorithms are significantly faster than existing methods.
The aim of the present paper is to develop a strategy for solving reliability-based design optimization (RBDO) problems that remains applicable when the performance models are expensive to evaluate. Starting with the premise that simulation-based approaches are not affordable for such problems, and that the most-probab…
Bayesian Optimization tackles hidden constraints in architecture optimization.
problem Optimizing system architectures with hidden constraints using expensive physics-based simulations.
method Surrogate-based optimization with Gaussian Process models, including strategies for handling failed evaluations.
result Best performance achieved with a mixed-discrete GP predicting Probability of Viability (PoV) and minimum PoV threshold selection.
An augmented Lagrangian (AL) can convert a constrained optimization problem into a sequence of simpler (e.g., unconstrained) problems, which are then usually solved with local solvers. Recently, surrogate-based Bayesian optimization (BO) sub-solvers have been successfully deployed in the AL framework for a more global …
ASEs use surrogate estimation to efficiently evaluate model performance with minimal labels.
problem Efficient model evaluation with limited labels.
method Surrogate-based estimation and active learning.
result ASEs offer greater label-efficiency than current methods for deep neural networks.
A new method helps novices automatically set AutoDock's hyperparameters.
problem Helping novice users set optimal AutoDock hyperparameters.
method Surrogate based multi-objective algorithm using radial basis function model and non-dominated sorting.
result The method effectively helps novices set AutoDock hyperparameters.
This study explains and mitigates inflated returns and turnover in SPO-based portfolio optimization.
problem Inflated returns and excessive turnover in SPO-based portfolio optimization.
method KKT-based interpretation of portfolio decisions as ranking over adjusted scores, empirical evaluation of stabilization mechanisms.
result Realistic output constraints and portfolio-level turnover control improve SPO-based strategies.
Human stablecoin transactions predict political risk in cryptocurrency markets.
problem Predicting political risk in cryptocurrency markets.
method Structural break analysis and surrogate-based robustness tests.
result Human-driven stablecoin transactions shift significantly before major political events.
New active learning framework for multiclass classification beyond realizability assumption.
problem Active learning in non-realizable settings with convex model classes.
method Surrogate risk minimization, epoch-based fitting, aggregation of models.
result Achieves label and sample complexity comparable to prior work in non-realizable settings.
mlr3mbo is a modular R toolbox for Bayesian optimization.
problem Efficiently solving optimization problems with multiple objectives and constraints.
method Bayesian optimization with support for multi-objective, multi-point proposals, parallelization, and custom algorithms.
result mlr3mbo performs competitively with state-of-the-art optimizers and robustly handles various optimization regimes.
Study uses topological signatures to quantify financial market complexity.
problem Capturing temporal organization beyond volatility measures.
method Null validated topological approach using L1 norm of persistence landscapes. result Persistence landscape norms reveal dynamical structure during market stress.
New approach improves robustness of deep neural networks without overfitting.
problem Adversarial vulnerability of deep neural networks.
method Non-zero-sum bilevel formulation of adversarial training.
result Algorithm matches and outperforms state-of-the-art attacks, maintains robustness, and avoids overfitting.
Differentiable pipeline replaces non-differentiable CAE components for shape optimization.
problem Gradient-based optimization is limited by non-differentiable components in CAE workflows.
method Surrogate models replace non-differentiable pipeline components, enabling gradient-based optimization.
result Gradient-based shape optimization possible without differentiable solvers.
VBMC+VIQR outperforms noisy models in Bayesian inference.
problem Bayesian inference with noisy likelihoods in complex models.
method Gaussian process surrogates, expected information gain, variational interquantile range.
result VBMC+VIQR achieves state-of-the-art performance in noisy inference benchmarks.
Local surrogate models, to approximate the local decision boundary of a black-box classifier, constitute one approach to generate explanations for the rationale behind an individual prediction made by the back-box. This paper highlights the importance of defining the right locality, the neighborhood on which a local su…
New method improves signal estimation by convexifying ℓ0-norm constraints.
problem Signal estimation with sparsity and smoothness priors.
method Iterative convex conic quadratic relaxations exploiting ℓ0-norm and smoothness terms. result Significantly better estimators than ℓ1-norm approaches and interpretable parameters. Majorizing measures control sequential complexities for online learning.
problem Extending classical empirical processes theory to sequential cases.
method Generic chaining, majorizing measures, fractional covering numbers.
result Sharp control of worst-case sequential Rademacher complexity.
Paper studies pseudo-projective tensors on warped products.
problem Characterizing pseudo-projectively flat warped products.
method Analyzes sequential warped products and pseudo-projective tensors.
result Necessary and sufficient conditions for pseudo-projectively flat sequential warped products.
We develop a probabilistic framework for sequential random projection.
problem Challenges of sequential decision-making under uncertainty.
method Novel construction of a stopped process and method of mixtures.
result Achieved a non-asymptotic probability bound for random projection.
In this note, we introduce a new type of warped products called as sequential warped products to cover a wider variety of exact solutions to Einstein's equation. First, we study the geometry of sequential warped products and obtain covariant derivatives, curvature tensor, Ricci curvature and scalar curvature formulas. …
OptIMIS method improves SRAM yield estimation efficiency and accuracy.
problem Efficient estimation of SRAM failure probability with shrinking technology nodes.
method Generalized norm minimization method, optimal manifold concept, onion sampling, neural coupling flow.
result OptIMIS method delivers up to 3.5x efficiency and 3x accuracy over state-of-the-art methods.
Paper proposes AdaBoost-assisted ELM for efficient online sequential classification.
problem Efficient online sequential classification with improved accuracy and stability.
method Utilizes AdaBoost for cost-sensitive learning and forgetting mechanism for stability.
result Achieves 94.41% accuracy on MNIST dataset with reduced standard deviation.
PPAT uses predictions to improve risk estimation in active testing.
problem Exploiting informative predictions from black-box models for efficient risk estimation.
method Combines LURE estimator with prediction-powered control variate.
result PPAT outperforms existing methods in risk estimation and uncertainty quantification.
Study finds conditions for certain warped product manifolds to be quasi-Einstein.
problem Conditions for quasi-Einstein sequential warped product manifolds.
method Investigated necessary and sufficient conditions for specific types of manifolds.
result Identified conditions for sequential warped product manifolds to be quasi-Einstein.
A new model for sequential memory using temporal predictive coding.
problem Forming accurate memory of sequential stimuli in the brain.
method Proposes a novel PC-based model called temporal predictive coding (tPC).
result Shows that tPC models can accurately memorize and retrieve sequential inputs.
This paper reviews methods for interpreting deep learning models with sequential data.
problem Limited interpretability of deep learning models in sequential data domains.
method Reviews and compares techniques for sequential interpretability.
result Current techniques have limitations and future research is needed.
An adversarial detector identifies anomalous sequences in sequential data.
problem Detecting anomalous sequences in one-class settings with limited data.
method Solves a minimax problem to find an optimal detector against the worst-case sequences from a generator, using marked point process model.
result Demonstrated good performance on simulations and real credit card fraud datasets.
We present a novel framework for kernel learning with sequential data of any kind, such as time series, sequences of graphs, or strings. Our approach is based on signature features which can be seen as an ordered variant of sample (cross-)moments; it allows to obtain a "sequentialized" version of any static kernel. The…
Reduces change detection to estimation using confidence sequences.
problem Detecting changes in data streams with minimal delay and false alarms.
method Reduction from sequential change detection to sequential estimation using confidence sequences.
result Change detection scheme with minimal structural assumptions and strong guarantees.
A universal framework for constructing confidence sets using sequential likelihood mixing.
problem Constructing reliable confidence sets for realizable likelihood functions.
method Sequential likelihood mixing, integrating Bayesian inference and regret inequalities.
result Establishes fundamental connections and provable coverage guarantees for various inference techniques.
New distributed EnKF method for non-sequential assimilation of large datasets.
problem Computational intensity and order dependencies in traditional EnKF.
method Distributed computing for full model error covariance matrix.
result Non-sequential assimilation outperforms sequential in performance.
Unified framework for modeling hierarchical spaces in design problems.
problem Challenges in modeling hierarchical, conditional, heterogeneous, or tree-structured domains.
method Unified framework combining feature modeling and graph theory, introducing meta and partially-decreed variables.
result Demonstrated effectiveness on complex system design problems, including neural networks and green-aircraft.
New private algorithm for sequential hypothesis testing with privacy and error rate guarantees.
problem Privacy protection in sequential hypothesis testing for sensitive data.
method Renyi differential privacy, Wald's Sequential Probability Ratio Test (SPRT).
result Private algorithm with strong privacy guarantees and theoretical performance analysis.
Paper tackles uncertainty prediction for deep sequential regression.
problem Challenges in generating accurate uncertainty estimates for deep recurrent networks.
method Flexible method that generates symmetric and asymmetric uncertainty estimates without stationarity assumptions.
result Outperforms competitive baselines on both drift and non-drift scenarios.