Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

59118176235 · Jun 202019922001200920172026
48 results for surrogate probability

Adaptive learning rates improve FTPL's BOBW guarantees in bandit problems.

problem Improving Follow-the-Perturbed-Leader's BOBW guarantees in bandit problems.
method Introducing surrogate probability functions to compute adaptive learning rates without exact probabilities.
result BOBW guarantees for FTPL with Pareto perturbations for any α>1α>1.

This paper presents a method to efficiently estimate rare event probabilities using a combination of high and low-fidelity models.

problem Estimating the probability of failure for complex systems using high-fidelity models is expensive and inaccurate for rare events.
method The paper introduces a multi-fidelity surrogate modeling strategy using active learning and subset simulation to merge high and low-fidelity models.
result The method significantly reduces computational cost while maintaining high accuracy in estimating rare event probabilities.

Bayesian surrogate models reduce uncertainty in high-dimensional design optimisation problems.

problem Uncertainty in high-dimensional inputs for complex computational models.
method Variational Bayesian inference for constructing statistical surrogates with Gaussian process priors and KL divergence for approximation.
result The RDVGP surrogate provides accurate and versatile approximations for robust structural optimisation.

Bayesian method refines surrogate models for accurate full waveform inversion.

problem Complex input/output relations in full waveform inversion make accurate surrogate models difficult.
method Iterative refinement of surrogate models using MCMC samples and progressively expanding frequency bandwidth.
result Highly accurate surrogate model across full bandwidth enables accurate final MCMC inversion.

This study proposes an efficient surrogate for Darcy flow inverse problems.

problem Efficiently constructing accurate surrogate models for high-dimensional complex inverse problems.
method Sequential Bayesian design strategy to acquire a locally accurate surrogate model focusing on high-probability regions.
result The proposed method accelerates inversion accuracy and computational speed.

A new method estimates rare failure events in complex systems.

problem Estimating the probability of rare failure events in non-linear systems.
method Stochastic Spectral Embedding (SSE) combined with modifications for efficient rare event estimation.
result Rare failure probability decomposed into conditional probabilities for easier computation.

Method quantifies sensitivity of reliability analysis to uncertainty sources.

problem Computational expense in reliability analysis of complex models.
method Gaussian process surrogate model, active learning, sensitivity analysis.
result Reduces main source of error in estimating rare event probabilities.

Develops methods to create consistent surrogate models for agent-based simulators.

problem High computational costs and misjudgment of interventions in agent-based models.
method Causal abstractions to learn interventionally consistent surrogate models.
result Surrogates trained for interventional consistency closely mimic the agent-based model's behavior under interventions.

We establish linear regret bounds for convex smooth losses using Fenchel-Young losses.

problem Establishing linear regret bounds for convex smooth losses.
method Constructing a convex smooth surrogate loss using Fenchel-Young losses generated by the convolutional negentropy.
result We derive a smooth loss with a linear surrogate regret bound.

The paper explores trading off consistency and dimensionality in convex surrogates for multiclass classification.

problem Designing consistent surrogate losses for multiclass classification with high-dimensional outcomes.
method Investigates embedding outcomes into convex polytopes and examining consistency under low-noise assumptions.
result Consistency can be achieved with less than n1n-1 dimensions, but hallucination occurs for some distributions.

Study tackles criterion collapse in learning criteria, showing conditions for loss minimization.

problem Criterion collapse in optimization, focusing on error probability minimizers.
method Analyzes various learning criteria, including DRO, OCE risks, and non-monotonic criteria.
result Non-monotonic criteria can avoid collapse, while monotonic ones cannot.

Study on learning to defer to multiple experts with consistent surrogates and confidence calibration.

problem Addressing the open problems of consistent surrogates, confidence calibration, and ensembling of experts.
method Derive two consistent surrogates (softmax and OvA) and propose a conformal inference technique for choosing experts.
result The OvA-based loss does not cause mis-calibration propagation, while the softmax-based loss does.

Bayesian framework predicts aerodynamic uncertainty from sparse measurements.

problem Calibrating aerodynamic models with sparse and uncertain measurements.
method Bayesian latent Gaussian process for surrogate model calibration.
result Calibrated surrogate model accurately predicts aerodynamic uncertainty.

In this paper we refine the process of computing calibration functions for a number of multiclass classification surrogate losses. Calibration functions are a powerful tool for easily converting bounds for the surrogate risk (which can be computed through well-known methods) into bounds for the true risk, the probabili…

2016-09-20abs ↗pdf ↗

New method uses imperfect LLM annotations for valid statistical inference in social science.

problem Inaccurate large language model annotations in social science research.
method Design-based supervised learning (DSL) combining imperfect LLM surrogates with gold-standard labels.
result DSL provides valid statistical inference with comparable predictive accuracy to existing methods.

A new kernel improves statistical surrogates for stochastic manifolds with diverse data.

problem Handling statistical surrogates for stochastic manifolds with heterogeneous data.
method A transient anisotropic kernel is introduced to improve statistical surrogates for stochastic manifolds with heterogeneous data.
result The transient anisotropic kernel provides a better representation of statistical dependencies in the learned probability measure.

This research improves PAC-Bayesian bounds for classification tasks using convexified loss.

problem Deriving generalization bounds for classification tasks with non-convex loss functions.
method Shift focus to misclassification excess risk bounds for PAC-Bayesian classification using convex surrogate loss and leveraging PAC-Bayesian relative bounds in expectation.
result Improved PAC-Bayesian bounds for classification tasks with convex surrogate loss.

New method optimizes multiple points in Bayesian optimization efficiently.

problem Optimizing multiple points in expensive black-box functions.
method Reformulated BO as probability measure optimization, using convex gradient flows.
result Demonstrated effectiveness on various benchmarks compared to state-of-the-art methods.

Novel F2NARX model improves surrogate modeling for stochastic dynamical systems.

problem Challenges in constructing accurate and efficient surrogate models for stochastic dynamical systems.
method Function-on-Function Nonlinear AutoRegressive model with eXogenous inputs (F2NARX) combining PCA and Gaussian process regression.
result F2NARX outperforms state-of-the-art NARX models in efficiency and accuracy.

Paper proposes a method to make image model explanations robust to distortions.

problem Ensuring robustness of explanations for images under distortions.
method Embedding perceptual distances in surrogate explainers to evaluate and improve robustness.
result Surrogate explanations become more coherent and robust to distortions.

This paper proposes a method for solving optimization problems in which the decision-maker cannot evaluate the objective function, but rather can only express a preference such as "this is better than that" between two candidate decision vectors. The algorithm described in this paper aims at reaching the global optimiz…

2019-09-28abs ↗pdf ↗

Structural reliability methods aim at computing the probability of failure of systems with respect to some prescribed performance functions. In modern engineering such functions usually resort to running an expensive-to-evaluate computational model (e.g. a finite element model). In this respect simulation methods, whic…

2011-05-03abs ↗pdf ↗

SVI and GP surrogates improve calibration of ABMs in epidemiology.

problem Calibrating stochastic ABMs in epidemiology is computationally expensive.
method Stein Variational Inference (SVI) with Gaussian process (GP) surrogates.
result SVI maintains comparable predictive accuracy and calibration effectiveness to MCMC.

Study examines neural network surrogate models for uncertainty in heat conduction problems.

problem Capturing the full distribution of solution fields, especially at the tails.
method Comparison of feed-forward fully connected network and Deep Operator Network architectures using data-driven and physics-informed loss functions.
result Worst-case prediction errors are significantly larger than mean field errors, highlighting the importance of extreme samples.

EASE estimator improves probabilistic value estimation efficiency.

problem Efficiently estimating probabilistic values like Shapley and semivalues.
method Developed an Efficiency-Aware Surrogate-adjusted Estimator (EASE) that minimizes first-order mean squared error.
result EASE consistently outperforms existing estimators for various probabilistic values.

A new method uses natural gradients for efficient distribution optimization.

problem Challenges in computing natural gradients for many distributions.
method Reframe optimization as a surrogate distribution with easy natural gradient computation.
result Expands set of distributions efficiently targetable with natural gradients.

Consider scene understanding problems such as predicting where a person is probably reaching, or inferring the pose of 3D objects from depth images, or inferring the probable street crossings of pedestrians at a busy intersection. This paper shows how to solve these problems using Approximate Bayesian Computation. The …

2019-05-22abs ↗pdf ↗

We propose a framework that directly tackles the probability distribution of the value function parameters in Deep Q Network (DQN), with powerful variational inference subroutines to approximate the posterior of the parameters. We will establish the equivalence between our proposed surrogate objective and variational i…

2017-11-30abs ↗pdf ↗

A new emulator connects observables directly from data.

problem Constructing fast and accurate surrogate models for robust predictions.
method Introduces Multiparameter Eigenvalue Problem (MEP) emulator trained with Eigenvector Continuation (EC) and Parametric Matrix Model (PMM) data.
result The MEP emulator can make predictions directly from observables to observables.

Survey and framework for efficient active learning in structural reliability.

problem Efficiently solving complex structural reliability problems.
method Generalized modular framework combining surrogate model, reliability estimation algorithm, learning function, and stopping criterion.
result 39 strategies for solving 20 reliability benchmark problems, highlighting the importance of surrogates and algorithms.

This work presents a technique for statistically modeling errors introduced by reduced-order models. The method employs Gaussian-process regression to construct a mapping from a small number of computationally inexpensive `error indicators' to a distribution over the true error. The variance of this distribution can be…

2014-05-20abs ↗pdf ↗

In this paper, we study a classification problem in which sample labels are randomly corrupted. In this scenario, there is an unobservable sample with noise-free labels. However, before being observed, the true labels are independently flipped with a probability ρ[0,0.5)ρ\in[0,0.5), and the random label noise can be class-co…

2014-11-27abs ↗pdf ↗

MF-GLaM models improve stochastic simulator emulation with multifidelity data.

problem Challenging to emulate stochastic simulators' full conditional probability distribution.
method Proposes MF-GLaMs to efficiently emulate HF stochastic simulators using LF data.
result MF-GLaMs achieve improved accuracy or comparable performance at reduced cost.

This work improves interpretability and calibration of complex-valued neural networks using Newton-Puiseux analysis.

problem Insufficient interpretability and probability calibration of complex-valued neural networks.
method Newton-Puiseux framework to examine local decision geometry, fitting a polynomial surrogate and factorizing it using Newton-Puiseux expansions.
result Enhanced Expected Calibration Error in ECG and wireless modulation datasets compared to uncalibrated softmax and standard post-hoc baselines.