Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

4591136181 · May 202619922001200920172026
48 results for low-probability risks

In [1] Zawadoski introduces a banking network model in which the asset and counter-party risks are treated separately and the banks hedge their assets risks by appropriate OTC contracts. In his model, each bank has only two counter-party neighbors, a bank fails due to the counter-party risk only if at least one of its …

2014-02-21abs ↗pdf ↗

Paper explores how risk-averse individuals' willingness to pay for insurance varies with risk probability.

problem Understanding how risk-averse individuals' willingness to pay for insurance varies with risk probability.
method Analyzes willingness to pay (WTP) for partial risk reduction within the dual theory of decision.
result In dual theory, reducing the probability of risk and providing insurance can be complementary if the surplus increases with risk reduction.

Develops a new method to compute risk-sharing allocations using Laplace transforms.

problem Complex integrals in computing conditional mean risk-sharing allocations.
method Uses Laplace-Stieltjes transforms to compute risk-sharing allocations from joint transforms.
result Provides closed-form or semi-analytic solutions for a broad class of distributions.

Fast risk assessment for autonomous vehicles using learned agent futures.

problem Risk assessment for autonomous vehicles given probabilistic predictions of other agents' futures.
method Non-sampling based methods using deep neural networks for probabilistic predictions, with Gaussian and non-Gaussian mixture models for agent positions and controls.
result Effective risk assessment for low probability events using learned models of agent futures.

Dynamic Vocabulary Pruning stabilizes LLM training by removing low-probability tokens.

problem Training Large Language Models (LLMs) with Reinforcement Learning (RL) causes numerical divergence between inference and training.
method Dynamic Vocabulary Pruning (DVP) constrains the RL objective to a safe vocabulary that excludes low-probability tokens.
result DVP stabilizes training by reducing systematic bias introduced by the extreme tail of the token distribution.

New method combines neural networks with Monte Carlo for complex system reliability.

problem Estimating small failure probabilities in complex systems.
method Subset Simulation with Hamiltonian Neural Networks.
result High acceptance rates and computational efficiency in low-probability regions.

Restricted Boltzmann Machines (RBMs) are a class of generative neural network that are typically trained to maximize a log-likelihood objective function. We argue that likelihood-based training strategies may fail because the objective does not sufficiently penalize models that place a high probability in regions where…

2018-04-23abs ↗pdf ↗

This paper establishes for the first time the predictive performance of speed priors and their computational complexity. A speed prior is essentially a probability distribution that puts low probability on strings that are not efficiently computable. We propose a variant to the original speed prior (Schmidhuber, 2002),…

2016-04-12abs ↗pdf ↗

We present and evaluate the Fast (conditional) Independence Test (FIT) -- a nonparametric conditional independence test. The test is based on the idea that when P(XY,Z)=P(XY)P(X \mid Y, Z) = P(X \mid Y), ZZ is not useful as a feature to predict XX, as long as YY is also a regressor. On the contrary, if $P(X \mid Y, Z) \neq P(X…

2018-04-08abs ↗pdf ↗

Generative model learns conditional distributions on collective variable levels.

problem Modeling conditional probability distributions on collective variable levels.
method General and efficient learning approach, data enrichment strategy.
result Effective generative models on different level-sets of collective variables.

We study a mini-batch diversification scheme for stochastic gradient descent (SGD). While classical SGD relies on uniformly sampling data points to form a mini-batch, we propose a non-uniform sampling scheme based on the Determinantal Point Process (DPP). The DPP relies on a similarity measure between data points and g…

2017-05-01abs ↗pdf ↗

We address an anomaly detection setting in which training sequences are unavailable and anomalies are scored independently of temporal ordering. Current algorithms in anomaly detection are based on the classical density estimation approach of learning high-dimensional models and finding low-probability events. These al…

2016-09-28abs ↗pdf ↗

NOFIS uses normalizing flows to estimate rare event probabilities more efficiently.

problem Accurate estimation of rare event probabilities using conventional methods is inefficient and resource-intensive.
method NOFIS learns a sequence of proposal distributions by minimizing KL divergence losses and estimates rare event probability using importance sampling.
result NOFIS outperforms baseline approaches in estimating rare event probabilities across 10 distinct test cases.

We improve density-based distances using normalizing flows and score matching.

problem Inaccurate density estimates and poor convergence in graph-based methods for high-dimensional spaces.
method Learn densities with normalizing flows and refine geodesics with a score model.
result Improved density-based distances that scale to high dimensions and improve numerical stability.

We investigate the properties of multidimensional probability distributions in the context of latent space prior distributions of implicit generative models. Our work revolves around the phenomena arising while decoding linear interpolations between two random latent vectors -- regions of latent space in close proximit…

2018-06-05abs ↗pdf ↗

New method speeds up Bayesian inference for complex simulators.

problem Challenges in Bayesian inference for complex stochastic simulators with intractable likelihood functions.
method Optimization Monte Carlo framework reformulated as deterministic optimization problems with gradient-based methods.
result Accurate posterior inference with reduced runtimes compared to existing methods.

Paper introduces new importance metrics for machine learning models, linking them to CATE.

problem Interpreting black-box models' importance metrics due to data dependence and non-parametric nature.
method Introduces MVIM and CVIM, proposing permutation-based estimation and bias-variance decomposition.
result MVIM and CVIM have a quadratic relationship with CATE, addressing bias in correlated predictors.

The study analyzes local minima in ReLU networks and finds low probability of bad local minima.

problem Understanding the existence and probability of local minima in ReLU networks.
method Theoretical analysis combined with linear programming and experiments on MNIST and CIFAR-10 datasets.
result No bad differentiable local minima found almost everywhere in weight space.

Unified approach to multiclass classification using Gabriel graphs.

problem Improving multiclass classification accuracy and efficiency.
method Integrates Gabriel graphs for binary and multiclass classification, proposing new activation functions and support edge neurons.
result Experimental results show superior performance compared to previous GG-based classifiers.

This work improves online fine-tuning of diffusion models for specific properties.

problem Efficiently fine-tuning diffusion models to maximize specific properties.
method A novel reinforcement learning procedure that efficiently explores feasible samples.
result The method provides a regret guarantee and empirical validation across multiple domains.

Graph-based methods are known to be successful in many machine learning and pattern classification tasks. These methods consider semi-structured data as graphs where nodes correspond to primitives (parts, interest points, segments, etc.) and edges characterize the relationships between these primitives. However, these …

2017-02-01abs ↗pdf ↗

Geometrically, high-likelihood regions in DGMs are unlikely to generate OOD data.

problem The paradox of high-likelihood OOD detection in deep generative models.
method Local intrinsic dimension estimation to identify high-likelihood regions that do not generate OOD data.
result A method pairing likelihoods and LID estimates for reliable OOD detection.

Paper solves robust convex problems with heavy-tailed noise.

problem Solving convex compositional problems with heavy-tailed noise.
method Sub-Gaussian confidence bounds under weak heavy-tailed noise assumptions, using boosting strategy.
result Achieves nearly optimal high probability convergence result.

Unified analysis of self-training for deep networks on unlabeled data.

problem Theoretical understanding of self-training for deep networks on unlabeled data.
method Unified theoretical analysis using expansion assumption and input-consistency regularization.
result Proves high accuracy of minimizers of population objectives based on self-training and input-consistency regularization.

Improved generative models for rare events using nonlinear diffusion.

problem Challenges in modeling rare conditional distributions with linear diffusion models.
method Adapting data representation and forward scheme for nonlinear drift term.
result Significant improvement in capturing extreme tail events.

The paper analyzes how adversarial attacks affect sparse regression models.

problem Effects of adversarial attacks on sparse regression models.
method Primal-dual witness paradigm to analyze support of estimated regression parameter vector.
result Adversaries can influence sample complexity by corrupting irrelevant features.

New statistical convex-cocompactness found for non-orientable surfaces.

problem Understanding the dynamics of mapping class groups on non-orientable surfaces.
method Using Teichmüller space and complexity length, showing geodesics leave compact regions with exponentially low probabilities.
result Statistical convex-cocompactness of mapping class groups on non-orientable surfaces.