Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

208416624832 · Jun 202019922001200920172026
48 results for minimum-volume confidence sets

This paper studies the geometry of minimum-volume confidence sets for multinomial parameters.

problem Determining if minimum-volume confidence sets for multinomial outcomes are disjoint.
method Enumerating and covering the continuous regions of the exact p-value function to study the geometry of minimum-volume confidence sets.
result The geometry of minimum-volume confidence sets for multinomial parameters is studied, providing insights into their structure and properties.

Paper certifies intersection of minimum-volume confidence sets for multinomial outcomes.

problem Certifying intersection of minimum-volume confidence sets for multinomial outcomes.
method Exploits likelihood ordering to induce halfspace constraints, enabling adaptive geometric partitioning and computable bounds on p-values.
result Efficient and provably sound algorithm for certifying intersection, disjointness, or indeterminate result.

We develop an efficient algorithm to find confidence ellipsoids with volume guarantees in high dimensions.

problem Finding robust confidence ellipsoids in high-dimensional data.
method Polynomial time algorithm using primal-dual structure and geometric Brascamp-Lieb inequality.
result Algorithm finds ellipsoids within a O(β)γdO(β)^{γd} volume factor of best ββ-conditioned ellipsoid.

SLS optimizes minimum-volume regions for conditional quantiles, bypassing density estimation.

problem Constructing minimum-volume prediction regions that satisfy conditional coverage.
method Super-level-set regression (SLS) directly optimizes geometric boundaries of conditional level sets.
result SLS optimizes regions directly, capturing complex conditional structures end-to-end.

We enumerate the small-volume manifolds that can be obtained by Dehn filling on Mom-2 and Mom-3 manifolds as defined by Gabai, Meyerhoff, and the author. In so doing we complete the proof that the Weeks manifold is the minimum-volume compact hyperbolic 3-manifold, as well as enumerating the 10 smallest one-cusped hyper…

2008-09-02abs ↗pdf ↗

We propose a non-parametric anomaly detection algorithm for high dimensional data. We first rank scores derived from nearest neighbor graphs on nn-point nominal training data. We then train limited complexity models to imitate these scores based on the max-margin learning-to-rank framework. A test-point is declared as…

2016-01-22abs ↗pdf ↗

We propose a new topic modeling procedure that takes advantage of the fact that the Latent Dirichlet Allocation (LDA) log likelihood function is asymptotically equivalent to the logarithm of the volume of the topic simplex. This allows topic modeling to be reformulated as finding the probability simplex that minimizes …

2019-04-03abs ↗pdf ↗

The paper provides bounds for the empirical angular measure and applies them to improve statistical learning in extreme regions.

problem Estimating the angular measure in high-dimensional data with different distributions.
method Established bounds for the maximal deviations of the empirical angular measure from the true measure, using rank transformation and analyzing the most extreme observations.
result The bounds provide performance guarantees for statistical learning procedures in extreme regions, such as binary classification and anomaly detection.

This paper aims at formulating the issue of ranking multivariate unlabeled observations depending on their degree of abnormality as an unsupervised statistical learning task. In the 1-d situation, this problem is usually tackled by means of tail estimation techniques: univariate observations are viewed as all the more …

2017-05-03abs ↗pdf ↗

We consider the setting of linear regression in high dimension. We focus on the problem of constructing adaptive and honest confidence sets for the sparse parameter θ, i.e. we want to construct a confidence set for theta that contains theta with high probability, and that is as small as possible. The l_2 diameter of a …

2015-01-19abs ↗pdf ↗

This is an expository paper on Mom-technology, describing the recent work of the authors in this area (found in arXiv:math/0606072, arXiv:0705.4325, and arXiv:0809.0346) concerning the use of Mom-technology to find the minimum-volume compact hyperbolic 3-manifold and the 10 smallest cusped hyperbolic 3-manifolds. In ad…

2009-10-27abs ↗pdf ↗

We propose an algorithm combining calibrated prediction and generalization bounds from learning theory to construct confidence sets for deep neural networks with PAC guarantees---i.e., the confidence set for a given input contains the true label with high probability. We demonstrate how our approach can be used to cons…

2019-12-31abs ↗pdf ↗

It was previously shown by the second author that every knot in S3S^3 is ambient isotopic to one component of a two-component, alternating, hyperbolic link. In this paper, we define the alternating volume of a knot KK to be the minimum volume of any link LL in a natural class of alternating, hyperbolic links such tha…

2019-01-08abs ↗pdf ↗

ACORE improves hypothesis testing and confidence sets in likelihood-free inference.

problem Constructing hypothesis tests and confidence sets in likelihood-free inference settings.
method Formulates classical LRT as a classification problem, uses machine learning to improve estimates.
result Demonstrates improved accuracy in hypothesis testing and confidence sets.

New method optimizes offline linear bandits using different confidence sets.

problem Optimizing offline learning for linear contextual bandits.
method Introduces a family of pessimistic learning rules based on p\ell_p confidence sets.
result The π^\hatπ_\infty rule achieves minimax performance and strictly dominates other predictors.

Novel confidence sets improve linear bandit performance by adapting to unknown noise levels.

problem Adapting to unknown noise levels in sequential decision-making.
method Proposed semi-adaptive and variance-adaptive confidence sets.
result Improved regret bounds and better performance in Bayesian optimization tasks.

The age of big data has produced data sets that are computationally expensive to analyze and store. Algorithmic leveraging proposes that we sample observations from the original data set to generate a representative data set and then perform analysis on the representative data set. In this paper, we present efficient a…

2016-06-05abs ↗pdf ↗

Improved regret bounds for logistic bandits via novel confidence set construction.

problem Dependencies in parameter space for logistic bandits, especially when SdS \geq d.
method Regret-to-confidence-set conversion (R2CS) to construct convex confidence sets.
result Strict improvement in regret bound w.r.t. SS in logistic bandits.

We shrink confidence sets for equivalent discrete distributions using permutation equivalence.

problem Building high-probability confidence sets for equivalent discrete distributions.
method Exploiting permutation-equivalence to refine confidence sets.
result Confidence sets shrink at asymptotic rates of O(1/kKnk)O(1/\sqrt{\sum_{k\in \mathcal K} n_k}) and O(1/maxkKnk)O(1/\max_{k\in K} n_{k}).

We propose a non-parametric anomaly detection algorithm for high dimensional data. We score each datapoint by its average KK-NN distance, and rank them accordingly. We then train limited complexity models to imitate these scores based on the max-margin learning-to-rank framework. A test-point is declared as an anomaly…

2015-02-06abs ↗pdf ↗

Develops methods for valid and validated confidence sets in multiclass and multilabel prediction.

problem Challenges of typical conformal prediction methods in multiclass and multilabel problems, especially uneven coverage.
method Leverages quantile regression to build methods that always guarantee correct coverage and asymptotically optimal conditional coverage, addressing label interactions with tree-structured classifiers.
result Empirical evaluation suggests more robust coverage of confidence sets.

Evaluating the log determinant of a positive definite matrix is ubiquitous in machine learning. Applications thereof range from Gaussian processes, minimum-volume ellipsoids, metric learning, kernel learning, Bayesian neural networks, Determinental Point Processes, Markov random fields to partition functions of discret…

2018-02-21abs ↗pdf ↗

A universal framework for constructing confidence sets using sequential likelihood mixing.

problem Constructing reliable confidence sets for realizable likelihood functions.
method Sequential likelihood mixing, integrating Bayesian inference and regret inequalities.
result Establishes fundamental connections and provable coverage guarantees for various inference techniques.

Overlap between treatment groups is required for non-parametric estimation of causal effects. If a subgroup of subjects always receives the same intervention, we cannot estimate the effect of intervention changes on that subgroup without further assumptions. When overlap does not hold globally, characterizing local reg…

2019-07-09abs ↗pdf ↗

The paper finds a fundamental trade-off between confidence and efficiency in transductive conformal prediction.

problem The challenge is to balance confidence and efficiency in predicting multiple data points.
method The authors derive a strict finite-sample bound and introduce a practical algorithm to approach this bound.
result Any non-trivial confidence level leads to exponential growth in prediction set size, with a linear scaling in the number of samples.

Study three types of uncertainty quantification for binary classification without distributional assumptions.

problem Uncertainty quantification for binary classification in a distribution-free setting.
method Established theorems connecting calibration, confidence intervals, and prediction sets for score-based classifiers.
result Distribution-free calibration is only possible using scoring functions that partition feature space into countably many sets.

This paper is the second in a series whose goal is to understand the structure of low-volume complete orientable hyperbolic 3-manifolds. Using Mom technology, we prove that any one-cusped hyperbolic 3-manifold with volume <= 2.848 can be obtained by a Dehn filling on one of 21 cusped hyperbolic 3-manifolds. We also sho…

2007-05-30abs ↗pdf ↗

A general approach for anomaly detection or novelty detection consists in estimating high density regions or Minimum Volume (MV) sets. The One-Class Support Vector Machine (OCSVM) is a state-of-the-art algorithm for estimating such regions from high dimensional data. Yet it suffers from practical limitations. When appl…

2015-08-30abs ↗pdf ↗

Paper presents methods to create stock price confidence intervals using LSTM models.

problem Creating accurate confidence intervals for LSTM-estimated stock prices.
method Three bootstrap methods for dependent data, optimal block length selection, and benchmark comparison.
result Illustrated through stock price data, different bootstrap strategies provide varying confidence intervals.

The paper addresses the gap between theoretical and practical confidence set widths in universal inference.

problem Inference procedures can be overly conservative, leading to wider confidence sets than expected.
method The authors identify the source of asymptotic conservativeness and propose a remedy based on studentization and bias correction.
result The proposed method achieves exact asymptotic coverage at the nominal 1α1-α level, even under model misspecification.