Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

96193289385 · Jun 202019922001200920172026
48 results for Frequentist Evaluation

Study evaluates posterior covariance matrix W for frequentist evaluation of Bayesian estimators.

problem Evaluating variability of posterior estimates in Bayesian models.
method Use of Bayesian Infinitesimal Jackknife approximation and W-kernel.
result Principal space of W is central to frequentist evaluation of Bayesian models.

DBPA assesses LLM perturbations using frequentist hypothesis testing.

problem Quantifying input perturbation impacts on LLM outputs.
method DBPA reformulates perturbation analysis as frequentist hypothesis testing, using Monte Carlo sampling for empirical null and alternative distributions.
result DBPA provides interpretable p-values and scalar effect sizes for LLM perturbations.

The study compares Bayesian and frequentist approaches in deep learning.

problem Comparing Bayesian and frequentist inference in deep learning.
method Conducts a comparative analysis of point and posterior estimators across various settings.
result Amortized point estimators generally outperform posterior inference, though posterior inference remains competitive in some low-dimensional problems.

FAQ efficiently evaluates LLMs with statistical guarantees using adaptive query selection.

problem Efficiently evaluating many LLMs on a large suite of benchmarks is expensive.
method FAQ uses Bayesian factor models, adaptive sampling, and proactive active inference to select queries.
result FAQ delivers up to 5x effective sample size gains over baselines, matching CI width with fewer queries.

In the stochastic bandit problem, the goal is to maximize an unknown function via a sequence of noisy evaluations. Typically, the observation noise is assumed to be independent of the evaluation point and to satisfy a tail bound uniformly on the domain; a restrictive assumption for many applications. In this work, we c…

2018-01-29abs ↗pdf ↗

New meta-learning framework for minimizing simple regret in bandits.

problem Minimizing simple regret in a sequence of bandit tasks with unknown distributions.
method Developed Bayesian and frequentist meta-learning algorithms for bandits, analyzing their meta simple regret.
result Bayesian algorithm achieves ildeO(m/n) ilde{O}(m / \sqrt{n}) meta simple regret, frequentist algorithm ildeO(mn+m/n) ilde{O}(\sqrt{m} n + m/ \sqrt{n}).

OOD-trained Bayesian neural networks perform similarly to frequentist methods in uncertainty quantification.

problem Bayesian neural networks struggle in out-of-distribution (OOD) detection tasks.
method Incorporated out-of-distribution data into Bayesian inference through four different methods.
result OOD-trained Bayesian neural networks are competitive with frequentist baselines.

Bayes optimal algorithm under certain conditions doesn't achieve exponential simple regret.

problem Best arm identification with normal rewards over time.
method Fixed-budget best arm identification problem with rewards from normal distributions. Evaluates performance via simple regret.
result Bayes optimal algorithm does not yield exponential decrease in simple regret.

Proposes dynamic borrowing method for historical data in clinical trials.

problem Insufficient statistical power in rare and pediatric disease clinical trials.
method Dynamic borrowing method based on frequentist approach using similarity measures.
result Demonstrates usefulness of dynamic borrowing in reanalyzing clinical trial data.

A new sequential method estimates Poisson means in streaming data, achieving optimality and efficiency.

problem Estimating Poisson means in a streaming, or online, framework.
method A quasi-Bayesian approach based on Newton's algorithm for a sequential estimate.
result Established frequentist guarantees including consistency and asymptotic optimality.

Theoretical framework for M-posteriors connects Bayesian and frequentist statistics.

problem Connecting Bayesian and frequentist approaches in statistical inference.
method Developed a theoretical framework for M-posteriors, showing asymptotic normality and frequentist consistency.
result M-posteriors are robust and contract around M-estimators under mild conditions.

Proposes a new method to control FDR using frequentist-assisted horseshoe for high-dimensional testing.

problem Designing tests with frequentist false discovery rate control using horseshoe prior.
method Frequentist-assisted horseshoe procedure for high-dimensional normal means testing.
result Consistently achieves robust finite-sample FDR control in various sparse cases.

This paper bridges statistical and machine learning approaches to variational inference.

problem Statisticians struggle to understand variational inference from a Frequentist perspective.
method Explains VI, VAEs, and DDMs from a Frequentist viewpoint, starting with EM.
result VI emerges as a scalable solution for intractable E-steps in VAEs and DDMs.

Study evaluates quality of uncertainty estimates for neural networks.

problem Lack of principled assessment methods for evaluating uncertainty quality in deep learning.
method Statistical methods of frequentist interval coverage, interval width, and expected calibration error.
result Different UQ methods produce markedly different quality uncertainty estimates.

We study, to the best of our knowledge, the first Bayesian algorithm for unimodal Multi-Armed Bandit (MAB) problems with graph structure. In this setting, each arm corresponds to a node of a graph and each edge provides a relationship, unknown to the learner, between two nodes in terms of expected reward. Furthermore, …

2016-11-17abs ↗pdf ↗

The paper addresses frequentist regret of Linear Thompson Sampling in stochastic linear bandits.

problem The frequentist regret of Linear Thompson Sampling (LinTS) is worse than its Bayesian counterpart.
method The paper proves the fundamental nature of the frequentist regret bound for LinTS and proposes a data-driven version of LinTS to achieve minimax optimal frequentist regret.
result The frequentist regret bound for LinTS is O~(ddT)\widetilde{\mathcal{O}}(d\sqrt{dT}), which is the best possible under certain conditions.

The paper analyzes distributed Bayesian inference and its Frequentist guarantees.

problem Analyzing large decentralized datasets with distributed Bayesian inference.
method Establishes Frequentist properties for distributed (non-)Bayesian inference.
result Distributed Bayesian inference retains parametric efficiency and enhances robustness.

New rigorous uncertainty bounds for Gaussian Process regression.

problem Need for frequentist uncertainty bounds in applications like learning-based control.
method Introduce new uncertainty bounds that are rigorous and practically useful.
result New bounds are less conservative and more useful for practical applications.

A new algorithm reduces frequentist regret in multi-agent bandit problems with sparse hypergraphs.

problem Deriving a frequentist regret bound for Thompson sampling in multi-agent settings with sparse hypergraphs.
method Proposed εε-exploring Multi-Agent Thompson Sampling (εε-MATS) algorithm that combines exploration and exploitation strategies.
result Achieves a worst-case frequentist regret bound sublinear in time horizon and local arm size, optimal up to constants and logarithms for sparse hypergraphs.

Automatically differentiable estimation for BLP model reduces bias in demand estimation.

problem Estimating the BLP model with reduced bias and improved performance.
method Phrasing BLP as an automatically differentiable moment function, using CUE for estimation, and incorporating MCMC credible intervals.
result CUE estimation shows lower bias but higher MAE compared to 2S-GMM, with MCMC providing closest empirical coverage.

A key challenge for modern Bayesian statistics is how to perform scalable inference of posterior distributions. To address this challenge, variational Bayes (VB) methods have emerged as a popular alternative to the classical Markov chain Monte Carlo (MCMC) methods. VB methods tend to be faster while achieving comparabl…

2017-05-09abs ↗pdf ↗

Improved Thompson Sampling reduces regret in contextual bandits and reinforcement learning.

problem Thompson Sampling's exploration is insufficient in some contexts.
method Developed Feel-Good Thompson Sampling to address exploration issues.
result Feel-Good Thompson Sampling reduces regret compared to standard Thompson Sampling.

We consider the exploration-exploitation dilemma in finite-horizon reinforcement learning (RL). When the state space is large or continuous, traditional tabular approaches are unfeasible and some form of function approximation is mandatory. In this paper, we introduce an optimistically-initialized variant of the popula…

2019-11-01abs ↗pdf ↗

Frequentist method estimates uncertainty in RNNs without altering architecture.

problem Uncertainty quantification in RNNs for decision-making.
method Jackknife resampling and influence functions to estimate variability.
result The method provides theoretical coverage guarantees on uncertainty intervals.

The paper improves bounds on regret in Gaussian process bandits.

problem Sequential optimization of expensive, possibly non-convex functions with noisy feedback.
method Analyzes maximal information gain and decay rates of GP kernel eigenvalues to improve regret bounds.
result General bounds on maximal information gain and improved regret bounds for various settings, including Matérn kernels.

New algorithm for competing influence spread in unknown networks.

problem Maximizing influence spread in a social network with unknown probabilities.
method Combinatorial multi-armed bandit (CMAB) framework, Triggering Probability Modulated (TPM) condition, OCIM-TS, OCIM-OFU, OCIM-ETC.
result Sublinear Bayesian and frequentist regret for OCIM-TS and OCIM-OFU, respectively.

We have recently proposed a new information-based approach to model selection, the Frequentist Information Criterion (FIC), that reconciles information-based and frequentist inference. The purpose of this current paper is to provide a simple example of the application of this criterion and a demonstration of the natura…

2015-06-19abs ↗pdf ↗

A new framework uses matrix flows to unify frequentist and Bayesian approaches for sparse GGMs.

problem Challenges in studying conditional independence among many variables with few observations.
method General framework for variational inference with matrix-variate Normalizing Flow in Gaussian Graphical Models.
result Unified benefits of frequentist and Bayesian frameworks for sparse GGMs.

The CLT fails for LLM evaluations with small data, leading to underestimation of uncertainty.

problem Inaccurate uncertainty estimates in LLM evaluations with small datasets.
method Alternative frequentist and Bayesian methods for uncertainty quantification.
result CLT-based methods underestimate uncertainty in small data settings.

Deep ensembles effectively capture epistemic uncertainty through training stochasticity, providing a frequentist perspective.

problem Understanding and quantifying epistemic uncertainty in machine learning models.
method Bootstrap-based estimator and decomposition of deep ensembles into data variability and training stochasticity.
result Deep ensembles primarily capture training stochasticity, explaining their effectiveness in quantifying epistemic uncertainty.

Bayesian SAE model with spectral clustering and uncertainty quantification.

problem Small Area Estimation (SAE) with uncertainty quantification.
method Spectral clustering with external covariates, posterior projections, and CPMSE.
result Closed form expressions for posterior mean estimators and CPMSE.

Bayesian online learning algorithm for one-pass data, achieving frequentist validity and uncertainty quantification.

problem Theoretical limitations in Bayesian online learning, especially in the one-pass setting.
method Proposed a new Bayesian online learning algorithm with a warm-start phase for the one-pass regime, establishing convergence rates and valid uncertainty quantification.
result The sequentially updated posterior attains optimal convergence rates and valid uncertainty quantification without diverging mini-batch sample sizes.