New algorithms reduce regret in both stochastic and deterministic environments.
problem Designing algorithms that perform well in both types of MDPs.
method Proposed new environment norms and algorithms with variance-dependent regret bounds.
result First algorithm with simultaneously optimal bounds for both stochastic and deterministic MDPs.
New algorithm optimizes multi-armed bandit performance in stochastic and adversarial settings.
problem Optimizing multi-armed bandit performance in both stochastic and adversarial environments.
method Follow-the-regularized-leader method with adaptive learning rates.
result First BOBW algorithm with gap-variance-dependent regret bounds in adversarial settings.
Improved regret bounds for contextual bandits considering variance sequences.
problem Establishing lower bounds for contextual bandits with variance-dependent regret.
method Developed variance-dependent lower bounds for linear contextual bandits under two settings: fixed and adaptive variance sequences.
result Lower bounds match upper bounds of SAVE algorithm up to logarithmic factors.
New algorithms reduce regret in online MDPs by adapting to data and variance.
problem Adapting to both adversarial and stochastic environments in online MDPs.
method Develops algorithms based on global optimization and policy optimization, using optimistic follow-the-regularized-leader with log-barrier regularization.
result Achieves refined data-dependent and variance-dependent regret bounds.
New algorithm reduces regret in infinite MDPs with optimal variance-dependent bounds.
problem Infinite horizon MDPs lack optimal algorithms with low regret.
method Developed a UCB-style algorithm for average-reward and γ-regret.
result Achieved optimal variance-dependent regret bounds for both objectives.
Improved bounds for Monte Carlo Rademacher Averages using self-bounding functions.
problem Proving sharper concentration bounds for MCERA.
method Deriving new bounds through self-bounding functions and concentration of measure.
result Novel bounds depend on data-dependent quantities, improving over standard methods.
New algorithm reduces regret for linear bandits with unknown noise variance.
problem Finding optimal actions in linear bandits with varying noise variance.
method Adaptive algorithm with Freedman-type concentration inequality and multi-layer structure.
result Achieves i l d e O ( d ∑ k = 1 K σ k 2 + d ) ilde{O}(d \sqrt{\sum_{k = 1}^K σ_k^2} + d) i l d e O ( d ∑ k = 1 K σ k 2 + d ) regret for linear bandits. Improved online confidence bounds for multinomial logistic models in bandits.
problem Achieving optimal regret in multinomial logistic bandits with bounded parameters and outcomes.
method Deriving an improved online confidence bound and proposing OFU-MNL++ and OFU-MN 2 ^2 2 L algorithms. result Achieved variance-dependent optimal regret for MNL bandits.
We consider a sequential learning problem with Gaussian payoffs and side information: after selecting an action i i i , the learner receives information about the payoff of every action j j j in the form of Gaussian observations whose mean is the same as the mean payoff, but the variance depends on the pair ( i , j ) (i,j) ( i , j ) (and may…
Improved GP bandit algorithms for noiseless, varying noise, and RKHS norms.
problem Minimizing regret in Gaussian process bandits with unknown reward functions.
method New upper bound on maximum posterior variance, refined MVR and PE algorithms.
result Optimal regret bounds for noiseless, varying noise, and RKHS norms.
New estimator accurately estimates mean of real-valued distributions without variance knowledge.
problem Estimating the mean of real-valued distributions without prior variance knowledge.
method Introduces a novel estimator that converges sub-Gaussian and works across distributions with bounded variance.
result The estimator achieves accuracy of σ·(1+o(1))√(2log(1/δ)/n) with parameters n, δ, and σ².
The paper analyzes methods for estimating linear functionals from observational data, proving upper bounds and showing optimal procedures.
problem Estimating linear functionals from observational data in causal inference and bandit literature.
method Two-stage procedures that first estimate treatment effect function, then use it to estimate the linear functional.
result Proves non-asymptotic upper bounds on mean-squared error for two-stage procedures and shows instance-dependent optimality.
Study problem-dependent rates in statistical learning theory, achieving optimal generalization error bounds.
problem Generalization error in statistical learning theory.
method Uniform localized convergence framework.
result Optimal generalization error bounds for various learning problems.
Atlas-type models are constant-parameter models of uncorrelated stocks for equity markets with a stable capital distribution, in which the growth rates and variances depend on rank. The simplest such model assigns the same, constant variance to all stocks; zero rate of growth to all stocks but the smallest; and positiv…
FGTSVA improves Thompson Sampling for contextual bandits with optimal variance-aware regret.
problem Optimizing regret bounds for Thompson Sampling in contextual bandits.
method Developed FGTSVA, a variance-aware Thompson Sampling algorithm for contextual bandits with a new decoupling coefficient.
result Achieved optimal regret bound of i l d e O ( d c ⋅ log ∣ F ∣ ∑ t = 1 T σ t 2 + d c ) ilde{O}(\sqrt{\mathrm{dc}\cdot\log|\mathcal{F}|\sum_{t=1}^Tσ_t^2}+\mathrm{dc}) i l d e O ( dc ⋅ log ∣ F ∣ ∑ t = 1 T σ t 2 + dc ) . Optimal strategy identified for minimizing regret in fixed-budget best arm selection.
problem Minimizing expected simple regret in fixed-budget best arm selection.
method Two-Stage (TS)-Hirano-Imbens-Ridder (HIR) strategy using HIR estimator.
result TS-HIR strategy is asymptotically minimax optimal.
Algorithm identifies best arm in bandit game with variance consideration.
problem Identifying the best arm in a stochastic multi-armed bandit game with varying variances.
method Adaptive algorithm using grouped median elimination to explore gaps and variances.
result Guarantees to output the best arm with probability (1-δ) using optimal number of samples.
A new batch ensemble method reduces regret in stochastic bandits.
problem Efficiently balancing exploration and exploitation in online RL.
method Proposes a batch ensemble scheme to achieve near-optimal regret.
result Proves near-optimal regret with a single parameter independent of variance.
Noise addition prevents overfitting in adaptive data analysis.
problem Overfitting in repeated use of a data sample via adaptively chosen queries.
method Simple noise addition algorithms and differential privacy-based analysis.
result Noise-addition algorithms provide variance-dependent guarantees for unbounded queries.
The aim of this article is to design a moment transformation for Student- t distributed random variables, which is able to account for the error in the numerically computed mean. We employ Student-t process quadrature, an instance of Bayesian quadrature, which allows us to treat the integral itself as a random variable…
Contextual bandits study how reward variance affects regret bounds.
problem Investigating how small reward variance impacts regret bounds in contextual bandits.
method Analyzing two types of adversaries and function approximation complexities.
result Regret bounds are influenced by the eluder dimension and reward variance.
The proposed model modifies option pricing formulas for the basic case of log-normal probability distribution providing correspondence to formulated criteria of efficiency and completeness. The model is self-calibrating by historic volatility data; it maintains the constant expected value at maturity of the hedged inst…
Learning DAG or Bayesian network models is an important problem in multi-variate causal inference. However, a number of challenges arises in learning large-scale DAG models including model identifiability and computational complexity since the space of directed graphs is huge. In this paper, we address these issues in …
The paper analyzes high-dimensional kernel regression, showing different risk curves based on data and regularization.
problem Characterizing generalization properties of high-dimensional kernel ridge regression.
method Bias-variance decomposition of the expected excess risk, considering different regularization schemes and data eigen-profiles.
result The risk curve of kernel regression can be double-descent-like, bell-shaped, or monotonic, depending on n, d, and regularization level.
Improves active learning efficiency by warping input space based on observed outputs.
problem Insensitivity of Gaussian process uncertainty to actual observations.
method Input warping with learned monotone reparameterization to adjust acquisition function behavior.
result Significantly improved sample efficiency across various benchmarks, especially in non-stationary conditions.
The relationship between the size and the variance of firm growth rates is known to follow an approximate power-law behavior σ ( S ) ∼ S − β ( S ) σ(S) \sim S^{-β(S)} σ ( S ) ∼ S − β ( S ) where S S S is the firm size and β ( S ) ≈ 0.2 β(S)\approx 0.2 β ( S ) ≈ 0.2 is an exponent weakly dependent on S S S . Here we show how a model of proportional growth which treats firms as classes compos…
Multiplicative noise models are often used instead of additive noise models in cases in which the noise variance depends on the state. Furthermore, when Poisson distributions with relatively small counts are approximated with normal distributions, multiplicative noise approximations are straightforward to implement. Th…
Subagging improves regression tree performance, especially with many splits.
problem Improving regression tree performance with subsample aggregating.
method Formalized bias and variance dependencies, compared subagging to single trees, and analyzed optimal tree sizes.
result Subagging improves tree performance, especially with many splits.
New insights into bias-variance tradeoff for data-driven optimization under local misspecification.
problem Understanding the relative performance of SAA, IEO, and ETO under local misspecification.
method Developed a local misspecification perspective using contiguity theory in statistics.
result Explicit expressions for decision bias and geometric understanding of variance.
New model captures state-dependent variability in partially observed systems.
problem Structured stochasticity not captured by constant-variance models.
method State-coupled stochastic volatility framework with particle expectation-maximization.
result Model consistently reduces recovery bias under partial observation.
Analyzes error sources in global feature effect estimation methods.
problem Unexplored error sources in global feature effect estimation methods.
method Systematic, estimator-level analysis of bias and variance.
result Holdout data is theoretically cleanest, but estimation variance depends on sample size and model characteristics.
New method corrects Markowitz variance for trading volume fluctuations.
problem Incorrect risk estimates from Markowitz variance in trading environments.
method Modeling portfolio variance based on trade volume fluctuations.
result Market-based variance can significantly differ from Markowitz variance.
A new model shows fairness mechanisms can improve selection utility even without implicit bias.
problem Improving selection fairness without introducing a utility trade-off.
method A model with latent quality and group-dependent variance, comparing fairness mechanisms to group-oblivious selection.
result Demographic parity always increases selection utility, while γ γ γ -rules weakly increase it. The study optimizes bounds for comparing training and population loss.
problem Optimizing bounds for comparing training and population loss.
method Derives generic information-theoretic and PAC-Bayesian generalization bounds using convex comparator functions.
result The tightest possible bound is obtained with the comparator being the convex conjugate of the CGF of the bounding distribution.
Introduces bounded scale measure and generalizes property A.
problem Defining property A for large scale spaces with bounded geometry.
method Introduces bounded scale measure, shows its coarse invariance, and generalizes property A.
result Definition of property A for large scale spaces with bounded scale measure is a coarse invariant.
Paper improves PAC-Bayes bounds for various loss types.
problem Improving PAC-Bayes bounds for different types of losses.
method Introducing new high-probability PAC-Bayes bounds for bounded and general tail behaviors losses, and extending to anytime-valid bounds.
result New fast-rate and mixed-rate bounds for losses with bounded ranges, and parameter-free bounds for losses with general tail behaviors.
Study bounds on self-shrinkers with bounded HA for applications.
problem Understanding bounds on self-shrinkers with bounded HA.
method Integral and pointwise bounds on the second fundamental form of self-shrinkers.
result Gap and compactness results for self-shrinkers.
Investigates tight PAC-Bayes bounds for small datasets.
problem Tightening PAC-Bayes bounds for small data.
method Generic PAC-Bayes theorem, meta-learning, synthetic tasks.
result PAC-Bayes bounds are competitive with Chernoff bounds but not as tight.
Extends Fatou theorem to bounded harmonic maps.
problem Classical Fatou theorem for bounded harmonic functions.
method Extending theorem to bounded harmonic maps.
result Identifies bounded harmonic maps on unit disk with bounded measurable functions on boundary.
New bound relaxes uniform gradient norm assumptions for PAC-Bayesian bounds.
problem Generalization bounds with strict assumptions like uniformly bounded loss.
method Relax uniform bounds assumptions to on-average bounded loss and gradient norm.
result Proposes a new generalization bound with a surrogate of model complexity.
Jiang et al. (2020) found no uniformly tight generalization bounds for neural networks in the overparameterized setting.
problem Finding uniformly tight generalization bounds for neural networks in the overparameterized setting.
method Examined more than a dozen generalization bounds, proving that no bounds can be uniformly tight in the overparameterized setting.
result No generalization bounds can be uniformly tight in the overparameterized setting.
Willmore-type inequalities for bounded domains in manifolds with curvature bounds.
problem Establishing inequalities for bounded domains in manifolds with curvature bounds.
method Using asymptotic or integral Ricci curvature bounds to establish inequalities.
result Recovering a recent inequality of Jin-Yin.
Lower bounds on curvature integral for manifolds with curvature constraints.
problem Bounding curvature integrals under curvature constraints.
method Proving a lower bound for the curvature integral using dimension, upper curvature bounds, and injectivity radius.
result Uniformly bounded below integral of scalar curvature.
Paper improves SLCB regret bound for bounded noise.
problem Stochastic linear contextual bandits with bounded noise.
method Set-membership estimation (SME) and optimism in the face of uncertainty (OFU).
result Improved regret bound of O ( log T ) O(\log T) O ( log T ) . Study on CMC hypersurfaces with bounded index and area, proving multiplicity one convergence and bounds on genus.
problem Understanding CMC hypersurfaces with bounded index and area.
method Bubble-compactness theory for embedded CMC hypersurfaces in low dimensions.
result Minimal blow-ups are all catenoids, and bounds on genus provided.
Uniform entropy bound for Ricci shrinkers with bounded curvature.
problem Bounding entropy for Ricci shrinkers with specific curvature constraints.
method Establishing uniform entropy bounds for simply connected Ricci shrinkers with a finite second homotopy group and uniform curvature bounds.
result Uniform entropy bound for simply connected Ricci shrinkers with a finite second homotopy group and uniform curvature bounds.
New study on regret lower bounds for multi-agent multi-armed bandit problems.
problem Understanding the limits of performance in multi-agent multi-armed bandit problems.
method Comprehensive study on different settings, establishing tight lower bounds.
result First comprehensive study on regret lower bounds across various settings.
The paper improves PAC-Bayes bounds for losses with finite moments.
problem Bounding generalization for losses with heavy tails and finite moments.
method Truncation method and PAC-Bayes bounds for unbounded losses with heavy tails and bounded variance.
result Bounds interpolate between slow and fast rates depending on the moment.