Unified complexity bound for sampling logconcave distributions
problem Sampling arbitrary logconcave distributions
method In-and-Out algorithm with exponential lifting
result Nearly tight convergence rate
Unified bounds for DP risks reduce noise and improve accuracy.
problem Difficult interpretation and calibration of DP mechanisms.
method Hypothesis-testing interpretation of DP (f-DP) and unified bounds. result Unified bounds are tighter and tunable for specific risks.
Unified framework for anytime-valid PAC-Bayes bounds.
problem Deriving time-uniform PAC-Bayes bounds for stochastic processes.
method Combines four tools: nonnegative supermartingales, method of mixtures, Donsker-Varadhan formula, and Ville's inequality.
result Unified PAC-Bayes theorem for a wide class of discrete stochastic processes.
Unified framework for lower bounds in interactive decision making.
problem Challenges in interactive decision making, especially bandits and reinforcement learning.
method Interactive Fano method and Fractional Covering Number.
result Unified characterization of learnability for stochastic bandit problems and tight lower bounds for interactive decision making.
Unified method to calculate Gromov norm for Kähler classes of bounded symmetric domains.
problem Calculating the Gromov norm of Kähler classes for all bounded symmetric domains.
method Combination of ideas from Domin-Toledo and Toledo, aided by the Polydisc Theorem.
result Unified and simplified calculation of Gromov norm for all bounded symmetric domains.
Unified framework for high-dimensional bandit problems with low-dimensional structures.
problem Stochastic high-dimensional bandit problems with low-dimensional structures.
method Proposed a simple unified algorithm and a general analysis framework for the regret upper bound.
result Unified algorithm achieves comparable regret bounds in various high-dimensional bandit problems.
Unified diffusive bounds for non-linear parabolic equations.
problem Proving diffusive upper bounds for parabolic equations.
method Simple exponential deformation argument.
result Unified diffusive upper bounds for a wide class of non-linear parabolic equations.
Unified learning bound for covariate and concept shifts.
problem Generalization under distribution shift in machine learning.
method Support-agnostic definitions of covariate and concept shifts using entropic optimal transport, leading to a unified error bound applicable to various loss functions and label spaces.
result Development of estimators for shifts with concentration guarantees and the DataShifts algorithm for quantifying and estimating the error bound.
In the context of dealing with financial risk management problems it is desirable to have accurate bounds for option prices in situations when pricing formulae do not exist in the closed form. A unified approach for obtaining upper and lower bounds for Asian-type options, including options on VWAP, is proposed in this …
One of the biggest issues in deep learning theory is the generalization ability of networks with huge model size. The classical learning theory suggests that overparameterized models cause overfitting. However, practically used large deep models avoid overfitting, which is not well explained by the classical approaches…
Unified PAC-Bayesian framework for deep learning generalization.
problem Limitations of existing PAC-Bayesian norm-based bounds for deep neural networks.
method Unified framework using anisotropic Gaussian posteriors and sensitivity matrix.
result Comparable or tighter generalization bounds compared to state-of-the-art approaches.
Based on differential privacy (DP) framework, we introduce and unify privacy definitions for the multi-armed bandit algorithms. We represent the framework with a unified graphical model and use it to connect privacy definitions. We derive and contrast lower bounds on the regret of bandit algorithms satisfying these def…
Unified framework for expert selection with bandit and lower-bound feedback.
problem Selecting the best expert in scenarios with bandit feedback and lower-bound information.
method Introduces a new feedback model combining bandit and lower-bound information, proving optimal regret bounds for modified Exp3 algorithms.
result Optimal regret bounds for modified Exp3 algorithms, generalizing both bandit and full-information settings.
Unified estimates for mean curvature in Lorentz-Minkowski space.
problem Estimating mean curvature for space-like and time-like graphs.
method Using gradient bounds to derive Heinz-type estimates.
result Unified vanishing theorem for mean curvature of constant mean curvature graphs.
Unified study of Riemannian and sub-Riemannian geometries with synthetic Ricci curvature bounds.
problem Unified framework for Riemannian and sub-Riemannian geometries.
method Study of gauge metric measure spaces.
result Unified synthetic Ricci curvature lower bounds for both Riemannian and sub-Riemannian structures.
Unified framework improves meta-learning generalization bounds.
problem Limited sharpness of existing meta-generalization bounds.
method Unified information-theoretic derivation for single-step bounds.
result Unified bounds exhibit tighter scaling and computational advantages.
Unified bounds for neural networks incorporating physical laws.
problem Limitations in existing generalization analyses for PINNs and VPINNs.
method Unified framework using Taylor expansion and Koopman-based analysis.
result High-rank networks can generalize well even with differential operators.
New bounds for quantile aggregation unify and clarify existing methods.
problem Analytical bounds for quantile aggregation with dependence uncertainty.
method Using inf-convolution of quantile-based risk measures, establish new analytical bounds called convolution bounds.
result Convolution bounds are the best available and provide sharp results in many cases.
This paper unifies risk-averse Thompson sampling for continuous risk functionals.
problem Designing and analyzing risk-averse Thompson sampling algorithms for continuous risk functionals.
method Developed analytical toolkits to prove asymptotically optimal regret bounds for various risk measures.
result Proved asymptotic optimality of ρ-MTS for Bernoulli distributions and a class of risk measures. Unified derivation of PAC-Bayes and MI bounds for general VC classes with fast rates.
problem Generalization bounds for machine learning models with VC classes.
method Unified derivation of conditional PAC-Bayesian and mutual information bounds, including MAC-Bayesian bounds.
result Nontrivial bounds for general VC classes and faster rates for specific conditions.
Unified bounds for random subset generalization error and improved SGD Langevin dynamics.
problem Generalization error bounds for random subsets and stochastic gradient Langevin dynamics.
method Unified framework based on Hellström and Durisi's work, extending bounds for Langevin dynamics.
result Unified and refined bounds for generalization error in stochastic gradient Langevin dynamics.
Unified framework for understanding TVO and improving model learning.
problem Improving the tightness and efficiency of variational inference bounds.
method Exponential family interpretation and equal spacing in moment parameters.
result Unified framework and improved gradient estimator for TVO.
Unified transformer-based LT-TTD improves ranking efficiency and quality.
problem Decoupled L1 and L2 models in recommendation and search systems cause irreversible error propagation and suboptimal ranking.
method LT-TTD combines two-tower models with transformer expressivity in a unified listwise learning framework, providing theoretical guarantees and UPQE evaluation.
result LT-TTD reduces irretrievable relevant items and achieves better global optimization than disjoint training.
Unified model for interactive estimation with improved learnability measure.
problem Improving learnability in interactive estimation models.
method Introducing a combinatorial measure (dissimilarity dimension) and a general algorithm with polynomial bounds.
result Unified model subsumes statistical-query learning and structured bandits.
This paper introduces the variational Rényi bound (VR) that extends traditional variational inference to Rényi's alpha-divergences. This new family of variational methods unifies a number of existing approaches, and enables a smooth interpolation from the evidence lower-bound to the log (marginal) likelihood that is co…
Unified framework for information-theoretic bounds on learning algorithms.
problem Deriving generalization bounds for learning algorithms.
method Probabilistic decorrelation lemma, symmetrization, couplings, chaining, Young's inequality.
result New upper bounds on generalization error in expectation and high probability.
Unified model detects transferable variables and source data in high-dimensional linear regression.
problem Scarcity of target data and heterogeneity of source and target data distributions.
method UTrans model, estimation error bounds, hypothesis testing for source detection.
result UTrans achieves lower estimation and prediction errors than existing methods.
Unified framework for distributional regret in bandits and reinforcement learning.
problem Characterizing the distribution of regret in multi-armed bandits and reinforcement learning.
method Unified framework with a UCBVI-style algorithm and distributional regret bounds.
result Distributional regret bounds with optimal trade-offs between expected and distributional regret.
Unified proof of knot unknotting bounds using Ma-Qiu index.
problem Finding bounds on the number of moves to unknot knots.
method Using the Ma-Qiu index to bound presentation distances and Gordian distances.
result Unified proof of various unknotting number bounds.
Unified estimate for complex Monge-Ampère equations on Kähler manifolds.
problem Estimating solutions to complex Monge-Ampère equations on Kähler manifolds.
method Unified approach using PDE methods and entropy bounds to construct comparison metrics.
result Improves previous results on modulus of continuity, stability, and W1,1-estimates of Green's functions. Unified framework for active learning problems using information theory.
problem Combining level set estimation and Bayesian optimization.
method Information-theoretic criterion and acquisition function.
result Unified framework achieves state-of-the-art performance.
We present a probabilistic viewpoint to multiple kernel learning unifying well-known regularised risk approaches and recent advances in approximate Bayesian inference relaxations. The framework proposes a general objective function suitable for regression, robust regression and classification that is lower bound of the…
We give a simple unified proof for several disparate bounds on Thurston-Bennequin number for Legendrian knots and self-linking number for transverse knots in R^3, and provide a template for possible future bounds. As an application, we give sufficient conditions for some of these bounds to be sharp.
Unified algorithm tackles various RL goals like reward-free and preference-based learning.
problem Unified approach to multiple RL learning goals.
method Decision-Estimation Coefficient (DEC) framework.
result Unified algorithm handles various learning goals with a single framework.
Unified bounds for iterative algorithms with Gaussian data matrices.
problem Establishing non-asymptotic bounds for iterative algorithms with Gaussian data.
method Explicit coupling between iterates and Gaussian process with deterministic covariance.
result Tight, dimension-free bounds for generalized first-order methods.
Unified framework for deriving generalization bounds in supervised learning.
problem Generalization error bounds in supervised learning.
method Data Processing Inequality PAC-Bayesian framework.
result Unified bounds on binary Kullback-Leibler generalization gap for various divergences.
Unified framework for N-tuples learning improves weakly supervised tasks.
problem Reducing annotation burden in supervised learning.
method Empirical risk minimization framework integrating pointwise unlabeled data.
result Framework improves generalization across various N-tuples learning tasks.
Unified discrete diffusion for categorical data simplifies training and sampling.
problem Training and sampling in discrete diffusion models for categorical data.
method Mathematical simplifications and elegant unification of discrete-time and continuous-time discrete diffusion.
result Unified Simplified Discrete Denoising Diffusion (USD3) outperforms SOTA baselines.
Unified theory for representation learning using learnable functions.
problem Insufficient theoretical understanding of unsupervised and self-supervised learning.
method Discriminative theoretical framework for analyzing sample complexity.
result Learnable regularization functions can reduce the amount of labeled data needed.
PySAD offers a unified Python framework for efficient streaming anomaly detection.
problem Efficient anomaly detection in streaming data with strict constraints.
method Unified architecture with 17+ streaming algorithms, specialized components, and support for multiple learning paradigms.
result PySAD enables real-time processing with bounded memory and is compatible with other Python frameworks.
Unified LLY Ricci curvature defined for hypergraphs.
problem Defining Ricci curvature for hypergraphs.
method Unified framework for LLY Ricci curvature on hypergraphs, establishing bounds and proving properties.
result Bonnet-Myers-type theorem for hypergraphs, highlighting curvature's potential in hypergraph analysis.
Unified framework for analyzing pessimism in off-policy learning with regularized importance sampling.
problem High variance in importance weighting for off-policy learning.
method Unified PAC-Bayesian study of pessimism with regularized importance sampling.
result Derivation of a tractable PAC-Bayesian generalization bound for common importance weight regularizations.
Unified representation for tree ensembles indexed by nodes
problem Unifying geometric object for tree ensembles indexed by nodes
method KPP indexes feature map by nodes, weighted by path metric
result Unified non-diagonal Gram for prediction, additive attribution, robust radius, and risk bounds
Unified error analysis for low-rank approximation improves data assimilation performance.
problem Analyzing the error in low-rank approximation methods for data assimilation.
method Unified stochastic analysis framework for Frobenius norm error bounds on centered and non-standard Gaussian matrices.
result Unified bounds provide clearer interpretations and enable better practical choices for covariance matrices.
Unified analysis of MPLE for Ising models with bounded operator norm or infinity norm.
problem Estimating Ising models in Total Variation distance with limited samples.
method Maximum Pseudo-Likelihood Estimator (MPLE) for two general classes of Ising models.
result Unified framework for polynomial-time estimation in TV distance for two general classes of Ising models.
In compressed sensing, in order to recover a sparse or nearly sparse vector from possibly noisy measurements, the most popular approach is ℓ1-norm minimization. Upper bounds for the ℓ2- norm of the error between the true and estimated vectors are given in [1] and reviewed in [2], while bounds for the $\ell_…
Unified framework for proving generalization bounds in machine learning.
problem Proving generalization bounds for machine learning algorithms.
method Conditional mutual information (CMI) framework to express and optimize bounds.
result Unified framework for proving generalization bounds in the realizable setting.
Unified framework for differentiable graph partitioning with probabilistic cuts.
problem Lack of general guarantees and principled gradients in prior probabilistic relaxations of graph cuts.
method Unified probabilistic framework covering a wide class of cuts, including Normalized Cut, with tight analytic upper bounds.
result Rigorous, numerically stable foundation for scalable, differentiable graph partitioning.