Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

228457685913 · Jun 202019922001200920172026
48 results for Sufficient Sample Complexity

Study on neural networks' sample complexity with one hidden layer.

problem Understanding how sample complexity is affected by network architecture and norm constraints.
method Norm-based uniform convergence bounds for scalar-valued one-hidden-layer networks, focusing on spectral and Frobenius norms.
result Spectral norm control is insufficient for uniform convergence guarantees, but Frobenius norm control is sufficient, with conditions.

This work establishes a new upper bound on the number of samples sufficient for PAC learning in the realizable case. The bound matches known lower bounds up to numerical constant factors. This solves a long-standing open problem on the sample complexity of PAC learning. The technique and analysis build on a recent brea…

2015-07-02abs ↗pdf ↗

Study shows how leveraging hierarchical similarity graphs improves matrix completion in recommender systems.

problem Improving matrix completion in recommender systems using hierarchical similarity graphs.
method Characterizes the optimal sample complexity using hierarchical stochastic block models and low-rank rating matrices.
result Exploiting hierarchical structure of social graphs significantly reduces the number of observed entries needed for accurate matrix completion.

Improved sample complexity for training diffusion models.

problem How many samples are needed to train an accurate diffusion model?
method Analyzing the sample complexity of training diffusion models using neural networks.
result Exponential improvement in the dependence on Wasserstein error and depth, along with improved dependencies on other parameters.

GenSDR tackles SDR by leveraging generative models to fully recover lower-dimensional structures.

problem Challenges in identifying low-dimensional sufficient structures in nonlinear SDR.
method Proposes GenSDR, a method that uses modern generative models to fully recover information in the central σ-field.
result Establishes consistency of GenSDR estimator for sample-level data and extends its applicability to non-Euclidean responses.

New findings show learnable distributions remain learnable even with noisy or adversarial perturbations.

problem Learning from perturbed samples in high-dimensional spaces.
method Developed a perturbation-quantization framework to analyze additive noise and adversarial corruption models.
result Sample compressible families remain learnable even under noisy or adversarial perturbations.

We give new upper and lower bounds on the minimax sample complexity of differentially private mean estimation of distributions with bounded kk-th moments. Roughly speaking, in the univariate case, we show that n=Θ(1α2+1αkk1ε)n = Θ\left(\frac{1}{α^2} + \frac{1}{α^{\frac{k}{k-1}}\varepsilon}\right) samples are necessary and sufficie…

2020-02-21abs ↗pdf ↗

Near-optimal sample complexity for phase retrieval with generative priors.

problem Phase retrieval with magnitude-only measurements and sparse signals.
method Near-optimal sample complexity with i.i.d. Gaussian measurements and generative models.
result O(k log L) samples suffice for phase retrieval with generative priors.

Paper develops a theory explaining contrastive pre-training for multimodal AI.

problem Limited theoretical understanding of contrastive pre-training for multi-modal AI.
method Introduces approximate sufficient statistics and Joint Generative Hierarchical Model.
result Near-minimizers of contrastive loss are approximately sufficient, enabling diverse downstream tasks.

The paper improves support recovery in high-dimensional precision matrix estimation using meta learning.

problem Support recovery in high-dimensional precision matrix estimation with reduced sample complexity.
method Pooling samples from different tasks and using an improper 1\ell_1-regularized log-determinant Bregman divergence to estimate a single precision matrix.
result The support of the improperly estimated single precision matrix is equal to the true support union with high probability.

The study examines property testing and estimation under non-identically distributed samples, finding necessary and sufficient sample complexities.

problem Property testing and estimation under non-identically distributed samples.
method Analysis of distributional property testing and estimation in settings with heterogeneous entities.
result Necessary and sufficient sample complexities for property testing and estimation under non-identically distributed samples.

An algorithm solves optimization problems with large sample sets, improving worst-case complexity.

problem Continuous nonlinear-equality-constrained optimization problems with large numbers of terms.
method Progressively sampled finite sets to solve related problems with growing sample sizes.
result Better worst-case sample complexity compared to solving with full sets of samples.

Improved sample and time complexity for identifying mixtures of product distributions.

problem Identifying a mixture of kk product distributions from statistics.
method Combining robust tensor decomposition and Hadamard extensions to bound the condition number of key matrices.
result Achieved sample complexity and run-time complexity of (1/ζ)O(k)(1/ζ)^{O(k)} for n2k1n \geq 2k-1.

Sampling from distributions to find the one with the largest mean arises in a broad range of applications, and it can be mathematically modeled as a multi-armed bandit problem in which each distribution is associated with an arm. This paper studies the sample complexity of identifying the best arm (largest mean) in a m…

2013-06-17abs ↗pdf ↗

Many machine learning problems, especially multi-modal learning problems, have two sets of distinct features (e.g., image and text features in news story classification, or neuroimaging data and neurocognitive data in cognitive science research). This paper addresses the joint dimensionality reduction of two feature ve…

2016-02-13abs ↗pdf ↗

Several approximate policy iteration schemes without value functions, which focus on policy representation using classifiers and address policy learning as a supervised learning problem, have been proposed recently. Finding good policies with such methods requires not only an appropriate classifier, but also reliable e…

2008-05-14abs ↗pdf ↗

In recent years there has been an increasing interest in learning Bayesian networks from data. One of the most effective methods for learning such networks is based on the minimum description length (MDL) principle. Previous work has shown that this learning procedure is asymptotically successful: with probability one,…

2013-02-13abs ↗pdf ↗

Standard acquisition functions are sufficient for asynchronous Bayesian optimization.

problem Redundant and repeated queries in asynchronous Bayesian optimization.
method Conceptual analysis and theoretical guarantees of standard acquisitions.
result Standard acquisition functions achieve theoretical guarantees equivalent to Thompson sampling in asynchronous settings.

Study on proper learning under relaxed worst-case robust loss for VC classes.

problem Proper adversarially robust PAC learning under relaxed worst-case robust loss.
method Introduced a family of robust loss relaxations and showed their effectiveness for proper learnability.
result VC classes are properly PAC learnable with sample complexity close to standard PAC learning setup.

The paper establishes conditions for optimal sampling configurations on complex manifolds.

problem Finding optimal sampling configurations on complex manifolds.
method Analyzes point configurations on compact complex manifolds using tensor powers of Hermitian ample line bundles.
result Necessary and sufficient conditions for the existence of asymptotically Fekete sequences.

Efficiently estimate Boolean product distribution parameters from truncated samples.

problem Estimating parameters of Boolean product distributions from truncated samples.
method Introducing fatness of truncation set, using membership queries, and adapting Stochastic Gradient Descent.
result Efficiently learn Boolean product distributions from truncated samples with small sample complexity.

The paper establishes bounds for score-matching in causal discovery and generative modeling.

problem Estimating causal relationships from data.
method Training a deep neural network to estimate the score function and applying it to causal discovery.
result Bounds on the error rate of causal discovery methods using score-matching.

This paper derives sufficient conditions for local recovery of coordinate dictionaries comprising a Kronecker-structured dictionary that is used for representing KKth-order tensor data. Tensor observations are assumed to be generated from a Kronecker-structured dictionary multiplied by sparse coefficient tensors that …

2017-12-10abs ↗pdf ↗

A new method reduces complexity of normalizing flows for MCMC preconditioning.

problem Improving sampling efficiency in MCMC algorithms for complex target distributions.
method Factorized preconditioning architecture combining a linear component and a conditional NF.
result Significantly better tail samples and higher effective sample sizes on various distributions.

We study the sample complexity of learning a high-dimensional simplex from a set of points uniformly sampled from its interior. Learning of simplices is a long studied problem in computer science and has applications in computational biology and remote sensing, mostly under the name of `spectral unmixing'. We theoretic…

2018-10-18abs ↗pdf ↗

This article studies the achievable guarantees on the error rates of certain learning algorithms, with particular focus on refining logarithmic factors. Many of the results are based on a general technique for obtaining bounds on the error rates of sample-consistent classifiers with monotonic error regions, in the real…

2015-12-22abs ↗pdf ↗

LACD uses unlabeled data to improve conditional diffusion models.

problem Costly and time-consuming acquisition of labeled data.
method Label-augmented conditional diffusion (LACD) with joint denoising score matching.
result LACD converges faster in total variation and Wasserstein-1 distances with sufficient unlabeled data.

We consider the fundamental learning problem of estimating properties of distributions over large domains. Using a novel piecewise-polynomial approximation technique, we derive the first unified methodology for constructing sample- and time-efficient estimators for all sufficiently smooth, symmetric and non-symmetric, …

2019-11-08abs ↗pdf ↗

New conditions show proxy data can improve policy learning in sparse expert data contexts.

problem Improving sample complexity of policy learning with sparse expert data.
method Sufficient conditions for proxy data to improve sample complexity, adaptable to LLMs.
result Provable improvement in sample complexity for policy learning with proxy data.

New approach for testable learning using moment matching and Rademacher complexity.

problem Replacing hard-to-verify distributional assumptions with testable ones.
method Moment matching and metric distances in probability.
result Improved sample complexity bounds for various concept classes and distributions.

We consider the problem of model selection in Gaussian Markov fields in the sample deficient scenario. In many practically important cases, the underlying networks are embedded into Euclidean spaces. Using the natural geometric structure, we introduce the notion of spatially stationary distributions over geometric grap…

2018-06-10abs ↗pdf ↗

Paper finds sample complexity for learning high-dimensional simplices from noisy data.

problem Learning high-dimensional simplices from noisy samples.
method Combines sample compression, high-dimensional geometry, and Fourier analysis.
result Proves sample complexity bound for achieving a simplex within a certain distance from the true simplex.

SAIL learns from sub-optimal demonstrations to improve sample efficiency in sparse reward tasks.

problem Reducing sample complexity in sparse-rewarded tasks.
method Self-Adaptive Imitation Learning (SAIL) that exploits sub-optimal demonstrations and efficient exploration.
result Significantly improved sample efficiency and better final performance across various tasks.