Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

160320479639 · Jun 202019922001200920172026
48 results for Statistical Query Lower Bounds

New bounds show complex neural networks need many queries to learn.

problem Learning non-polynomial activation functions with Gaussian marginals.
method Gradient boosting procedure to amplify lower bounds on SQ dimension of neural networks.
result Statistical-query lower bounds for ReLU regression with 2ncε2^{n^c} ε queries.

Statistical query algorithms and low-degree tests are nearly equivalent in high-dimensional hypothesis testing.

problem High-dimensional hypothesis testing and information-computation gaps.
method Analysis of statistical query framework and low-degree polynomials.
result Statistical query algorithms and low-degree polynomials are almost equivalent in power under mild conditions.

Paper solves k-sparse parity problem with sign SGD, matching SQ lower bound.

problem Solving k-sparse parity problems efficiently.
method Sign stochastic gradient descent on neural networks.
result Matches Statistical Query lower bound for solving k-sparse parity problems.

The study sets limits on how well halfspaces can be learned when labels are corrupted.

problem Learning halfspaces in the presence of Massart noise.
method Statistical query (SQ) lower bounds.
result No SQ algorithm can achieve misclassification error better than the corruption rate ηη with superpolynomial accuracy or a superpolynomial number of queries.

Optimized Franz-Parisi criterion matches SQ lower bounds for various statistical models.

problem Understanding computational hardness in statistical inference.
method Proposed and refined Franz-Parisi criterion, established equivalence with SQ lower bounds.
result Optimized Franz-Parisi criterion is equivalent to Statistical Query (SQ) lower bounds.

New SQ lower bounds show learning mixtures of bounded covariance Gaussians is hard.

problem Learning mixtures of Gaussians with bounded covariance matrices is hard.
method Statistical Query (SQ) lower bounds.
result Any SQ algorithm requires complexity at least dΩ(1/ε)d^{Ω(1/ε)} for learning mixtures of bounded covariance Gaussians.

Tensor PCA problem analyzed with statistical query lower bounds.

problem Estimating the expected value of a rank-1 tensor from Gaussian samples.
method Sharp analysis of optimal sample complexity in the Statistical Query model.
result SQ algorithms with polynomial query complexity fail in the conjectured hard phase and have sub-optimal sample complexity.

New SQ lower bound shows complexity nearly matches known upper bound for smoothed agnostic learning.

problem Smoothed agnostic learning of halfspaces under subgaussian distributions.
method Statistical Query (SQ) lower bound using moment-matching hard distribution and linear programming duality.
result First non-trivial lower bound on complexity nearly matches known upper bound.

Study near-optimal bounds for learning Gaussian halfspaces with random noise.

problem Learning general halfspaces with Gaussian distribution and random classification noise.
method Established nearly-matching algorithmic and SQ lower bounds, developed a computationally efficient learning algorithm.
result Sample complexity of learning algorithm is O(d/ε+d/(max{p,ε})2)O(d/ε + d/(\max\{p, ε\})^2), SQ lower bound is Ω(d1/2/(max{p,ε})2)Ω(d^{1/2}/(\max\{p, ε\})^2).

The study establishes SQ lower bounds for learning halfspaces and ReLUs under Gaussian marginals.

problem Agnostically learning halfspaces and ReLUs under Gaussian marginals.
method Statistical Query (SQ) lower bounds analysis.
result Proves SQ lower bounds of dpoly(1/ε)d^{\mathrm{poly}(1/ε)} for both problems.

This work sets lower bounds on the number of score queries needed for diffusion sampling.

problem Establishing information-theoretic limits on the number of score evaluations required for diffusion sampling.
method Proving lower bounds on the number of adaptive score queries needed for sampling.
result Any sampling algorithm requires at least \(\widetilde{\Omega}(\sqrt{d})\) adaptive score queries for \(d\)-dimensional distributions.

Improved efficient robust regression with near-linear time and subquadratic samples.

problem Robust linear regression with unknown covariance matrix under Gaussian covariates.
method Near-linear time algorithm using subquadratic samples, complemented by SQ and polynomial lower bounds.
result Achieves prediction error O(εκ)O(\sqrt{εκ}) for εκ1εκ\lesssim 1, improving over prior works.

New SQ lower bounds for NGCA without requiring chi-squared condition.

problem Proving SQ hardness for NGCA under moment-matching conditions.
method General SQ lower bound methodology applied to NGCA under moment-matching conditions.
result Proved near-optimal SQ lower bounds for NGCA without chi-squared condition.

New algorithm for learning ReLU networks with Gaussian noise, improving previous results.

problem PAC learning one-hidden-layer ReLU networks with Gaussian marginals and label noise.
method First polynomial-time algorithm for kk up to ildeO(logd) ilde{O}(\sqrt{\log d}) for positive coefficients, no assumptions on rank or condition number.
result Proves a Statistical Query lower bound of dΩ(k)d^{Ω(k)} for arbitrary real coefficients, separating learnability classes.

New lower bounds for sampling from log-concave distributions in higher dimensions.

problem Proving lower bounds for sampling from log-concave distributions in higher dimensions.
method Multiscale construction inspired by geometric measure theory and reduction to block Krylov algorithms.
result Query lower bounds for sampling from log-concave distributions in higher dimensions are established.

Lower bounds show learning mixtures of linear classifiers is nearly impossible.

problem Learning mixtures of linear classifiers under Gaussian covariates.
method Statistical Query (SQ) lower bounds and new spherical designs.
result Complexity of any SQ algorithm is \( n^{\mathrm{poly}(1/Δ) \log(r)} \), where Δ is the pairwise \(\ell_2\)-separation.

New lower bounds show learning intersections of halfspaces is hard even for a few halfspaces.

problem Learning intersections of halfspaces in polynomial time under standard assumptions.
method Unified connection to parallel pancakes distribution for proving hardness.
result Learning ω(loglogN)ω(\log \log N) halfspaces in dimension NN requires super-polynomial time under standard assumptions.

We consider the problem of sampling from a strongly log-concave density in Rd\mathbb{R}^d, and prove an information theoretic lower bound on the number of stochastic gradient queries of the log density needed. Several popular sampling algorithms (including many Markov chain Monte Carlo methods) operate by using stochas…

2020-02-01abs ↗pdf ↗

New method generates private synthetic data with optimal utility for smooth queries.

problem Achieving strong utility guarantees for meaningful downstream analysis of sensitive datasets.
method Proposes a polynomial-time algorithm for generating (ε,δ)(\varepsilon,δ)-differentially private synthetic data with minimax optimal error rates for smooth queries.
result Achieves a minimax error rate of Ok,d(nmin{1,kd})O_{k,d}(n^{-\min \{1, \frac{k}{d}\}}) for kk-smooth queries, up to a log(n)\log(n) factor.

New algorithm for reliable learning of Gaussian halfspaces with improved sample and computational complexity.

problem Learning halfspaces under Gaussian marginals with reliable agnostic model.
method Developed a new algorithm for reliable learning of Gaussian halfspaces with specific sample and computational complexity.
result Achieved a new algorithm with improved sample and computational complexity for reliable learning of Gaussian halfspaces.

New insights into query complexity for Nash equilibrium learning.

problem Characterizing the number of queries needed to learn approximate Nash equilibria in matrix games.
method Introduced a new technique to prove lower bounds on query complexity, improving previous techniques.
result Lower bounds of order Ω(log(1Kε))Ω(\log(\frac{1}{Kε})) for any ε1/(cK4)ε\leq 1 / (cK^4), where cc is a constant.

We study active learning where the labeler can not only return incorrect labels but also abstain from labeling. We consider different noise and abstention conditions of the labeler. We propose an algorithm which utilizes abstention responses, and analyze its statistical consistency and query complexity under fairly nat…

2016-10-30abs ↗pdf ↗

We lower bound the complexity of finding εε-stationary points (with gradient norm at most εε) using stochastic first-order methods. In a well-studied model where algorithms access smooth, potentially non-convex functions through queries to an unbiased stochastic gradient oracle with bounded variance, we prove that (i…

2019-12-05abs ↗pdf ↗

BILBO optimizes bilevel problems without repeated lower-level optimizations.

problem Challenges in bilevel optimization, especially in noisy, constrained, and derivative-free settings.
method BILevel Bayesian Optimization (BILBO) that optimizes both levels simultaneously, using confidence-bounds and function query selection.
result Theoretical and empirical evidence of BILBO's effectiveness on various problems.

Overlapping clusters are common in models of many practical data-segmentation applications. Suppose we are given nn elements to be clustered into kk possibly overlapping clusters, and an oracle that can interactively answer queries of the form "do elements uu and vv belong to the same cluster?" The goal is to recov…

2019-10-28abs ↗pdf ↗

Study shows a tradeoff between sample complexity and computational efficiency for learning halfspaces with random noise.

problem PAC learning γ-margin halfspaces with Random Classification Noise.
method Established an information-computation tradeoff and provided a simple efficient algorithm with sample complexity O(1/(γ^2 ε^2)). Also, proved lower bounds for SQ algorithms and low-degree polynomial tests.
result Inherent gap between sample complexity and computational efficiency for learning halfspaces with random noise.

New algorithms learn multi-index models via harmonic analysis, achieving statistical and computational trade-offs.

problem Learning multi-index models with unknown projections of input data.
method Exploiting the equivariance of the problem under the orthogonal group, we derive lower bounds and construct spectral algorithms based on harmonic tensor unfolding.
result Achieve statistical and computational trade-offs between sample and runtime complexity.

In adaptive data analysis, the user makes a sequence of queries on the data, where at each step the choice of query may depend on the results in previous steps. The releases are often randomized in order to reduce overfitting for such adaptively chosen queries. In this paper, we propose a minimax framework for adaptive…

2016-02-13abs ↗pdf ↗

New algorithm for learning mixtures with mostly uniform weights, improving on previous bounds.

problem Learning mixtures of Gaussians with uniform weights and mostly uniform component weights.
method Statistical Query (SQ) lower bound and quasi-polynomial upper bound for testing.
result Quasi-polynomial upper bound for testing mixtures with mostly uniform weights.

Optimal locally private hypothesis selection with interactive rounds.

problem Locally private hypothesis selection under i.i.d. samples.
method Developed an ε-LDP algorithm using critical queries for hypothesis selection.
result Achieved optimal sample complexity of Θ(k/α²ε²) for hypothesis selection.

We present new differentially private algorithms for learning a large-margin halfspace. In contrast to previous algorithms, which are based on either differentially private simulations of the statistical query model or on private convex optimization, the sample complexity of our algorithms depends only on the margin of…

2019-02-24abs ↗pdf ↗