We prove near-tight concentration of measure for polynomial functions of the Ising model under high temperature. For any degree d d d , we show that a degree- d d d polynomial of a n n n -spin Ising model exhibits exponential tails that scale as exp ( − r 2 / d ) \exp(-r^{2/d}) exp ( − r 2/ d ) at radius r = Ω ~ d ( n d / 2 ) r=\tildeΩ_d(n^{d/2}) r = Ω ~ d ( n d /2 ) . Our concentration radius is opti…
Low-degree method fails to predict robust subspace recovery problem.
problem Predicting computational tractability of robust subspace recovery problem.
method Low-degree polynomial framework, anti-concentration properties.
result Low-degree method fails to predict computational tractability of robust subspace recovery problem even up to high degree.
Improved subspace recovery algorithm with dimension-independent error and polynomial time.
problem Efficiently recover a covariance matrix from a mix of inliers and adversarial outliers.
method List-decodable subspace recovery algorithm with faster fixed-polynomial time and less restrictive distributional assumptions.
result Achieved dimension-independent error guarantee of O(1/α) with poly(1/α d^O(1)) time complexity.
Study on Fox's trapezoidal conjecture for specific alternating links.
problem Investigating Fox's trapezoidal conjecture for alternating links.
method Diagrammatic Murasugi sums, Alexander polynomial, and concordance analysis.
result Established inequalities and conditions for the Alexander polynomial and trapezoidal conjecture.
New method certifies anti-concentration for various non-Gaussian distributions.
problem Efficiently certifying anti-concentration for non-Gaussian distributions.
method Sum-of-Squares relaxation of integer program for anti-concentration.
result Quasi-polynomial time certificates for non-Gaussian distributions.
Computes knot types using HOMFLY-PT polynomial.
problem Determining chiral knot and link types with small crossing numbers.
method Uses the HOMFLY-PT polynomial to compute knot types from 3D coordinates.
result Efficacy of HOMFLY-PT for knot types up to crossing number 16.
This is an extended abstract of the talk given at the Oberwolfach Workshop "Algebraic Structures in Low-Dimensional Topology", 25 May -- 31 May 2014. My goal was to describe progress in distributive homology from the previous Oberwolfach Workshop June 3 - June 9, 2012, in particular my work on Yang-Baxter homology; how…
Acceleration in Hilbert spaces reduces computations but not accuracy.
problem Improving learning accuracy with fewer computations.
method Analysis of Nesterov acceleration and heavy-ball methods in Hilbert spaces.
result Acceleration can reduce computations but not improve accuracy with respect to gradient descent.
Paper develops polynomial approximations for complex probability densities.
problem Approximating high-dimensional concentrated probability densities.
method Tensor-product spectral polynomials and KR rearrangements.
result Efficient approximation of complex densities using composite maps.
New insights into Khovanov polynomials using tangle calculus.
problem Understanding the structure and evolution of Khovanov polynomials for long braids.
method Application of tangle calculus and evolution theory to Khovanov polynomials, focusing on jumps and thickness.
result Jumps in evolution are less frequent than expected, with most contributions being non-jumping.
The paper proves concentration inequalities for diffusion processes.
problem Proving concentration inequalities for diffusion processes.
method Analysis via the Poisson equation for a broad class of subexponentially ergodic processes.
result Demonstrates power of concentration inequalities in validating conditions for Lasso estimation and sampling algorithms.
Quantum kernel methods can lead to trivial models due to exponential concentration of kernel values.
problem Exponential concentration of quantum kernel values can lead to trivial models in QML.
method Analyzing the resources needed to accurately estimate quantum kernel values and identifying four sources of concentration.
result Quantum kernel values can be exponentially concentrated, leading to trivial models.
Paper tackles offline RL with weak assumptions on both function classes and data coverage.
problem Achieve sample-efficient offline RL with weak assumptions on both factors.
method Simple algorithm based on primal-dual formulation of MDPs, with density-ratio function modeling dual variables.
result Polynomial sample complexity achieved under realizability and single-policy concentrability.
Polynomial-time algorithm for estimating covariance in corrupted Gaussian data.
problem Estimating covariance in data with up to 1-α fraction of adversarial corruptions.
method Uses low-degree sum-of-squares certificates for anti-concentration and hypercontractivity.
result Outputs a list of candidate parameters with high probability containing a nearly correct covariance.
The paper examines the optimality of kernel methods in high-dimensional clustering.
problem Understanding the optimality of kernel methods in high-dimensional data clustering.
method High-dimensional Gaussian clustering, exponential kernel function, kernel k-means, semi-definite relaxation.
result The exponential kernel function optimally recovers clusters in high-dimensional data, matching information-theoretic limits up to a factor of √2.
We propose a consistent polynomial-time method for the unseeded node matching problem for networks with smooth underlying structures. Despite widely conjectured by the research community that the structured graph matching problem to be significantly easier than its worst case counterpart, well-known to be NP-hard, the …
Robustly learns Ising models with corrupted data.
problem Learning Ising models corrupted by a constant fraction of adversarial samples.
method Develops a computationally efficient algorithm for robust learning.
result First near-optimal error guarantees for robust learning of Ising models.
We provide upper bounds of the expected Wasserstein distance between a probability measure and its empirical version, generalizing recent results for finite dimensional Euclidean spaces and bounded functional spaces. Such a generalization can cover Euclidean spaces with large dimensionality, with the optimal dependence…
The paper analyzes tensor recovery from symmetric rank-one measurements using information theory.
problem Recovering tensors with low symmetric rank from symmetric rank-one measurements.
method Covering numbers argument, Carbery-Wright inequality, orthogonal polynomials, Fano's inequality.
result Near-optimal sample complexity bounds for log-concave distributions.
Study spectral properties of sparse random graphs to recover latent vectors.
problem Recovering latent vectors in sparse random geometric graphs.
method Analyzes spectral concentration and uses orthogonal polynomial expansions, decoupling, and matrix concentration.
result Sharpens spectral norm bounds and proves exact recovery for Gaussian mixture models.
The aim of this paper is mainly, after some theoretical explanations, to provide a program on Maple for computing, whatever be d, the curvature of the planar d-web implicitely defined by a differential equation F(x,y,y')=0, F being polynomial of degree d with respect to y'. Moreover, we prove in the appendix a "concent…
New algorithm learns halfspaces with noise using Forster decomposition.
problem Learning halfspaces in noisy data.
method Forster decomposition and efficient mixture of distributions.
result First polynomial-time algorithm with strongly polynomial sample complexity.
New method learns shared structures in non-linear tasks.
problem Learning shared linear representations in non-linear tasks.
method Convex optimization with structural assumptions.
result Rank and clustered estimators recover shared structures under certain conditions.
New analysis improves Monte Carlo Tree Search for reinforcement learning.
problem Improving Monte Carlo Tree Search for reinforcement learning with finite simulations.
method Established polynomial concentration property of regret for non-stationary MABs, leading to a new UCB with polynomial bonus term.
result MCTS with polynomial bonus term requires nearly optimal sample size for learning value functions.
Deep networks can perfectly classify two low-dimensional manifolds on a sphere with large depth and width.
problem Binary classification of two low-dimensional submanifolds on a sphere.
method Analysis of a deep fully-connected neural network trained to separate two submanifolds of the unit sphere.
result Randomly-initialized gradient descent can perfectly classify the two manifolds with high probability when the network depth is large relative to certain geometric and statistical properties of the data.
Paper tackles offline preference-based RL with human feedback.
problem Offline Preference-based Reinforcement Learning with preference feedback.
method Two-step approach: MLE for reward estimation and distributionally robust planning.
result First guarantee for learning any target policy with polynomial samples.
Algorithm learns Gaussian mixtures robust to outliers.
problem Efficiently learn high-dimensional Gaussian mixtures with outliers.
method Sum-of-Squares based proofs to algorithms approach.
result Polynomial time algorithm for k k k -mixture with pairwise separated components. New insights on offline RL with state aggregation and trajectory data.
problem Understanding sample complexity in offline policy evaluation.
method Analyzing concentrability coefficient in aggregated Markov Transition Model.
result Sample complexity depends on concentrability coefficient in aggregated model.
Algorithm finds a nearly correct solution even when more than half of the data is corrupted.
problem Robust regression in the presence of a large fraction of adversarially corrupted data.
method List-decodable learning framework based on sum-of-squares method.
result Polynomial-time algorithm that outputs a small list of potential solutions.
Analyzes the differential expansion of knot polynomials, focusing on its applicability and modifications.
problem Understanding the differential expansion of colored knot polynomials, especially for non-trivial knots and those with defects.
method Examines the current status of differential expansion, analyzes its applicability to non-trivial knots, and introduces a new transformation.
result A new transformation V V V that converts Z \cal{Z} Z to standard Z Z Z -factors and allows for the calculation of F F F . Polynomial-time test for detecting dense subgraphs in heterogeneous networks.
problem Detecting a planted community in heterogeneous networks.
method Proposes a polynomial-time test with a standard normal distribution null limiting distribution.
result The test is efficient and performs well in both simulations and real data.
Randomly initialized neural networks can linearly separate arbitrary sets.
problem Mapping two arbitrary sets to linearly separable sets.
method Randomly initialized one-layer neural networks with sufficient width.
result With high probability, these networks can transform two sets into linearly separable sets.
Optimizes privacy-preserving optimization for heavy-tailed data.
problem Privacy-preserving optimization with heavy-tailed gradients.
method Pure ε-differential privacy framework for Lipschitz extensions.
result Minimax optimal excess-risk rate for pure ε-DP heavy-tailed SCO.
Designs efficient algorithms to maximize the expectation of Gaussian random variables.
problem Maximizing the expectation of the supremum of Gaussian random variables.
method Polynomial time approximation scheme and O ( log n ) O(\log n) O ( log n ) approximation algorithm for general m > 1 m>1 m > 1 . result Characterizes optimal variance allocation and provides approximation algorithms.
We propose fast approximations for the generalized sliced-Wasserstein distance.
problem Efficient approximation of the generalized sliced-Wasserstein distance in high dimensions.
method Deterministic approximations using random projections and concentration of measure results.
result One-dimensional projections of high-dimensional random vectors are approximately Gaussian.
Study on computing and estimating calibration distance, showing hardness and efficiency.
problem Computing and estimating calibration distance under different assumptions.
method Efficient algorithm for exact computation, polynomial-time approximation scheme; sample-based estimation for upper bounds.
result The problem becomes NP-hard when assumptions are removed, but efficient algorithms exist under certain conditions.
Paper tackles robust offline RL for non-Markovian processes, improving efficiency and applicability.
problem Learning robust policies for non-Markovian decision processes with limited offline data.
method Proposes a novel algorithm with dataset distillation and LCB design for robust values, derived new dual forms, and introduces concentrability coefficients.
result Proves polynomial sample efficiency for finding ε-optimal robust policies.
Tensor rank and low-rank tensor decompositions have many applications in learning and complexity theory. Most known algorithms use unfoldings of tensors and can only handle rank up to n ⌊ p / 2 ⌋ n^{\lfloor p/2 \rfloor} n ⌊ p /2 ⌋ for a p p p -th order tensor in R n p \mathbb{R}^{n^p} R n p . Previously no efficient algorithm can decompose 3rd order ten…
Algorithm learns Sherrington-Kirkpatrick model parameters at low temperatures.
problem Learning parameters of random graphical models at low temperatures.
method Multiplicative-weight update algorithm for polynomial time learning.
result Algorithm learns SK model parameters at β ≤ log n β\leq \sqrt{\log n} β ≤ log n . Polynomial chaos expansions on Grassmannian submanifolds for high-dimensional stochastic systems.
problem Uncertainty quantification in high-dimensional stochastic systems.
method Principal Geodesic Analysis on the Grassmann manifold, adaptive algorithm for local submanifolds, polynomial chaos expansion.
result Efficient surrogate modeling of system behavior across different parameter spaces.
Theory for algebraic data on categories via concentration structures.
problem Defining algebraic structures on categories.
method Introducing concentration structures and concentration monoids.
result Every group can be represented as a concentration monoid of a trivial category.
Paper addresses concentration of distances for fractional quasi p-norms, identifying conditions for concentration and anti-concentration.
problem Understanding concentration of distances for fractional quasi p-norms in high dimensions.
method Analyzes conditions for concentration and anti-concentration of distances for fractional quasi p-norms.
result Identifies conditions for concentration and anti-concentration of fractional quasi p-norms, ruling out some approaches and specifying conditions for control.
Study Finsler metric measure manifolds' concentration properties.
problem Understanding concentration properties in Finsler metric measure manifolds.
method Established relationships with observable diameter, isoperimetric inequalities, and first eigenvalue.
result Derived a Cheng type upper bound estimate for the first closed eigenvalue.
We solve ReLU regression with efficient approximations for various distributions.
problem Finding the best fitting ReLU function with square loss from unknown distributions.
method Introduced efficient constant-factor approximation algorithm and polynomial-time approximation scheme.
result First constant-factor approximation algorithm for ReLU regression with weak concentration conditions.
The paper establishes lower bounds for learning polynomial functions on hypercube.
problem Establishing lower bounds for learning polynomial functions on the discrete hypercube.
method Using packing numbers and Fourier analysis, the paper proves lower bounds on the number of queries needed for learning.
result Proves sharp lower bounds on the number of queries required for learning polynomial functions.
Unified method for estimating properties of large domain distributions efficiently.
problem Estimating properties of distributions over large domains efficiently.
method Piecewise-polynomial approximation technique for constructing sample- and time-efficient estimators.
result Near-linear-time computable estimators with optimal and highly-concentrated approximation values.
Study shows RFRR's effectiveness with nearly orthogonal data in overparameterized settings.
problem Understanding the effectiveness of random feature regression with nearly orthogonal data.
method Investigates RFRR with nearly orthogonal deterministic unit-length input data vectors in the overparameterized regime.
result Shows high-probability non-asymptotic concentration results for RFRR's training, cross-validation, and generalization errors.
In recent years, sparse principal component analysis has emerged as an extremely popular dimension reduction technique for high-dimensional data. The theoretical challenge, in the simplest case, is to estimate the leading eigenvector of a population covariance matrix under the assumption that this eigenvector is sparse…