arXiv research

Estimation is the computational task of recovering a hidden parameter $x$ associated with a distribution $D_x$, given a measurement $y$ sampled from the distribution. High dimensional estimation problems arise naturally in statistics, machine learning, and complexity theory. Many high dimensional estimation problems ca…

New algorithms learn graph structures privately, matching best results.

Hilbert's 17th problem asks that whether every nonnegative polynomial can be a sum of squares of rational functions. It has been answered affirmatively by Artin. However, the question as to whether a given nonnegative polynomial is a sum of squares of polynomials is still a central question in real algebraic geometry. …

Paper solves outlier robust mean estimation near breakdown point.

New framework reduces sum-of-squares proof degree, speeding up clustering and robust moment estimation.

In recent years, optimization theory has been greatly impacted by the advent of sum of squares (SOS) optimization. The reliance of this technique on large-scale semidefinite programs however, has limited the scale of problems to which it can be applied. In this paper, we introduce DSOS and SDSOS optimization as linear …

Polynomial-time algorithm estimates edge density of random graphs with privacy and robustness.

Paper introduces a new kernel model for PSD-valued functions with theoretical guarantees and applications.

The paper develops sum-of-squares relaxations for computing $f$-divergences.

In order to model entanglements of polymers in a confined region, we consider the linking numbers and writhes of cycles in random linear embeddings of complete graphs in a cube. Our main results are that for a random linear embedding of $K_n$ in a cube, the mean sum of squared linking numbers and the mean sum of square…

We consider two problems that arise in machine learning applications: the problem of recovering a planted sparse vector in a random linear subspace and the problem of decomposing a random low-rank overcomplete 3-tensor. For both problems, the best known guarantees are based on the sum-of-squares method. We develop new …

New algorithm estimates transport maps with nearly optimal error.

We obtain the first polynomial-time algorithm for exact tensor completion that improves over the bound implied by reduction to matrix completion. The algorithm recovers an unknown 3-tensor with $r$ incoherent, orthogonal components in $\mathbb R^n$ from $r\cdot \tilde O(n^{1.5})$ randomly observed entries of the tensor…

In this paper, we generalize the Cao-Yau's gradient estimate for the sum of squares of vector fields up to higher step under assumption of the generalized curvature-dimension inequality. With its applications, by deriving a curvature-dimension inequality, we are able to obtain the Li-Yau gradient estimate for the CR he…

We study a statistical model for the tensor principal component analysis problem introduced by Montanari and Richard: Given a order-$3$ tensor $T$ of the form $T = τ\cdot v_0^{\otimes 3} + A$, where $τ\geq 0$ is a signal-to-noise ratio, $v_0$ is a unit vector, and $A$ is a random noise tensor, the goal is to recover th…

Explicitly constructed 3XOR instances hard for Sum-of-Squares hierarchy.

In the noisy tensor completion problem we observe $m$ entries (whose location is chosen uniformly at random) from an unknown $n_1 \times n_2 \times n_3$ tensor $T$. We assume that $T$ is entry-wise close to being rank $r$. Our goal is to fill in its missing entries using as few observations as possible. Let $n = \max(n…

New algorithms recover signals robustly against outliers and heavy-tailed noise.

Efficiently estimates prediction error in regression with Gaussian covariates under privacy constraints.

This work improves graph inference using the degree-4 sum-of-squares hierarchy.

Nearly all Gaussian points in high dimensions lie on a common ellipsoid.

KSOS improves kernel learning for dynamical systems via global optimization.

This note optimizes distributions using kernel mean embeddings with a new parameterization.

In this paper we prove local analytic hypoellipticity for a degenerate sum of squares of complex vector fields generalizing those of Kohn in "Hypoellipticity and Loss of Derivatives". Kohn's article is to appear in the Annals of Mathematics with an appendix by Derridj and Tartakoff proving local analyticity in that cas…

SOS programming verifies MTW tensor non-negativity for optimal transport maps.

Three algorithms improve starting solutions for clustering problems.

New tools in nonlinear random matrices improve understanding of the Sum of Squares hierarchy.

Polynomial-time algorithm estimates mean with bounded covariance using differential privacy.

New method clusters non-spherical Gaussian mixtures with fewer samples and time.

Efficiently constructs prediction bands with minimal assumptions.

Triangular map is a recent construct in probability theory that allows one to transform any source probability density function to any target density function. Based on triangular maps, we propose a general framework for high-dimensional density estimation, by specifying one-dimensional transformations (equivalently co…

Sum-of-Squares lower bound shows NGCA requires more samples than known algorithms.

Algorithm estimates mixtures of arbitrary Gaussians robustly in presence of corruptions.

We develop efficient algorithms for estimating low-degree moments of unknown distributions in the presence of adversarial outliers. The guarantees of our algorithms improve in many cases significantly over the best previous ones, obtained in recent works of Diakonikolas et al, Lai et al, and Charikar et al. We also sho…

New algorithms improve privacy in statistical estimation by making them robust.

Two spectral clustering methods for multi-layer networks are analyzed and compared.

Algorithm learns Gaussian mixtures robust to outliers.

Tensor rank and low-rank tensor decompositions have many applications in learning and complexity theory. Most known algorithms use unfoldings of tensors and can only handle rank up to $n^{\lfloor p/2 \rfloor}$ for a $p$-th order tensor in $\mathbb{R}^{n^p}$. Previously no efficient algorithm can decompose 3rd order ten…

New algorithm learns mixtures of any constant number of Gaussians robustly.

New method finds global minima using function evaluations and kernel approximations.

We study tensor completion in the agnostic setting. In the classical tensor completion problem, we receive $n$ entries of an unknown rank-$r$ tensor and wish to exactly complete the remaining entries. In agnostic tensor completion, we make no assumption on the rank of the unknown tensor, but attempt to predict unknown …

This is the fourth article of our series. Here, we study weighted norm inequalities for the Riesz transform of the Laplace-Beltrami operator on Riemannian manifolds and of subelliptic sum of squares on Lie groups, under the doubling volume property and Gaussian upper bounds.

New estimator avoids overfitting in convex regression.

We study the problem of high-dimensional sparse mean estimation in the presence of an $ε$-fraction of adversarial outliers. Prior work obtained sample and computationally efficient algorithms for this task for identity-covariance subgaussian distributions. In this work, we develop the first efficient algorithms for rob…

New method certifies anti-concentration for various non-Gaussian distributions.

Proves subgaussian distributions are SoS-certifiably subgaussian, enabling efficient algorithms for various statistical tasks.

Robustly clusters mixtures of Gaussians even with outliers.

Bayesian method synthesizes barrier certificates for unknown systems with latent states.