arXiv research

The moduli space metric and its Kahler potential for well-separated non-Abelian vortices are obtained in U(N) gauge theories with N Higgs fields in the fundamental representation.

EM algorithm achieves optimal sample complexity for well-separated Gaussian mixtures.

New findings on robust learning with well-separated data.

Stochastic Neighbor Embedding and its variants are widely used dimensionality reduction techniques -- despite their popularity, no theoretical results are known. We prove that the optimal SNE embedding of well-separated clusters from high dimensions to any Euclidean space R^d manages to successfully separate the cluste…

New method estimates density ratio for well-separated distributions using multi-class logistic regression.

We introduce a convex approach for mixed linear regression over $d$ features. This approach is a second-order cone program, based on L1 minimization, which assigns an estimate regression coefficient in $\mathbb{R}^{d}$ for each data point. These estimates can then be clustered using, for example, $k$-means. For problem…

Algorithm distinguishes Gaussian mixtures from pure Gaussians in quasi-polynomial time.

At critical coupling, the interactions of Ginzburg-Landau vortices are determined by the metric on the moduli space of static solutions. The asymptotic form of the metric for two well separated vortices is shown here to be expressible in terms of a Bessel function. A straightforward extension gives the metric for N vor…

Improved sample efficiency with normalized RBF kernels in neural networks.

Consistent estimator for mixtures of nonparametric elliptical distributions helps cluster analysis.

This study examines when non-parametric methods are robust to adversarial examples.

New algorithm learns POMDPs without computational oracles.

We analyze the spectral clustering procedure for identifying coarse structure in a data set $x_1, \dots, x_n$, and in particular study the geometry of graph Laplacian embeddings which form the basis for spectral clustering algorithms. More precisely, we assume that the data is sampled from a mixture model supported on …

The paper analyzes the risk of CV-tuned regularized estimators and connects it to SURE.

Relative moduli spaces of periodic monopoles provide novel examples of Asymptotically Locally Flat hyperkahler manifolds. By considering the interactions between well-separated periodic monopoles, we infer the asymptotic behavior of their metrics. When the monopole moduli space is four-dimensional, this construction yi…

Recent progress has shown that few-shot learning can be improved with access to unlabelled data, known as semi-supervised few-shot learning(SS-FSL). We introduce an SS-FSL approach, dubbed as Prototypical Random Walk Networks(PRWN), built on top of Prototypical Networks (PN). We develop a random walk semi-supervised lo…

Researchers create initial data for multiple collapsing boson stars.

Suppose M is a compact orientable irreducible 3-manifold with Heegaard splitting surfaces P and Q. Then either Q is isotopic to a possibly stabilized copy of P or the Hempel distance of the splitting P is no greater than twice the genus of Q. More generally, if P and Q are bicompressible but weakly incompressible conne…

New algorithm for planning in observable POMDPs in quasi-polynomial time.

We investigate the problem of nodes clustering under privacy constraints when representing a dataset as a graph. Our contribution is threefold. First we formally define the concept of differential privacy for structured databases such as graphs, and give an alternative definition based on a new neighborhood notion betw…

The main contribution of the paper is to show that Gaussian sketching of a kernel-Gram matrix $\boldsymbol K$ yields an operator whose counterpart in an RKHS $\mathcal H$, is a \emph{random projection} operator---in the spirit of Johnson-Lindenstrauss (J-L) lemma. To be precise, given a random matrix $Z$ with i.i.d. Ga…

Irregular features disrupt the desired classification. In this paper, we consider aggressively modifying scales of features in the original space according to the label information to form well-separated clusters in low-dimensional space. The proposed method exploits spectral clustering to derive scaling factors that a…

Constructs classifiers for neural networks with specific data configurations.

On a complete manifold, such as Euclidean 3-space or hyperbolic 3-space, the limit at infinity of the norm of the Higgs field is called the mass of the monopole. We show the existence, on hypebolic 3-space, of monopoles with given magnetic charge and arbitrary mass. Previously, aside from charge one monopoles, existenc…

Neural networks have many successful applications, while much less theoretical understanding has been gained. Towards bridging this gap, we study the problem of learning a two-layer overparameterized ReLU neural network for multi-class classification via stochastic gradient descent (SGD) from random initialization. In …

Constructs initial data for multiple black holes with specified ADM parameters.

Learning the parameters of Gaussian mixture models is a fundamental and widely studied problem with numerous applications. In this work, we give new algorithms for learning the parameters of a high-dimensional, well separated, Gaussian mixture model subject to the strong constraint of differential privacy. In particula…

Deep neural networks (DNNs) have achieved exceptional performances in many tasks, particularly, in supervised classification tasks. However, achievements with supervised classification tasks are based on large datasets with well-separated classes. Typically, real-world applications involve wild datasets that include si…

We inspect a possible clustering structure of the corruption perception among 134 countries. Using the average linkage clustering, we uncover a well-defined hierarchy in the relationships among countries. Four main clusters are identified and they suggest that countries worldwide can be quite well separated according t…

Adaptive clustering and personalization algorithms minimize regret in multi-agent stochastic linear bandits.

Improved sample complexity for Gaussian process approximations.

Convex clustering can only learn convex clusters, with significant gaps between clusters.

A new approach clusters data first, then embeds each cluster, improving transparency.

Sampling from posterior distributions using Markov chain Monte Carlo (MCMC) methods can require an exhaustive number of iterations, particularly when the posterior is multi-modal as the MCMC sampler can become trapped in a local mode for a large number of iterations. In this paper, we introduce the pseudo-extended MCMC…

Sparse subspace clustering (SSC) is an elegant approach for unsupervised segmentation if the data points of each cluster are located in linear subspaces. This model applies, for instance, in motion segmentation if some restrictions on the camera model hold. SSC requires that problems based on the $l_1$-norm are solved …

The nearest neighbor rule is proven consistent in a broad setting.

Density-based clustering is the task of discovering high-density regions of entities (clusters) that are separated from each other by contiguous regions of low-density. DBSCAN is, arguably, the most popular density-based clustering algorithm. However, its cluster recovery capabilities depend on the combination of the t…

DDSME outperforms SME in estimating multimodal distributions.

Paper proposes a novel unsupervised feature selection method using K-means and ADMM.

The study bounds the stability of Gaussian mixtures under small perturbations.

t-distributed Stochastic Neighborhood Embedding (t-SNE), a clustering and visualization method proposed by van der Maaten & Hinton in 2008, has rapidly become a standard tool in a number of natural sciences. Despite its overwhelming success, there is a distinct lack of mathematical foundations and the inner workings of…

Improved KSD test for better detection of differences in distributions.

Paper optimizes hyperspherical prototypes for better class separation.

Numerous networks in the real world change over time, in the sense that nodes and edges enter and leave the networks. Various dynamic random graph models have been proposed to explain the macroscopic properties of these systems and to provide a foundation for statistical inferences and predictions. It is of interest to…

DNLL loss improves deep LDA accuracy and consistency.

In a standard cluster analysis, such as k-means, in addition to clusters locations and distances between them, it's important to know if they are connected or well separated from each other. The main focus of this paper is discovering the relations between the resulting clusters. We propose a new method which is based …

Adversarially robust machine learning has received much recent attention. However, prior attacks and defenses for non-parametric classifiers have been developed in an ad-hoc or classifier-specific basis. In this work, we take a holistic look at adversarial examples for non-parametric classifiers, including nearest neig…

A new method improves Bayesian inference for multimodal posteriors.