Constructs orthogonal coordinates in curved spaces.
problem Separating variables in curved spaces.
method Explicit construction of orthogonal coordinates and transformations.
result Explicit formulas for Killing tensors and Stäckel matrices.
Let X be a nonsingular simply connected projective variety of dimension m, E a rank n vector bundle on X, and L a line bundle on X. Suppose that S2(E∗)⊗L is an ample vector bundle and that there is a constant even rank r≥2 symmetric bundle map E→E∗⊗L. We prove that m≤n−r. We u…
Polynomial time algorithm matches correlated Gaussian matrices without vanishing correlation.
problem Matching vertices in two correlated Erdős-Rényi graphs.
method Iterative matching algorithm for correlated Gaussian Wigner matrices.
result First polynomial time algorithm for graph matching with arbitrarily small constant correlation.
The paper studies minimal 2-spheres of constant curvature in complex hyperquadrics using matrix theory.
problem Exploring minimal 2-spheres of constant curvature in complex hyperquadrics.
method Using singular-value decomposition of complex matrices to study the moduli space of noncongruent spheres.
result Uniqueness proven for totally real constantly curved 2-spheres.
We investigate the high-dimensional regression problem using adjacency matrices of unbalanced expander graphs. In this frame, we prove that the ℓ2-prediction error and the ℓ1-risk of the lasso and the Dantzig selector are optimal up to an explicit multiplicative constant. Thus we can estimate a high-dim…
This article provides a new toolbox to derive sparse recovery guarantees from small deviations on extreme singular values or extreme eigenvalues obtained in Random Matrix Theory. This work is based on Restricted Isometry Constants (RICs) which are a pivotal notion in Compressed Sensing and High-Dimensional Statistics a…
In compressed sensing problems, ℓ1 minimization or Basis Pursuit was known to have the best provable phase transition performance of recoverable sparsity among polynomial-time algorithms. It is of great theoretical and practical interest to find alternative polynomial-time algorithms which perform better than $\e…
We analyze the condition number of random feature matrices and prove their well-conditioned nature.
problem Understanding the condition number of random feature matrices and its impact on generalization error.
method Established concentration bounds and derived risk bounds for regression problems using random feature matrices.
result The risk associated with random feature matrices exhibits the double descent phenomenon, improving even with noise.
We propose a scheme for recycling Gaussian random vectors into structured matrices to approximate various kernel functions in sublinear time via random embeddings. Our framework includes the Fastfood construction as a special case, but also extends to Circulant, Toeplitz and Hankel matrices, and the broader family of s…
The paper uses Betti curves to confirm hyperbolic geometry in brain, climate, and financial networks.
problem Confirming the curvature of real-world networks using topology.
method Using Betti curves and integral Betti signatures derived from Persistent Homology to distinguish different geometric matrices.
result Integral Betti signatures effectively distinguish Euclidean, spherical, and hyperbolic geometric matrices.
We present explicit formulas for the coordinates in which the Hamiltonians of the Benenti systems with flat metrics take natural form and the metrics in question are represented by constant diagonal matrices.
A spacelike surface in the Minkowski 3-space is called a constant slope surface if its position vector makes a constant angle with the normal at each point on the surface. These surfaces completely classified in [J. Math. Anal. Appl. 385 (1) (2012) 208-220]. In this study, we give some relations between split quaternio…
Develops log-Euclidean Lie groups for SPD and correlation matrices.
problem Unifies various log-Euclidean constructions for SPD and correlation matrices.
method Theory and explicit isometries linking different log-Euclidean metrics.
result Explicit log-Euclidean metrics on SPD and correlation matrices.
The paper addresses portfolio allocation with uncertain covariance matrices, finding a logarithmic risk dependence.
problem Portfolio allocation with uncertain covariance matrices.
method Calculates the expected value of CARA utility function over a distribution of covariance matrices, considering uncertainty in future returns and covariances.
result Marginalization introduces a logarithmic dependence on risk, leading to lower allocation levels for higher uncertainties.
New structures on symplectic manifolds derived from convex functions and matrices.
problem Investigating new types of toric generalized Kaehler structures on compact manifolds.
method Characterizing structures by triples (τ,C,F), proving canonical structures, and showing reversibility. result Underlying each structure is a canonical toric Kähler structure with a symplectic potential given by τ. Analog arrays are a promising upcoming hardware technology with the potential to drastically speed up deep learning. Their main advantage is that they compute matrix-vector products in constant time, irrespective of the size of the matrix. However, early convolution layers in ConvNets map very unfavorably onto analog a…
New method tightens Lipschitz bounds for CNNs efficiently.
problem Lipschitz regularization of Convolutional Neural Networks (CNNs).
method Using Toeplitz matrix theory, introduces a tight and computationally efficient upper bound for convolutional layers.
result Developed an algorithm to train Lipschitz regularized CNNs.
New GMM models fit high-dimensional data with fewer parameters.
problem Overparameterization and lack of flexibility in GMMs for high-dimensional data.
method Piecewise-constant covariance eigenvalue profiles, EM and penalized EM algorithms.
result Superior likelihood-parsimony tradeoffs in density fitting, clustering, and denoising.
New estimators reduce computation for Kendall's tau and conditional Kendall's tau matrices under structural assumptions.
problem Efficient estimation of Kendall's tau and conditional Kendall's tau matrices for large dimensions.
method Averaging pairwise estimates over blocks or conditional estimates, exploiting structural assumptions.
result Improved estimators with reduced computational cost and similar error level.
This note improves correlation stress tests using geodesic distance.
problem Improving financial risk management through better covariance stress tests.
method Proposes a new geometrically invariant definition of correlation stress tests.
result Demonstrates a submanifold approach to stress testing covariance matrices.
Constructs finite element spaces for (p,q)-forms, excluding one subspace.
problem Constructing finite element spaces for (p,q)-forms. method Piecewise polynomial finite element spaces for all natural subspaces of (p,q)-forms, excluding one subspace. result Recovers known finite element spaces and introduces new ones.
Sharp inequalities for matrix means with unknown variance.
problem Estimating matrix means with unknown variance.
method Empirical Bernstein inequalities for symmetric random matrices.
result Adapts to unknown variance with tight deviation bounds.
How many samples are sufficient to guarantee that the eigenvectors and eigenvalues of the sample covariance matrix are close to those of the actual covariance matrix? For a wide family of distributions, including distributions with finite second moment and distributions supported in a centered Euclidean ball, we prove …
We introduce Parseval networks, a form of deep neural networks in which the Lipschitz constant of linear, convolutional and aggregation layers is constrained to be smaller than 1. Parseval networks are empirically and theoretically motivated by an analysis of the robustness of the predictions made by deep neural networ…
Improved concentration inequalities for sub-Weibull variables enhance statistical and machine learning applications.
problem Improving concentration inequalities for sub-Weibull random variables.
method Developed new concentration inequalities for sums of independent sub-Weibull random variables, including a new sub-Weibull parameter.
result New concentration inequalities with sharper constants and a mixture of sub-Gaussian and sub-Weibull tails.
Motivated by a sampling problem basic to computational statistical inference, we develop a nearly optimal algorithm for a fundamental problem in spectral graph theory and numerical analysis. Given an n×n SDDM matrix M, and a constant −1≤p≤1, our algorithm gives efficient access to a…
Unified determinants via a single equation.
problem Defining determinants with all known properties.
method Proposing a single equation implying all known properties of determinants.
result Unified definition of determinants with all properties.
This paper presents a margin-based multiclass generalization bound for neural networks that scales with their margin-normalized "spectral complexity": their Lipschitz constant, meaning the product of the spectral norms of the weight matrices, times a certain correction factor. This bound is empirically investigated for…
New algorithm reduces matrix multiplication time for sparse matrices.
problem Efficiently multiply large sparse matrices with limited space.
method Exploits sparsity to reduce QR decompositions and time complexity.
result Time complexity reduced to $\widetilde{O}\left((
nz(X)+
nz(Y))\ell+n\ell^2
ight)$ in expectation.
New curvature tensor and matrices for connection graphs derived from Bakry-Émery curvature.
problem Deriving Buser-type bounds on eigenvalues of connection Laplacians.
method Reformulation of Bakry-Émery curvature through curvature matrices and tensor representations.
result Extension of curvature matrices to connection graphs, addressing eigenfunction challenges.
We detail the theory of Discrete Riemann Surfaces. It takes place on a cellular decomposition of a surface, together with its Poincaré dual, equipped with a discrete conformal structure. A lot of theorems of the continuous theory follow through to the discrete case, we define the discrete analogs of period matrices, Ri…
Deviance-style normalization for sparse, jointly overdispersed count matrices
problem Jointly overdispersed count matrices
method Dirichlet-multinomial deviance residualization
result Preserves exact sparsity, evaluates in constant time, recovers multinomial residual
InQMAD detects anomalies in streaming data using quantum measurements and density matrices.
problem Detecting anomalies in streaming data with challenges like conceptual drift and continuous learning.
method Incremental anomaly detection based on random Fourier features and quantum measurements.
result InQMAD outperforms 12 state-of-the-art methods in a systematic evaluation.
We propose an L-BFGS optimization algorithm on Riemannian manifolds using minibatched stochastic variance reduction techniques for fast convergence with constant step sizes, without resorting to linesearch methods designed to satisfy Wolfe conditions. We provide a new convergence proof for strongly convex functions wit…
A linear different operator L is called weakly hypoelliptic if any local solution u of Lu=0 is smooth. We allow for systems, that is, the coefficients may be matrices, not necessarily of square size. This is a huge class of important operators which cover all elliptic, overdetermined elliptic, subelliptic and parabolic…
The paper calculates bounds on the local Lipschitz constants of neural network layers.
problem Understanding the Lipschitz constants of neural network layers for robustness analysis.
method Analytical approach to determine upper bounds on local Lipschitz constants of affine-ReLU functions.
result The method produces tighter bounds than the standard conservative bound, especially for small perturbations.
Paper tackles robust graph matching in dense graphs with AMP type algorithm.
problem Matching recovery between correlated Gaussian Wigner matrices with adversarial perturbations.
method Approximate Message Passing (AMP) type iterative algorithm with time-dependent matrix multiplication.
result Algorithm succeeds in polynomial time for non-vanishing correlation and small perturbations.
Estimates matrix trace optimization with statistical learning theory.
problem Optimizing trace of parameter-dependent matrices.
method Monte Carlo estimator with bounds derived from epsilon nets and generic chaining.
result Predicts small sampling amount for matrices with small off-diagonal mass.
Study finds the minimum number of finite Gaussian mixtures for best approximation.
problem Finding the minimum number of finite Gaussian mixtures for best approximation.
method Local moment matching for upper bound and spectral analysis for lower bound.
result Corrects a previous lower bound in the case of Gaussian mixing distributions.
Random surfaces have a strong spectral gap with polynomial rate.
problem Understanding spectral gaps in random hyperbolic surfaces.
method Adapting polynomial method for random matrices to Laplacian on surfaces.
result Laplacian spectral gap at least 1/4 - O(1/g^c) for large g.
This paper considers compressed sensing and affine rank minimization in both noiseless and noisy cases and establishes sharp restricted isometry conditions for sparse signal and low-rank matrix recovery. The analysis relies on a key technical tool which represents points in a polytope by convex combinations of sparse v…
New algorithms learn graph structures privately, matching best results.
problem Private learning of graph structures with multiple blocks.
method Sum-of-squares relaxation and exponential mechanism for score function.
result Matches statistical utility of previous best non-private methods.
The study classifies hypersurfaces in quaternionic space forms with constant principal curvatures.
problem Classifying hypersurfaces in quaternionic space forms with specific curvature properties.
method Analyzing curvature-adapted real hypersurfaces in non-flat quaternionic space forms HPm and HHm. result Classification of hypersurfaces including geodesic hyperspheres, tubes, and specific examples in HPm and HHm. Kernel matrix concentration leads to KSC consistency.
problem High-dimensional clustering with noisy data.
method Nonasymptotic concentration inequalities for Lipschitz kernels.
result KSC algorithm consistency for noisy nested manifolds.
This paper tightens bounds on the smallest eigenvalue of NTK for deep ReLU networks.
problem Analyzing the smallest eigenvalue of Neural Tangent Kernel for deep ReLU networks.
method Analyzing various quantities of independent interest, including lower bounds on the smallest singular value of hidden feature matrices and upper bounds on the Lipschitz constant of input-output feature maps.
result Tight bounds on the smallest eigenvalue of NTK matrices for deep ReLU nets, both in the limiting case of infinite widths and for finite widths.
This paper investigates the average-case time complexity of certifying RIP matrices.
problem Certifying the restricted isometry property (RIP) for large sparsity levels in random Gaussian matrices.
method Analysis of the low-degree likelihood ratio to determine the average-case time complexity.
result Subexponential runtime of NildeΩ(s2/M) is required for certifying RIP matrices. Extends covariance estimation with multiple targets for better performance.
problem Improving covariance estimation for multiple targets.
method Combines multiple constant matrices with sample covariance matrix, derives estimators and proves convergence.
result The multi-target linear shrinkage estimator outperforms other estimators in various situations.
Many problems in computer vision and recommender systems involve low-rank matrices. In this work, we study the problem of finding the maximum entry of a stochastic low-rank matrix from sequential observations. At each step, a learning agent chooses pairs of row and column arms, and receives the noisy product of their l…