New method accelerates smooth games using spectral shape analysis.
problem Accelerating optimization in smooth games with complex numerical challenges.
method Matrix iteration theory and spectral shape analysis to characterize and manipulate acceleration.
result Identified a continuum of optimization strategies from convex minimization to gradient descent.
A novel 3D shape registration method using spectral graph embedding and probabilistic matching.
problem Challenges in 3D shape analysis and registration, especially with large variability.
method Combining spectral graph matching with Laplacian embedding for large graphs, using commute-time embedding and PCA.
result A method to register shapes with different samplings and isometric deformations.
Informative and discriminative feature descriptors play a fundamental role in deformable shape analysis. For example, they have been successfully employed in correspondence, registration, and retrieval tasks. In the recent years, significant attention has been devoted to descriptors obtained from the spectral decomposi…
Inverse spectral theory reveals shapes from sound.
problem Can the shape of a drum be determined by its sound?
method Inverse isospectral techniques applied to specific shapes.
result The regular n-gon can be uniquely determined by its eigenvalues.
To a compact hyperbolic Riemann surface, we associate a finitely summable spectral triple whose underlying topological space is the limit set of a corresponding Schottky group, and whose ``Riemannian'' aspect (Hilbert space and Dirac operator) encode the boundary action through its Patterson-Sullivan measure. We prove …
A registration-free framework monitors shape and color in 4D point clouds.
problem Monitoring shape and color changes in complex parts without registration.
method Laplace-Beltrami operator spectral properties for geometric and color feature capture; combined monitoring scheme for shape and color anomalies.
result Effective detection of shape deformations and color anomalies without registration or mesh reconstruction.
Information Cascades Model captures dynamical properties of user activity in a social network. In this work, we develop a novel framework for activity shaping under the Continuous-Time Information Cascades Model which allows the administrator for local control actions by allocating targeted resources that can alter the…
This paper proposes a new Nystrom-based clustering algorithm for large-scale data.
problem Spectral clustering's high computational complexity for large-scale data.
method Centroid Minimum Sum of Squared Similarities (CMS3) sampling procedure with eigen spectrum shape heuristic.
result Competitive low-rank approximations in test datasets compared to state-of-the-art methods.
Language models fail to process hallucinated responses, and this study diagnoses the failure.
problem Language models fail to process hallucinated responses, leading to over-concentration or diffuse attention.
method The study uses forced scoring of benchmark-labeled responses to compute attention shapes and analyze the symmetric component of the degree-normalized attention operator.
result The study proves that every transpose-invariant spectral diagnostic of the attention operator is orientation-blind and bounds the sensitivity of any Lipschitz diagnostic by the asymmetry coefficient \(G\).
SaR-SVM-STV improves hyperspectral image classification with shape-adaptive reconstruction and denoising.
problem Classifying hyperspectral images with limited labeled data.
method Shape-adaptive Reconstruction (SaR) for pixel preprocessing, SVM for probability estimation, and Smoothed Total Variation (STV) for denoising.
result SaR-SVM-STV outperforms SVM-STV with fewer labeled data.
The manifold M of star-shaped curves in Rn is considered via the theory of connections on vector bundles, and cyclic D-modules. The appropriate notion of an "integral curve" (i.e. certain admissible deformations) on M is defined, and the resulting space of admissible defo…
New kernel models multi-output Gaussian processes accurately.
problem Challenges in modelling cross-covariances for multiple-output Gaussian processes.
method Replaced Gaussian components with block components of finite bandwidth in spectral mixture kernel.
result First multi-output generalization of spectral mixture kernel that can approximate any stationary multi-output kernel to arbitrary precision.
Spectral clustering is a fast and popular algorithm for finding clusters in networks. Recently, Chaudhuri et al. (2012) and Amini et al.(2012) proposed inspired variations on the algorithm that artificially inflate the node degrees for improved statistical performance. The current paper extends the previous statistical…
Spectral Graph Convolutional Networks (GCNs) are a generalization of convolutional networks to learning on graph-structured data. Applications of spectral GCNs have been successful, but limited to a few problems where the graph is fixed, such as shape correspondence and node classification. In this work, we address thi…
New matrix ensembles better match deep neural network spectral densities.
problem Theoretical spectral density models for deep networks do not match empirical observations.
method Introduced new matrix ensemble classes to better fit observed spectral densities.
result Theoretical models for deep networks are significantly flawed.
When it comes to clustering nonconvex shapes, two paradigms are used to find the most suitable clustering: minimum cut and maximum density. The most popular algorithms incorporating these paradigms are Spectral Clustering and DBSCAN. Both paradigms have their pros and cons. While minimum cut clusterings are sensitive t…
Paper revisits graph-CNNs using Laplace-Beltrami spectral filters and polynomials.
problem Improving spectral graph convolutional neural networks (graph-CNNs).
method Developed Laplace-Beltrami CNN (LB-CNN) by replacing graph Laplacian with LB operator and approximating spectral filters using Chebyshev, Laguerre, and Hermite polynomials.
result Classification accuracy of LB-CNN is not dependent on the type of polynomials or operators.
Magnitude of geometric shapes studied for smooth manifolds, revealing spectral geometry insights.
problem Understanding the geometric significance of Leinster's magnitude for smooth manifolds.
method Investigation of magnitude function for various distance functions, including submanifolds and Riemannian manifolds, with asymptotic analysis in the limit.
result Magnitude function is well-defined and meromorphically continued for large distances, revealing volume, surface area, and curvature integrals.
Improves functional linear regression with shape transfer learning.
problem Data scarcity in functional linear models.
method Shape-based transfer learning from auxiliary to target domains.
result Enhances robustness and generalizability of functional linear models.
Muon dynamics study uses spectral Wasserstein flow for optimization stability.
problem Optimizing deep learning models with gradient normalization.
method Introduces Spectral Wasserstein distances for matrix flows, proving equivalence with Benamou--Brenier formulation.
result Gradient-flow interpretation of mean-field normalized training dynamics.
BIG Laplacians bridge combinatorial and Hodge Laplacians for discrete data.
problem Comparing combinatorial and Hodge Laplacians for discrete data.
method Introducing Boundary-Induced Graph (BIG) Laplacians using DEC.
result BIG Laplacian eigenvalues converge to Hodge Laplacian for simple shapes.
We consider the problem of clustering with the longest-leg path distance (LLPD) metric, which is informative for elongated and irregularly shaped clusters. We prove finite-sample guarantees on the performance of clustering with respect to this metric when random samples are drawn from multiple intrinsically low-dimensi…
The paper addresses uncertainties in spectral clustering of corrupted data.
problem Uncertainties in spectral clustering due to measurement errors and missing data.
method Mathematical framework based on random set theory for Monte Carlo approximation of expected clusterings.
result Consistent quantities of interest for evaluating clusterings in corrupted data.
The paper explores how structured representations influence learning dynamics in neural networks.
problem Understanding the training dynamics of deep neural networks.
method Investigates a family of enriched transformation layers with constrained pathways and adaptive corrections.
result Improved robustness, smoother optimization, and scalable depth behavior are achieved through structured representations.
In the context of clustering, we consider a generative model in a Euclidean ambient space with clusters of different shapes, dimensions, sizes and densities. In an asymptotic setting where the number of points becomes large, we obtain theoretical guaranties for a few emblematic methods based on pairwise distances: a si…
NASirt automates CNN architecture design for spectral data.
problem Designing optimal neural architectures for complex data.
method Neural Architecture Search (NAS) with Item Response Theory (IRT) for instance-level complexity.
result NASirt achieves high accuracy (97.40%) on spectral datasets.
New method learns high-quality Laplacian representations for reinforcement learning.
problem Lack of accurate Laplacian representations in large or continuous state spaces.
method Reformulated spectral graph drawing objective to have eigenvectors as unique global minimizer.
result Learned Laplacian representations more faithfully approximate the ground truth.
Constructs minimal surfaces in balls, maximizing eigenvalues.
problem Finding minimal surfaces in Euclidean balls with controlled topology.
method Maximizing the first non-trivial Steklov eigenvalue for isoperimetric problems.
result Constructs free boundary minimal immersions with controlled topology.
Compactness proven for isospectral Birkhoff billiard tables.
problem Proving compactness of isospectral Birkhoff billiard tables.
method Derived a hierarchical structure for integral invariants and used interpolating Hamiltonian.
result Compactness of equivalence classes of marked length isospectral Birkhoff billiard tables.
The study analyzes spectral asymmetry and index theory on manifolds with generalized hyperbolic cusps.
problem Analyzing spectral asymmetry and index theory on manifolds with generalized hyperbolic cusps.
method Equivariant index theorem for Dirac operators on manifolds with φ-cusps under conditions on φ. result The cusp contribution is zero if the spectrum of the relevant Dirac operator on a hypersurface is symmetric around zero.
Study reveals learning curves and benign overfitting in spectral algorithms for large dimensions.
problem Understanding learning curves and benign overfitting in spectral algorithms for large-dimensional data.
method Analysis of learning curves and benign overfitting in spectral algorithms for inner-product kernels on the sphere and general domains.
result Characterization of three distinct regimes: over-regularized, under-regularized, and interpolation regimes, revealing benign overfitting across both under-regularized and interpolation regimes.
Shampoo achieves higher token efficiency than Muon in language models.
problem Understanding the relationship and relative data efficiency of Shampoo and Muon compared to Adam and Signum.
method Extensive experiments on language models, demonstrating Shampoo's higher efficiency and decomposing its updates.
result Shampoo's benefits are attributed to its application to weight matrices, challenging interpretations based on variance adaptation and whitening.
New methods correct spectral distortions using known analyte concentrations.
problem Distorted spectral shapes from absorbing and scattering contributions.
method Modified penalized baseline correction methods that incorporate known analyte concentrations.
result Improved prediction performance on near infra-red data sets.
Jets from boosted heavy particles have a typical angular scale which can be used to distinguish them from QCD jets. We introduce a machine learning strategy for jet substructure analysis using a spectral function on the angular scale. The angular spectrum allows us to scan energy deposits over the angle between a pair …
New method reveals corners of drum shapes.
problem Determining the shape of drum corners from its sound.
method Locality principle and calculations of heat kernels.
result Corners are spectral invariants of the Laplacian.
This paper introduces persistent equivariant cohomology and applies it to circle actions.
problem Understanding the cohomology of filtered spaces with group actions.
method Persistent Borel equivariant cohomology, Serre spectral sequence, Gysin homomorphism.
result Explicit description and cohomology computation for circle actions.
New bounds on trajectory safety in training models with Langevin Dynamics.
problem Bounding the probability of a model's trajectory staying away from a designated failure region.
method Analyzes Langevin dynamics on smooth, strongly convex loss landscapes, introducing shape-free and local relaxation bounds.
result The in-set probability relaxes to the static value after a burn-in time of order d, using only the global spectral gap of the loss.
In this paper, we propose the Self-Attention Generative Adversarial Network (SAGAN) which allows attention-driven, long-range dependency modeling for image generation tasks. Traditional convolutional GANs generate high-resolution details as a function of only spatially local points in lower-resolution feature maps. In …
SpecGrad improves neural vocoder sound quality by adapting diffusion noise to log-mel spectrogram.
problem Improving neural vocoder sound quality, especially in high-frequency bands.
method Adapting the diffusion noise distribution to the conditioning log-mel spectrogram through time-varying filtering.
result SpecGrad generates higher-fidelity speech waveform than conventional DDPM-based neural vocoders.
Sharp stability of Alexandrov's theorem for C1 domains in the small-excess regime
problem Stability of Alexandrov's theorem for C1 domains in the small-excess regime method Combines a BV version of Fuglede's spectral-gap argument, a star-shaped rearrangement for sets of finite perimeter, quantitative estimates for the part of the boundary contained in the tentacles, and a polyhedral approximation argument for the non-graphical region result Sharp stability estimate in a genuinely non-parametric regime
Study homology manifolds using spectral sheaves and spectral six functor formalism.
problem Characterize and understand homology manifolds through spectral sheaves.
method Adapt six functor formalism to spectral sheaves on locally compact Hausdorff spaces.
result Prove that compact ANR homology manifolds are Poincaré duality complexes.
NeuralFLoC unifies registration and clustering of functional data, overcoming phase variation challenges.
problem Challenges in clustering functional data due to phase variation and temporal misalignment.
method NeuralFLoC uses Neural ODE-driven diffeomorphic flows and spectral clustering for joint registration and clustering.
result NeuralFLoC effectively disentangles phase and amplitude variation, achieving state-of-the-art performance.
In this paper, we prove that Euclidean hypersurfaces with almost extremal extrinsic radius or λ1 have a spectrum that asymptotically contains the spectrum of the extremal sphere in the Reilly or Hasanis-Koutroufiotis Inequalities. We also consider almost extremal hypersurfaces which satisfy a supplementary bound on …
Optimization geometrodynamics simplifies adaptive optimizer dynamics.
problem Hidden states in adaptive optimizers complicate gradient-based learning.
method Develops a variational theory to eliminate hidden states and compose across hierarchies.
result Yields interaction curvature that integrates to finite contrasts.
New method for analyzing complex data spaces.
problem Dimensionality reduction and learning data representations for continuous spaces.
method Manifold factorization based on spectral graph methods.
result Recovering factors yields meaningful lower-dimensional representations.
We uniquely and explicitly reconstruct the instantaneous intrinsic metric of the Kerr-Newman Event Horizon from the spectrum of its Laplacian. In the process we find that the angular momentum parameter, radius, area; and in the uncharged case, mass, can be written in terms of these eigenvalues. In the uncharged case th…
Self-training in linear models shows a U-shaped test-risk curve due to signal forgetting and denoising.
problem Understanding the dynamics of iterative self-training in high-dimensional linear regression.
method Derivation of deterministic-equivalent recursions for prediction risk and effective noise, analysis of signal forgetting and denoising effects.
result An optimal early-stopping time is determined, and a U-shaped test-risk curve is observed.
Mathematicians decode geometric properties from eigenvalues over 112 years.
problem Recovering geometric properties from eigenvalues of Laplace equations.
method Analyzing the relationship between eigenvalues, domain volume, and dimensionality.
result Deep connection between eigenvalues and geometric properties elucidated by Weyl's law.