arXiv research

Accelerates optimal transport computation by 10x with spectral insights.

The paper explores the Rumin complex and spectral sequence on Carnot groups.

Rewiring GNNs to optimize community and feature alignment improves their performance.

Graph spectral analysis can yield meaningful embeddings of graphs by providing insight into distributed features not directly accessible in nodal domain. Recent efforts in graph signal processing have proposed new decompositions-e.g., based on wavelets and Slepians-that can be applied to filter signals defined on the g…

Recently, there is increasing interest and research on the interpretability of machine learning models, for example how they transform and internally represent EEG signals in Brain-Computer Interface (BCI) applications. This can help to understand the limits of the model and how it may be improved, in addition to possi…

Clustering is fundamental for gaining insights from complex networks, and spectral clustering (SC) is a popular approach. Conventional SC focuses on second-order structures (e.g., edges connecting two nodes) without direct consideration of higher-order structures (e.g., triangles and cliques). This has motivated SC ext…

word2vec due to Mikolov \textit{et al.} (2013) is a word embedding method that is widely used in natural language processing. Despite its great success and frequent use, theoretical justification is still lacking. The main contribution of our paper is to propose a rigorous analysis of the highly nonlinear functional of…

Paper explores SNN for learning spectral geometric info from data.

Spectral Method is a commonly used scheme to cluster data points lying close to Union of Subspaces by first constructing a Random Geometry Graph, called Subspace Clustering. This paper establishes a theory to analyze this method. Based on this theory, we demonstrate the efficiency of Subspace Clustering in fairly broad…

Muon optimizer simplifies matrix optimization with spectral orthogonalization.

A novel nonstationary permanental process relaxes kernel constraints and captures complex data patterns.

Improved neural network predicts spectral functions more accurately than traditional methods.

A framework uses free probability to analyze Transformer models.

Interpolates mean shift and spectral clustering on graphs.

Graph pruning improves neural network performance by addressing squashing and smoothing issues.

We analyze DMs using spectral methods to design effective noise schedules.

Proposes a deep network for multi-class classification using spectral training and Gaussian kernel.

This paper re-visits the spectral method for learning latent variable models defined in terms of observable operators. We give a new perspective on the method, showing that operators can be recovered by minimizing a loss defined on a finite subset of the domain. A non-convex optimization similar to the spectral method …

Study clusters Indian stocks using polyspectral means for nuanced market insights.

New insights into spectral clustering reveal strong connections within eigenvectors.

Spectral normalization stabilizes GANs by controlling gradient explosion and vanishing.

Magnitude of geometric shapes studied for smooth manifolds, revealing spectral geometry insights.

Spectral feature learning improves IV regression for causal effect estimation.

Improved spectral clustering via Gromov-Wasserstein Learning.

The paper proves criticality criteria and spectral splitting theorems for manifolds with Ricci bounds.

Biological and social systems consist of myriad interacting units. The interactions can be represented in the form of a graph or network. Measurements of these graphs can reveal the underlying structure of these interactions, which provides insight into the systems that generated the graphs. Moreover, in applications s…

The problem of Hybrid Linear Modeling (HLM) is to model and segment data using a mixture of affine subspaces. Different strategies have been proposed to solve this problem, however, rigorous analysis justifying their performance is missing. This paper suggests the Theoretical Spectral Curvature Clustering (TSCC) algori…

The inverse covariance matrix provides considerable insight for understanding statistical models in the multivariate setting. In particular, when the distribution over variables is assumed to be multivariate normal, the sparsity pattern in the inverse covariance matrix, commonly referred to as the precision matrix, cor…

Improves few-shot learning using multi-task representation learning theory.

Study reveals class disparities in balanced datasets through spectral imbalance.

With inspiration from Random Forests (RF) in the context of classification, a new clustering ensemble method---Cluster Forests (CF) is proposed. Geometrically, CF randomly probes a high-dimensional data cloud to obtain "good local clusterings" and then aggregates via spectral clustering to obtain cluster assignments fo…

This paper proposes a new approach to construct high quality space-filling sample designs. First, we propose a novel technique to quantify the space-filling property and optimally trade-off uniformity and randomness in sample designs in arbitrary dimensions. Second, we connect the proposed metric (defined in the spatia…

We introduce the convolutional spectral kernel (CSK), a novel family of non-stationary, nonparametric covariance kernels for Gaussian process (GP) models, derived from the convolution between two imaginary radial basis functions. We present a principled framework to interpret CSK, as well as other deep probabilistic mo…

Networks or graphs can easily represent a diverse set of data sources that are characterized by interacting units or actors. Social networks, representing people who communicate with each other, are one example. Communities or clusters of highly connected actors form an essential feature in the structure of several emp…

FreDN separates trends and periodicities in non-stationary time series forecasts.

Paper provides unbiased spectral moment estimates from finite data.

Study of meromorphic connections and their spectral duals in $\mathfrak{gl}_3(\mathbb{C})$.

Study identifies cancer genes through graph anomaly analysis of protein interactions.

This paper focuses on obtaining clustering information about a distribution from its i.i.d. samples. We develop theoretical results to understand and use clustering information contained in the eigenvectors of data adjacency matrices based on a radial kernel function with a sufficiently fast tail decay. In particular, …

In this paper, we provide a novel construction of the linear-sized spectral sparsifiers of Batson, Spielman and Srivastava [BSS14]. While previous constructions required $Ω(n^4)$ running time [BSS14, Zou12], our sparsification routine can be implemented in almost-quadratic running time $O(n^{2+\varepsilon})$. The funda…

We present an algorithm for extraction of a probabilistic deterministic finite automaton (PDFA) from a given black-box language model, such as a recurrent neural network (RNN). The algorithm is a variant of the exact-learning algorithm L*, adapted to a probabilistic setting with noise. The key insight is the use of con…

ULES embeds dynamic networks with stability guarantees.

Spectro-Riemannian Graph Neural Networks integrate spectral and curvature signals for better graph representation learning.

Improves regression models' performance on covariate shift.

Two spectral clustering methods for multi-layer networks are analyzed and compared.

SEDA improves RLDA for high-dimensional data.

Graph clustering is a basic technique in machine learning, and has widespread applications in different domains. While spectral techniques have been successfully applied for clustering undirected graphs, the performance of spectral clustering algorithms for directed graphs (digraphs) is not in general satisfactory: the…

Are neural networks biased toward simple functions? Does depth always help learn more complex features? Is training the last layer of a network as good as training all layers? How to set the range for learning rate tuning? These questions seem unrelated at face value, but in this work we give all of them a common treat…