Spectral Inference Networks learn eigenfunctions from data using optimization.
problem Learning eigenfunctions of linear operators from data.
method Spectral Inference Networks generalize Slow Feature Analysis to generic symmetric operators and use stochastic optimization.
result Spectral Inference Networks accurately recover eigenfunctions and discover interpretable representations from video data.
Survey on statistical inference methods for random dot product graphs.
problem Statistical inference on random dot product graphs.
method Spectral embeddings of adjacency and Laplacian matrices.
result Consistency and asymptotic normality of spectral embeddings.
Develops spectral estimators for network structure with nodal covariates.
problem Identifying observed and unobserved factors affecting network structure.
method Spectral estimators for unobserved blocks and covariates in stochastic blockmodels.
result Asymptotic normality of estimators and superior performance compared to existing methods.
New method detects and analyzes correlation in multiple network data.
problem Detecting and analyzing correlation in multiple network data.
method Generalized omnibus embedding methodology.
result Induced correlation can significantly extend the reach of spectral inference procedures.
Study on identifying and inferring nonlinear dynamics on unknown networks.
problem Identifying network structure in nonlinear dynamic systems with unknown interactions.
method Showed network structure is not generically identified, requiring sufficient spectral heterogeneity. Developed necessary and sufficient conditions for identification and proposed a semiparametric estimator.
result Necessary and sufficient conditions for identification of network structure in nonlinear dynamic systems.
Graph convolutional networks fail to use eigenvectors beyond the first, unlike spectral embedding.
problem Understanding when graph convolutional networks fail compared to spectral embedding.
method Presented a simple generative model to illustrate failure.
result Graph convolutional networks fail to use eigenvectors beyond the first in certain graphs.
fBNNs use stochastic processes for variational inference in neural networks.
problem Difficulties in specifying priors and posteriors in high-dimensional weight spaces.
method Maximize Evidence Lower Bound (ELBO) on stochastic processes, using spectral Stein gradient estimator.
result fBNNs provide reliable uncertainty estimates and extrapolate well with structured priors.
The paper distills a weighted automaton from RNNs for language modeling.
problem Tackles the gap between deep learning and grammatical inference.
method Uses a spectral approach to infer a weighted automaton from a trained RNN.
result Extracted weighted automata are good approximations of the RNNs, validating the approach.
Spectral method for detecting communities in time-varying networks from noisy signals.
problem Detect communities in time-varying networks from noisy signals.
method Spectral algorithm based on latent stochastic blockmodel.
result Consistent recovery of community structure in time-varying networks.
FastGAT reduces GNN computation time by 10x using graph sparsification.
problem High computational burden in attention-based GNNs.
method Spectral sparsification to generate optimal graph pruning.
result Per-epoch time is almost linear in graph nodes, reducing computational time by up to 10x.
Proposes a new algorithm to estimate invariant subspaces across multilayer networks.
problem Estimating invariant subspaces across heterogeneous multiple networks.
method Bias-corrected joint spectral embedding algorithm that recursively calibrates diagonal bias and iteratively updates the subspace estimator.
result Established entrywise subspace perturbation bound and entrywise eigenvector central limit theorem for the algorithm.
New spectral tensor network algorithms solve continuous tensor problems.
problem Continuous tensor decomposition and orbit recovery problems over infinite groups.
method Leverage tensor networks to design spectral algorithms.
result Solve continuous multi-reference alignment over infinite SO(2) group.
Inference of hidden classes in stochastic block model is a classical problem with important applications. Most commonly used methods for this problem involve naïve mean field approaches or heuristic spectral methods. Recently, belief propagation was proposed for this problem. In this contribution we perform a comparati…
Neural non-stationary spectral kernels improve performance on benchmark datasets.
problem Learning and discovering complex patterns in data.
method Generalized spectral mixture kernels with input-dependent functions modeled as Gaussian processes and hyperparameter functions as neural networks.
result Neural non-stationary spectral kernels achieve the best performance on benchmark datasets.
We present semiparametric spectral modeling of the complete larval Drosophila mushroom body connectome. Motivated by a thorough exploratory data analysis of the network via Gaussian mixture modeling (GMM) in the adjacency spectral embedding (ASE) representation space, we introduce the latent structure model (LSM) for n…
New method for faster graph parameter inference from large random Kronecker graphs.
problem Efficiently infer graph parameters from large random Kronecker graphs.
method Decompose adjacency matrix into signal and noise components, then use denoising and solving approach.
result Proposed method achieves comparable or better performance than existing methods at lower computational cost.
The classical setting of community detection consists of networks exhibiting a clustered structure. To more accurately model real systems we consider a class of networks (i) whose edges may carry labels and (ii) which may lack a clustered structure. Specifically we assume that nodes possess latent attributes drawn from…
Inference for the stochastic blockmodel is currently of burgeoning interest in the statistical community, as well as in various application domains as diverse as social networks, citation networks, brain connectivity networks (connectomics), etc. Recent theoretical developments have shown that spectral embedding of gra…
Improves learning of spectral mixture kernels with approximate Bayesian inference.
problem Difficult optimization of large number of SM kernel parameters.
method Approximate Bayesian inference using variational distribution of spectral points and random Fourier features.
result Accelerates convergence and leads to better optimal parameters.
High-dimensional inference for sparse spectral precision matrices
problem Inference on the spectral precision matrix at a fixed frequency
method Full likelihood-based inference using neighboring discrete Fourier transforms
result Simultaneous control of regularization, finite-sample truncation, and smoothing biases
A new method for community detection in networks is presented.
problem Community detection in network analysis.
method Mixed regularized spectral clustering (Mixed-RSC) based on the regularized Laplacian matrix.
result The method is asymptotically consistent under mild conditions.
Consider observing an undirected network that is `noisy' in the sense that there are Type I and Type II errors in the observation of edges. Such errors can arise, for example, in the context of inferring gene regulatory networks in genomics or functional connectivity networks in neuroscience. Given a single observed ne…
New method extrapolates spectral densities from smaller models to larger ones.
problem Limited practical computations for large machine learning models.
method Algebraic spectral curve theory for free decompression.
result Framework enables extrapolation of spectral densities with multiple or multi-modal bulks.
Bayesian framework integrates spectral deconvolution with expert reasoning for robust peak estimation.
problem Challenges in extracting meaningful peaks from noisy or complex spectra.
method Bayesian spectral deconvolution coupled with a physical-property regression layer.
result Recovery of weak peaks in poly(lactic acid) IR spectra related to degradation rates.
Online social networks (OSN) contain extensive amount of information about the underlying society that is yet to be explored. One of the most feasible technique to fetch information from OSN, crawling through Application Programming Interface (API) requests, poses serious concerns over the the guarantees of the estimat…
Perfect clustering achieved in hypergraphs with enough interactions.
problem Complexity and lack of tractable models for analyzing hypergraphs.
method Introduced an interaction hypergraph model for analyzing hypergraphs, defined latent embeddings, and analyzed spectral estimators.
result A spectral estimate of interaction latent positions can achieve perfect clustering with enough interactions.
Spectral Independence Criterion helps infer cause-effect relationships in time series.
problem Distinguishing cause from effect in time series data.
method Spectral Independence Criterion (SIC) based on PSD and frequency response.
result SIC provides a robust method for causal inference in time series data.
New method speeds up galaxy analysis from hours to seconds.
problem Infeasibility of state-of-the-art SED analyses for large surveys.
method Amortized Neural Posterior Estimation (ANPE) for scalable Bayesian inference.
result Posterior distributions of 12 model parameters estimated in seconds per galaxy.
PRISMA uses PDE residuals for fast, robust, and accurate inference.
problem Slow gradient-based optimization and instability in PDE residual-based methods.
method Integrates PDE residuals directly into the model's architecture via attention mechanisms in the spectral domain.
result Competitive accuracy with significantly lower inference costs and faster speeds.
A federated model learns shared archetypes from heterogeneous clients in continual learning.
problem Federated learning struggles with client heterogeneity and streaming distribution shifts.
method Clients encode their data as low-rank Hebbian operators, which are sent to a central server for aggregation and factorization into global archetypes.
result Improved global archetype reconstruction and associative retrieval in heterogeneous clients, drift, and novelty settings.
DiMMSB models directed mixed membership networks, identifying distinct community structures.
problem Modeling directed mixed membership networks with distinct community structures.
method Directed Mixed Membership Stochastic Blockmodel (DiMMSB) with DiSP algorithm.
result DiSP algorithm is asymptotically consistent and outperforms competitors.
New method infers causal relationships from nonstationary time series data.
problem Challenges in inferring causal relationships from nonstationary time series data.
method Proposes a new class of restricted SCM with time-varying filters and stationary noise, leveraging asymmetry from nonstationarity.
result Demonstrates effectiveness of the proposed methodology on various synthetic and real datasets.
Proves generic existence of spectral networks for many cases.
problem Existence of spectral networks for a broad range of spectral data.
method Generic existence proof for spectral networks.
result Proves existence for a large class of spectral data.
Over the past decade there has been considerable interest in spectral algorithms for learning Predictive State Representations (PSRs). Spectral algorithms have appealing theoretical guarantees; however, the resulting models do not always perform well on inference tasks in practice. One reason for this behavior is the m…
LASE learns graph embeddings by unrolling GD iterations into a neural network.
problem Learning graph embeddings from graph inputs.
method Truncating and interpreting GD iterations as layers in a GNN.
result LASE outperforms eigendecomposition routines and GNNs in link prediction and node classification.
This work proposes a novel autoencoder for fusing visible and infrared images.
problem Challenging task to combine spatial and spectral information from visible and infrared images.
method Spatially constrained adversarial autoencoder with residual architecture and adversarial regularizer.
result Generates a more realistic fused image with enhanced spatial and spectral information.
Bayesian model improves spectral estimation from partial, noisy data.
problem Challenges in spectral estimation with partial and noisy observations.
method Joint probabilistic model with Gaussian process prior and Bayes' rule for exact inference.
result Proposed model provides functional-form representation of power spectral density.
The study investigates how data variability impacts the generalization of neural networks.
problem Understanding the impact of data variability on neural network generalization.
method Developed a field-theoretic formalism to compute generalization properties of neural networks, focusing on data variability.
result Data variability leads to non-Gaussian action, affecting the learning curve and generalization properties of neural networks.
Combines neural networks and probabilistic graphical models for efficient higher-order inference.
problem Lack of efficient higher-order relational information in graph neural networks and probabilistic graphical models.
method Derives efficient approximate sum-product loopy belief propagation for higher-order PGMs, embeds into neural network, proposes methods for constructing higher-order factors.
result Substantially outperforms state-of-the-art k-order graph neural networks in molecular datasets.
New algorithms recover network structure from noisy snapshots of diffusive processes.
problem Recovering network structure from nodal observations of a diffusive process without knowing the edges.
method Spectral algorithms based on latent stochastic block models and random matrix theory.
result Provable high-accuracy recovery of network partition and SBM parameters.
The paper improves spectral ranking methods for diverse comparison graphs.
problem Estimating preference scores from multiway comparisons with heterogeneous sizes.
method Develops a two-step spectral method for estimating preference scores and their uncertainties.
result The two-step spectral method achieves the same asymptotic efficiency as the Maximum Likelihood Estimator (MLE).
We analyze DMs using spectral methods to design effective noise schedules.
problem Lack of theoretical foundation for synthesis process decisions in DMs.
method Introduced a frequency response perspective based on Gaussianity assumption.
result Proposed a spectral transfer function to understand DM inference process.
Lyapunov analysis improves RNN performance prediction.
problem Uncertainty in RNN performance prediction due to hyperparameters and architecture.
method Lyapunov spectral analysis of RNNs and Autoencoder-Lyapunov Embedding Learning (AeLLE).
result AeLLE successfully correlates RNN Lyapunov spectrum with accuracy and predicts performance.
This work uses neural density estimation to analyze laser-induced breakdown spectroscopy data, enabling accurate predictions and uncertainty quantification.
problem Inference of probability densities in high-dimensional spectral data is often intractable.
method Normalizing flows on structured spectral latent spaces for density estimation and uncertainty quantification.
result The approach enables generation of realistic spectral samples and accurate prediction of state vectors with well-calibrated uncertainties.
The paper develops spectral networks in symplectic topology and their relation to Lagrangian fillings.
problem Understanding spectral networks in symplectic topology and their role in Lagrangian fillings.
method Analytic results on adiabatic degeneration of Floer trajectories and explicit computation of continuation strips.
result Established equivalence between Family Floer functor and non-abelianization functor for Lagrangian fillings with spectral networks.
Spectral decoupling improves neural network generalization in medical imaging.
problem Poor generalization of neural networks trained on medical imaging data.
method Spectral decoupling, a regularization technique that encourages learning more features.
result Spectral decoupling increases network robustness and performance on external datasets.
Extracts weighted automata from black box models for sequential data.
problem Global interpretability of black box models for symbolic sequential data.
method Spectral algorithm for extracting weighted automata from black boxes without access to inner representation.
result Approximation of black box models using inferred weighted automata is of high quality.
Develops DSD for analyzing multiscale biological networks.
problem Analyzing multiscale structure in biological networks.
method Data-driven diffusion process with multitemporal analysis.
result Parameter-free inference of intrinsic data structure.