Spectral methods improve efficiency in nonparametric model inference.
problem Efficient inference for nonparametric models like IBP and HDP.
method Spectral methods for Indian Buffet Process and Hierarchical Dirichlet Process.
result Spectral methods provide computationally and statistically efficient inference.
Paper proposes a forecasting model combining autoregressive models with spectral attention.
problem Time series forecasting across various domains.
method Combines deep autoregressive models with Spectral Attention (SA) module.
result SAAM consistently demonstrates improved forecasting accuracy compared to state-of-the-art approaches.
Spectral deconfounding improves machine learning models by reducing hidden confounding effects.
problem Machine learning models can be misled by hidden confounders, leading to unreliable predictions.
method Develops a nonlinear spectral deconfounding framework for gradient boosting that modifies boosting dynamics to slow down in confounding-aligned directions.
result Spectrally deconfounded boosting improves estimation of the target function under hidden confounding and is more scalable.
Random hyperbolic surfaces have nearly optimal spectral gaps.
problem Proving the nearly optimal spectral gap conjecture for random Belyi surfaces.
method Using the Brooks-Makover model, the authors show a spectral gap greater than 1/4 - c/log(n).
result A random hyperbolic surface in the Brooks-Makover model has a spectral gap greater than 1/4 - c/log(n).
New method extrapolates spectral densities from smaller models to larger ones.
problem Limited practical computations for large machine learning models.
method Algebraic spectral curve theory for free decompression.
result Framework enables extrapolation of spectral densities with multiple or multi-modal bulks.
Bayesian parametric matrix models provide uncertainty quantification for spectral learning.
problem Uncertainty quantification in spectral learning for safety-critical applications.
method Bayesian parametric matrix models (B-PMMs) that extend PMMs to provide uncertainty estimates.
result B-PMMs achieve exceptional uncertainty calibration (ECE < 0.05) while maintaining favorable scaling.
Optimal spectral method found for inhomogeneous spiked Wigner model.
problem Structured noise in learning scenarios.
method Random matrix theory and spectral analysis.
result Optimal threshold for phase transition in block-structured Wigner model.
Supervised topic models simultaneously model the latent topic structure of large collections of documents and a response variable associated with each document. Existing inference methods are based on variational approximation or Monte Carlo sampling, which often suffers from the local minimum defect. Spectral methods …
A Python package solves source duplication in single channel LVMs using spectral regularisation.
problem Source duplication in LVMs hampers their practical use in single channel applications.
method Spectral regularisation term added to address source duplication issue.
result Spectral regularisation framework enables easier investigation and utilisation of LVMs.
Spectral norm regularization improves deep learning models' generalizability.
problem High sensitivity to input perturbation degrades deep learning model performance.
method Spectral norm regularization, penalizing high spectral norm of weight matrices.
result Models trained with spectral norm regularization show better generalizability.
Modeling the Drosophila connectome using semiparametric spectral methods.
problem Understanding the structure and function of the Drosophila mushroom body network.
method Semiparametric spectral modeling, latent structure model (LSM), Gaussian mixture modeling (GMM), adjacency spectral embedding (ASE).
result Captures latent connectome structure and elucidates neuronal properties.
Dual regularized graph Laplacian improves spectral clustering for community detection.
problem Detecting clusters in networks with improved spectral clustering methods.
method Proposes dual regularized graph Laplacian for three spectral clustering approaches.
result Theoretical analysis shows DRSC and DRSLIM yield stable consistent community detection.
Paper studies randomized spectral clustering for large-scale networks.
problem Computational challenges in large-scale network community detection.
method Randomized sketching algorithms for spectral clustering.
result Theoretical bounds for approximation, misclassification, and link probability estimation.
Spectral regularization simplifies sequence models by focusing on grammatical simplicity.
problem Sequence modeling challenges in learning tasks.
method Introduces spectral regularization based on Hankel matrices and trace norm, addressing bi-infinite matrices with an unbiased estimator.
result Demonstrates spectral regularization's potential benefits on Tomita grammars.
Spectral clustering for directed graphs using likelihood estimation.
problem Clustering directed graphs with edge directions.
method Maximum likelihood estimation on stochastic block models.
result Significant performance gains over existing methods.
Spectral clustering identifies clusters of multivariate extremes.
problem Analyzing the dependence structure of multivariate extremes.
method Spectral clustering based on a random k-nearest neighbor graph. result Spectral clustering can consistently identify clusters of multivariate extremes under certain conditions.
Bayesian framework integrates spectral deconvolution with expert reasoning for robust peak estimation.
problem Challenges in extracting meaningful peaks from noisy or complex spectra.
method Bayesian spectral deconvolution coupled with a physical-property regression layer.
result Recovery of weak peaks in poly(lactic acid) IR spectra related to degradation rates.
New spectral clustering method improves community detection in sparse networks.
problem Community detection in sparse networks using spectral clustering.
method Data-driven regularization and novel spectral truncation for adjacency matrix.
result Consistency results for community detection in general SBM and beyond.
Spectral clustering achieves strong consistency in the stochastic block model under certain conditions.
problem Achieving strong consistency in spectral clustering for the stochastic block model.
method Entrywise analysis of the Fielder eigenvector of graph Laplacians.
result Spectral clustering achieves exact recovery of hidden communities under matching information-theoretic limits.
Improved spectral-based GCN for directed graphs.
problem Cannot directly work on directed graphs.
method Redefined Laplacians to improve propagation model.
result Outperforms state-of-the-art methods on directed graph datasets.
New spectral clustering method for multi-layer networks improves accuracy.
problem Detecting community structure in multi-layer networks.
method Integrative spectral clustering based on adaptive layer aggregation.
result Our methods minimize mis-clustering error and outperform existing methods.
Method detects confounders in high-dimensional linear models using spectral measure first moments.
problem Detecting confounders in high-dimensional linear models.
method Uses the first moment of the spectral measure of the regression coefficient vector.
result Statistical asymmetry in first moments of spectral measures indicates the presence of confounders.
Paper analyzes spectral clustering for large graphs using random signals.
problem Complex eigen decomposition for large graphs.
method Graph filtering of random signals for approximate spectral embedding.
result Consistency of spectral clustering in stochastic block model.
Introduces Spectral Graph Network combining spatial and spectral message passing.
problem Relational reasoning in graph structured data.
method Applies message passing to both spatial and spectral domains of a graph.
result Promotes efficient training with fewer iterations and robustness to edge dropout.
New spectral clustering method using LASSO regularization for robust graph partitioning.
problem Lack of theoretical guarantees for spectral clustering on general graph models.
method 1-spectral clustering on a new random model with LASSO regularization.
result Effective and robust to small noise perturbations, validated by simulations and real data.
Introduces Spectral Attention for better long-range time series forecasting.
problem Challenges in capturing long-range dependencies in time series forecasting.
method Spectral Attention mechanism that preserves temporal correlations and long-range dependencies.
result Achieves state-of-the-art results on 11 real-world time series datasets.
L2SC improves spectral clustering performance by selectively transferring knowledge across tasks.
problem L2SC tackles the challenge of incorporating new spectral clustering tasks without relearning all previous tasks.
method L2SC uses an orthogonal basis library and feature embedding library to selectively transfer knowledge from previously learned tasks to new tasks.
result L2SC outperforms state-of-the-art spectral clustering algorithms on real-world benchmark datasets.
Bayesian model improves spectral estimation from partial, noisy data.
problem Challenges in spectral estimation with partial and noisy observations.
method Joint probabilistic model with Gaussian process prior and Bayes' rule for exact inference.
result Proposed model provides functional-form representation of power spectral density.
We analyze the performance of spectral clustering for community extraction in stochastic block models. We show that, under mild conditions, spectral clustering applied to the adjacency matrix of the network can consistently recover hidden communities even when the order of the maximum expected degree is as small as $\l…
We analyze DMs using spectral methods to design effective noise schedules.
problem Lack of theoretical foundation for synthesis process decisions in DMs.
method Introduced a frequency response perspective based on Gaussianity assumption.
result Proposed a spectral transfer function to understand DM inference process.
Neural non-stationary spectral kernels improve performance on benchmark datasets.
problem Learning and discovering complex patterns in data.
method Generalized spectral mixture kernels with input-dependent functions modeled as Gaussian processes and hyperparameter functions as neural networks.
result Neural non-stationary spectral kernels achieve the best performance on benchmark datasets.
Study spectral estimators for multi-index models to recover low-dimensional signal subspaces.
problem Recovering low-dimensional signal subspaces in multi-index models.
method Spectral estimators for multi-index models.
result Precise asymptotic characterization of spectral methods' performance, revealing a phase transition for weak recovery.
Spectral flow connects manifold geometry to rigidity criteria.
problem Tackling rigidity of simply-connected closed manifolds.
method Spectral deformation flow and invariant-based approach.
result Spherical profile is the unique manifold-compatible asymptotic realization.
Regularization improves spectral embedding by focusing on the largest blocks.
problem Improving the quality of spectral embedding for graph data.
method Explained the impact of complete graph regularization on spectral embedding of a block model.
result Regularization forces spectral embedding to focus on the largest blocks, making it less sensitive to noise or outliers.
Spectral clustering is robust to helpful model changes but not to random changes.
problem Robustness of spectral clustering in the presence of semirandom adversaries.
method Analysis of spectral clustering algorithms under semirandom adversaries.
result Spectral clustering with unnormalized Laplacian is strongly consistent under semirandom adversaries.
Graph signal processing detects hallucinations in large language models.
problem Detecting factual reasoning from hallucinations in large language models.
method Modeling transformer layers as dynamic graphs, using spectral analysis to define diagnostics.
result Spectral signatures can distinguish different types of hallucinations and achieve high accuracy.
New RL algorithm for POMDPs using spectral methods.
problem Learning POMDPs where interactions change future observations.
method Epoch-based spectral decomposition for parameter learning, followed by optimal policy optimization.
result Order-optimal regret bound with efficient scaling.
The paper bridges spectral and spatial graph convolutions, improving model capacity and transferability.
problem Improving graph neural networks by bridging spectral and spatial design.
method Theoretical demonstration and general framework for spectral analysis, new spectral convolutions, and depthwise separable convolutions.
result General framework allows spectral analysis of ConvGNNs, showing their performance and limits, and proposing new spectral convolutions.
New kernel models multi-output Gaussian processes accurately.
problem Challenges in modelling cross-covariances for multiple-output Gaussian processes.
method Replaced Gaussian components with block components of finite bandwidth in spectral mixture kernel.
result First multi-output generalization of spectral mixture kernel that can approximate any stationary multi-output kernel to arbitrary precision.
New argument suggests torsion cannot be part of gravity models.
problem The presence of torsion in gravity models is debated.
method Used spectral geometry and pseudo-differential calculus.
result No well-defined functional for torsion in spectral formulation.
Spectral sparsification improves Gaussian graphical models under MTP2 constraints.
problem Learning accurate, sparse graphs from data under MTP2 constraints.
method Spectral graph sparsification applied to Gaussian graphical models.
result Spectral-MTP2 preserves MTP2 and approximates the original model well.
Enhanced geographical features improve predictive models for colorectal cancer survival curves.
problem Predicting colorectal cancer survival curves in Iowa.
method Used neural networks to explore feature representations, comparing ABC performance.
result Spectral analysis-based representations improve predictive performance by approximately 40%.
Enhanced spectral clustering for geometric graphs improves clustering accuracy.
problem Ineffective standard spectral clustering for geometric graphs.
method Higher-order spectral clustering using higher-order eigenvectors.
result Established weak and strong consistency for Soft Geometric Block Model.
New methods avoid spectral pollution in transfer operators for accurate analysis.
problem Spectral pollution in finite-dimensional approximations of transfer operators.
method Algorithms for computing spectral properties of transfer operators without spectral pollution.
result Accurate spectral estimation across various applications, including protein folding models.
Two embedding methods in spectral graph clustering yield different but valid groupings.
problem Clustering vertices of a graph without true groupings.
method Spectral graph clustering using Laplacian or Adjacency spectral embedding.
result Laplacian embedding captures left hemisphere/right hemisphere structure, while adjacency embedding captures gray matter/white matter structure.
Quantum computers can enhance spectral methods in machine learning.
problem Spectral methods are fundamental but challenging for classical models.
method Utilizing quantum Fourier Transform for spectral manipulations.
result Quantum computing can offer more efficient spectral design.
Spectral clustering with edge counting detects communities in sparse models.
problem Detecting communities in sparse latent space models.
method Spectral clustering followed by edge counting.
result Algorithm achieves consistency and optimality for a broad class of models.
Graph classification improved using spectral features and wavelet filters.
problem Categorizing graphs based on their structure and node attributes.
method Derived spectral features from graph signal processing, designed two Gaussian process models: one simple and one sophisticated.
result Simple and sophisticated Gaussian process models yield competitive performance, including well-calibrated uncertainty estimates.