Spectral density matrix estimation of multivariate time series is a classical problem in time series and signal processing. In modern neuroscience, spectral density based metrics are commonly used for analyzing functional connectivity among brain regions. In this paper, we develop a non-asymptotic theory for regularize…
Deep learning speeds spectral density estimation for large 2D/3D grids.
problem Computational challenges in estimating spectral densities for large grids.
method Deep learning neural network for spectral density estimation.
result Deep learning estimator is a universal approximator and faster than existing methods.
Sketching reduces data size for accurate spectral estimation.
problem Estimating spectral density from large simulation datasets.
method Sketching for dimensionality reduction and data compression.
result Sketching provides 90% accurate spectral density estimate with 10% data.
Optimizes spectral density estimation for stationary and nonstationary processes.
problem Estimating spectral density of time series with complex structure.
method Optimally adaptive Bayesian spectral density estimation using smoothing spline covariance structure.
result Optimal eigendecomposition provides superior performance compared to alternative covariance functions.
Interactive privacy mechanisms improve spectral density estimation under local differential privacy.
problem Estimating spectral density of Gaussian time series with local differential privacy constraints.
method Two-stage process: Laplace mechanism followed by privatized sample analysis.
result Interactive mechanisms achieve faster rates for spectral density estimation.
Lie PCA improves density estimation on symmetric manifolds.
problem Density estimation for symmetric manifolds.
method Spectral method to approximate Lie algebra of symmetry group.
result Improved sample complexity and density estimation on various data sets.
This work uses neural density estimation to analyze laser-induced breakdown spectroscopy data, enabling accurate predictions and uncertainty quantification.
problem Inference of probability densities in high-dimensional spectral data is often intractable.
method Normalizing flows on structured spectral latent spaces for density estimation and uncertainty quantification.
result The approach enables generation of realistic spectral samples and accurate prediction of state vectors with well-calibrated uncertainties.
Method reduces categorical data to lower dimensions using density matrices.
problem Dimensionality reduction for categorical data.
method Density-matrix construction from class-conditional frequencies; spectral embedding.
result Low-dimensional spectral embeddings with controlled rank.
We study the connections between spectral clustering and the problems of maximum margin clustering, and estimation of the components of level sets of a density function. Specifically, we obtain bounds on the eigenvectors of graph Laplacian matrices in terms of the between cluster separation, and within cluster connecti…
Following Hartigan, a cluster is defined as a connected component of the t-level set of the underlying density, i.e., the set of points for which the density is greater than t. A clustering algorithm which combines a density estimate with spectral clustering techniques is proposed. Our algorithm is composed of two step…
Bayesian method estimates Kronecker graphical models from autoregressive processes.
problem Estimating Kronecker graphical models from autoregressive Gaussian processes.
method Bayesian approach to estimate Kronecker graphical models.
result Effectiveness demonstrated through numerical experiments and real-world data application.
Estimates Gaussian location model with ridge regularization, comparing variational and spectral methods.
problem Estimating parameters in Gaussian location model with regularization.
method Ridge-regularized log-density-ratio estimation, variational and spectral approaches.
result Regularized variational estimator has lower risk with many observations, spectral estimator with fewer observations.
In this work a robust clustering algorithm for stationary time series is proposed. The algorithm is based on the use of estimated spectral densities, which are considered as functional data, as the basic characteristic of stationary time series for clustering purposes. A robust algorithm for functional data is then app…
Recently, there has been a surge of interest in using spectral methods for estimating latent variable models. However, it is usually assumed that the distribution of the observations conditioned on the latent variables is either discrete or belongs to a parametric family. In this paper, we study the estimation of an $m…
Derives spectral density function for symplectic manifolds.
problem Calculating spectral density functions on symplectic manifolds.
method Explicit local formula derivation for spectral density function.
result Explicit formula for spectral density function.
Method estimates number of clusters in Block Markov Chain trajectories.
problem Challenges in choosing number of clusters for sequential data.
method Spectral embedding and density-based clustering.
result Asymptotically consistent method for estimating clusters.
FSPA bypasses eigenvalue estimation for quantum PCA, achieving optimal complexity and robustness.
problem Quantum PCA eigenvalue estimation is computationally expensive and prone to errors.
method Filtered Spectral Projection Algorithm (FSPA) that projects onto the dominant spectral subspace directly.
result FSPA achieves optimal complexity and robustness, outperforming classical methods.
A new method combines spectral and density-based clustering for robust nonconvex clustering.
problem Finding robust clusterings for nonconvex shapes with varying densities and noise.
method Combining spectral and density-based clustering approaches to optimize a density criterion.
result Our method provides robust and reliable clusterings on synthetic and real-world data.
Bayesian method models financial time series with non-stationarity and dependency.
problem Discrimination between non-stationarity and long-range dependency in financial time series.
method Adaptive spectral technique using non-parametric Bayesian inference with Reversible Jump Markov Chain Monte Carlo.
result Bayesian method effectively models both long-range dependency and non-stationarity in financial time series.
We perform a parallel analysis of the spectral density of (i) the logarithm of price and (ii) the daily number of trades of a set of stocks traded in the New York Stock Exchange. The stocks are selected to be representative of a wide range of stock capitalization. The observed spectral densities show a different power-…
Study on JNR monopoles, focusing on their spectral curves and energy density.
problem Understanding JNR monopoles and their spectral curves.
method Analysis of spectral curves, rational maps, and holomorphic spheres.
result Established conditions for a spectral curve to be a JNR monopole and derived a formula for energy density at infinity.
New ICA method for sources with mixed spectra.
problem Inaccurate separation of sources with temporal autocorrelations and mixed spectra.
method Estimates spectral density functions and line spectra using cubic splines and indicator functions, then maximizes the Whittle likelihood function.
result Outperforms existing ICA methods in simulations and EEG data applications.
The paper tackles semi-supervised learning on point clouds using PDE methods.
problem Extend labels to an entire data set on point clouds.
method Minimizing constrained discrete p-Dirichlet energy, connecting to continuum p-Dirichlet energy, applying PDE methods like pseudo-spectral methods. result Consistency of the numerical scheme in the large data limit for density estimation methods.
CCs learn high-dimensional distributions from heterogeneous data.
problem Learning high-dimensional distributions from heterogeneous data.
method Introducing characteristic circuits (CCs) that learn from data and use spectral domain.
result CCs outperform state-of-the-art density estimators on common benchmark data sets.
Algorithm learns graph ARMA processes for missing signal estimation.
problem Missing signal estimation in time-varying graph signals.
method Learning joint time-vertex power spectral density through convex relaxations.
result High accuracy in time-vertex signal estimation.
A new method for nonstationary Gaussian processes using Fourier features.
problem Efficient simulation of nonstationary Gaussian processes with high-dimensional distributions.
method Discretizes the spectral representation of nonstationary processes, avoiding probability measure assumptions.
result An efficient low-rank approximation of nonstationary spectral densities, consistent and positive semi-definite.
Quantum vacuum energy (Casimir energy) is reviewed for a mathematical audience as a topic in spectral theory. Then some one-dimensional systems are solved exactly, in terms of closed classical paths and periodic orbits. The relations among local spectral densities, energy densities, global eigenvalue densities, and tot…
Study on Matérn covariance approximations on grids, finding issues with high-frequency aliasing.
problem Issues with high-frequency aliasing in SPDE approximations of Matérn covariance functions.
method Analysis of aliased spectral densities and numerical simulations.
result SPDE approximations assign too much power at high frequencies and do not improve accuracy as grid spacing decreases.
For a symplectic manifold with quantizing line bundle, a choice of almost complex structure determines a Laplacian acting on tensor powers of the bundle. For high tensor powers Guillemin-Uribe showed that there is a well-defined cluster of low-lying eigenvalues, whose distribution is described by a spectral density fun…
Spectral algorithms improve under covariate shift with novel weighted techniques.
problem Improving spectral algorithms' performance under covariate shift.
method Analysis of spectral algorithms in non-parametric regression over RKHS, proposing a weighted spectral algorithm with clipped weights.
result Normalized weighted spectral algorithm achieves optimal capacity-independent convergence rates, and clipped weights can approach optimal capacity-dependent rates.
New matrix ensembles better match deep neural network spectral densities.
problem Theoretical spectral density models for deep networks do not match empirical observations.
method Introduced new matrix ensemble classes to better fit observed spectral densities.
result Theoretical models for deep networks are significantly flawed.
Optimizes graph spectral density learning for large networks.
problem Ad-hoc kernel function and bandwidth selection in graph spectral techniques.
method Maximum Entropy approach to learn a smooth graph spectral density.
result Outperforms comparable iterative spectral approaches on synthetic and real graphs.
New method extrapolates spectral densities from smaller models to larger ones.
problem Limited practical computations for large machine learning models.
method Algebraic spectral curve theory for free decompression.
result Framework enables extrapolation of spectral densities with multiple or multi-modal bulks.
Develops a method to estimate network difference in high-dimensional time series data.
problem Estimating network differences in high-dimensional data can be unreliable.
method Uses an L1 penalty on the difference of inverse spectral densities to estimate network differences.
result Establishes consistency of the method for sparse network differences.
This paper proposes and analyzes a novel clustering algorithm that combines graph-based diffusion geometry with techniques based on density and mode estimation. The proposed method is suitable for data generated from mixtures of distributions with densities that are both multimodal and have nonlinear shapes. A crucial …
Spectral estimation (SE) aims to identify how the energy of a signal (e.g., a time series) is distributed across different frequencies. This can become particularly challenging when only partial and noisy observations of the signal are available, where current methods fail to handle uncertainty appropriately. In this c…
A natural way to characterize the cluster structure of a dataset is by finding regions containing a high density of data. This can be done in a nonparametric way with a kernel density estimate, whose modes and hence clusters can be found using mean-shift algorithms. We describe the theory and practice behind clustering…
SpecAE detects anomalies in attributed networks by projecting them into a tailored space.
problem Detecting anomalies in attributed networks with complex dependencies and nodal attributes.
method Spectral convolution and deconvolution framework, leveraging Laplacian sharpening and density estimation.
result SpecAE effectively detects global and community anomalies in attributed networks.
This paper presents a practical, and theoretically well-founded, approach to improve the speed of kernel manifold learning algorithms relying on spectral decomposition. Utilizing recent insights in kernel smoothing and learning with integral operators, we propose Reduced Set KPCA (RSKPCA), which also suggests an easy-t…
Sharp comparison theorems are derived for all eigenvalues of the (weighted) Laplacian, for various classes of weighted-manifolds (i.e. Riemannian manifolds endowed with a smooth positive density). Examples include Euclidean space endowed with strongly log-concave and log-convex densities, extensions to p-exponential …
Fast simulates Volterra processes using RFF, focusing on S-fBM.
problem Efficiently simulate Volterra processes for fractional Brownian motion.
method Random Fourier Features (RFF) approximation of kernel, spectral representation, Hamiltonian Monte Carlo sampling.
result Quantitative guarantees for RFF approximation, competitive in terms of efficiency and error.
We present a method for finding high density, low-dimensional structures in noisy point clouds. These structures are sets with zero Lebesgue measure with respect to the D-dimensional ambient space and belong to a d<D dimensional space. We call them "singular features." Hunting for singular features corresponds to f…
Polynomial density theorem for specific subgroup orbits in quotient spaces.
problem Effective density of orbits in arithmetic quotients of SL2(C) and SL2(R)imesSL2(R). method Use of Margulis function, incidence geometry tools, and spectral gap of ambient space.
result Proved effective density theorems with polynomial error rate.
Confidence intervals and joint confidence sets are constructed for the nonparametric calibration of exponential Lévy models based on prices of European options. To this end, we show joint asymptotic normality in the spectral calibration method for the estimators of the volatility, the drift, the jump intensity and the …
Paper connects probability density cuts to graph theory eigenfunctions.
problem Developing sparse cuts for probability densities.
method Defines sparse cuts and principal eigenfunctions for probability densities, proving Cheeger and Buser inequalities.
result No such inequalities hold for prior definitions, proving new inequalities for probability densities.
Study reveals 1/f noise in signals made from nonoverlapping rectangular pulses.
problem Analyzing 1/f noise in signals composed of nonoverlapping pulses. method Derived a general formula for power spectral density, analyzed rectangular pulse case.
result Observed pure 1/f noise until very low frequencies with long pulse durations. A new method improves flow matching by dynamically weighting density estimates.
problem High-dimensional integration inefficiency in flow matching.
method Density-weighted Dynamic Stein operators.
result Significant improvement in vector field smoothness and sampling efficiency.
Recently there have been increasing interests in learning and inference with implicit distributions (i.e., distributions without tractable densities). To this end, we develop a gradient estimator for implicit distributions based on Stein's identity and a spectral decomposition of kernel operators, where the eigenfuncti…