Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

200399599798 · Jun 202019922001200920172026
48 results for neural spectra

BSD is a Bayesian framework for analyzing neural spectral data.

problem Challenges in statistical analysis and group-level comparisons of neural power spectra.
method Bayesian Spectral Decomposition (BSD) for parametric models of neural spectra.
result BSD outperforms existing methods in model selection and parameter estimation.

This paper proposes a new loss using short-time Fourier transform (STFT) spectra for the aim of training a high-performance neural speech waveform model that predicts raw continuous speech waveform samples directly. Not only amplitude spectra but also phase spectra obtained from generated speech waveforms are used to c…

2018-10-29abs ↗pdf ↗

Proposes a method for training Bayesian neural networks using synthetic data from Raman and CARS spectra.

problem Limited real observations in Raman and CARS spectroscopy.
method Log-Gaussian Gamma Processes and Bayesian Neural Networks.
result Trained Bayesian neural networks provide accurate estimates of Raman and CARS spectra with uncertainty quantification.

Deep neural networks correct Mie scattering in FTIR spectra of biological samples.

problem Mie scattering obscures biochemically relevant spectral information in FTIR spectra of biological samples.
method Deep neural networks to approximate the preprocessing function that removes Mie scattering.
result The model is faster and more generalizable across different tissue types.

Are neural networks biased toward simple functions? Does depth always help learn more complex features? Is training the last layer of a network as good as training all layers? How to set the range for learning rate tuning? These questions seem unrelated at face value, but in this work we give all of them a common treat…

2019-07-24abs ↗pdf ↗

This work analyzes neural scaling laws using power-law data spectra and derives analytical expressions for generalization error.

problem Understanding how neural network performance scales with key factors like data size and model complexity.
method Statistical mechanics techniques applied to one-pass stochastic gradient descent in a student-teacher framework.
result Derivation of analytical expressions for generalization error under power-law data spectra and identification of conditions for power-law scaling.

Study eigenvalue distributions of neural kernels for linear-width networks.

problem Eigenvalue distributions of neural kernels in linear-width networks.
method Asymptotic analysis of Conjugate Kernel and Neural Tangent Kernel under random initialization and approximate orthogonality.
result Eigenvalue distributions converge to deterministic limits, described by recursive fixed-point equations.

Neural networks learn simpler features first, then more complex ones; Fourier analysis reveals this pattern.

problem Understanding the learning dynamics of neural networks, especially with natural image data.
method Fourier analysis of translation-invariant and power-law spectra to study feature learning.
result Simple neural networks first rely on amplitude information, then phase information, and power-law spectra can accelerate learning phase information.

Investigates spectral properties of neural networks, showing invariance under certain conditions.

problem Understanding the spectral evolution and invariance in linear-width neural networks.
method Empirical and theoretical analysis of spectra of weight matrices in high-dimensional settings.
result Spectra of weight matrices are invariant under certain training conditions, with implications for feature learning.

DeepHybrid uses radar data to classify objects accurately.

problem Challenges in classifying objects using automotive radar sensors.
method Combines radar signal processing and Deep Learning; uses neural architecture search.
result Improves object classification performance compared to models using only spectra.

SGD's training dynamics align with Hessian and gradient spectra in high-dimensional classification tasks.

problem Understanding the spectra of Hessian and gradient matrices in high-dimensional classification tasks.
method Rigorous analysis of SGD dynamics and spectra of Hessian and gradient matrices.
result SGD trajectory and emergent outlier eigenspaces align with a common low-dimensional subspace in multi-class high-dimensional mixtures and neural networks.

We propose a learning-based approach for estimating the spectrum of a multisinusoidal signal from a finite number of samples. A neural-network is trained to approximate the spectra of such signals on simulated data. The proposed methodology is very flexible: adapting to different signal and noise models only requires m…

2018-11-14abs ↗pdf ↗

Machine learning models simulate molecular spectra and reactions in solvents.

problem Accurate simulation of molecular spectra and reactions in solvent environments.
method Introduced FieldSchNet, a deep neural network for modeling molecular interactions with external fields.
result Demonstrated significant lowering of Claisen rearrangement reaction activation barrier using FieldSchNet.

As in many other scientific domains, we face a fundamental problem when using machine learning to identify proteins from mass spectrometry data: large ground truth datasets mapping inputs to correct outputs are extremely difficult to obtain. Instead, we have access to imperfect hand-coded models crafted by domain exper…

2018-08-20abs ↗pdf ↗

We give a simple sufficient condition for Quinn's "bordism-type spectra" to be weakly equivalent to strictly associative ring spectra. We also show that Poincare bordism and symmetric L-theory are naturally weakly equivalent to monoidal functors. Part of the proof of these statements involves showing that Quinn's funct…

2009-07-14abs ↗pdf ↗

Tomova, along with results of Bachman and Schleimer, showed that any high distance knot has a stair-step bridge spectrum. In this paper, we compute the bridge spectra and distance of generalized Montesinos knots. In particular, we produce the first example of a class of knots which attain the stair-step bridge spectra …

2015-10-28abs ↗pdf ↗

New ICA method for sources with mixed spectra.

problem Inaccurate separation of sources with temporal autocorrelations and mixed spectra.
method Estimates spectral density functions and line spectra using cubic splines and indicator functions, then maximizes the Whittle likelihood function.
result Outperforms existing ICA methods in simulations and EEG data applications.

Jones-Wenzl projectors lifted to Khovanov spectra, proving knot conjectures.

problem Understanding Jones-Wenzl projectors in Khovanov spectra.
method Constructing and studying lifted projectors via maps and polynomial actions.
result Complete computation of 3-colored Khovanov spectrum of the unknot, proving conjectures.

We give a method to calculate spectra of the square of the Rarita-Schwinger operator on compact symmetric spaces. According to Weitzenböck formulas, the operator can be written by the Laplace operator, which is the Casimir operator on compact symmetric spaces. Then we can obtain the spectra by using the Freudenthal's f…

2020-01-17abs ↗pdf ↗

We introduce a framework, twisted parametrized stable homotopy theory, for describing semi-infinite homotopy types. A twisted parametrized spectrum is a section of a bundle whose fibre is the category of spectra. We define these bundles in terms of modules over a stack of parametrized spectra and in terms of diagrams o…

2005-08-03abs ↗pdf ↗

We prove explicit upper and lower bounds for the L1L^1-moment spectra for the Brownian motion exit time from extrinsic metric balls of submanifolds PmP^m in ambient Riemannian spaces NnN^{n}. We assume that PP and NN both have controlled radial curvatures (mean curvature and sectional curvature, respectively) as view…

2010-09-07abs ↗pdf ↗

The paper proves geometric and spectral alignment for deep neural networks.

problem Understanding the singular spectra of deep neural network layers.
method Proves deterministic quotient-geometric estimates for singular spectra of Frobenius-normalized layer factors.
result Exact power-law spectra form a trace-normalized Cartan orbit under Frobenius normalization.

The paper describes correlations of spectra for higher rank Anosov representations.

problem Understanding correlations of spectra for Anosov representations of higher rank groups.
method Relates correlation problem to counting projections in truncated hypertubes.
result Extends previous work on rank one representations to higher rank.

We view strict ring spectra as generalized rings. The study of their algebraic K-theory is motivated by its applications to the automorphism groups of compact manifolds. Partial calculations of algebraic K-theory for the sphere spectrum are available at regular primes, but we seek more conceptual answers in terms of lo…

2014-03-24abs ↗pdf ↗

The design of the nanostructures that are used in the field of nano-photonics has remained complex, very often relying on the intuition and expertise of the designer, ultimately limiting the reach and penetration of this groundbreaking approach. Recently, there has been an increasing number of studies suggesting to app…

2019-11-26abs ↗pdf ↗

Wavelet scattering spectra model non-Gaussian time-series, proving scale invariance for self-similar processes.

problem Modeling non-Gaussian time-series with stationary increments.
method Complex wavelet transform for scale variations, joint correlation matrix for scale dependencies, second wavelet transform for diagonalization, maximum entropy models conditioned by scattering spectra coefficients.
result Scattering spectra of self-similar processes are scale invariant, allowing statistical testing and generation of new time-series.

Manifold methods improve amino acid classification in LIBS spectra.

problem Improving classification accuracy of amino acids in LIBS spectra.
method Developed an information theoretic method for measuring LIBS energy spectra, implemented manifold methods for nonlinear dimensionality reduction.
result Nonlinear methods lead to increased classification accuracy in amino acid classification.