Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

111222333444 · Jun 202019922001200920172026
48 results for spectral dimensionality reduction

Improved LDA method for better classification and dimensionality reduction.

problem Improving linear discriminant analysis for better classification performance.
method Integrates spectrally-corrected covariance matrix and regularized discriminant analysis.
result SRLDA has a linear classification global optimal solution under spiked model assumption.

Unified framework for spectral methods, kernel learning, and manifold unfolding.

problem Tackles the unification and optimization of spectral dimensionality reduction methods.
method Unified spectral methods as kernel PCA, kernel learning by SDP, and detailed explanation of MVU variants.
result Unified understanding and optimization of manifold learning techniques.

This work connects LLE, factor analysis, and probabilistic PCA through a stochastic perspective.

problem Exploring the theoretical connection between LLE, factor analysis, and probabilistic PCA.
method Solving the stochastic linear reconstruction of LLE using expectation maximization.
result LLE, factor analysis, and probabilistic PCA are shown to be connected through a stochastic perspective.

Survey of Laplacian-based methods for data dimensionality reduction and embedding.

problem Efficiently reducing high-dimensional data to lower dimensions while preserving important features and structures.
method Laplacian-based methods including spectral clustering, Laplacian eigenmap, locality preserving projection, graph embedding, and diffusion map.
result Comprehensive overview of various optimization variants and applications of Laplacian-based techniques.

Develops precise expressions for random projections for better machine learning tasks.

problem Improving the accuracy of dimensionality reduction in machine learning tasks.
method Exploits recent developments in spectral analysis of random matrices to derive accurate expressions for random projection matrices.
result Provides precise expressions that reflect the practical performance of sketching methods, including Gaussian and Rademacher sketches.

This paper introduces a new unsupervised method for dimensionality reduction via regression (DRR). The algorithm belongs to the family of invertible transforms that generalize Principal Component Analysis (PCA) by using curvilinear instead of linear features. DRR identifies the nonlinear features through multivariate r…

2016-01-31abs ↗pdf ↗

Spectral dimensionality reduction algorithms are widely used in numerous domains, including for recognition, segmentation, tracking and visualization. However, despite their popularity, these algorithms suffer from a major limitation known as the "repeated Eigen-directions" phenomenon. That is, many of the embedding co…

2016-12-11abs ↗pdf ↗

SEDA improves RLDA for high-dimensional data.

problem Inconsistent performance of RLDA in high-dimensional scenarios.
method Developed a non-asymptotic approximation of misclassification rate, derived new theoretical results on eigenvectors, and proposed SEDA algorithm.
result SEDA achieves higher classification accuracy and dimensionality reduction compared to existing LDA methods.

Spectral dimensionality reduction methods enable linear separations of complex data with high-dimensional features in a reduced space. However, these methods do not always give the desired results due to irregularities or uncertainties of the data. Thus, we consider aggressively modifying the scales of the features to …

2018-05-18abs ↗pdf ↗

Proves new inequality linking spectral numbers of Lagrangians and their reductions.

problem Understanding spectral properties of Lagrangian submanifolds.
method Develops inverse reduction inequalities for spectral numbers.
result Proof of inequality between spectral numbers of Lagrangian and its reductions.

Proposes a spectral method to assess and combine multiple data visualizations.

problem Evaluating and combining the strengths of different data visualization algorithms.
method Spectral method for assessing and combining multiple visualizations.
result Proposes a visualization eigenscore to quantify relative performance and a consensus visualization.

Study characterizes cryospheric spectral feature space using joint PC+t-SNE approach.

problem Characterize cryospheric spectral feature space for remote sensing applications.
method Compare and contrast two approaches for identifying feature space basis vectors via dimensionality reduction (PCA and t-SNE).
result Joint characterization reveals distinct continua and clusters of ice reflectance properties.

This study evaluates clustering algorithms on high-dimensional data.

problem Comparing clustering algorithms on high-dimensional datasets.
method Evaluation of K-means, DBSCAN, and Spectral Clustering using PCA, t-SNE, UMAP, and multiple metrics.
result UMAP preprocessing improves clustering quality across all algorithms, with Spectral Clustering excelling.

Can one reduce the size of a graph without significantly altering its basic properties? The graph reduction problem is hereby approached from the perspective of restricted spectral approximation, a modification of the spectral similarity measure used for graph sparsification. This choice is motivated by the observation…

2018-08-31abs ↗pdf ↗

New method filters large networks from financial data to reveal key subnetworks.

problem Filtering large dimensional networks to isolate key constituents.
method Exploits spectral properties of high-dimensional data networks, tuning for sparsity and consistency.
result Shows method can interpolate between zero and maximal filtering, preserving spectral properties.

In recent years, the spectral analysis of appropriately defined kernel matrices has emerged as a principled way to extract the low-dimensional structure often prevalent in high-dimensional data. Here we provide an introduction to spectral methods for linear and nonlinear dimension reduction, emphasizing ways to overcom…

2009-06-24abs ↗pdf ↗

We consider a curve of Fredholm pairs of Lagrangian subspaces in a fixed Banach space with continuously varying (weak) symplectic structures. Assuming vanishing index, we obtain intrinsically a continuously varying splitting of the total Banach space into pairs of symplectic subspaces. Using such decompositions we defi…

2014-06-03abs ↗pdf ↗

Given an SL(3)SL(3) spectral curve over a simply connected Riemann surface, we describe in detail the reduction steps necessary to construct the core of a pre-building with versal harmonic map whose differential is given by the spectral curve.

2016-11-26abs ↗pdf ↗

Dimensionality reduction is a topic of recent interest. In this paper, we present the classification constrained dimensionality reduction (CCDR) algorithm to account for label information. The algorithm can account for multiple classes as well as the semi-supervised setting. We present an out-of-sample expressions for …

2008-02-20abs ↗pdf ↗

We consider a distributed learning approach in supervised learning for a large class of spectral regularization methods in an RKHS framework. The data set of size n is partitioned into m=O(nα)m=O(n^α) disjoint subsets. On each subset, some spectral regularization method (belonging to a large class, including in particular K…

2016-10-24abs ↗pdf ↗

While the existence of low-dimensional embedding manifolds has been shown in patterns of collective motion, the current battery of nonlinear dimensionality reduction methods are not amenable to the analysis of such manifolds. This is mainly due to the necessary spectral decomposition step, which limits control over the…

2015-08-13abs ↗pdf ↗

Discrete Fourier transforms provide a significant speedup in the computation of convolutions in deep learning. In this work, we demonstrate that, beyond its advantages for efficient computation, the spectral domain also provides a powerful representation in which to model and train convolutional neural networks (CNNs).…

2015-06-11abs ↗pdf ↗

In most convolution neural networks (CNNs), downsampling hidden layers is adopted for increasing computation efficiency and the receptive field size. Such operation is commonly so-called pooling. Maximation and averaging over sliding windows (max/average pooling), and plain downsampling in the form of strided convoluti…

2018-10-07abs ↗pdf ↗

An important step in speaker verification is extracting features that best characterize the speaker voice. This paper investigates a front-end processing that aims at improving the performance of speaker verification based on the SVMs classifier, in text independent mode. This approach combines features based on conven…

2013-06-12abs ↗pdf ↗

We explore the geometry of the Nahm-Schmid equations, a version of Nahm's equations in split signature. Our discussion ties up different aspects of their integrable nature: dimensional reduction from the Yang--Mills anti-self-duality equations, explicit solutions, Lax-pair formulation, conservation laws and spectral cu…

2017-11-07abs ↗pdf ↗

Novel model captures high-dimensional copulas with spectral dynamics and regularization.

problem Modeling time-varying, asymmetric, tail-dependent copulas in high dimensions.
method Score-driven dynamics for eigenvalues, non-linear shrinkage for biases, parsimonious and scalable.
result Model outperforms recent alternatives in capturing co-movements and diversification potential.

CDP reduces point cloud dimensions by preserving detour-induced local non-convexity.

problem Preserving local non-convexity in point cloud dimensionality reduction.
method CDP builds a k-NN graph, identifies admissible pairs, aggregates normalized directions, and uses top-k eigenvectors for projection.
result CDP provides verifiable guarantees on post-projection distortion and direction energy.