Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,181 papers · 148 categories

Trend · papers per month

4487131174 · Jun 202019922001200920182026
48 results for subspace change

Fast robust subspace tracking in sparse data-dependent noise with near-optimal delay.

problem Robustly tracking time-varying subspaces in the presence of sparse outliers.
method Introduces a fast mini-batch robust ST solution under mild assumptions.
result Provably correct subspace tracking with near-optimal delay and same time complexity as simple PCA.

Online detection of abrupt changes in high-dimensional data streams.

problem Detecting abrupt changes in high-dimensional, streaming data with multiple subspaces.
method Dynamic sparse subspace learning approach with multiple structural change-point model, Bayesian information criterion for penalty coefficients selection, and Pruned Exact Linear Time algorithm.
result Effectiveness demonstrated through simulation and real gesture data studies.

Robust PCA methods are typically batch algorithms which requires loading all observations into memory before processing. This makes them inefficient to process big data. In this paper, we develop an efficient online robust principal component methods, namely online moving window robust principal component analysis (OMW…

2017-02-19abs ↗pdf ↗

Develops a new algorithm for robustly tracking data vectors in a subspace, even with outliers.

problem Tracking data vectors in a slowly changing low-dimensional subspace robustly against outliers.
method ReProCS-NORST, a recursive projected compressive sensing algorithm.
result Achieves a near optimal tracking delay of O(rlognlog(1/ε))O(r \log n \log(1/ε)).

Paper models dynamic multivariate functional data with sparse subspace learning.

problem Complex, high-dimensional multivariate functional data with evolving cross-correlations.
method Sparse subspace learning for automatic subspaces formulation and cross-correlation dynamics description.
result Efficient estimation and feature extraction of multivariate functional data.

This work tackles phaseless subspace tracking, recovering time-varying signals from phaseless projections.

problem Recovering time-varying signals from phaseless linear projections under gradual subspace change.
method Dynamic subspace tracking approach, leveraging gradual subspace change over time.
result Demonstrates feasibility of phaseless subspace tracking with gradual subspace change.

Paper extends multivariate rank tests for robust subspace detection.

problem Testing distributional similarity in multivariate data.
method Soft and subspace robust multivariate rank tests based on entropy regularized optimal transport.
result Trade-off between detection power and false alarm rate via projections.

Dynamic robust PCA refers to the dynamic (time-varying) extension of robust PCA (RPCA). It assumes that the true (uncorrupted) data lies in a low-dimensional subspace that can change with time, albeit slowly. The goal is to track this changing subspace over time in the presence of sparse outliers. We develop and study …

2017-05-24abs ↗pdf ↗

Subspace clustering refers to the problem of clustering unlabeled high-dimensional data points into a union of low-dimensional linear subspaces, assumed unknown. In practice one may have access to dimensionality-reduced observations of the data only, resulting, e.g., from "undersampling" due to complexity and speed con…

2014-04-27abs ↗pdf ↗

Active subspaces on Riemannian manifolds generalize Euclidean principles.

problem Understanding how scalar-valued quantities change over Riemannian manifolds.
method Generalization of active subspaces from Euclidean to Riemannian spaces using parallel transport.
result The method provides a new way to study scalar-valued quantities on manifolds, differing from extrinsic approaches.

Paper analyzes neural networks using active subspace for structural analysis and vulnerability, reducing model size and improving attacks.

problem Analyzing and reducing the complexity of neural networks.
method Active subspace method for measuring active neurons, network structure modification, and additive universal adversarial attack vector.
result ASNet achieves significant parameter and flops reduction, and improves universal adversarial attack performance.

P-OCS detects OOD samples in a low-dimensional subspace, outperforming existing methods.

problem Efficient OOD detection for deep learning models in open-world environments.
method P-OCS operates in the orthogonal complement of the principal subspace, applying a single projected perturbation.
result P-OCS achieves state-of-the-art OOD detection with negligible computational cost and without requiring model retraining.

This paper proposes a new method to adapt ROMs for new parameter settings.

problem ROMs lack robustness when applied to new parameter settings.
method Regression trees on Grassmann Manifold to learn the mapping between parameters and POD bases.
result The proposed method is capable of establishing the mapping between parameters and POD bases, thus adapting ROMs for new parameters.

Detects graph topology changes from noisy signals using prior spectral information.

problem Detecting changes in graph topology from graph signals.
method Leverages graph filtering and subspace detection to distill problem into a CUSUM-based algorithm.
result Demonstrates the effectiveness of incorporating prior spectral signatures for change-point detection.

Neural recordings are nonstationary time series, i.e. their properties typically change over time. Identifying specific changes, e.g. those induced by a learning task, can shed light on the underlying neural processes. However, such changes of interest are often masked by strong unrelated changes, which can be of physi…

2013-01-25abs ↗pdf ↗

The method learns disentangled representations for localized image manipulations.

problem Image generating neural networks are viewed as black boxes with global effects.
method Localized ResNet Autoencoder with multiple loss functions.
result The network can transfer specific facial attributes like shape and color of eyes, hair, mouth, etc. between persons.

New method disentangles latent subspaces under correlation shifts.

problem Correlations between factors of variation make disentanglement models less robust.
method Enforces independence between subspaces conditioned on available attributes using adversarial CMI minimization.
result Models are disentangled and robust under correlation shifts, including in weakly supervised settings.

This work studies two interrelated problems - online robust PCA (RPCA) and online low-rank matrix completion (MC). In recent work by Candès et al., RPCA has been defined as a problem of separating a low-rank matrix (true data), L:=[1,2,t,,tmax]L:=[\ell_1, \ell_2, \dots \ell_{t}, \dots , \ell_{t_{\max}}] and a sparse matrix (outliers…

2015-03-11abs ↗pdf ↗

To each ribbon graph we assign a so-called L-space, which is a Lagrangian subspace in an even-dimensional vector space with the standard symplectic form. This invariant generalizes the notion of the intersection matrix of a chord diagram. Moreover, the actions of Morse perestroikas (or taking a partial dual) and Vassil…

2014-01-23abs ↗pdf ↗

The paper extends hypothesis testing to non-diagonalizable matrices, improving network statistics inference.

problem Testing on non-diagonalizable matrices for network statistics.
method Generalizes Wald and t-tests to non-symmetric matrices, controlling convergence rates.
result Improved inference on network statistics from directed networks.

Unified framework for disentangled representations using mechanistic independence.

problem Identifiability of disentangled latent factors under statistical dependencies.
method Introduces mechanistic independence to characterize latent factors by their actions on observed variables, proposing various independence criteria.
result Establishes conditions for identifiability of latent subspaces without statistical assumptions.

Proposes a method to predict responses from covariates over time.

problem Predicting responses from covariates with changing conditional distributions over time.
method Invariant Subspace Decomposition (ISD) framework that splits the conditional distribution into time-invariant and time-dependent components.
result The decomposition can be used for zero-shot and time-adaptation prediction tasks.

EigenGAN discovers interpretable dimensions in GAN layers for semantic control.

problem Lack of explicit dimensions to control semantic attributes in GAN layers.
method EigenGAN embeds linear subspaces with orthogonal bases into each generator layer, learning eigen-dimensions corresponding to semantic attributes via adversarial training.
result EigenGAN can produce samples with continuous changes corresponding to specific semantic attributes.

Recent work in distance metric learning has focused on learning transformations of data that best align with provided sets of pairwise similarity and dissimilarity constraints. The learned transformations lead to improved retrieval, classification, and clustering algorithms due to the better adapted distance or similar…

2016-03-11abs ↗pdf ↗

Memory-efficient optimizers fail to track a subspace, leading to unpredictable model performance.

problem Memory-efficient optimizers fail to track a subspace, leading to unpredictable model performance.
method Analyzing the behavior of memory-efficient optimizers like GaLore, which project gradients onto a rank-r subspace recomputed every T steps.
result Memory-efficient optimizers fail to track a subspace, leading to unpredictable model performance.

In this paper, we analyze the geometric structure of an Euclidean submanifold whose osculating spaces form a nonconstant family of proper subspaces of the same dimension. We prove that if the rate of change of the osculating spaces is small, then the submanifold must be a (submanifold of a) ruled submanifold of a very …

2011-05-04abs ↗pdf ↗

A geometric string solution has background fields in overlapping coordinate patches related by diffeomorphisms and gauge transformations, while for a non-geometric background this is generalised to allow transition functions involving duality transformations. Non-geometric string backgrounds arise from T-duals and mirr…

2004-06-11abs ↗pdf ↗

Detecting emergence of a low-rank signal from high-dimensional data is an important problem arising from many applications such as camera surveillance and swarm monitoring using sensors. We consider a procedure based on the largest eigenvalue of the sample covariance matrix over a sliding window to detect the change. T…

2016-10-03abs ↗pdf ↗

LineBO tackles high-dimensional Bayesian optimization by solving 1D subproblems.

problem Bayesian optimization struggles in high dimensions due to complex acquisition steps.
method LineBO restricts high-dimensional problems to 1D subproblems iteratively solved efficiently.
result LineBO converges globally and achieves a fast local rate for strongly convex functions.

ASEBO optimizes complex functions by learning optimal sensing directions.

problem Optimizing high-dimensional blackbox functions with expensive queries.
method Adapts to function geometry, learns sensing directions, uses active subspaces.
result More sample-efficient than state-of-the-art algorithms.

GDMaps reduces high-dimensional data to lower dimensions for better classification.

problem High-dimensional data classification and representation.
method Grassmannian Diffusion Maps technique for nonlinear dimensionality reduction.
result GDMaps effectively identifies intrinsic subspace structures in high-dimensional data.

This work examines how adversarial vulnerability changes with the dimensionality of the subspace of perturbations.

problem Understanding adversarial vulnerability in constrained input spaces.
method Investigates adversarial vulnerability in subspace VV of the input space XX with varying dimensions, using PGD attacks and analyzing the dependence on εε and dim(V)/dim(X)dim(V)/dim(X).
result Adversarial success of PGD attacks is a monotonically increasing function of $ε( rac{dim(V)}{dim(X)})^{ rac{1}{q}}$.