Robust PCA, the problem of PCA in the presence of outliers has been extensively investigated in the last few years. Here we focus on Robust PCA in the column sparse outlier model. The existing methods for column sparse outlier model assumes either the knowledge of the dimension of the lower dimensional subspace or the …
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “fast identification”
Paper speeds up topological signal identification and cycle matching.
problem Efficiently identifying and matching topological signals across datasets.
method Cohomological approach to persistent homology computation.
result Significantly faster performance on large-scale datasets.
Paper compares ML models for fast power system contingency case identification.
problem Identifying critical power system states quickly.
method Comparison of regression and classification ML models.
result MLPs most suitable for fast contingency case prediction.
COSMIC identifies LTV systems from large data sets efficiently.
problem Identification of discrete-time linear time-variant systems from large-scale data.
method Formulates as regularized least squares problem, develops closed-form algorithm with linear complexity.
result Achieves optimal results even with large data volumes, significantly faster than general solvers.
The paper offers error bounds for quantized dynamical models.
problem Accuracy of dynamical models from dependent data sequences.
method Developed uniform error bounds for quantized models and imperfect optimization algorithms.
result Unified bounds for slow and fast rates, scaling with model encoding bits.
A new method selects variables efficiently for fast and accurate dynamic system identification.
problem Efficiently selecting variables for scalable Gaussian processes.
method Forward variable selection using Karhunen-Loève decomposition and Gibbs sampling.
result Method yields competitive accuracies and inference times for dynamic systems.
Paper separates financial time series into fast and slow components.
problem Multiscale behavior in financial time series data.
method Uses variance and tail stationarity criteria as generalized eigenvalue problems.
result Identifies slow and fast components in asset returns and prices.
Parameter identification and comparison of dynamical systems is a challenging task in many fields. Bayesian approaches based on Gaussian process regression over time-series data have been successfully applied to infer the parameters of a dynamical system without explicitly solving it. While the benefits in computationa…
A novel algorithm for best-arm identification in non-stationary linear bandits reduces error probability.
problem Non-stationary environments in A/B testing scenarios.
method Proposes a novel algorithm - for robust best-arm identification.
result Error probability decreases as , demonstrating robustness to non-stationarity.
Optimal multi-fidelity best-arm identification reduces cost with better accuracy.
problem Finding the best arm with highest mean reward at minimum cost.
method Gradient-based approach with asymptotically optimal cost complexity.
result Asymptotically optimal cost complexity compared to existing methods.
The growing integration of distributed energy resources (DERs) in urban distribution grids raises various reliability issues due to DER's uncertain and complex behaviors. With a large-scale DER penetration, traditional outage detection methods, which rely on customers making phone calls and smart meters' "last gasp" si…
A self-adaptive and robust fission clustering algorithm via heat diffusion and maximal turning anglecs.LG
A new clustering algorithm fuses heat diffusion and turning angle for robustness.
problem Cluster similar elements in various fields.
method Combines heat diffusion and maximal turning angle for robust fission clustering.
result The SARFC algorithm outperforms other methods in clustering performance.
New fast estimation methods stemming from control theory lead to a fresh look at time series, which bears some resemblance to "technical analysis". The results are applied to a typical object of financial engineering, namely the forecast of foreign exchange rates, via a "model-free" setting, i.e., via repeated identifi…
Paper shows faster core identification in matching markets.
problem Core Identification Problem in one-sided matching markets.
method Randomized SVD on preference-derived Markov matrix.
result CIP solved in O(Ln) time, matching lower bound.
Method identifies IPS governing equations from particle data efficiently.
problem Identify governing equations of interacting particle systems efficiently.
method Combines mean-field theory and WSINDy for large and .
result Converges with rate for .
Robust PCA, the problem of PCA in the presence of outliers has been extensively investigated in the last few years. Here we focus on Robust PCA in the outlier model where each column of the data matrix is either an inlier or an outlier. Most of the existing methods for this model assumes either the knowledge of the dim…
Efficiently simulates slow dynamics of high-dimensional stochastic systems.
problem Simulating high-dimensional stochastic systems with slow dynamics and fast modes.
method Designs an algorithm to estimate an invariant manifold and its dynamics, averaging out fast modes.
result Efficient simulator of effective dynamics on low-dimensional invariant manifold.
Paper proposes algorithms to accurately identify breakpoints in piecewise regression.
problem Identifying accurate breakpoints in piecewise regression for better data fitting.
method Proposes novel greedy algorithms to minimize error and determine optimal breakpoints.
result The proposed algorithms outperform existing methods in accuracy and efficiency.
Fast and Regret Optimal Best Arm Identification: Fundamental Limits and Low-Complexity Algorithmscs.LG
This paper solves the best arm identification problem with both quick commitment and reward maximization.
problem Simultaneously identifying the best arm and minimizing regret in a stochastic Multi-Armed Bandit problem.
method Introduces Regret Optimal Best Arm Identification (ROBAI) and presents algorithms EOCP and its variants.
result Achieves asymptotic optimal regret and quick commitment to the optimal arm in both pre-determined and adaptive stopping times.
New method identifies distribution grid outages using smart meter data.
problem Outages in urban distribution grids due to DERs and smart meters' last gasp signals.
method Data-driven approach based on stochastic time series analysis and maximum likelihood estimation.
result Proves optimal performance in identifying distribution grid outages using smart meter data.
In this paper, we consider a privacy preserving encoding framework for identification applications covering biometrics, physical object security and the Internet of Things (IoT). The proposed framework is based on a sparsifying transform, which consists of a trained linear map, an element-wise nonlinearity, and privacy…
Herein, we propose a spatio-temporal extension of RBFNN for nonlinear system identification problem. The proposed algorithm employs the concept of time-space orthogonality and separately models the dynamics and nonlinear complexities of the system. The proposed RBF architecture is explored for the estimation of a highl…
The identification of slow invariant manifolds (SIMs) is an essential part in model-order reduction for reactive systems. The mathematical definition of the SIM by Fenichel can be considered unsatisfactory, because it is only applicable to so-called slow-fast system and does not provide the uniqueness of the SIM. Obser…
We present a novel methodology able to distinguish meaningful level shifts from typical signal fluctuations. A two-stage regularization filtering can accurately identify the location of the significant level-shifts with an efficient parameter-free algorithm. The developed methodology demands low computational effort an…
WSINDy for PDEs robustly identifies models from noisy data.
problem Identifying nonlinear dynamics from noisy partial differential equations data.
method Weak formulation of PDEs, Fourier-based model identification, sequential-thresholding least-squares.
result WSINDy enables robust identification of PDEs in noisy conditions.
We propose a generalization of the best arm identification problem in stochastic multi-armed bandits (MAB) to the setting where every pull of an arm is associated with delayed feedback. The delay in feedback increases the effective sample complexity of standard algorithms, but can be offset if we have access to partial…
Over the past years Robust PCA has been established as a standard tool for reliable low-rank approximation of matrices in the presence of outliers. Recently, the Robust PCA approach via nuclear norm minimization has been extended to matrices with linear structures which appear in applications such as system identificat…
AI enhances cancer diagnostics using spectroscopy.
problem Early and accurate cancer diagnosis.
method Combining AI with spectroscopy-based techniques.
result AI improves cancer diagnostics speed and safety.
We study the problem of interference source identification, through the lens of recognizing one of 15 different channels that belong to 3 different wireless technologies: Bluetooth, Zigbee, and WiFi. We employ deep learning algorithms trained on received samples taken from a 10 MHz band in the 2.4 GHz ISM Band. We obta…
Bayesian-SINDy learns differential equations from noisy data quickly.
problem Learning correct model equations from limited and noisy data.
method Bayesian-SINDy framework using Gaussian approximations.
result Bayesian-SINDy is more robust and accurate in learning correct model equations from noisy data.
A new method for fast Bayesian mixture model estimation.
problem Estimating Bayesian mixture models is computationally challenging.
method Amortized Bayesian Inference (ABI) framework for mixture models.
result The method provides fast inference for mixture models.
New algorithms identify Pareto optimal sets in multi-objective bandit problems.
problem Identifying Pareto optimal sets in multi-objective bandit problems.
method Empirical Gap Elimination (EGE) algorithms combining hardness estimation and elimination schemes.
result Two EGE algorithms have exponentially decaying error probabilities with budget.
New method detects change-points in population genetics.
problem Identifying homozygosity islands in a population.
method Penalized maximum likelihood approach with dynamic programming and greedy algorithms.
result Consistent detection of homozygosity islands in population genetics.
A new algorithm speeds up sparse regression for discovering equations from data.
problem Learning governing equations from vast data with unsatisfying descriptions.
method SPRINT: a fast algorithm using bisection and analytic bounds to identify optimal rank-1 modifications.
result A calculation that would take millions of years can be done in a day.
Algorithm identifies the best arm in linear bandits with high probability.
problem Best arm identification in linear multi-armed bandits with noisy measurements.
method Phased Elimination Linear Exploration Game (PELEG) using no-regret learners.
result PELEG achieves sample complexity matching lower bounds.
Knot Floer homology is a knot invariant defined using holomorphic curves. In more recent work, taking cues from bordered Floer homology,the authors described another knot invariant, called "bordered knot Floer homology", which has an explicit algebraic and combinatorial construction. In the present paper, we extend the…
Algorithm identifies Pareto optimal designs efficiently for noisy, multi-objective functions.
problem Optimizing multi-objective functions with noisy data and large design spaces.
method Adaptive discretization and tree-based approach to identify Pareto optimal designs.
result Algorithm identifies Pareto optimal designs with fewer evaluations than exhaustive search.
Unsupervised detection and open-set classification of fast-ramped flexibility activation eventseess.SY
Automates detection of fast-ramped flexibility events for DSOs.
problem Monitoring and supervising flexibility activations in power systems.
method Unsupervised detection and open-set classification.
result Automatically identifies critical flexibility activations for early intervention.
This paper analyzes the stability and generalization of triplet learning algorithms.
problem Lack of theoretical understanding of triplet learning's generalization performance.
method Stability analysis and high-probability generalization bounds for triplet learning algorithms.
result Established general high-probability generalization bound for triplet learning algorithms.
t-distributed Stochastic Neighborhood Embedding (t-SNE) is a method for dimensionality reduction and visualization that has become widely popular in recent years. Efficient implementations of t-SNE are available, but they scale poorly to datasets with hundreds of thousands to millions of high dimensional data-points. W…
Finding Social Media Trolls: Dynamic Keyword Selection Methods for Rapidly-Evolving Online Debatescs.LG
Online harassment is a significant social problem. Prevention of online harassment requires rapid detection of harassing, offensive, and negative social media posts. In this paper, we propose the use of word embedding models to identify offensive and harassing social media messages in two aspects: detecting fast-changi…
We extend Neural Processes (NPs) to sequential data through Recurrent NPs or RNPs, a family of conditional state space models. RNPs model the state space with Neural Processes. Given time series observed on fast real-world time scales but containing slow long-term variabilities, RNPs may derive appropriate slow latent …
Paper explores using EEG for better speaker identification, even in noisy environments.
problem Speaker identification performance degrades in background noise.
method Uses EEG signals to enhance speaker identification systems, comparing with acoustic features.
result Speaker identification system using only EEG features outperforms one using only acoustic features in high background noise.
This paper presents a module of vehicle reidentification based on make/model and color classification. It could be used by the Automated Vehicular Surveillance (AVS) or by the fast analysis of video data. Many of problems, that are related to this topic, had to be addressed. In order to facilitate and accelerate the pr…
Classifiers trained on data sets possessing an imbalanced class distribution are known to exhibit poor generalisation performance. This is known as the imbalanced learning problem. The problem becomes particularly acute when we consider incremental classifiers operating on imbalanced data streams, especially when the l…
Simultaneous Identification of Sparse Structures and Communities in Heterogeneous Graphical Modelsstat.ML
Paper identifies sparse structures and communities in heterogeneous graphical models.
problem Detecting community structures in graphical models.
method Novel decomposition into sparse and low-rank parts, three-stage estimation procedure.
result Consistent model selection for adaptive penalized estimator.
There has been substantial research on sub-linear time approximate algorithms for Maximum Inner Product Search (MIPS). To achieve fast query time, state-of-the-art techniques require significant preprocessing, which can be a burden when the number of subsequent queries is not sufficiently large to amortize the cost. Fu…
Study fast learning rates for square loss in dependent data with hypercontractivity condition.
problem Learning from dependent data with fast rates matching independent data.
method Martingale difference noise, trajectory hypercontractivity condition, least-squares estimator.
result Excess risk bound matches iid rate after burn-in time, independent of mixing-time.