In this paper we propose a computationally efficient algorithm for on-line variable selection in multivariate regression problems involving high dimensional data streams. The algorithm recursively extracts all the latent factors of a partial least squares solution and selects the most important variables for each facto…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “multivariate data streams”
A new method detects anomalies in multivariate streams without unit dependence.
problem Detect anomalies in multivariate streams without unit dependence.
method Proposes SigMahaKNN combining variance norm and path signature.
result SigMahaKNN detects anomalies better than existing methods.
KQT-EWMA monitors multivariate data streams online with flexible and practical change detection.
problem Online monitoring of multivariate data streams for detecting changes.
method Combines Kernel-QuantTree histogram and EWMA statistic for non-parametric monitoring.
result Controls Average Run Length (ARL0) while achieving comparable detection delays.
PySAD offers a unified Python framework for efficient streaming anomaly detection.
problem Efficient anomaly detection in streaming data with strict constraints.
method Unified architecture with 17+ streaming algorithms, specialized components, and support for multiple learning paradigms.
result PySAD enables real-time processing with bounded memory and is compatible with other Python frameworks.
Develops new techniques for learning from sequential data groups.
problem Learning from groups of inputs rather than individual inputs.
method Introduces feature-based and kernel-based learning techniques for sequential data.
result Achieves state-of-the-art performance on various real-world examples.
The study examines how bias affects hypothesis formation in neural networks.
problem Characterizing the impact of bias on hypothesis formation in neural networks.
method An automated data-driven projection pursuit neural network to extract and select features for binary classification.
result The refinement of a working hypothesis converges to a robust multivariate perception of data.
In recent years, there has been a growing interest in identifying anomalous structure within multivariate data streams. We consider the problem of detecting collective anomalies, corresponding to intervals where one or more of the data streams behaves anomalously. We first develop a test for a single collective anomaly…
Paper tackles class-incremental time series classification with dual-stream feature extraction.
problem Class-incremental continual learning for multivariate time series data.
method Dual-stream feature extraction pipeline combining deep temporal embedding features and statistical features.
result Competitive average accuracy across multiple datasets with low forgetting rates.
Deep Stacked Stochastic Configuration Networks for Lifelong Learning of Non-Stationary Data Streamscs.LG
The concept of SCN offers a fast framework with universal approximation guarantee for lifelong learning of non-stationary data streams. Its adaptive scope selection property enables for proper random generation of hidden unit parameters advancing conventional randomized approaches constrained with a fixed scope of rand…
Streaming Approach to Quadratic Covariation Estimation Using Financial Ultra-High-Frequency Dataq-fin.CP
A streaming algorithm estimates quadratic covariation from financial data efficiently.
problem Estimating quadratic covariation from ultra-high-frequency financial data with limited memory.
method Formulated multi-scale, realized kernel, pre-averaging, and modulated realized covariance estimators with fixed bandwidth.
result Fixed bandwidth estimators require higher bandwidth for positive semidefiniteness.
STVNN models spatiotemporal data using covariance matrices.
problem Challenges in modeling spatiotemporal interactions in multivariate time series.
method Introduces SpatioTemporal coVariance Neural Network (STVNN) that operates on sample covariance matrix and uses joint spatiotemporal convolutions.
result STVNN is stable to online estimation uncertainties and outperforms temporal PCA.
Proposes a multi-stream RNN model for predicting merchant transactions.
problem Predicting future transaction statistics of merchants.
method Multi-stream RNN model tailored for multivariate time series and multi-step predictions.
result Outperforms existing state-of-the-art methods in merchant transaction predictions.
Many events occur in the world. Some event types are stochastically excited or inhibited---in the sense of having their probabilities elevated or decreased---by patterns in the sequence of previous events. Discovering such patterns can help us predict which type of event will happen next and when. We model streams of d…
Online change detection algorithm using random Fourier features.
problem Online non-parametric change point detection in multivariate data streams.
method Sequential testing procedure based on random Fourier features.
result The algorithm has optimal detection delay in the minimax sense.
A Federated Data Fusion-Based Prognostic Model for Applications with Multi-Stream Incomplete Signalsstat.ML
A federated model predicts failures using multi-stream incomplete data.
problem Insufficient data for reliable prognostic models in multi-stream applications.
method Federated data fusion, multivariate functional principal component analysis, (log)-location-scale regression model, federated algorithm.
result Performance is as good as classic non-federated models and better than individual models.
Sequential or online dimensional reduction is of interests due to the explosion of streaming data based applications and the requirement of adaptive statistical modeling, in many emerging fields, such as the modeling of energy end-use profile. Principal Component Analysis (PCA), is the classical way of dimensional redu…
Proposes a model for predicting events from event streams.
problem Predicting events like part replacement and failure in manufacturing and teleservice systems.
method Non-parametric prognostic framework using MGCP modulated Poisson processes.
result MGCP prior facilitates sharing of information and analysis of flexible event patterns.
Estimating the dependency of variables is a fundamental task in data analysis. Identifying the relevant attributes in databases leads to better data understanding and also improves the performance of learning algorithms, both in terms of runtime and quality. In data streams, dependency monitoring provides key insights …
The paper monitors artificial neural networks using embeddings and multivariate control charts.
problem Ensuring the stability of artificial neural networks during deployment.
method Monitoring the latent feature representation (embedding) of ANN outputs using multivariate control charts based on data depth and ranks.
result The proposed method effectively detects nonstationary data streams in ANN outputs.
Develops a framework for inferring causal relationships in networked data with uncertainty quantification.
problem Extracting reliable inference from complex Hawkes network data with uncertainty.
method Statistical inference framework based on maximum likelihood estimation and concentration inequalities of continuous-time martingales.
result Provides a non-asymptotic confidence set for uncertainty quantification.
Graph representations offer powerful and intuitive ways to describe data in a multitude of application domains. Here, we consider stochastic processes generating graphs and propose a methodology for detecting changes in stationarity of such processes. The methodology is general and considers a process generating attrib…
Data stream classification methods demonstrate promising performance on a single data stream by exploring the cohesion in the data stream. However, multiple data streams that involve several correlated data streams are common in many practical scenarios, which can be viewed as multi-task data streams. Instead of handli…
The paper optimizes sensor selection for network time series data.
problem Optimizing sensor selection for network time series data with minimal error.
method Data-driven strategies to turn off sensors or select a sampling set of nodes.
result Proposes and compares various data-driven strategies for sensor selection.
Data stream clustering tackles real-time data processing challenges.
problem Real-time processing of data streams with less prior information.
method Review of data stream clustering algorithms and their characteristics.
result Comparison and analysis of data stream clustering algorithms.
BayOTIDE tackles imputation of irregularly sampled multivariate time series with uncertainty quantification.
problem Imputation of irregularly sampled multivariate time series with missing values and noises.
method BayOTIDE treats multivariate time series as a combination of low-rank temporal factors with different patterns, using Gaussian Processes (GPs) as functional priors and converting them into state-space priors for scalable online inference.
result BayOTIDE can handle imputation over arbitrary time stamps and offers uncertainty quantification and interpretability.
Bayesian tensor train method recovers streaming data with high accuracy.
problem Recovering high-order, incomplete, and noisy streaming data.
method Bayesian tensor train decomposition using streaming variational Bayes method.
result The proposed SPTT algorithm excels in recovering streaming data compared to state-of-the-art methods.
MAD-GAN: Multivariate Anomaly Detection for Time Series Data with Generative Adversarial Networkscs.LG
The prevalence of networked sensors and actuators in many real-world systems such as smart buildings, factories, power plants, and data centers generate substantial amounts of multivariate time series data for these systems. The rich sensor data can be continuously monitored for intrusion events through anomaly detecti…
New method detects changes in high-dimensional data from small samples.
problem Detecting changes in high-dimensional data with limited samples.
method Angular kernel scan framework for detecting marginal distributional shifts.
result Exact population mean factorization and asymptotically distribution-free test.
Nowadays, every device connected to the Internet generates an ever-growing stream of data (formally, unbounded). Machine Learning on unbounded data streams is a grand challenge due to its resource constraints. In fact, standard machine learning techniques are not able to deal with data whose statistics is subject to gr…
stream-learn is a Python package compatible with scikit-learn and developed for the drifting and imbalanced data stream analysis. Its main component is a stream generator, which allows to produce a synthetic data stream that may incorporate each of the three main concept drift types (i.e. sudden, gradual and incrementa…
While the volume of electronic health records (EHR) data continues to grow, it remains rare for hospital systems to capture dense physiological data streams, even in the data-rich intensive care unit setting. Instead, typical EHR records consist of sparse and irregularly observed multivariate time series, which are wel…
Dynamic Model Tree improves online learning for evolving data streams.
problem Effective and transparent machine learning on data streams is challenging.
method Revisit Model Trees for data stream applications, introducing Dynamic Model Tree.
result Dynamic Model Tree reduces the number of splits and outperforms state-of-the-art models.
Bayesian analysis of financial time series using R-INLA.
problem Analyzing interdependencies between stock volatility measures.
method Flexible level correlated model (LCM) with INLA approximation.
result Fast approximate Bayesian modeling of positive-valued time series.
Adapts DPMM for fast streaming data clustering.
problem Clustering streaming data with time-dependent statistics.
method Adapts DPMM and sampling-based inference for online clustering.
result Obtains state-of-the-art results in speed and accuracy.
CROC identifies the earliest-changing stream as the root cause in multi-stream data.
problem Distribution-free root cause analysis in multi-stream data with unknown distributional changes.
method Conformal p-values and finite-sample valid confidence sets.
result CROC efficiently isolates the root cause under minimal assumptions.
In machine learning, the one-class classification problem occurs when training instances are only available from one class. It has been observed that making use of this class's structure, or its different contexts, may improve one-class classifier performance. Although this observation has been demonstrated for static …
This research generates synthetic data streams for handling concept drifts and novel classes.
problem Handling concept drifts and novel classes in dynamic data streams.
method Synthetic data stream generation for both concept drifts and novel classes.
result Demonstrates the effectiveness of unsupervised drift detectors in open set recognition.
SDF adapts Deep Forest for evolving data streams with active learning.
problem Adapting Deep Forest for evolving data streams.
method Streaming Deep Forest (SDF) with Augmented Variable Uncertainty (AVU) active learning.
result SDF with AVU outperforms other methods trained with all instances by 70% labeling budget.
Paper improves Oja's algorithm for Markovian data streams.
problem Estimating the top eigenvector of a covariance matrix from Markovian data.
method Improves Oja's algorithm for streaming PCA with Markovian dependence.
result First sharp rate for Oja's algorithm on entire data stream, removing sample size dependence.
We introduce a new sub-linear space sketch---the Weight-Median Sketch---for learning compressed linear classifiers over data streams while supporting the efficient recovery of large-magnitude weights in the model. This enables memory-limited execution of several statistical analyses over streams, including online featu…
Paper proposes a method to estimate coverage in data streams.
problem Estimating coverage in data streams with limited storage.
method Modified CVM algorithm for estimating coverage in streaming settings.
result The method efficiently estimates coverage in data streams.
A privacy-preserving framework detects faults in circular economy processes.
problem Lack of shared data across company borders due to privacy concerns.
method Federated Principal Component Analysis (PCA) and Secure Multiparty Computation.
result The proposed FedMSPC framework outperforms standard PCA in fault detection.
A method detects changes in heterogeneous data streams over graph nodes.
problem Detecting changes in data streams from nodes of a graph.
method Online non-parametric method using likelihood-ratio estimation.
result The method accurately identifies change-points in real-world applications.
A new method for estimating SW from streaming data.
problem Estimating Wasserstein distance from sample streams.
method Introducing a streaming estimator of the 1DW and applying it to all projections.
result Stream-SW achieves more accurate approximation of SW than random subsampling.
CURIE uses cellular automata to detect concept drift in data streams.
problem Detecting changes in data distribution (concept drift) in data streams.
method CURIE represents data stream distribution in a cellular automata grid and uses its neighborhood rule to detect changes.
result CURIE, when hybridized with base learners, performs competitively in detection metrics and classification accuracy.
Differentially private ensemble classifiers adapt to data streams while protecting privacy.
problem Adapting to evolving data characteristics while protecting private information.
method Unbounded ensemble updates, model agnostic approach.
result Outperforms competitors on various privacy, drift, and distribution settings.
Visual analytics tool detects and corrects concept drift in data streams.
problem Concept drift causes inaccurate predictions in evolving data.
method DriftVis combines drift detection and visualization.
result Visual analytics supports detection, examination, and correction of concept drift.
Enhash detects concept drift in data streams quickly and efficiently.
problem Detecting abrupt, gradual, virtual, or recurring events in data streams.
method Uses projection hash to insert incoming samples and detects concept drift.
result Enhash has competitive performance and moderate resource requirements compared to existing ensemble learners.