Depth helps neural networks learn simpler solutions incrementally.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
EILearn learns incrementally using previous classifier knowledge.
A new generative classification strategy outperforms existing methods in class-incremental learning.
Data is continuously generated by modern data sources, and a recent challenge in machine learning has been to develop techniques that perform well in an incremental (streaming) setting. In this paper, we investigate the problem of private machine learning, where as common in practice, the data is not given at once, but…
Incremental versions of batch algorithms are often desired, for increased time efficiency in the streaming data setting, or increased memory efficiency in general. In this paper we present a novel algorithm for incremental kernel PCA, based on rank one updates to the eigendecomposition of the kernel matrix, which is mo…
The condition for stationary increments, not scaling, detemines long time pair autocorrelations. An incorrect assumption of stationary increments generates spurious stylized facts, fat tails and a Hurst exponent H_s=1/2, when the increments are nonstationary, as they are in FX markets. The nonstationarity arises from s…
A new model learns preferences incrementally without personal data.
The generalized correlation approach, which has been successfully used in statistical radio physics to describe non-Gaussian random processes, is proposed to describe stochastic financial processes. The generalized correlation approach has been used to describe a non-Gaussian random walk with independent, identically d…
We introduce incremental variational inference and apply it to latent Dirichlet allocation (LDA). Incremental variational inference is inspired by incremental EM and provides an alternative to stochastic variational inference. Incremental LDA can process massive document collections, does not require to set a learning …
Paper improves convergence rates and step sizes for gradient algorithms.
This paper introduces Dex, a reinforcement learning environment toolkit specialized for training and evaluation of continual learning methods as well as general reinforcement learning problems. We also present the novel continual learning method of incremental learning, where a challenging environment is solved using o…
Improved incremental sequence classification with temporal consistency.
Incremental clustering approaches have been proposed for handling large data when given data set is too large to be stored. The key idea of these approaches is to find representatives to represent each cluster in each data chunk and final data analysis is carried out based on those identified representatives from all t…
GD learns matrix solutions incrementally, revealing insights into generalization.
New algorithm improves on EM for streaming data, outperforming existing methods.
The paper extends cluster validity indices for incremental analysis.
Paper proposes faster incremental subclass discriminant analysis.
Time and Sales of corn futures traded electronically on the CME Group Globex are studied. Theories of continuous prices turn upside down reality of intra-day trading. Prices and their increments are discrete and obey lattice probability distributions. A function for systematic evolution of futures trading volume is pro…
Efficiently samples sequences without replacement for machine learning models.
Mirror flows converge to a limiting flow with a convex potential.
Paper tackles class-incremental time series classification with dual-stream feature extraction.
Paper tackles few-shot class-incremental learning with a neural gas network.
The paper addresses intervention effects in longitudinal studies with dropout and many timepoints.
Autoencoder reduces memory overhead in incremental class learning.
Study finds Bitcoin volatility exhibits roughness, not constant over time.
The method of cointegration in regression analysis is based on an assumption of stationary increments. Stationary increments with fixed time lag are called integration I(d). A class of regression models where cointegration works was identified by Granger and yields the ergodic behavior required for equilibrium expectat…
CNAS optimizes neural architectures for class-incremental learning.
Meta-learning approach prevents forgetting across tasks.
Paper proposes CNE-net to tackle incremental learning in (T)ACSA tasks.
This paper introduces Deep Incremental Boosting, a new technique derived from AdaBoost, specifically adapted to work with Deep Learning methods, that reduces the required training time and improves generalisation. We draw inspiration from Transfer of Learning approaches to reduce the start-up time to training each incr…
Generative replay improves continual learning by using generated data as negative examples.
GraphSAIL updates GNN-based recommender models incrementally to reduce computation time and improve frequent updates.
This paper presents a novel approach for incremental semiparametric inverse dynamics learning. In particular, we consider the mixture of two approaches: Parametric modeling based on rigid body dynamics equations and nonparametric modeling based on incremental kernel methods, with no prior information on the mechanical …
Incremental ELMVIS learns from large, unorganized datasets.
Cross-validation (CV) is one of the main tools for performance estimation and parameter tuning in machine learning. The general recipe for computing CV estimate is to run a learning algorithm separately for each CV fold, a computationally expensive process. In this paper, we propose a new approach to reduce the computa…
We analyze the question whether sliding window time averages applied to stationary increment processes converge to a limit in probability. The question centers on averages, correlations, and densities constructed via time averages of the increment x(t,T)=x(t+T)-x(t)and the assumption is that the increment is distribute…
PEC improves class-incremental learning by measuring prediction error.
Proposes MEDIC to improve incremental learning by preventing forgetting and intransigence.
Stochastic Gradient Trees learn decision trees incrementally.
iCVI-ARTMAP accelerates clustering with adaptive resonance theory and validity indices.
It was recently shown that architectural, regularization and rehearsal strategies can be used to train deep models sequentially on a number of disjoint tasks without forgetting previously acquired knowledge. However, these strategies are still unsatisfactory if the tasks are not disjoint but constitute a single increme…
Tensor decompositions are invaluable tools in analyzing multimodal datasets. In many real-world scenarios, such datasets are far from being static, to the contrary they tend to grow over time. For instance, in an online social network setting, as we observe new interactions over time, our dataset gets updated in its "t…
The statistical properties of the increments x(t+T) - x(t) of a financial time series depend on the time resolution T on which the increments are considered. A non-parametric approach is used to study the scale dependence of the empirical distribution of the price increments x(t+T) - x(t) of S&P Index futures, for time…
PEAKS selects key training examples incrementally based on prediction error and kernel similarity.
For classification of the high frequency trading quantities, waiting times, price increments within and between sessions are referred to as the a-, b-, and c-increments. Statistics of the a-b-c-increments are computed for the Time & Sales records posted by the Chicago Mercantile Exchange Group for the futures traded on…
We present a simple and general result that the sign of the variations or increments of uncorrelated times series are predictable with a remarkably high success probability of 75% for symmetric sign distributions. The origin of this paradoxical result is explained in details. We also present some tests on synthetic, fi…
Knowledge graph construction consists of two tasks: extracting information from external resources (knowledge population) and inferring missing information through a statistical analysis on the extracted information (knowledge completion). In many cases, insufficient external resources in the knowledge population hinde…
Paper improves privacy-preserving measurement of advertising incrementality.