GraphSAIL updates GNN-based recommender models incrementally to reduce computation time and improve frequent updates.
problem Incremental updates in GNN-based recommender systems are computationally expensive and prone to forgetting.
method GraphSAIL uses a graph structure preservation strategy to update GNN models incrementally, preserving long-term preferences and properties.
result GraphSAIL reduces computation time and improves frequent updates compared to other incremental learning techniques.
PrIU optimizes machine learning model updates after data cleaning.
problem Incrementally updating machine learning models after removing problematic training samples.
method Provenance-based approach for efficient model parameter updates.
result PrIU-opt achieves up to two orders of magnitude speed-up compared to retraining from scratch.
OpenHAIV integrates OOD detection and incremental learning for open-world models.
problem Challenges in open-world recognition, especially in model knowledge updates and OOD detection.
method Unified pipeline combining OOD detection, new class discovery, and incremental fine-tuning.
result Models can autonomously acquire and update knowledge in open-world environments.
SaMbaTen efficiently maintains tensor decompositions for growing datasets.
problem Maintaining tensor decompositions for dynamic, growing datasets.
method Sampling-based batch incremental tensor decomposition algorithm.
result SaMbaTen achieves comparable accuracy to state-of-the-art techniques but is significantly faster and scalable.
DID solves NMF for large distributed data.
problem Large distributed nonnegative matrix factorization.
method Distributed incremental block coordinate descent.
result Only one communication step per iteration.
Algorithm estimates bounds of updated classifier coefficients efficiently.
problem Determining sensitivity of updated classifiers without retraining.
method Proposes an algorithm to estimate upper and lower bounds of updated classifier coefficients.
result Estimates bounds with low computational complexity and tightness.
GROUSE (Grassmannian Rank-One Update Subspace Estimation) is an incremental algorithm for identifying a subspace of Rn from a sequence of vectors in this subspace, where only a subset of components of each vector is revealed at each iteration. Recent analysis has shown that GROUSE converges locally at an expected linea…
Efficient algorithm removes redundant nodes and obsolete samples in machine learning.
problem Pruning redundant nodes and removing obsolete training samples in machine learning.
method Deduced decremented learning algorithms from incremental learning algorithms, using inverse Cholesterol factor and unitary transformation.
result Proposed decremented learning algorithms efficiently prune redundant nodes and remove obsolete training samples.
Proposes a probabilistic optimization method for large-scale problems.
problem Large-scale regularized optimization problems.
method Develops a probabilistic interpretation of the incremental proximal gradient algorithm and uses Bayesian filtering.
result Makes it possible to solve large-scale problems using well-known Bayesian filters.
CILF learns adaptive embeddings for class-incremental learning with novel class detection and model update.
problem Handling unknown classes and model update in streaming data with new classes.
method CILF uses decoupled prototype based loss for intra-class and inter-class structure improvement, and a learnable curriculum clustering operator for adaptive embedding.
result CILF effectively detects multiple novel classes and mitigates embedding confusion, while updating the model without catastrophic forgetting.
A new model learns preferences incrementally without personal data.
problem Incremental session-based recommendation without personal data.
method Memory Augmented Neural model (MAN) that combines a neural recommender with a nonparametric memory.
result MAN consistently outperforms existing methods in incremental session-based recommendation.
DoubleAdapt improves stock trend forecasting by adapting models to evolving data.
problem Incremental learning for stock trend forecasting is challenging due to distribution shifts.
method DoubleAdapt framework with two adapters for data and model adaptation.
result DoubleAdapt achieves state-of-the-art predictive performance on real-world stock datasets.
We introduce a novel sensitivity analysis framework for large scale classification problems that can be used when a small number of instances are incrementally added or removed. For quickly updating the classifier in such a situation, incremental learning algorithms have been intensively studied in the literature. Alth…
The paper connects a proximal method to stochastic filters and Bayes updates.
problem Large-scale optimization and probabilistic methods for regression.
method Explicit form of Bayes updates for linear regression and general sequential setting.
result The incremental proximal method can be realized by the Kalman filter for linear-quadratic cost functions.
Paper develops efficient methods for covariance updates and belief space planning.
problem Efficiently updating covariance and evaluating belief space planning in high-dimensional state spaces.
method Novel incremental covariance update technique and factor-graph action tree approach.
result State-of-the-art methods for covariance updates and belief space planning are improved.
Novel spam filter improves e-mail classification accuracy.
problem Uneven class distribution, unequal error cost, frequent content change, personalized discrimination.
method TFDCR feature selection, incremental learning, dynamic feature update.
result TFDCR outperforms in feature selection, incremental model improves classification accuracy.
Develops an efficient method for real-time data analysis and visualization.
problem Challenges of analyzing high-dimensional data.
method Incremental non-linear manifold approximation using GMRA framework.
result Accurately represents non-linear manifolds with small initial samples.
Lambda Learner improves model freshness in data streams.
problem Balancing model freshness and computational costs in data streams.
method Incremental updates in response to mini-batches from data streams.
result Lambda Learner outperforms offline models in time-sensitive updates.
A new method for efficiently updating large-scale matrices in real-time.
problem Updating large-scale matrices with evolving data in real-time.
method Incremental SVD approach that handles row/column appends, rank-1 updates, and refresh strategies.
result Incremental SVD achieves accuracy close to full SVD with a fraction of the computational cost.
A new algorithm for faster incremental kernel PCA and Nyström approximation.
problem Efficiency in handling streaming data and large datasets.
method Incremental kernel PCA and Nyström approximation using rank one updates.
result More computationally and memory efficient than existing methods.
A new method for machine learning updates reduces complexity and improves robustness.
problem Stochastic gradient updates are inefficient and sensitive to feature scaling.
method Incremental Gauss-Newton Descent (IGND) reduces the need for matrix operations and improves robustness.
result IGND improves robustness to sensitivity scaling and can be competitive with common stochastic optimizers.
Efficiently updates beliefs with virtual observations.
problem Incremental belief updates in Bayesian models.
method Constructs weighted virtual observations to match posterior.
result Reconstructed posterior matches original posterior closely.
In recent years, dynamically growing data and incrementally growing number of classes pose new challenges to large-scale data classification research. Most traditional methods struggle to balance the precision and computational burden when data and its number of classes increased. However, some methods are with weak pr…
Meta-learning approach prevents forgetting across tasks.
problem Catastrophic forgetting in deep neural networks.
method Incremental Task-Agnostic Meta-learning (iTAML) with a meta-update rule.
result Significant improvements in class-incremental learning tasks.
Stochastic Gradient Trees learn decision trees incrementally.
problem Learning decision trees using stochastic gradient information.
method Incremental learning setting, soft splits not used, new tree not constructed per update.
result Performs similarly to standard incremental classification trees, outperforms state of the art incremental regression trees, comparable to batch multi-instance learning methods.
As we enter into the big data age and an avalanche of images have become readily available, recognition systems face the need to move from close, lab settings where the number of classes and training data are fixed, to dynamic scenarios where the number of categories to be recognized grows continuously over time, as we…
This work presents GROUSE (Grassmanian Rank-One Update Subspace Estimation), an efficient online algorithm for tracking subspaces from highly incomplete observations. GROUSE requires only basic linear algebraic manipulations at each iteration, and each subspace update can be performed in linear time in the dimension of…
Develops local population-risk certificates for model updates
problem Model updates in machine learning
method Certify population-risk increments around a model
result Certified upper endpoint yields a risk-controlled update rule
Two-Timescale EM Methods improve EM for nonconvex models.
problem Nonconvex latent variable models are challenging for EM.
method Two-stage stochastic updates to handle nonconvex optimization.
result Global convergence for nonconvex objective functions.
Adaptive XGBoost improves accuracy on evolving data streams by updating the ensemble dynamically.
problem Concept drift in evolving data streams.
method Adapts XGB to update the ensemble with new data, maintaining consistency with current concept.
result Improves classification accuracy on evolving data streams compared to other methods.
BI-MAML learns multiple tasks without forgetting old ones.
problem Catastrophic forgetting in meta learning.
method Incremental model adaptation with balanced learning strategy.
result BI-MAML outperforms state-of-the-art models in accuracy and efficiency.
Improved incremental sequence classification with temporal consistency.
problem Updating predictions as new sequence elements are revealed.
method Temporal-difference learning and a temporal-consistency condition for successive predictions.
result Optimizing a novel loss function improves data efficiency and predictive accuracy.
Incremental clustering approaches have been proposed for handling large data when given data set is too large to be stored. The key idea of these approaches is to find representatives to represent each cluster in each data chunk and final data analysis is carried out based on those identified representatives from all t…
A new method for asynchronous eigenspace computation on the Grassmannian.
problem Asynchronous optimization for finite-sum eigenspace computation in distributed systems.
method Grassmannian incremental aggregation method that refreshes only arriving components and reuses cached gradients.
result Two-phase linear convergence with constants controlled by component spectral spreads.
FISHDBC clusters arbitrary data with flexible, scalable, and hierarchical features.
problem Clustering arbitrary data with arbitrary distance functions efficiently.
method Flexible, incremental, scalable, hierarchical density-based clustering algorithm.
result Flexible clustering of arbitrary data without feature extraction.
Method tackles catastrophic forgetting in CNNs for remote sensing data.
problem Catastrophic forgetting in CNNs when adding new classes without old class annotations.
method Incremental learning approach using a frozen network as memory and a loss function balancing new and old classes.
result Performance for old classes maintained while adding new classes, without old class annotations.
Paper describes an on-line PCA algorithm for real-time data analysis.
problem Continuity of principal components during real-time analysis.
method Incremental PCA algorithm that updates coefficients on-line without keeping all samples.
result Algorithm maintains the same transformation coefficients as the batch version.
Efficiently processes dynamic inputs in AI writing assistants with incremental computation.
problem Efficiently updating AI models in real-time with dynamic inputs.
method Incremental computing using vector quantization to filter and reuse intermediate values in neural networks.
result Comparable accuracy with 12.1X fewer operations for processing dynamic inputs.
Accelerates optimization in asynchronous systems with sparse updates.
problem Optimizing finite-sum objectives in asynchronous lock-free environments.
method New accelerated SVRG variant with sparse updates.
result Achieves optimal incremental gradient complexity.
Optimal Volt/VAR control rules are designed using deep neural networks.
problem Designing optimal Volt/VAR control rules for distributed energy resources (DERs).
method Formulate optimal rule design as a bilevel program, then reformulate it as training a deep neural network (DNN). Use proximal gradient descent (PGD) iterations to emulate Volt/VAR dynamics.
result The proposed solution can be adapted to single/multi-phase feeders and achieves enhanced steady-state voltage profiles.
This study presents an efficient incremental/decremental approach for big streams based on Kernel Ridge Regression (KRR), a frequently used data analysis in cloud centers. To avoid reanalyzing the whole dataset whenever sensors receive new training data, typical incremental KRR used a single-instance mechanism for upda…
This paper analyzes and improves EM algorithms for large datasets.
problem Scaling EM algorithm to large datasets.
method Incremental and stochastic EM algorithms, variance reduction.
result Established non-asymptotic convergence bounds for global convergence.
An incremental/online state dynamic learning method is proposed for identification of the nonlinear Gaussian state space models. The method embeds the stochastic variational sparse Gaussian process as the probabilistic state dynamic model inside a particle filter framework. Model updating is done at measurement sample …
Paper proposes mnemonics framework for MCIL without forgetting.
problem Learning new concepts without forgetting previous ones in MCIL.
method Automatic framework using bilevel optimizations for parameterizing and optimizing exemplars.
result Mnemonics exemplars surpass state-of-the-art performance.
SAIF efficiently selects features for sparse learning problems.
problem Efficiently selecting features in high-dimensional sparse learning problems.
method Incremental feature selection starting from a small set of features, with convergence guarantees.
result SAIF achieves superior or comparable efficiency and high scalability with a safe convergence guarantee.
Bayesian method improves deep neural network performance with incremental learning.
problem Deep neural networks struggle with suboptimal solutions when trained on new data alone.
method Bayesian approach to update model with each new data part.
result Bayesian method outperforms traditional approach in experiments.
Efficiently adds or deletes data in GBDT models.
problem Traditional GBDT training requires all data to be accessed simultaneously, limiting add/delete operations.
method Proposes an online learning framework for GBDT supporting incremental and decremental learning.
result First work to unify incremental and decremental learning on GBDT in-place.
An online framework improves investment management by making incremental updates.
problem Offline investment processes restrict silos from collectively pursuing a unified goal.
method Developed an online algorithm workflow for portfolio management.
result The online framework outperforms market benchmarks and reduces overfitting.