New method for clustering and optimization handles evolving datasets efficiently.
problem Clustering and optimization for evolving datasets.
method Proposed a new variant of ADMM to solve SCO efficiently.
result Theoretical guarantee of model accuracy for ridge regression and convex clustering.
Wittgenstein's Rule Following evolves datasets by extrapolating structural descriptors.
problem Generating meaningful continuations of evolving datasets.
method Wittgenstein's Rule Following (WRF) uses structural descriptors to extrapolate trajectories and average historical descriptors.
result WRF can generate meaningful continuations of evolving datasets.
This paper introduces a novel technique to track structures in time evolving graphs. The method is based on a parameter free approach for three-dimensional co-clustering of the source vertices, the target vertices and the time. All these features are simultaneously segmented in order to build time segments and clusters…
dCMF models evolving patterns in multiway data with temporal dynamics.
problem Capturing evolving patterns in multiway datasets with temporal dependencies.
method Time-aware coupled factorization model constrained by LDS structure.
result dCMF outperforms alternatives in capturing complex dynamics.
EvoMSN tackles time series forecasting under distribution shifts by evolving multi-scale normalization.
problem Accurate long-term time series forecasting under complex distribution shifts.
method EvoMSN framework with multi-scale statistics prediction and adaptive ensembling for collaborative updating.
result Improves forecasting performance of five mainstream methods on benchmark datasets.
New method for learning evolving tasks with performance guarantees.
problem Learning tasks in a sequence with evolving similarity.
method Adaptable learning methodology with performance guarantees.
result Improved performance in multiple scenarios with reliable guarantees.
Enhances graph classification models on small datasets.
problem Over-fitting and undergeneralization on small-scale benchmark datasets.
method Data augmentation via graph structure transformation and model evolution framework.
result Average improvement of 3 - 13% accuracy on graph classification tasks.
EggNet reconstructs particle tracks from hits using evolving graph attention networks.
problem Particle track reconstruction is computationally expensive and combinatorial.
method EggNet uses a one-shot object condensation approach with evolving graph attention networks.
result EggNet outperforms methods requiring fixed input graphs on TrackML dataset.
Improved detection of burnt areas in satellite images using evolved hyper-features.
problem Radiometric variations across satellite images and different datasets.
method Understanding feature spaces, training on multi-image datasets, evolving hyper-features, and optimizing for different classifiers.
result Training on multi-image datasets improves model generalization, and evolved hyper-features enhance classifier performance.
How can we effectively encode evolving information over dynamic graphs into low-dimensional representations? In this paper, we propose DyRep, an inductive deep representation learning framework that learns a set of functions to efficiently produce low-dimensional node embeddings that evolves over time. The learned embe…
Unified approach detects anomalies in evolving categorical data at multiple scales.
problem Anomaly detection in high-dimensional, time-evolving categorical data without labeled samples.
method Combines Adversarial Autoencoder and Recurrent Neural Network for cross-scale learning and anomaly detection.
result Enhanced two-resolution anomaly detector outperforms state-of-the-art methods.
Study examines AutoML adaptation to evolving data.
problem Understanding and improving AutoML performance with concept drift.
method 6 concept drift adaptation strategies evaluated on various AutoML approaches.
result Robust AutoML techniques can be developed to handle concept drift.
SYNC learns time-aware causal representations to improve model generalization in evolving domains.
problem Spurious correlations and shortcut learning in existing EDG methods hinder model generalization.
method SYNC integrates dynamic causal factors and causal mechanism drifts into a sequential VAE framework.
result SYNC achieves superior temporal generalization performance on synthetic and real-world datasets.
A framework for clustering evolving high-dimensional data using LSTM networks.
problem Clustering evolving high-dimensional data with temporal evolution patterns.
method LSTM-ESCM framework exploiting self-expressive trait and LSTM networks.
result The proposed algorithm outperforms other methods in terms of run time and accuracy.
Generative adversarial networks generate realistic, time-evolving high-resolution atmospheric fields.
problem Improving spatial resolution of low-resolution atmospheric images.
method Recurrent, stochastic super-resolution GAN for generating ensembles of time-evolving high-resolution atmospheric fields.
result The GAN produces realistic, temporally consistent super-resolution sequences for radar-measured precipitation and cloud optical thickness.
New bandit algorithms adapt to evolving user interests influenced by social circles.
problem Adapting to evolving user interests in recommendation systems.
method Online recommendation algorithms tailored for social influence, based on LinREL and Thompson Sampling.
result Our adaptations maintain asymptotic regret bounds similar to non-social cases.
A new method constrains PARAFAC2 for better pattern recovery.
problem Challenges in analyzing multi-way measurements with variations across one mode.
method AO-ADMM approach to fit PARAFAC2 model with flexible constraints.
result The proposed method allows for flexible constraints, recovers patterns accurately, and is computationally efficient.
Tensor decompositions are invaluable tools in analyzing multimodal datasets. In many real-world scenarios, such datasets are far from being static, to the contrary they tend to grow over time. For instance, in an online social network setting, as we observe new interactions over time, our dataset gets updated in its "t…
EML model tackles evolving features in online metric learning.
problem Challenges in applying metric learning to evolving features.
method Develops a new Evolving Metric Learning (EML) model for incremental and decremental features.
result EML model handles instance and feature evolutions simultaneously.
Modeling how individuals evolve over time is a fundamental problem in the natural and social sciences. However, existing datasets are often cross-sectional with each individual observed only once, making it impossible to apply traditional time-series methods. Motivated by the study of human aging, we present an interpr…
An adaptive clustering algorithm learns from evolving data without manual tuning.
problem Clustering in dynamic data environments where distributions change over time.
method ART-based topological clustering with self-adjusting vigilance parameter.
result The algorithm outperforms state-of-the-art methods in clustering performance and continual learning.
SDF adapts Deep Forest for evolving data streams with active learning.
problem Adapting Deep Forest for evolving data streams.
method Streaming Deep Forest (SDF) with Augmented Variable Uncertainty (AVU) active learning.
result SDF with AVU outperforms other methods trained with all instances by 70% labeling budget.
SGRNN models evolving graph data for better property prediction.
problem Modeling evolving graph data for property prediction.
method SGRNN uses stochastic latent variables to capture both node attribute and topology evolution, with semi-implicit variational inference and KL-divergence simplification.
result SGRNN improves property prediction on real-world datasets.
ECGs improve GNNs for non-homophilic data.
problem Improving GNNs for datasets where nodes are not likely to belong to the same class.
method ECGs rewire GNNs' computation graph to connect nodes likely in the same class using weaker classifiers.
result ECGs improve GNN performance on non-homophilic datasets.
We present the collaborative Kalman filter (CKF), a dynamic model for collaborative filtering and related factorization models. Using the matrix factorization approach to collaborative filtering, the CKF accounts for time evolution by modeling each low-dimensional latent embedding as a multidimensional Brownian motion.…
Estimates change-points and graph structures in a time-varying Ising model.
problem Detecting and understanding changes in a time-varying Ising model.
method Maximizing a penalized conditional log-likelihood to estimate neighborhood of each node, enforcing sparsity and piece-wise constant graph structures.
result First change-points consistency theorems for unknown number of change-points in time-varying Ising model.
Click-through rate~(CTR) prediction, whose goal is to estimate the probability of the user clicks, has become one of the core tasks in advertising systems. For CTR prediction model, it is necessary to capture the latent user interest behind the user behavior data. Besides, considering the changing of the external envir…
TGAT learns node embeddings for evolving graphs, capturing both static and temporal features.
problem Learning node embeddings for dynamic graphs with evolving topological structures and temporal patterns.
method Temporal Graph Attention (TGAT) layer using self-attention and functional time encoding.
result TGAT model can inductively infer node embeddings for new and observed nodes as the graph evolves.
A new learning scheme improves model efficiency and performance.
problem Characterizing correlation between batch-level and global data distributions.
method Epoch-evolving Gaussian Process Guided Learning (GPGL) scheme with context labels and triangle consistency loss.
result Significantly outperforms existing models on mainstream datasets.
Understanding how neural networks learn remains one of the central challenges in machine learning research. From random at the start of training, the weights of a neural network evolve in such a way as to be able to perform a variety of tasks, like classifying images. Here we study the emergence of structure in the wei…
This paper demonstrates the use of genetic algorithms for evolving: 1) a grandmaster-level evaluation function, and 2) a search mechanism for a chess program, the parameter values of which are initialized randomly. The evaluation function of the program is evolved by learning from databases of (human) grandmaster games…
Proves upper bounds for heat kernels evolving on manifolds.
problem Bounding heat kernels on evolving manifolds.
method Logarithmic Sobolev inequalities and ultracontractivity estimates.
result Gaussian upper bounds for heat kernels are derived.
DISCO predicts system states from short trajectories using an evolved operator.
problem Predicting next states of dynamical systems governed by unknown PDEs.
method DISCO uses a hypernetwork to generate parameters of a smaller operator network for state prediction.
result DISCO achieves state-of-the-art performance with fewer training epochs and generalizes well.
Establishes Calderón-Zygmund inequalities on evolving Riemannian manifolds.
problem Calderón-Zygmund inequalities on evolving Riemannian manifolds.
method Establishes various Calderón-Zygmund inequalities on evolving Riemannian manifolds with bounded curvature.
result Provides concrete applications of established inequalities.
FactorMiner discovers financial alpha factors with low redundancy.
problem Finding novel financial alpha factors in a vast search space.
method Modular Skill Architecture and Experience Memory to distill and guide exploration.
result FactorMiner constructs a diverse library of high-quality factors with competitive performance.
Word evolution refers to the changing meanings and associations of words throughout time, as a byproduct of human language evolution. By studying word evolution, we can infer social trends and language constructs over different periods of human history. However, traditional techniques such as word representation learni…
Proposes tPARAFAC2 for tracking evolving patterns in time-evolving data.
problem Lack of temporal regularization in tensor factorizations for capturing evolving patterns.
method Temporal PARAFAC2 (tPARAFAC2) with temporal regularization.
result tPARAFAC2 accurately captures evolving patterns better than existing methods.
Temporal networks are ubiquitous and evolve over time by the addition, deletion, and changing of links, nodes, and attributes. Although many relational datasets contain temporal information, the majority of existing techniques in relational learning focus on static snapshots and ignore the temporal dynamics. We propose…
Graphs evolve; GNNs learn from past tasks.
problem Learning from evolving graphs and new classes.
method Incremental training method for lifelong learning on graphs.
result Less than 50% of the GNN's receptive field is needed for 95% accuracy.
Network representation learning in low dimensional vector space has attracted considerable attention in both academic and industrial domains. Most real-world networks are dynamic with addition/deletion of nodes and edges. The existing graph embedding methods are designed for static networks and they cannot capture evol…
Dynamic networks are a general language for describing time-evolving complex systems, and discrete time network models provide an emerging statistical technique for various applications. It is a fundamental research question to detect the community structure in time-evolving networks. However, due to significant comput…
Dyn-VGAE learns evolving network structures.
problem Learning dynamic network representations.
method Dynamic joint Variational Graph Autoencoders (Dyn-VGAE).
result Dyn-VGAE captures temporal evolution in dynamic networks.
A new neural model evolves to learn at the synaptic level.
problem Lack of biologically realistic neural models in deep learning.
method Evolve individual neuron and synaptic models using ENUs.
result Evolved neural network learns complex tasks like a T-maze.
This paper demonstrates the use of genetic algorithms for evolving a grandmaster-level evaluation function for a chess program. This is achieved by combining supervised and unsupervised learning. In the supervised learning phase the organisms are evolved to mimic the behavior of human grandmasters, and in the unsupervi…
The paper proposes a Gaussian mixture model for Hilbert-space-valued data.
problem Challenges in characterizing probability measures for infinite-dimensional random objects.
method Gaussian mixture framework based on kernel mean embeddings.
result The proposed algorithm yields a dense class of approximations in infinite-dimensional spaces.
While variational dropout approaches have been shown to be effective for network sparsification, they are still suboptimal in the sense that they set the dropout rate for each neuron without consideration of the input data. With such input-independent dropout, each neuron is evolved to be generic across inputs, which m…
New method detects anomalies in computing centers' logs.
problem Anomaly detection in continuously changing log data for predictive maintenance.
method Evolving granular classifiers using Fuzzy-set-Based evolving Modeling and evolving Granular Neural Network.
result Classification model prioritizes maintenance based on anomaly severity.
CoMGNN models heterogeneous graphs with evolving nodes and edges.
problem Modeling complex, evolving graphs with diverse information.
method Meta graph attention on co-evolving heterogeneous graphs.
result Significant improvement over state-of-the-art methods.