New Polish word embeddings improve temporal expression recognition.
problem Recognizing temporal expressions in Polish text.
method Created KGR10 corpus, used BiLSTM-CRF model with custom embeddings.
result Custom embeddings enhance BiLSTM-CRF model's performance.
Next-generation sequencing (NGS) to profile temporal changes in living systems is gaining more attention for deriving better insights into the underlying biological mechanisms compared to traditional static sequencing experiments. Nonetheless, the majority of existing statistical tools for analyzing NGS data lack the c…
Universal learning machine is a theory trying to study machine learning from mathematical point of view. The outside world is reflected inside an universal learning machine according to pattern of incoming data. This is subjective pattern of learning machine. In [2,4], we discussed subjective spatial pattern, and estab…
Quantitative modeling of post-transcriptional regulation process is a challenging problem in systems biology. A mechanical model of the regulatory process needs to be able to describe the available spatio-temporal protein concentration and mRNA expression data and recover the continuous spatio-temporal fields. Rigorous…
Develops a learning algorithm for PSL formulas from examples.
problem Learning human-interpretable descriptions of complex systems from examples.
method Reduces learning to propositional logic constraint satisfaction and uses SAT solver.
result Proposed method provides succinct human-interpretable descriptions from examples.
A framework for clustering evolving high-dimensional data using LSTM networks.
problem Clustering evolving high-dimensional data with temporal evolution patterns.
method LSTM-ESCM framework exploiting self-expressive trait and LSTM networks.
result The proposed algorithm outperforms other methods in terms of run time and accuracy.
We consider the general problem of modeling temporal data with long-range dependencies, wherein new observations are fully or partially predictable based on temporally-distant, past observations. A sufficiently powerful temporal model should separate predictable elements of the sequence from unpredictable elements, exp…
Proposes a time-aware attention model for CTR prediction.
problem Lack of temporal signals in existing CTR prediction models.
method Time-aware attention model with absolute and relative temporal signals, regularized adversarial sampling.
result Significantly improves CTR prediction performance.
It is a known fact that training recurrent neural networks for tasks that have long term dependencies is challenging. One of the main reasons is the vanishing or exploding gradient problem, which prevents gradient information from propagating to early layers. In this paper we propose a simple recurrent architecture, th…
New model for temporal KG completion using diachronic entity embeddings.
problem Temporal knowledge graph completion for incomplete KGs.
method Developed novel models by equipping static KG embedding models with a diachronic entity embedding function.
result Combining diachronic entity embeddings with SimplE results in superior temporal KG completion.
Advances in deep learning for spatio-temporal event modeling.
problem Limitations of traditional parametric models in capturing nonstationary dynamics.
method Integration of deep neural architectures to model conditional intensity function and influence kernels.
result Deep influence kernel approach enhances expressiveness and statistical explainability.
Estimation of facial expressions, as spatio-temporal processes, can take advantage of kernel methods if one considers facial landmark positions and their motion in 3D space. We applied support vector classification with kernels derived from dynamic time-warping similarity measures. We achieved over 99% accuracy - measu…
Convolutional architectures have recently been shown to be competitive on many sequence modelling tasks when compared to the de-facto standard of recurrent neural networks (RNNs), while providing computational and modeling advantages due to inherent parallelism. However, currently there remains a performance gap to mor…
This paper studies mutual information in sequence models and finds Transformers excel in capturing long-range dependencies.
problem Understanding the expressive power of sequence models in capturing temporal dependencies.
method Theoretical and empirical analysis of linear and nonlinear RNNs, including Transformers.
result Transformers can capture long-range mutual information more efficiently than RNNs.
DDP models dynamic comorbidity networks from event data.
problem Understanding complex temporal patterns of co-occurring diseases.
method Developed deep diffusion processes (DDP) to model dynamic comorbidity networks.
result DDP enables accurate risk prediction and interpretable disease trajectories.
Due to the dynamic nature of biological systems, biological networks underlying temporal process such as the development of {\it Drosophila melanogaster} can exhibit significant topological changes to facilitate dynamic regulatory functions. Thus it is essential to develop methodologies that capture the temporal evolut…
A new method detects financial fraud using graph transformers.
problem Detecting fraudulent transactions in financial data.
method Spatial-Temporal-Aware Graph Transformer (STA-GT) integrating GNNs and transformers.
result STA-GT outperforms general GNN models on financial fraud detection.
DeepONets enhance spatial-temporal surrogates for structural dynamics.
problem Creating full spatial-temporal surrogates for dynamical systems under uncertainty.
method Proposed Full-Field Extended DeepONet (FExD) to learn full solution operator across multiple degrees of freedom.
result FExD achieves superior accuracy and computational efficiency compared to other models.
Develops a new model for spatio-temporal data using imitation learning.
problem Capturing complex spatio-temporal dependence in discrete event data.
method NEST point process model with imitation learning for efficient model fitting.
result The imitation learning approach leads to more robust and interpretable results.
A new model DKMPP integrates covariates and uses an integration-free method for spatio-temporal point processes.
problem Training intractable deep spatio-temporal point processes with multimodal covariates.
method DKMPP uses a deep kernel to model complex relationships and an integration-free score matching method.
result DKMPP and score-based estimators outperform baseline models in spatio-temporal point processes.
Simpler CNN model with spatial attention and temporal pooling outperforms complex models.
problem Emotion recognition from videos with small face deformations and identity variations.
method Spatial attention mechanism and temporal softmax pooling applied to a pre-trained CNN.
result The approach achieves higher accuracy than state-of-the-art methods on the EmotiW dataset.
Unified approach for clustering financial multiplex networks.
problem Lack of methods to capture interconnections between assets over time.
method Tensor-based unified local and global clustering coefficients for multiplex networks.
result Unified clustering coefficients effectively describe dependencies between assets over time.
Study develops curvature for contact-sequence networks, revealing temporal dynamics.
problem Lack of geometric analysis for temporal network sequences.
method Develops Forman--Ricci curvature on spatiotemporal prism complexes.
result Two curvature variants disagree on 56-67% of temporal edges.
Safe reinforcement learning with logical constraints for optimal policy synthesis.
problem Ensuring safety during reinforcement learning while maximizing goal satisfaction.
method Adaptive safe padding that synthesizes optimal control policies satisfying temporal logic formulas.
result The proposed method handles the trade-off between exploration and safety with theoretical guarantees.
Novel framework for spatio-temporal event analysis using Hawkes processes.
problem Inference of dynamics in spatio-temporal event sequences.
method Randomized Fourier feature-based transformations and gradient descent.
result Improved fitting capability in synthetic and real datasets.
We present a scalable Gaussian process model for identifying and characterizing smooth multidimensional changepoints, and automatically learning changes in expressive covariance structure. We use Random Kitchen Sink features to flexibly define a change surface in combination with expressive spectral mixture kernels to …
ADD-THIN improves TPP forecasting by handling long-term data sequences.
problem Sequential limitations in autoregressive models for TPPs.
method Diffusion model for TPPs that operates on entire sequences.
result ADD-THIN outperforms state-of-the-art models in forecasting.
Wind power prediction is of vital importance in wind power utilization. There have been a lot of researches based on the time series of the wind power or speed, but In fact, these time series cannot express the temporal and spatial changes of wind, which fundamentally hinders the advance of wind power prediction. In th…
Survey of TPPs from Bayesian, neural, and LLM perspectives.
problem Modeling event sequences in continuous time.
method Bayesian, neural, and LLM approaches.
result Advances in LLMs offer new possibilities for TPP modeling.
Develops STC for sequential data with missing labels.
problem Learning from partially labeled and unsegmented sequential data.
method Introduces Star Temporal Classification (STC) using a star token and GTN framework.
result Recover most of supervised baseline performance with up to 70% missing labels.
Temporal-difference and Q-learning learn feature representations that converge to optimal ones.
problem Understanding how feature representations evolve in temporal-difference and Q-learning with neural networks.
method Mean-field theory applied to overparameterized two-layer neural networks.
result The feature representation converges to the optimal one, generalizing previous results.
Paper clusters event sequences using a reinforcement learning approach with policy mixture model.
problem Clustering event sequences with varying temporal patterns.
method Reinforcement learning with a policy mixture model, decomposing sequences into states and actions.
result Effective clustering of event sequences into underlying policies, outperforming existing methods.
Paper analyzes privacy-aware mobility behavior using entropy metrics.
problem Intrusive user location tracking makes it easy to identify users.
method Proposes spatio-temporal entropy to quantify mobility, uses GAMs to study effects of variables.
result Global GAM provides more accurate predictions of spatio-temporal entropy.
Develops a deep non-stationary kernel for non-stationary spatio-temporal point processes.
problem Capturing non-stationary dependencies in point process data.
method Approximates the influence kernel with a novel low-rank decomposition and introduces a log-barrier penalty to maintain non-negativity.
result Demonstrates superior performance and computational efficiency compared to state-of-the-art methods.
Paper tackles reinforcement learning for STL specifications with state history.
problem Learning optimal policies to satisfy STL specifications often requires too much state history, making the problem computationally intractable.
method Proposes a compact augmented state-space representation to capture state history and an approximation method to solve the objective.
result Shows the performance bound of the approximate solution and compares it with an existing technique.
We propose a framework for general probabilistic multi-step time series regression. Specifically, we exploit the expressiveness and temporal nature of Sequence-to-Sequence Neural Networks (e.g. recurrent and convolutional structures), the nonparametric nature of Quantile Regression and the efficiency of Direct Multi-Ho…
Enhances reinforcement learning uncertainty estimation with a generalized Gaussian error model.
problem Inaccurate error representations and compromised uncertainty estimation in conventional uncertainty-aware TD learning.
method Introduces a novel framework for generalized Gaussian error modeling in deep reinforcement learning, incorporating higher-order moments, particularly kurtosis, to improve uncertainty estimation and mitigation.
result Significant performance gains in policy gradient algorithms with the proposed framework.
Develops a more flexible HDP-HMM for temporal data segmentation.
problem Limited expressiveness of sticky HDP-HMM due to stationary self-persistence probability.
method Introduces recurrent sticky HDP-HMM with a novel Gibbs sampling strategy.
result RS-HDP-HMM outperforms other models in segmentation tasks.
Proposes a flexible neural network model for temporal point processes.
problem Limited expressiveness of RNN-based models for temporal point processes.
method Integrates intensity function using a feedforward neural network and calculates it as its derivative.
result Achieves competitive or superior performance compared to previous methods.
GAttNHP predicts future events in temporal knowledge graphs by encoding long-range dependencies and handling mutual excitation.
problem Forecasting future events in temporal knowledge graphs due to long-range dependencies, mutual excitation, and heavy-tailed inter-arrival times.
method GAttNHP uses a self-attention encoder, semantic soft-grouping, and NCQ regression to address these issues.
result GAttNHP improves entity and time prediction on six benchmark TKG datasets compared to state-of-the-art baselines.
We introduce a method for learning the dynamics of complex nonlinear systems based on deep generative models over temporal segments of states and actions. Unlike dynamics models that operate over individual discrete timesteps, we learn the distribution over future state trajectories conditioned on past state, past acti…
Framework learns image dynamics between time steps using latent variables.
problem Challenges in capturing evolving image patterns and temporal information.
method Estimates intermediary image stages using a physical latent variable model.
result Demonstrates robustness and effectiveness in geoscientific imagery.
New method models MTPP without predefined intensity functions.
problem Parameterizing conditional joint PDF for MTPP.
method IFIB framework, modeling p∗(m,t) directly. result Superior experimental results on real and synthetic data.
This work optimizes reservoir computing models by linking recurrence and non-linear dynamics.
problem Understanding how recurrence and non-linear dynamics in cortical networks contribute to their function.
method Transformed time-continuous, recurrent dynamics into an effective feed-forward structure of linear and non-linear temporal kernels.
result Optimal time-series classifiers can be built from random reservoir networks, demonstrating significant performance gains.
Algorithm mines environment assumptions for cyber-physical systems.
problem Modeling and verifying complex cyber-physical systems.
method Supervised learning to mine STL formulas for input signals.
result Algorithm learns both the structure and constants of STL formulas.
In many fields observations are performed irregularly along time, due to either measurement limitations or lack of a constant immanent rate. While discrete-time Markov models (as Dynamic Bayesian Networks) introduce either inefficient computation or an information loss to reasoning about such processes, continuous-time…
We propose a probabilistic framework to directly insert prior knowledge in reinforcement learning (RL) algorithms by defining the behaviour policy as a Bayesian posterior distribution. Such a posterior combines task specific information with prior knowledge, thus allowing to achieve transfer learning across tasks. The …
We study the problem of estimating a temporally varying coefficient and varying structure (VCVS) graphical model underlying nonstationary time series data, such as social states of interacting individuals or microarray expression profiles of gene networks, as opposed to i.i.d. data from an invariant model widely consid…