Meta-learning improves event prediction from short sequences.
problem Predicting events from short sequences is challenging.
method Meta-learning approach using recurrent neural networks and monotonic neural networks.
result Meta-learning enhances long-term prediction performance.
Improved neural models for diverse user event sequences.
problem Challenges in modeling diverse user event sequences.
method Mixtures of latent embeddings with amortized variational inference.
result Systematic improvements over existing work for various predictive metrics.
Predict sepsis early from EHR data with aggregated clinical events.
problem Predict sepsis from clinical data in EHR with temporal interactions.
method Aggregates heterogeneous clinical events, captures temporal interactions with LSTM.
result Achieved high utility score (0.321) in PhysioNet/Computing in Cardiology Challenge 2019.
SMURF-THP improves Transformer Hawkes process models by providing uncertainty quantification.
problem Uncertainty quantification for Transformer Hawkes process predictions.
method Score matching for learning the score function of event arrival times.
result SMURF-THP outperforms likelihood-based methods in confidence calibration.
Impute missing events in continuous-time sequences using particle smoothing.
problem Missing events in continuous-time sequences.
method Particle smoothing with trainable bidirectional LSTM proposals.
result Imputed sequences have low Bayes risk compared to ground truth.
Predict human lives using sequences of life events.
problem Predicting human life outcomes based on detailed event sequences.
method Adapting natural language processing techniques to analyze life events.
result Models predict diverse outcomes with high accuracy, outperforming state-of-the-art models.
Clinical outcome prediction based on the Electronic Health Record (EHR) plays a crucial role in improving the quality of healthcare. Conventional deep sequential models fail to capture the rich temporal patterns encoded in the longand irregular clinical event sequences. We make the observation that clinical events at a…
New models predict future events with uncertainty.
problem Predicting future events in asynchronous sequences with uncertainty.
method Two new architectures, WGP-LN and FD-Dir, modeling time-dependent distributions.
result Models outperform other approaches in various datasets.
Survey on modeling event sequences through temporal processes.
problem Modeling phenomena with sequences of events over continuous time.
method Probabilistic models based on point processes, categorized into simple, marked, and spatio-temporal.
result Analysis of existing approaches and their applicability to prediction and modeling.
THP model captures complex dependencies in event sequences efficiently.
problem Inability of existing models to capture long-term dependencies in event sequences.
method Transformer Hawkes Process (THP) model using self-attention mechanism.
result THP outperforms existing models in likelihood and event prediction accuracy.
Modeling latent dynamics in high-dimensional event sequences without prior knowledge.
problem Modeling latent dynamics in high-dimensional event sequences with unknown marker relations.
method Adversarial imitation learning framework decomposed into latent structural intensity model, efficient random walk model, and seq2seq discriminator.
result Effective detection of hidden network among markers and decent prediction for future events.
Framework handles both exchangeable and non-exchangeable event sequences without tuning.
problem Handling both exchangeable and non-exchangeable event sequences efficiently.
method Parametric Hawkes-process-inspired conditional probability mass function with variational inference.
result Competitive computational and predictive performance against state-of-the-art methods.
S2P2 model improves predictive likelihoods for MTPPs.
problem Modeling irregular time intervals in event sequences.
method State-space point process model using deep state-space techniques.
result Empirically, S2P2 achieves state-of-the-art predictive likelihoods.
Proposes a model for multi-horizon probabilistic forecasting of time series influenced by asynchronous events.
problem Forecasting time series influenced by asynchronous events is challenging.
method Introduces Variational Synergetic Multi-Horizon Network (VSMHN), a deep conditional generative model combining deep point processes and variational recurrent neural networks.
result Produces accurate, sharp, and realistic probabilistic forecasts.
Paper introduces efficient methods for probabilistic querying of event sequences.
problem Hard queries about future events in continuous-time sequences.
method Importance sampling framework for addressing query types.
result Method is more efficient than naive simulation, often 1,000 times.
EventFlow forecasts event sequences without autoregression, improving accuracy.
problem Forecasting errors in autoregressive models for event sequences.
method EventFlow uses flow matching to learn joint distributions over event times directly.
result EventFlow reduces forecast error by 20%-53% compared to baselines.
Graph Hawkes Neural Network forecasts evolving graph sequences.
problem Modeling dynamic graph sequences with complex event types.
method Generalized Hawkes process to neural network, capturing complex event impacts.
result Effective at predicting future events in evolving graph sequences.
PRAGMA models financial event sequences for various banking tasks.
problem Handling diverse financial data for multiple applications.
method Pre-training a Transformer model on a large banking event corpus with a self-supervised objective.
result PRAGMA achieves superior performance across multiple financial domains from raw event sequences.
Predicts cryptocurrency pump probability using sequence-based neural networks.
problem Detecting pump-and-dump schemes in cryptocurrency markets.
method Developed a sequence-based neural network (SNN) that encodes historical P&D events into sequences for prediction.
result SNN improves prediction accuracy by leveraging positional attention to extract useful information.
Click through rate (CTR) prediction is very important for Native advertisement but also hard as there is no direct query intent. In this paper we propose a large-scale event embedding scheme to encode the each user browsing event by training a Siamese network with weak supervision on the users' consecutive events. The …
New method embeds time span into self-attention for better temporal pattern recognition.
problem Capturing temporal patterns in event sequences without recurrent networks.
method Functional time representation learning with Bochner's and Mercer's Theorems.
result Proposed methods outperform baseline models in various continuous-time event sequence prediction tasks.
HARMLESS meta-learning method models short event sequences with relational information.
problem Learning heterogeneous point process models from short event sequence data.
method Hierarchical Bayesian mixture Hawkes process model with stochastic variational meta expectation maximization.
result HARMLESS outperforms existing methods in predicting future events.
Variational autoencoder models dynamic latent graphs for neural point processes.
problem Modeling event dynamics with changing trends over time.
method Sequential latent variable model with dynamic latent graphs.
result Higher accuracy in predicting inter-event times and event types.
We are now witnessing the increasing availability of event stream data, i.e., a sequence of events with each event typically being denoted by the time it occurs and its mark information (e.g., event type). A fundamental problem is to model and predict such kind of marked temporal dynamics, i.e., when the next event wil…
This paper explores neural models to improve modeling of Hawkes process intensity functions.
problem Traditional Hawkes process intensity function's parametrized kernel function biases future event predictions.
method Uses neural models to model the kernel function of Hawkes process intensity function.
result Neural models can better capture future event characteristics using past events data.
Simple tabular event prediction model outperforms existing methods.
problem Predicting events from tabular data with historic events.
method Standard autoregressive LLM-style transformers with elementary positional embeddings and causal language modeling.
result Simple model outperforms existing approaches across various datasets and use-cases.
Many events occur in the world. Some event types are stochastically excited or inhibited---in the sense of having their probabilities elevated or decreased---by patterns in the sequence of previous events. Discovering such patterns can help us predict which type of event will happen next and when. We model streams of d…
Various and ubiquitous information systems are being used in monitoring, exchanging, and collecting information. These systems are generating massive amount of event sequence logs that may help us understand underlying phenomenon. By analyzing these logs, we can learn process models that describe system procedures, pre…
Predicting fine-grained interests of users with temporal behavior is important to personalization and information filtering applications. However, existing interest prediction methods are incapable of capturing the subtle degreed user interests towards particular items, and the internal time-varying drifting attention …
Proposes OC4Seq for detecting anomalies in discrete event sequences.
problem Challenges in detecting anomalies in discrete event sequences, including data imbalance, discrete events, and sequential nature.
method Integrates anomaly detection with recurrent neural networks (RNNs) to embed sequences into latent spaces and designs a multi-scale RNN framework to capture multi-scale sequential patterns.
result OC4Seq consistently outperforms various baselines on three benchmark datasets.
Most real-world datasets, and particularly those collected from physical systems, are full of noise, packet loss, and other imperfections. However, most specification mining, anomaly detection and other such algorithms assume, or even require, perfect data quality to function properly. Such algorithms may work in lab c…
CAUSE learns Granger causality from event sequences, outperforming existing methods.
problem Learning Granger causality from complex, interdependent event sequences.
method CAUSE uses a neural point process to capture interdependency and an attribution method to extract Granger causality.
result CAUSE outperforms state-of-the-art methods in inferring inter-type Granger causality.
In complex processes, various events can happen in different sequences. The prediction of the next event given an a-priori process state is of importance in such processes. Recent methods have proposed deep learning techniques such as recurrent neural networks, developed on raw event logs, to predict the next event fro…
New algorithm predicts spatio-temporal events with improved accuracy.
problem Non-stationary spatio-temporal prediction on dense and sparse sequences.
method Probabilistic approach using point processes and self-organizing decision trees.
result Significant performance improvements over baseline and state-of-the-art methods.
Detects outliers in continuous-time event sequences, including unexpected absences and occurrences.
problem Identifying unexpected events in event sequences that may indicate abnormal situations.
method Developed methods based on Bayesian decision theory and hypothesis testing for context-aware outlier detection.
result Effective methods for detecting outliers in both synthetic and real-world data.
Proposes SAHP for better Hawkes process modeling.
problem Predicting occurrence patterns of event sequences.
method Leverages self-attention to modify Hawkes process intensity function.
result Demonstrates effectiveness on real-world datasets.
Timely prediction of clinically critical events in Intensive Care Unit (ICU) is important for improving care and survival rate. Most of the existing approaches are based on the application of various classification methods on explicitly extracted statistical features from vital signals. In this work, we propose to elim…
A system is presented that segments, clusters and predicts musical audio in an unsupervised manner, adjusting the number of (timbre) clusters instantaneously to the audio input. A sequence learning algorithm adapts its structure to a dynamically changing clustering tree. The flow of the system is as follows: 1) segment…
Study examines Bitcoin's price history and identifies recurring events.
problem Understanding Bitcoin's price fluctuations and recurring events.
method Analyzed BTC price time-series (2010-2021), identified recurring events, and approximated price evolution using a Fibonacci sequence.
result BTC price history shows recurring events with similar duration and can be approximated using a Fibonacci sequence.
Induction of common sense knowledge about prototypical sequences of events has recently received much attention. Instead of inducing this knowledge in the form of graphs, as in much of the previous work, in our method, distributed representations of event realizations are computed based on distributed representations o…
A novel transformer model improves classification of partially ordered sequences.
problem Classification of partially ordered sequences with uncertainty in timestamps.
method Developed a transformer-based model for partially ordered sequences, benchmarked against set models.
result Transformer-based model outperforms set models on three datasets.
Given key performance indicators collected with fine granularity as time series, our aim is to predict and explain failures in storage environments. Although explainable predictive modeling based on spiky telemetry data is key in many domains, current approaches cannot tackle this problem. Deep learning methods suitabl…
A new HP model balances interpretability and flexibility for EHR event sequences.
problem Balancing interpretability and flexibility in modeling diagnostic event sequences.
method Proposes a neural network-based HP with flexible impact kernel and transformer layers.
result Accurately recovers impact functions, competitive performance, and clinically meaningful interpretation.
Develops a framework for modeling set-valued data in continuous-time.
problem Handling sequences where each event is associated with a set of items.
method General framework for modeling set-valued data, developed inference methods, and importance sampling techniques.
result Orders-of-magnitude improvements in efficiency for probabilistic queries over direct sampling.
New models directly model inter-event times without intensity functions.
problem Learning temporal point processes with intensity-based approaches.
method Normalizing flows and mixture models for flexible and efficient modeling.
result Achieves state-of-the-art performance in prediction tasks.
For autonomous agents to successfully operate in the real world, anticipation of future events and states of their environment is a key competence. This problem has been formalized as a sequence extrapolation problem, where a number of observations are used to predict the sequence into the future. Real-world scenarios …
Mamba Hawkes Process improves modeling of event sequences with long-term dependencies.
problem Modeling mutual inhibition and nonlinearity in asynchronous event sequences.
method Introduces Mamba Hawkes Process using Mamba state space architecture.
result MHP outperforms existing models across various datasets.
Data of practical interest - such as personal records, transaction logs, and medical histories - are sequential collections of events relevant to a particular source entity. Recent studies have attempted to link sequences that represent a common entity across data sets to allow more comprehensive statistical analyses a…