Deep learning for particle classification on large event images.
problem Training deep learning models on large, high-fidelity event images from MicroBooNE is challenging and time-consuming.
method Scaling training to multiple GPUs and architectures, using simulated MicroBooNE events.
result Demonstrated successful scaling of particle classification training to multiple GPUs and architectures.
It is known that describing or calculating the conditional probabilities of multiple events is exponentially expensive. In this work, Bayesian tensor network (BTN) is proposed to efficiently capture the conditional probabilities of multiple sets of events with polynomial complexity. BTN is a directed acyclic graphical …
A new compressed sensing system speeds up PSTE detection.
problem Accurately detecting fast, small optical events (PSTEs) is challenging.
method Developed a novel compressed sensing algorithm for rolling shutter systems.
result Accurately recovered PSTEs with spatial undersampling, showing speed and quality advantages.
New method quantifies resilience of electric distribution systems from historical data.
problem Large blackouts caused by extreme winds have significant costs and impacts.
method Formulate large event risk from utility outage data, quantify resilience improvements through investments.
result Investments in wind hardening and faster restoration can reduce the probability of large cost events.
Distributed Acoustic Sensing (DAS) using fiber optic cables is a promising new technology for pipeline monitoring and protection. In this work, we applied and compared two approaches for event detection using DAS: Classic machine learning approach and the approach based on image processing and deep learning. Although w…
A key question for machine learning approaches in particle physics is how to best represent and learn from collider events. As an event is intrinsically a variable-length unordered set of particles, we build upon recent machine learning efforts to learn directly from sets of features or "point clouds". Adapting and spe…
Recent progress in applying machine learning for jet physics has been built upon an analogy between calorimeters and images. In this work, we present a novel class of recursive neural networks built instead upon an analogy between QCD and natural languages. In the analogy, four-momenta are like words and the clustering…
Recently, self-supervised learning has proved to be effective to learn representations of events suitable for temporal segmentation in image sequences, where events are understood as sets of temporally adjacent images that are semantically perceived as a whole. However, although this approach does not require expensive…
The plausibility of uncommon events and miracles based on testimony of such an event has been much discussed. When analyzing the probabilities involved, it has mostly been assumed that the common events can be taken as data in the calculations. However, we usually have only testimonies for the common events. While this…
Event-based control improves neural network training speed and accuracy.
problem Optimizing learning rate and gradient tuning for CNN convergence.
method Two Event-Based control loops for adjusting learning rate in E/PD algorithm.
result Event-Based E/PD control leads to higher final accuracy and lower final loss.
Social media plays a major role during and after major natural disasters (e.g., hurricanes, large-scale fires, etc.), as people ``on the ground'' post useful information on what is actually happening. Given the large amounts of posts, a major challenge is identifying the information that is useful and actionable. Emerg…
Click through rate (CTR) prediction is very important for Native advertisement but also hard as there is no direct query intent. In this paper we propose a large-scale event embedding scheme to encode the each user browsing event by training a Siamese network with weak supervision on the users' consecutive events. The …
New method detects TC imagery patterns for rapid intensity change.
problem Detecting upcoming rapid intensity changes in TC satellite imagery.
method Nonparametric test of association between images and event labels using neural networks and bootstrap.
result Identifies archetypes of infrared imagery associated with elevated rapid intensification risk.
New STH distance finds patterns in event timeseries without resampling.
problem Lack of efficient analysis methods for event and state timeseries.
method Define STE-ts, propose STH, leveraging both time and state duration.
result Improved precision and computation time compared to resampled metrics.
Convolutional Neural Networks (CNNs) have proven very effective in image classification and show promise for audio. We use various CNN architectures to classify the soundtracks of a dataset of 70M training videos (5.24 million hours) with 30,871 video-level labels. We examine fully connected Deep Neural Networks (DNNs)…
This paper presents a study on power grid disturbance classification by Deep Learning (DL). A real synchrophasor set composing of three different types of disturbance events from the Frequency Monitoring Network (FNET) is used. An image embedding technique called Gramian Angular Field is applied to transform each time …
In spite of the many advantages of aerial imagery for crowd monitoring and management at mass events, datasets of aerial images of crowds are still lacking in the field. As a remedy, in this work we introduce a novel crowd dataset, the DLR Aerial Crowd Dataset (DLR-ACD), which is composed of 33 large aerial images acqu…
In an Ultrafast Extreme Event (or Mini Flash Crash), the price of a traded stock increases or decreases strongly within milliseconds. We present a detailed study of Ultrafast Extreme Events in stock market data. In contrast to popular belief, our analysis suggests that most of the Ultrafast Extreme Events are not prima…
Predicting event attendance using social influence from social networks.
problem Predicting people's participation in real-world events.
method Modeling social influence, using non-geotagged posts and social group structures, applying graph embedding techniques, and training a neural network.
result The proposed classifier achieves 89% accuracy on the VFestival dataset, outperforming state-of-the-art methods.
AUC is unreliable in rare event settings but stable with moderate numbers of events.
problem Misleading performance metrics in rare event settings.
method Simulation study varying dataset sizes and event rates.
result AUC is unreliable in rare event settings but stable with moderate numbers of events.
A new framework generates high-dimensional event sequences efficiently.
problem Challenges in modeling high-dimensional marked temporal point processes.
method Conditional generator that learns from event history.
result Superior performance compared to existing methods.
Anomaly detection plays an important role in modern data-driven security applications, such as detecting suspicious access to a socket from a process. In many cases, such events can be described as a collection of categorical values that are considered as entities of different types, which we call heterogeneous categor…
We study large deviations and rare default clustering events in a dynamic large heterogeneous portfolio of interconnected components. Defaults come as Poisson events and the default intensities of the different components in the system interact through the empirical default rate and via systematic effects that are comm…
We present a probabilistic model of events in continuous time in which each event triggers a Poisson process of successor events. The ensemble of observed events is thereby modeled as a superposition of Poisson processes. Efficient inference is feasible under this model with an EM algorithm. Moreover, the EM algorithm …
Missing data and noisy observations pose significant challenges for reliably predicting events from irregularly sampled multivariate time series (longitudinal) data. Imputation methods, which are typically used for completing the data prior to event prediction, lack a principled mechanism to account for the uncertainty…
Study rare-event simulation for neural networks and random forests.
problem Safety evaluation and robustness quantification of machine learning models.
method Importance sampling scheme integrating large deviations and sequential mixed integer programming.
result Efficiency guarantees and numerical demonstrations for various neural network architectures.
Electroencephalography (EEG) during sleep is used by clinicians to evaluate various neurological disorders. In sleep medicine, it is relevant to detect macro-events (> 10s) such as sleep stages, and micro-events (<2s) such as spindles and K-complexes. Annotations of such events require a trained sleep expert, a time co…
Enhanced X-ray polarimetry with deep learning for better exposure times.
problem Improving sensitivity of X-ray telescopic observations with imaging polarimeters.
method A weighted maximum likelihood combination of predictions from a deep ensemble of ResNet convolutional neural networks trained on Monte Carlo event simulations.
result Improves effective exposure times by ~45% for power-law source spectra.
Vision problems ranging from image clustering to motion segmentation to semi-supervised learning can naturally be framed as subspace segmentation problems, in which one aims to recover multiple low-dimensional subspaces from noisy and corrupted input data. Low-Rank Representation (LRR), a convex formulation of the subs…
The paper uses machine learning to compute rare event probabilities in stochastic systems.
problem Characterizing rare events in stochastic dynamical systems with weak noise.
method Developed a neural network framework for computing quasipotential, most probable paths, and prefactors.
result Demonstrated higher effectiveness and accuracy of the algorithm in calculating mean exit times.
Machine learning detects and characterizes whistler radio waves for real-time monitoring of the plasmasphere.
problem Detect and characterise whistler radio waves generated by lightning strokes for real-time monitoring of the plasmasphere.
method Developed a machine learning model using image classification and localisation on spectrogram data to identify and localise whistlers.
result The proposed detectors achieve a misdetection and false alarm rate of less than 15% on Marion's dataset.
TailCoR measures co-movement of financial crises events.
problem Measuring co-movement of financial crises events.
method Combines linear and non-linear dependencies using tail inter quantile range.
result TailCoR performs well in small samples and no optimisations are needed.
Neural model uses deductive database to predict events from past patterns.
problem Difficulty in predicting future events from past patterns when event types are large.
method Temporal deductive database with rules to prove facts from other facts and past events. Neural nets model fact states and probabilities.
result Neural models derived from concise Datalog programs improve prediction by encoding domain knowledge.
xVAE models extreme turbulence events in turbulent flows.
problem Capturing extreme events in turbulent flows.
method Max-infinitely divisible process with heavy-tailed distributions embedded into a standard VAE framework.
result xVAE more robust in capturing extreme values compared to POD modes.
We present ProxiModel, a novel event mining framework for extracting high-quality structured event knowledge from large, redundant, and noisy news data sources. The proposed model differentiates itself from other approaches by modeling both the event correlation within each individual document as well as across the cor…
TRR detects stock portfolio crashes by simulating human reasoning.
problem Detecting stock portfolio crashes with limited historical data.
method Temporal Relational Reasoning (TRR) framework.
result TRR outperforms state-of-the-art techniques in detecting stock portfolio crashes.
Models for predicting the risk of cardiovascular events based on individual patient characteristics are important tools for managing patient care. Most current and commonly used risk prediction models have been built from carefully selected epidemiological cohorts. However, the homogeneity and limited size of such coho…
In digital advertising, Click-Through Rate (CTR) and Conversion Rate (CVR) are very important metrics for evaluating ad performance. As a result, ad event prediction systems are vital and widely used for sponsored search and display advertising as well as Real-Time Bidding (RTB). In this work, we introduce an enhanced …
Develops a method for causal inference in recurrent event data with terminal failure.
problem Causal inference in recurrent event data with a terminal event.
method Multiply robust estimation framework for causal inference.
result Proposes an estimator for the expected number of recurrent events and failure survival function.
Predicts clinical events using a landmark approach with machine learning for large biomarker histories.
problem Dynamic prediction of clinical events from large biomarker histories.
method Landmark approach extended to endogenous markers history combined with machine learning methods for survival data.
result Superlearner combining regularized regressions and random survival forests outperforms standard survival models.
A method to monitor probability predictions for calibration loss in image classification models.
problem Maintaining calibration in machine learning predictions over time.
method Cumulative sum-based approach with dynamic limits for early detection of miscalibration.
result Early detection of operational context changes impacting image classification performance.
A cased-based reasoning method predicts rare events on strategic sites using satellite imagery.
problem Manual prediction of rare events on strategic sites is impractical due to large datasets.
method Case-based reasoning approach incorporating expert knowledge for irregular time series and small datasets.
result The method significantly outperforms random selection on challenging applications.
The combination of large open data sources with machine learning approaches presents a potentially powerful way to predict events such as protest or social unrest. However, accounting for uncertainty in such models, particularly when using diverse, unstructured datasets such as social media, is essential to guarantee t…
We consider the problem of separating error messages generated in large distributed data center networks into error events. In such networks, each error event leads to a stream of messages generated by hardware and software components affected by the event. These messages are stored in a giant message log. We consider …
Proposes OC4Seq for detecting anomalies in discrete event sequences.
problem Challenges in detecting anomalies in discrete event sequences, including data imbalance, discrete events, and sequential nature.
method Integrates anomaly detection with recurrent neural networks (RNNs) to embed sequences into latent spaces and designs a multi-scale RNN framework to capture multi-scale sequential patterns.
result OC4Seq consistently outperforms various baselines on three benchmark datasets.
We investigate the large-volatility dynamics in financial markets, based on the minute-to-minute and daily data of the Chinese Indices and German DAX. The dynamic relaxation both before and after large volatilities is characterized by a power law, and the exponents p± usually vary with the strength of the large vo…
New metrics prevent event collapse in contrast maximization frameworks.
problem Event collapse in contrast maximization frameworks.
method First principles of space-time deformation based on differential geometry and physics.
result Proposed metrics mitigate event collapse and do not harm well-posed warps.
Combining multiple collider events improves machine learning performance.
problem Improving machine learning for collider physics.
method Study of single-event vs multi-event classifiers under IID assumption.
result Training single-event classifiers is more effective than multi-event classifiers.