A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
This research examines rare spurious correlations in neural networks and their impact on accuracy and privacy.
A new method estimates rare failure events in complex systems.
Study improves estimation of rare language model outputs.
Optimizes sampling for faster convergence in Bayesian experimental design and uncertainty quantification.
Regions of high-dimensional input spaces that are underrepresented in training datasets reduce machine-learnt classifier performance, and may lead to corner cases and unwanted bias for classifiers used in decision making systems. When these regions belong to otherwise well-represented classes, their presence and negati…
Proposes a method to refine PDE-driven high-dimensional rare-event simulation.
We propose rectified factor networks (RFNs) to efficiently construct very sparse, non-linear, high-dimensional representations of the input. RFN models identify rare and small events in the input, have a low interference between code units, have a small reconstruction error, and explain the data covariance structure. R…
The paper introduces diagnostic transport maps to improve the reliability of rare event predictions.
Industry datasets used for text classification are rarely created for that purpose. In most cases, the data and target predictions are a by-product of accumulated historical data, typically fraught with noise, present in both the text-based document, as well as in the targeted labels. In this work, we address the quest…
Inspired by the tremendous success of deep generative models on generating continuous data like image and audio, in the most recent year, few deep graph generative models have been proposed to generate discrete data such as graphs. They are typically unconditioned generative models which has no control on modes of the …
This research analyzes how input and output layers affect deep neural networks' resistance to adversarial attacks.
New backdoor attacks in FL can fool models on rare inputs.
Fine-grained pretraining improves neural network's ability to learn rare features.
When simulating a complex stochastic system, the behavior of output response depends on input parameters estimated from finite real-world data, and the finiteness of data brings input uncertainty into the system. The quantification of the impact of input uncertainty on output response has been extensively studied. Most…
It is common in modern prediction problems for many predictor variables to be counts of rarely occurring events. This leads to design matrices in which many columns are highly sparse. The challenge posed by such "rare features" has received little attention despite its prevalence in diverse areas, ranging from natural …
It is well-known that the robustness of artificial neural networks (ANNs) is important for their wide ranges of applications. In this paper, we focus on the robustness of the classification ability of a spiking neural network which receives perturbed inputs. Actually, the perturbation is allowed to be arbitrary styles.…
Generative model simulates rare events for better decision making.
The development of machine learning systems for the diagnosis of rare diseases is challenging mainly due the lack of data to study them. Despite this challenge, this paper proposes a system for the Computer Aided Diagnosis (CAD) of low-prevalence, congenital muscular dystrophies from confocal microscopy images. The pro…
AI boosts study of rare weather extremes with lower costs.
Rare diseases affecting 350 million individuals are commonly associated with delay in diagnosis or misdiagnosis. To improve those patients' outcome, rare disease detection is an important task for identifying patients with rare conditions based on longitudinal medical claims. In this paper, we present a deep learning m…
Develops a method to estimate rare-event probabilities under distributional uncertainty.
Reduces false positives in classifying rare online platforms.
This paper proposes an active learning system for sound event detection (SED). It aims at maximizing the accuracy of a learned SED model with limited annotation effort. The proposed system analyzes an initially unlabeled audio dataset, from which it selects sound segments for manual annotation. The candidate segments a…
This paper evaluates data enrichment techniques for rare event detection in manufacturing.
Enhanced diffusion sampling improves rare event sampling in biomolecular simulations.
An important but rarely-addressed option pricing question is how to choose appropriate strikes for implied volatility inputs when pricing more exotic multi-asset derivatives. By means of Malliavin Calculus we construct an optimal log-linear strikevconvention for exchange options under stochastic volatility models. This…
Enhanced diffusion sampling tackles rare event sampling in biomolecular simulations.
Proposes a method to ensure accurate estimation of rare events in AI systems.
In many situations, classes of data points of primary interest also happen to be those that are least numerous. A well-known example is detection of fraudulent transactions among the collection of all financial transactions, the vast majority of which are legitimate. These types of problems fall under the label of `rar…
Machine learning models are notoriously difficult to interpret and debug. This is particularly true of neural networks. In this work, we introduce automated software testing techniques for neural networks that are well-suited to discovering errors which occur only for rare inputs. Specifically, we develop coverage-guid…
WEST uses EHRs and expert cases to improve rare disease phenotyping.
Rare diseases affect a relatively small number of people, which limits investment in research for treatments and cures. Developing an efficient method for rare disease detection is a crucial first step towards subsequent clinical research. In this paper, we present a semi-supervised learning framework for rare disease …
Given a labeled dataset that contains a rare (or minority) class of of-interest instances, as well as a large class of instances that are not of interest, how can we learn to recognize future of-interest instances over a continuous stream? We introduce RaRecognize, which (i) estimates a general decision boundary betwee…
In rare disease physician targeting, a major challenge is how to identify physicians who are treating diagnosed or underdiagnosed rare diseases patients. Rare diseases have extremely low incidence rate. For a specified rare disease, only a small number of patients are affected and a fractional of physicians are involve…
Simulates patient pathways to detect delayed rare disease diagnoses.
Markov chain Monte Carlo (MCMC) algorithms for hidden Markov models often rely on the forward-backward sampler. This makes them computationally slow as the length of the time series increases, motivating the development of sub-sampling-based approaches. These approximate the full posterior by using small random subsequ…
Model predicts travel time under rare conditions using a vector-space model.
Paper proposes a secure protocol for federated learning.
For many important problems the quantity of interest is an unknown function of the parameters, which is a random vector with known statistics. Since the dependence of the output on this random vector is unknown, the challenge is to identify its statistics, using the minimum number of function evaluations. This problem …
Study compares resampling methods for rare event prediction in longitudinal studies.
Kernel embeddings of distributions and the Maximum Mean Discrepancy (MMD), the resulting distance between distributions, are useful tools for fully nonparametric two-sample testing and learning on distributions. However, it is rarely that all possible differences between samples are of interest -- discovered difference…
The paper analyzes logistic regression for rare events data, deriving new insights on estimator efficiency and sampling strategies.
New test uncovers causal links in rare event dynamics.
Proposes Ada-Sit method for mortality prediction of rare diseases.
PRESTO improves rare event prediction by shrinking towards proportional odds model.
Deep-PrAE improves rare-event simulation for black-box systems.
Develops a method to simulate rare dangerous events in autonomous systems.
NOFIS uses normalizing flows to estimate rare event probabilities more efficiently.