This paper offers a distribution-free method for post-detection changepoint localization.
problem Locating the exact time of a change in distribution after a sequential detection procedure.
method A distribution-free framework using conformal test martingales for sequential change detection and post-detection inference.
result Valid post-detection coverage guarantees and non-asymptotic bounds on confidence set size.
Develops methods for inference after detecting a change in sequential data.
problem Inference after a detected change in sequential data.
method General framework for constructing confidence sets using only data up to a stopping time.
result First general method for sequential changepoint localization with theoretical guarantees.
Paper proposes a new method for selective inference in robust regression.
problem Statistical inference after removing outliers identified by robust methods.
method Conditional SI using piecewise-linear homotopy continuation.
result Proposed method is applicable to a wide class of robust regression and outlier detection methods.
CAD-DA controls anomaly detection under domain adaptation.
problem Valid statistical inference after domain adaptation.
method Conditional Selective Inference to handle domain adaptation effects.
result Valid statistical inference under domain adaptation achieved.
STAND-DA improves AD in DA target domains with limited data.
problem Statistical validity of AD after DA with limited data.
method Selective Inference framework for GPU-accelerated p-value computation. result Valid p-values and controlled false positive rate. Post-detection analysis identifies responsible coordinates for multivariate change-points.
problem Identifying which coordinates in multivariate time series change after a detected change-point.
method Two-sample testing procedures with nonparametric tests for Type I error control.
result Strong performance of proposed post hoc statistical procedures.
Novel algorithm detects causal macrovariables from high-dimensional data.
problem Leveraging high-dimensional observational datasets for coarse-grained causal models.
method Inspired by information bottlenecks, novel algorithm detects macrovariables and investigates causal relationships through additive noise models.
result Algorithm robustly detects and infers causal relationships in both synthetic and real climate datasets.
Paper proposes a method to improve variational inference for sparse networks.
problem Variational inference struggles with sparse networks, leading to inaccurate community detection.
method The method involves hard thresholding the posterior of community assignment after each iteration.
result The proposed method accurately recovers true community labels in sparse networks.
AdvMind detects adversary intent in black-box attacks with high accuracy.
problem Detecting adversary intent in black-box adversarial attacks is challenging.
method AdvMind accounts for adversary adaptiveness and synthesizes queries to expose intent.
result AdvMind detects adversary intent with over 75% accuracy after observing less than 3 query batches.
Adversarial validation detects concept drift in user targeting systems.
problem Concept drift in user targeting automation systems deteriorates model performance over time.
method Adversarial validation approach to detect and adapt to concept drift.
result Adversarial validation effectively addresses concept drift in user targeting systems.
The artificial neural network shows powerful ability of inference, but it is still criticized for lack of interpretability and prerequisite needs of big dataset. This paper proposes the Rule-embedded Neural Network (ReNN) to overcome the shortages. ReNN first makes local-based inferences to detect local patterns, and t…
We envision that in the near future, humanoid robots would share home space and assist us in our daily and routine activities through object manipulations. One of the fundamental technologies that need to be developed for robots is to enable them to detect objects and recognize them for effective manipulations and take…
The paper provides high-probability bounds on false discovery proportions in conformal inference.
problem Existing methods fail to provide high-probability bounds on the realized false discovery proportion.
method Constructing a high-probability envelope for the empirical distribution function of null conformal p-values by sampling from their joint distribution.
result Establishes finite-sample, distribution-free upper bounds on the FDP that hold simultaneously over all possible rejection thresholds.
A drift detection method for large datasets without labels.
problem Early detection of concept drift in large, unlabeled datasets.
method Classical statistical process control in a label-less setting.
result Better statistical power than previous methods under computational constraints.
New method prevents invalid inference after causal discovery.
problem Invalid inference after causal discovery.
method Developed tools for valid post-causal-discovery inference.
result Our method provides reliable coverage while achieving more accurate causal discovery.
The development of human-robot systems able to leverage the strengths of both humans and their robotic counterparts has been greatly sought after because of the foreseen, broad-ranging impact across industry and research. We believe the true potential of these systems cannot be reached unless the robot is able to act w…
Changepoints are abrupt variations in the generative parameters of a data sequence. Online detection of changepoints is useful in modelling and prediction of time series in application areas such as finance, biometrics, and robotics. While frequentist methods have yielded online filtering and prediction techniques, mos…
We propose a method for detection and prediction of native and synthetic iceberg orders on Chicago Mercantile Exchange. Native (managed by the exchange) icebergs are detected using discrepancies between the resting volume of an order and the actual trade size as indicated by trade summary messages, as well as by tracki…
New method improves deep learning models' uncertainty estimates.
problem Overconfidence in deep learning predictions.
method Develops a novel training algorithm using conformal inference.
result Produces more reliable uncertainty estimates without sacrificing accuracy.
SI-CLAD improves clustering-based anomaly detection by controlling false positives.
problem Lack of reliability in clustering-based anomaly detection.
method SI-CLAD (Statistical Inference for CLustering-based Anomaly Detection) using Selective Inference framework.
result SI-CLAD rigorously controls false detection probability below a specified significance level.
We study the problem of detecting change points (CPs) that are characterized by a subset of dimensions in a multi-dimensional sequence. A method for detecting those CPs can be formulated as a two-stage method: one for selecting relevant dimensions, and another for selecting CPs. It has been difficult to properly contro…
Study analyzes market co-movements in critical mineral investments using change point detection and cross-sectional analysis.
problem Market dynamics in critical mineral investments during significant global events.
method Combines change-point detection (PELT algorithm) with cross-sectional analysis on ESG-ranked ETFs.
result Investors herded during market downturns and shifted to anti-herding after positive news and geopolitical shocks.
Study examines inference methods after variable selection in Cox models.
problem Bias and misleading inference after variable selection in Cox models.
method Simulation study of inference procedures for Lasso and adaptive Lasso in Cox models.
result Performance of inference procedures varies, with debiased Lasso showing promise.
Adversarial sample attacks perturb benign inputs to induce DNN misbehaviors. Recent research has demonstrated the widespread presence and the devastating consequences of such attacks. Existing defense techniques either assume prior knowledge of specific attacks or may not work well on complex models due to their underl…
We propose a method for causal inference using satellite image time series, in order to determine the treatment effects of interventions which impact climate change, such as deforestation. Simply put, the aim is to quantify the 'before versus after' effect of climate related human driven interventions, such as urbaniza…
Post-ADC inference corrects bias in statistical inference after active data collection.
problem Bias in inference after active data collection.
method Post-ADC inference framework that corrects bias from both ADC process and data-driven target construction.
result Valid inference for data collected by SMBO methods like GP-UCB and TPE.
Study proposes a statistical testing framework for evaluating clustering pipelines.
problem Quantifying the statistical reliability of clustering results from data analysis pipelines.
method Selective inference-based statistical testing framework for clustering pipelines.
result The proposed test controls the type I error rate and is effective in validating clustering results.
New method for valid and exact statistical inference of multi-dimensional change-points.
problem Statistical inference of change-points in multi-dimensional sequences.
method Proposes a method to guarantee the statistical reliability of both location and components of detected changes.
result Demonstrates the effectiveness of the method in genomic abnormality identification and human behavior analysis.
To use machine learning in high stakes applications (e.g. medicine), we need tools for building confidence in the system and evaluating whether it is reliable. Methods to improve model reliability often require new learning algorithms (e.g. using Bayesian inference to obtain uncertainty estimates). An alternative is to…
EdgeLite detects hazardous supermarket floors, improving safety.
problem Detecting hazardous conditions on supermarket floors to prevent injuries.
method Developed a lightweight deep learning model, EdgeLite, for edge devices.
result EdgeLite outperformed state-of-the-art models in detecting hazards on supermarket floors.
Valid inference method for DTW distance for abnormal time-series detection.
problem Statistical inference on DTW distance under uncertain conditions.
method Conditional selective inference framework to derive valid p-values.
result First method to provide valid p-values for DTW distance.
New study on time series anomaly detection shows overlapping inference improves performance.
problem Heterogeneous evaluation practices and inference procedures in time series anomaly detection.
method Unified training, tuning, and evaluation protocol on TSB-AD benchmark, analyzing overlapping vs. disjoint inference.
result Overlapping inference yields consistent improvements, with average relative gain up to +28%.
Aux-NAS uses auxiliary labels to improve primary task performance without extra inference cost.
problem Improving primary task performance using auxiliary labels without increasing inference cost.
method Architecture-based approach with a flexible asymmetric structure for primary and auxiliary tasks, using Neural Architecture Search (NAS) to evolve networks with only primary-to-auxiliary connections.
result Achieves improved performance on multiple tasks without increasing inference cost.
Study uses RNN to detect CPs with SI to control false positives.
problem Detecting false positives in RNN-based change point detection.
method Introduces Selective Inference (SI) framework to RNN for CP detection.
result Valid p-values for CPs detected by RNN reduce false positives.
BLISS detects and separates astronomical sources quickly and accurately.
problem Detecting and separating overlapping astronomical sources in large images.
method Bayesian Light Source Separator (BLISS) using deep generative models and variational inference.
result BLISS can process megapixel images in seconds and produce highly accurate catalogs.
Optimizes quickest detection of drift in Brownian motion with false negatives.
problem Quickest detection of drift in Brownian motion with false negatives.
method Formulated as an optimal multiple stopping problem, then equivalent to a recursive optimal stopping problem, solved using free boundary methods.
result Explicit formulae for expected cost and optimal strategy found.
New method for community detection in graphs faster than DCBM inference.
problem Efficiently detecting communities in graphs with heterogeneous node degrees.
method Reformulated constrained nonnegative matrix factorization for DCBM inference.
result Faster community detection (4 minutes for 100k nodes vs. DCBM's 10+ minutes).
Structural damage due to excessive loading or environmental degradation typically occurs in localized areas in the absence of collapse. This prior information about the spatial sparseness of structural damage is exploited here by a hierarchical sparse Bayesian learning framework with the goal of reducing the source of …
Improves change-point detection for high-dimensional time-series.
problem Uncertainty in latent variable estimation affects change-point detection.
method Proposes multinomial sampling to improve detection rate and reduce delay.
result Results outperform baseline method in experiments.
Microdata improves inflation forecasts after major shocks, study finds.
problem Forecasting inflation in a non-stationary environment with microeconomic data.
method Developed a scan test to detect periods of micro forecast outperformance, combined with adaptive machine learning.
result Micro forecasts improve inflation predictions after major shocks, especially after 2020.
From a sequence of similarity networks, with edges representing certain similarity measures between nodes, we are interested in detecting a change-point which changes the statistical property of the networks. After the change, a subset of anomalous nodes which compares dissimilarly with the normal nodes. We study a sim…
Personalized deep learning reduces inappropriate shocks in VA detection.
problem High inappropriate shock rate in traditional VA detection methods.
method Personalized deep learning framework using CNN for real-time VA detection and collaborative inference.
result 6.6% reduction in inappropriate shock rate compared to traditional methods.
Quantum computing at room temperature achieves high accuracy in image classification.
problem Classifying images with single photons at room temperature.
method Optical transformation of quantum state to exploit interference and entanglement.
result Theoretical accuracy of 41.27% for MNIST and 36.14% for Fashion-MNIST.
An increasing number of sensors on mobile, Internet of things (IoT), and wearable devices generate time-series measurements of physical activities. Though access to the sensory data is critical to the success of many beneficial applications such as health monitoring or activity recognition, a wide range of potentially …
The high structural deficient rate poses serious risks to the operation of many bridges and buildings. To prevent critical damage and structural collapse, a quick structural health diagnosis tool is needed during normal operation or immediately after extreme events. In structural health monitoring (SHM), many existing …
Study detects spoofing in high-frequency trading using micro-structural analysis.
problem Challenges in detecting spoofing due to complex electronic platforms and high-frequency trading.
method Micro-structural study in a simplified setting, optimization of spoofing strategy, monitoring with Wasserstein distance.
result Optimal spoofing strategy and its impact on market imbalance quantified.
The paper investigates model misspecification in Bayesian inference using neural networks.
problem Detecting model misspecification in Bayesian inference with neural networks.
method Conceptualized types of model misspecification and proposed an augmented optimization objective with MMD.
result MMD can detect potentially catastrophic misspecifications in Bayesian inference.
TRA detects causal direction from bivariate data using geometric shapes.
problem Inferring causal direction from observational data is challenging and unreliable.
method TRA compares rank-based copula-standardized residual clouds to detect causal direction.
result TRA is robust and superior in detecting causal direction across various scenarios.