Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

24487195 · May 202619922001200920172026
48 results for margin p-values

The paper develops p-values for outlier detection using conformal inference.

problem Detecting outliers in nonparametric data sets.
method Conformal inference framework for constructing marginally valid but mutually dependent p-values.
result Valid p-values for outlier detection with conditional independence and marginal false discovery rate control.

Conformal Test Martingales can be 'blind' to significant changes in data distribution.

problem The converse of exchangeability does not hold, leading to potential blindness of CTMs.
method Explicit construction of AA-cryptic change-point using bivariate Gaussian distributions.
result CTMs can be perfectly cryptic to a significant change in marginal means.

A new method for anomaly detection adapts to local non-stationarity in low-data regimes.

problem Adapting conformal anomaly detection to handle distribution shifts in real-world data.
method Proposes a continuous inference relaxation using continuous weighted kernel density estimation to decouple local adaptation from tail resolution.
result Restores detection capabilities and statistical power in low-data regimes while maintaining valid error control.

This paper presents an alternative approach to p-values in regression settings. This approach, whose origins can be traced to machine learning, is based on the leave-one-out bootstrap for prediction error. In machine learning this is called the out-of-bag (OOB) error. To obtain the OOB error for a model, one draws a bo…

2017-01-18abs ↗pdf ↗

New methods improve cross-conformal prediction's prediction sets without sacrificing coverage guarantees.

problem Improving the width of prediction sets in cross-conformal prediction.
method Proposed new variants of existing methods based on recent results on more efficient combination of p-values.
result Smaller prediction sets achieved without compromising theoretical guarantees.

The paper develops distribution-free methods for ordinal classification.

problem Constructing valid prediction sets for ordinal classification problems.
method Leveraging conformal prediction and multiple testing with FWER control.
result The proposed methods achieve satisfactory levels of marginal and class-specific conditional coverages.

We present the expected values from p-value hacking as a choice of the minimum p-value among mm independents tests, which can be considerably lower than the "true" p-value, even with a single trial, owing to the extreme skewness of the meta-distribution. We first present an exact probability distribution (meta-distrib…

2016-03-24abs ↗pdf ↗

The paper examines risk aggregation under mixtures of marginals, finding that more homogeneous distributions lead to larger uncertainty.

problem Investigating the impact of mixing on risk aggregation uncertainty.
method Analyzes ordering relations and inequalities for aggregation sets under distribution and quantile mixtures.
result More homogeneous marginals result in larger aggregation sets, indicating greater model uncertainty.

We propose a differentiable sigmoid function for efficient p-value calculation in clustering.

problem Efficient and accurate p-value calculation for clustering algorithms.
method Designed a differentiable sigmoid function to approximate the Dip-p-value transformation.
result Accelerates computation and integrates well with gradient descent-based learning schemes.

A fast method estimates group-adaptive elastic net penalties using co-data.

problem Computational inefficiency in estimating group-adaptive elastic net penalties.
method Derive low-dimensional representation of Taylor approximation for marginal likelihood and its derivative for group-adaptive ridge penalties; approximate elastic net marginal likelihood by ridge; transform ridge penalties to elastic net penalties.
result Significantly decreases computation time and outperforms other methods.

Many model selection algorithms produce a path of fits specifying a sequence of increasingly complex models. Given such a sequence and the data used to produce them, we consider the problem of choosing the least complex model that is not falsified by the data. Extending the selected-model tests of Fithian et al. (2014)…

2015-12-08abs ↗pdf ↗

Paper certifies intersection of minimum-volume confidence sets for multinomial outcomes.

problem Certifying intersection of minimum-volume confidence sets for multinomial outcomes.
method Exploits likelihood ordering to induce halfspace constraints, enabling adaptive geometric partitioning and computable bounds on p-values.
result Efficient and provably sound algorithm for certifying intersection, disjointness, or indeterminate result.

Structural equation models and Bayesian networks have been widely used to study causal relationships between continuous variables. Recently, a non-Gaussian method called LiNGAM was proposed to discover such causal models and has been extended in various directions. An important problem with LiNGAM is that the results a…

2009-09-16abs ↗pdf ↗

This paper improves prediction accuracy for multi-input classification tasks using p-value aggregation.

problem Generating accurate predictive sets with guaranteed coverage for multi-input classification tasks.
method Integrates p-values from each observation to reduce the size of the predicted label set while maintaining class-conditional coverage.
result The method reduces the size of the predicted label set while preserving the required coverage guarantee.

Unified Bayesian framework improves clinical trial hypothesis testing.

problem Lack of transparency and inability to quantify evidence in traditional P-values.
method Interval null hypothesis framework combined with Bayes factor-based tests.
result Bayesian interval hypothesis testing ensures frequentist error control and interpretability.

To date, testing interactions in high dimensions has been a challenging task. Existing methods often have issues with sensitivity to modeling assumptions and heavily asymptotic nominal p-values. To help alleviate these issues, we propose a permutation-based method for testing marginal interactions with a binary respons…

2012-06-27abs ↗pdf ↗

Assigning significance in high-dimensional regression is challenging. Most computationally efficient selection algorithms cannot guard against inclusion of noise variables. Asymptotically valid p-values are not available. An exception is a recent proposal by Wasserman and Roeder (2008) which splits the data into two pa…

2008-11-13abs ↗pdf ↗

Proposes a method to quantify the reliability of salient regions in deep learning models using p-values.

problem Difficulty in assessing the reliability of saliency maps generated by deep learning models.
method Proposes a selective inference framework to quantify the reliability of salient regions as selected hypotheses by deep learning models.
result The method can provably control the probability of false positive detections of salient regions.

Image segmentation is one of the most fundamental tasks of computer vision. In many practical applications, it is essential to properly evaluate the reliability of individual segmentation results. In this study, we propose a novel framework to provide the statistical significance of segmentation results in the form of …

2019-06-03abs ↗pdf ↗

A method selects candidates based on predictions with statistical control.

problem Screening candidates for resource-intensive steps like hiring or drug discovery.
method Wraps around any prediction model to produce a subset of candidates with controlled false selection rate.
result Empirically demonstrates selection of candidates whose predictions exceed a data-dependent threshold.

The paper addresses selection bias in conformal prediction for focal units.

problem Selection bias in marginally valid conformal prediction intervals for focal units.
method A general framework for constructing selection-conditional coverage prediction sets.
result Efficient methods for various selection rules with exact finite-sample coverage.

The paper confirms two groups of gamma-ray bursts using a new nonparametric metric.

problem Determining the number of inherent groups in gamma-ray bursts.
method A new nonparametric interpoint distance-based measure, combined with clustering methods.
result Confirms two groups of short and long gamma-ray bursts.

New method tests Granger non-causality in panel data with cross-sectional dependencies.

problem Testing Granger non-causality in panel data with cross-sectional dependencies.
method Proposes a new approach to aggregate p-values from panel members to test Granger non-causality, showing lower FDR.
result Our approach discovers true causal relations in panel data, unlike state-of-the-art methods.

Proposes a new method to improve Bayesian computation accuracy using flexible classification.

problem Bayesian computations accuracy check using rank-based simulation-based calibration has limitations.
method Replaces marginal rank test with a flexible classification approach that learns from data.
result Improves statistical power and provides an interpretable divergence measure of miscalibration.

RobKMR improves robustness in multi-omics data analysis for osteoporosis biomarker discovery.

problem Sensitivity to adversarial outliers and lack of comprehensive multi-omics data integration.
method RobKMR, a non-linear M-estimator-based approach using robust kernel centered Gram matrix and robust score test.
result Selected biomarkers (DKK1, MTND5, FASTKD2) significantly bond with four drugs for osteoporosis.

This paper introduces a new method to compare collections of distributions on manifolds and graphs.

problem Comparing collections of probability distributions over diverse domains.
method Intrinsic slicing construction for Wasserstein distances, Hilbert embedding, resampling, p-value combination.
result Powerful and well-calibrated p-values for comparing distributions on manifolds and graphs.

Let (X,Y)(X,Y) be a random variable consisting of an observed feature vector XXX\in \mathcal{X} and an unobserved class label Y{1,2,...,L}Y\in \{1,2,...,L\} with unknown joint distribution. In addition, let D\mathcal{D} be a training data set consisting of nn completely observed independent copies of (X,Y)(X,Y). Usual classification…

2008-01-18abs ↗pdf ↗

Paper extends SI method for detecting CPs in complex systems' frequency domain.

problem Identifying change points in complex systems' frequency domain.
method Extends SI framework to frequency domain using DFT properties and develops valid p-values.
result Reliable detection of genuine CPs with strong statistical guarantees.

Novel conformal methods test out-of-distribution data with labeled outliers.

problem Testing whether new data comes from the same distribution as a reference.
method Integrative conformal p-values re-weight standard p-values using dependent side information.
result The methods outperform standard conformal p-values in simulations and applications.

OptCS optimizes model selection after conformal inference, controlling FDR and power loss.

problem Challenges in model selection for conformal inference, especially when limited labeled data and many model choices are available.
method OptCS framework that allows valid statistical testing after flexible data-driven model optimization, using novel multiple testing procedures.
result Valid conformal p-values constructed despite substantial data reuse, maintaining FDR control.

Solves capillary curvature problems for specific p values.

problem Capillary curvature problems for n<p<1-n < p < 1 and θ(0,π2)θ\in (0,\fracπ{2}).
method Iterative scheme based on capillary Minkowski problem and capillary curvature image operators.
result Fixed points of capillary curvature image operators correspond to solutions of capillary LpL_p-Minkowski problem.

Method predicts rarity of image features to support research integrity investigations.

problem Difficulty in determining if image reuse is by chance or intentional.
method Statistical estimation of ORB features' chance occurrence across PubMed Open Access Subset dataset.
result The method produces decreasingly smaller p-values for more complex imagery, supporting null hypothesis.

Unified theoretical guarantees for distribution-free changepoint detection and testing.

problem Distribution-free changepoint inference with finite-sample validity and consistency.
method Distribution-free changepoint localization using conformal p-values with theoretical guarantees.
result Unified distribution-free guarantees for changepoint detection, localization, and testing.

New algorithms predict causal links better than traditional methods in time series data.

problem Learning causal structure from time series data with challenges in real-world Earth sciences.
method Combination of established ideas for linear methods to identify causal links in non-linear systems, with a focus on large regression coefficients.
result Large regression coefficients can predict causal links better than small p-values in practice.

Paper introduces a method to assess the statistical reliability of changepoints using selective inference and dynamic programming.

problem Assessing the statistical reliability of detected changepoints.
method Selective inference framework combined with dynamic programming for exact p-value computation.
result Proposes a method with high statistical power and decent computational efficiency.