Two new tests assess how well conditional models fit data.
problem Assessing goodness of fit for conditional distributions.
method Nonparametric statistical tests using Stein operators.
result Tests are consistent and interpretable.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,742 papers · 148 categories
Trend · papers per month
48 results for “conditional goodness of fit”
GRASP tests goodness-of-fit for binary classifiers without parametric assumptions.
problem Assessing the fit of a binary classifier to the underlying conditional law of labels given features.
method Formulates a tolerance hypothesis testing problem and proposes a novel test called GRASP.
result Proposes GRASP and Model-X GRASP tests for assessing goodness-of-fit in finite sample settings.
New robustness test for kernel goodness-of-fit tests.
problem Lack of robustness in existing kernel goodness-of-fit tests.
method Proposes a new robust kernel goodness-of-fit test using kernel Stein discrepancy (KSD) balls.
result First robust kernel goodness-of-fit test addressing both qualitative and quantitative robustness.
New test assesses probabilistic model calibration without expensive approximations.
problem Assessing calibration of probabilistic models with scores.
method Kernel Calibration Conditional Stein Discrepancy (KCCSD) test using new score-based kernels.
result Control over type-I error with improved scalability and efficiency.
Unified neural network model for astro-particle physics predictions with coverage, systematics, and goodness-of-fit.
problem Lack of statistical uncertainties, coverage, systematic uncertainties, and goodness-of-fit in neural network predictions.
method KL-divergence objective for joint distribution of data and labels, conditional normalizing flows, amortized with neural networks.
result Unified supervised learning and VAEs under stochastic variational inference for event property predictions.
Improved MMD test for non-Euclidean data with spectral regularization.
problem Inefficient and impractical MMD goodness-of-fit tests for non-Euclidean data.
method Spectral regularization of MMD test, extending results to general cases.
result Minimax optimal test for non-Euclidean data with appropriate regularization.
A new kernel Stein test assesses fit for variable-length sequential data.
problem Evaluating goodness of fit for varying-dimensional data like text documents of different lengths.
method Extends kernel Stein discrepancy (KSD) to variable-dimension settings by identifying appropriate Stein operators and proposing a novel KSD goodness-of-fit test.
result The proposed test performs well on discrete sequential data benchmarks.
In quantitative finance, we often fit a parametric semimartingale model to asset prices. To ensure our model is correct, we must then perform goodness-of-fit tests. In this paper, we give a new goodness-of-fit test for volatility-like processes, which is easily applied to a variety of semimartingale models. In each cas…
The coefficient of determination, known as , is commonly used as a goodness-of-fit criterion for fitting linear models. is somewhat controversial when fitting nonlinear models, although it may be generalised on a case-by-case basis to deal with specific models such as the logistic model. Assume we are fittin…
Neyman-Pearson testing improves goodness of fit in detecting new physics.
problem Detecting small anomalies in data distributions.
method Employing Neyman-Pearson strategy with a rich parametrized family of models.
result Neyman-Pearson testing is more sensitive to small departures and unbiased towards specific anomalies.
Expert-guided model improves seismic compliance monitoring.
problem Classifying seismic data with missingness and expert knowledge.
method Expert-guided class-conditional model with interpretable goodness-of-fit features.
result Interpretable classifier outperforms standard machine learning, especially with small training data.
Improved SSD for faster and more accurate goodness-of-fit tests and model learning.
problem Optimal slicing directions for SSD are computationally expensive and sub-optimal.
method Relaxed optimal slicing requirement, active sub-space construction, spectral decomposition.
result 14-80x speed-up in goodness-of-fit tests compared to gradient-based alternatives.
This paper illustrates a procedure for fitting financial data with -stable distributions. After using all the available methods to evaluate the distribution parameters, one can qualitatively select the best estimate and run some goodness-of-fit tests on this estimate, in order to quantitatively assess its quality. I…
New spectral tests assess network model fits efficiently.
problem Determining if network models fit data well and extrapolate.
method Random matrix theory-derived goodness-of-fit tests.
result General approach simplifies parameter selection in network models.
Sliced kernelized Stein discrepancy improves goodness-of-fit tests and model learning in high dimensions.
problem The curse-of-dimensionality in kernelized Stein discrepancy (KSD).
method Sliced Stein discrepancy and its scalable variants using optimal one-dimensional projections.
result Significantly outperforms KSD and baselines in goodness-of-fit tests and improves model learning.
Paper develops a minimax optimal test for goodness-of-fit using kernel Stein discrepancy.
problem Developing a robust goodness-of-fit test for general domains.
method Kernel Stein Discrepancy (KSD) with spectral regularization and adaptive testing.
result Proposed regularized test achieves minimax optimality up to a logarithmic factor.
Develops a goodness-of-fit test for self-exciting processes.
problem Quantifying how well generative models capture self-exciting point processes.
method Connects to Quasi-maximum-likelihood estimator (QMLE) theory and develops a non-parametric self-normalizing statistic, the Generalized Score (GS) statistics.
result Validates the proposed GS test's good performance through numerical simulation and real-data experiments.
The -generalised distribution fits daily stock returns well.
problem Stock returns are often heavy-tailed, not normally distributed.
method Used the -generalised distribution with a Monte-Carlo goodness of fit test.
result The -generalised distribution fits historic daily stock returns well for a significant proportion of analyzed stocks.
We show that univariate and symmetric multivariate Hawkes processes are only weakly causal: the true log-likelihoods of real and reversed event time vectors are almost equal, thus parameter estimation via maximum likelihood only weakly depends on the direction of the arrow of time. In ideal (synthetic) conditions, test…
We propose a nonparametric statistical test for goodness-of-fit: given a set of samples, the test determines how likely it is that these were generated from a target density function. The measure of goodness-of-fit is a divergence constructed via Stein's method using functions from a Reproducing Kernel Hilbert Space. O…
A new test assesses how well observed networks fit a specified ERGM model.
problem Testing the goodness of fit for ERGMs with a single network observation.
method Kernel Stein discrepancy combined with a discrete Stein operator for ERGMs, Monte Carlo simulation.
result The test provides theoretical and practical support for assessing ERGM fit.
KSDAgg combines multiple KSD tests to improve goodness-of-fit testing without splitting data.
problem Improving goodness-of-fit testing without data splitting.
method KSDAgg aggregates multiple KSD tests with different kernels to maximize power.
result KSDAgg achieves the smallest uniform separation rate of the collection, up to a logarithmic term.
Copula Analysis of Risk: A Multivariate Risk Analysis for VaR and CoVaR using Copulas and DCC-GARCHq-fin.RM
Study uses copulas and DCC-GARCH for multivariate risk analysis of VaR and CVaR.
problem Multivariate risk analysis for Value at Risk (VaR) and Conditional Value at Risk (CoVaR).
method Copulas and Dynamic Conditional Correlation (DCC)-GARCH models applied to historical financial data.
result Comparison of different copula families for goodness-of-fit and effectiveness.
We derive a new discrepancy statistic for measuring differences between two probability distributions based on combining Stein's identity with the reproducing kernel Hilbert space theory. We apply our result to test how well a probabilistic model fits a set of observations, and derive a new class of powerful goodness-o…
New autoencoder uses goodness-of-fit tests for better model performance.
problem Improving the goodness-of-fit in generative models.
method Develops Goodness-of-Fit Autoencoder (GoFAE) incorporating GoF tests at minibatch and global levels.
result GoFAE achieves comparable performance to deep generative models while retaining statistical indistinguishability.
Software package assesses spherical data distributions and clusters.
problem Assessing and clustering spherical data distributions.
method Innovative goodness-of-fit tests and clustering algorithms using kernel-based quadratic distances.
result Efficient and mathematically sound goodness-of-fit tests for spherical data.
A new framework improves kernel Stein discrepancy tests for validating distributions.
problem Improving goodness-of-fit testing for non-normal distributions.
method Introducing Sf-KSD, a unifying framework for studying Stein operators in KSD-based tests.
result Sf-KSD guides the development of new tests and outperforms existing methods.
It is often stated in papers tackling the task of inferring Bayesian network structures from data that there are these two distinct approaches: (i) Apply conditional independence tests when testing for the presence or otherwise of edges; (ii) Search the model space using a scoring metric. Here I argue that for complete…
Global Optimization Networksstat.ML
GONs improve predictions of maximizers from noisy black-box functions.
problem Estimating maximizers of noisy black-box functions.
method Global Optimization Networks (GONs) composed of invertible and unimodal functions.
result GONs outperform convex fits, GPR, and DNNs in prediction accuracy.
Semiparametric KSD test: unifying score and distance-based approaches for goodness-of-fit testingstat.ML
Unified score and distance-based GoF tests for model adequacy.
problem Difficulty in extending score-based GoF tests to nonparametric alternatives.
method Introducing semiparametric kernelized Stein discrepancy (SKSD) test.
result SKSD test is computationally efficient and universally consistent.
Deep Learning-Based Estimation and Goodness-of-Fit for Large-Scale Confirmatory Item Factor Analysisstat.ML
New deep learning methods improve estimation and GOF assessment for large-scale IFA.
problem Estimating and assessing goodness-of-fit for large-scale confirmatory IFA models.
method Extended deep learning algorithm for parameter estimation and simulation-based tests for GOF assessment.
result Proposed methods provide comparable estimates and detect latent dimensionality misspecification.
CEDA improves understanding of data fit to models.
problem Real-world data often deviates from theoretical models.
method Categorical Exploratory Data Analysis (CEDA) to highlight deviations.
result CEDA reveals where and how data fits or deviates from models.
RENAL test evaluates generative models for time series data.
problem Evaluating generative models for time series data is challenging.
method RENAL test uses recurrent neural networks to transform time series into conditionally independent data pairs for goodness-of-fit testing.
result RENAL test outperforms existing methods in evaluating generative models for time series data.
Given two candidate models, and a set of target observations, we address the problem of measuring the relative goodness of fit of the two models. We propose two new statistical tests which are nonparametric, computationally efficient (runtime complexity is linear in the sample size), and interpretable. As a unique adva…
Improved KSD test for better detection of differences in distributions.
problem Low power of KSD test when distributions have same modes but different mixing proportions.
method Perturb the observed sample using Markov transition kernels to improve KSD test power.
result Perturbed KSD test can lead to substantially higher power than the original KSD test.
Fourier representation improves KSD for infinite-dimensional data.
problem Applying KSD to infinite-dimensional data.
method Combining measure equations with kernel methods for a Fourier representation of KSD.
result KSD can separate measures in infinite-dimensional Hilbert spaces.
The paper introduces tests for missing data models based on graph assumptions.
problem Verification of assumptions in missing data models is insufficiently addressed.
method The paper explores three classes of missing data models and designs goodness-of-fit tests.
result The paper provides new insights and tests for missing data graphical models.
New method uses reinforcement learning to sample from complex data structures efficiently.
problem Constructing reliable samples from high-dimensional polytopes for goodness-of-fit tests.
method Markov decision process and reinforcement learning for sampling.
result Demonstrated scalable tools from linear algebra for theoretical guarantees in non-linear algebra context.
Generalized Naive Bayesstat.ML
Paper introduces Generalized Naive Bayes for better data fitting.
problem Improving Naive Bayes for better data fitting.
method Developed new greedy and optimal algorithms for GNB.
result Proves GNB fits data at least as well as classical NB.
Bad models can teach well by replicating noise.
problem Overparameterized models can replicate noise in training data.
method Knowledge distillation from noisy samplers.
result Distillation from samplers approximates Bayes optimal classifier.
We review the main "omnibus procedures" for goodness-of-fit testing for copulas: tests based on the empirical copula process, on probability integral transformations, on Kendall's dependence function, etc, and some corresponding reductions of dimension techniques. The problems of finding asymptotic distribution-free te…
Computable Stein discrepancies have been deployed for a variety of applications, ranging from sampler selection in posterior inference to approximate Bayesian inference to goodness-of-fit testing. Existing convergence-determining Stein discrepancies admit strong theoretical guarantees but suffer from a computational co…
A new method for modeling insurance claim frequencies using random proportions.
problem Inaccurate fitting of classical distributions to insurance claim frequency data.
method Modeling claim frequencies using random proportions of insurance contracts and applying goodness-of-fit tests.
result A new statistical approach for better modeling insurance claim frequencies.
We propose a novel adaptive test of goodness-of-fit, with computational cost linear in the number of samples. We learn the test features that best indicate the differences between observed samples and a reference model, by minimizing the false negative rate. These features are constructed via Stein's method, meaning th…
A new sequential test for unnormalized densities.
problem Testing unnormalized densities with adaptive stopping.
method Sequential kernelized Stein discrepancy test, using non-uniform Stein kernels.
result Valid test with asymptotic lower bound for growth.
A goodness-of-fit test for DCSBM improves scalability and power for large sparse networks.
problem Testing goodness-of-fit for degree-corrected stochastic block models (DCSBM) in large sparse networks.
method Proposes an adjusted chi-square test statistic for multinomial distributions, adjusted for degree-corrected networks, and applies it to compressed adjacency matrices.
result The test statistic converges in distribution under null, and is consistent in recovering the number of communities.
Two models are identified for robust cross-impact analysis.
problem Developing and validating cross-impact models that fit data and are well-behaved.
method Classified cross-impact models according to desirable properties and evaluated them on three asset classes.
result Only one model satisfies all desirable properties and is suitable for applications.
The paper fits a seven-parameter GTS distribution to financial data.
problem Nonexistence of GTS probability density function makes MLE inadequate.
method Used fractional Fourier transform to circumvent MLE and provide good parameter estimation.
result The GTS distribution fits financial data significantly better than other models.