New auction design uses statistical learning to reduce costs and improve fairness.
problem Designing efficient multi-item auctions with reduced implementation costs and fairness.
method Nonparametric density estimation for credible intervals, two new strategies.
result Strategies consistently outperform alternative methods in revenue maximization and cost reduction.
New method for credible intervals of Covid19 reproduction number.
problem Lack of credibility intervals in existing estimates.
method Combines Langevin Monte Carlo with Proximal operators.
result Produces credible intervals for reproduction number estimates.
BIGUE algorithm provides credible intervals for hyperbolic network embeddings.
problem Uncertainty in hyperbolic network embeddings.
method Markov chain Monte Carlo (MCMC) algorithm for Bayesian hyperbolic random graph model.
result Samples from the posterior distribution provide credible intervals for hyperbolic coordinates and network properties.
Credibility theory provides tools to obtain better estimates by combining individual data with sample information. We apply the Credibility theory to a Uniform distribution that is used in testing the reliability of forecasting an interest rate for long term horizons. Such empirical exercise is asked by Regulators (CRR…
Bayesian method improves estimation of unseen species.
problem Estimating unseen species in biological and physical sciences.
method Bayesian nonparametric approach with Pitman-Yor prior and Gaussian credible intervals.
result Improves asymptotic credible intervals for unseen species estimation.
Bayesian method for estimating ATE with robustness to model misspecification.
problem Estimating average treatment effects under unconfoundedness.
method Double robust Bayesian inference using adjusted prior and posterior distributions.
result Bayesian credible sets form asymptotically exact confidence intervals.
Bayesian inference engines improve density estimation accuracy and scalability.
problem Constructing accurate and scalable probability density functions.
method Bayesian inference engines (no-U-turn sampling and expectation propagation) with binning strategy.
result Density estimates have excellent comparative performance and scale well to large sample sizes.
Gaussian process (GP) regression is a powerful interpolation technique due to its flexibility in capturing non-linearity. In this paper, we provide a general framework for understanding the frequentist coverage of point-wise and simultaneous Bayesian credible sets in GP regression. As an intermediate result, we develop…
Adapts Gaussian process surrogate evaluation with conformal prediction for better coverage guarantees.
problem Uncertainty quantification and model specification issues in Gaussian process surrogate models.
method Adaptive cross-conformal prediction intervals using posterior standard deviation weighting.
result Conformal prediction intervals provide significant correlation with surrogate model error and frequentist coverage guarantees.
Methods for reasoning under uncertainty are a key building block of accurate and reliable machine learning systems. Bayesian methods provide a general framework to quantify uncertainty. However, because of model misspecification and the use of approximate inference, Bayesian uncertainty estimates are often inaccurate -…
This work develops rigorous theoretical basis for the fact that deep Bayesian neural network (BNN) is an effective tool for high-dimensional variable selection with rigorous uncertainty quantification. We develop new Bayesian non-parametric theorems to show that a properly configured deep BNN (1) learns the variable im…
Randomized predictions ensure fair and accurate individual calibration in machine learning.
problem Systematic bias in typical calibration methods leads to unfair predictions for certain subgroups.
method Randomization of predictions to enforce individual calibration, trading off bias with variance.
result Randomized regression functions are more calibrated for arbitrary subgroups and achieve higher utility.
Bayesian framework improves LLM evaluation stability and transparency.
problem Pass@k and avg@N are unstable and misleading for LLMs.
method Bayesian evaluation with posterior estimates and credible intervals.
result Posterior-based evaluation yields stable and transparent rankings.
Walley's Imprecise Dirichlet Model (IDM) for categorical i.i.d. data extends the classical Dirichlet model to a set of priors. It overcomes several fundamental problems which other approaches to uncertainty suffer from. Yet, to be useful in practice, one needs efficient ways for computing the imprecise=robust sets or i…
Study uses Viber and street polls to estimate Belarus election ratings and turnout.
problem Obtaining accurate ratings of candidates in Belarus's banned polls.
method Bayesian multilevel regression with poststratification.
result Estimated ratings and turnout contradict official election results.
The paper discusses methods for interval estimation of coefficients in penalized regression models for insurance data.
problem Valid inference on coefficients after feature selection in GLM family for insurance data.
method Proposes methodologies for constructing confidence intervals of coefficients after feature selection in GLM family.
result Valid inference on coefficients after feature selection in GLM family for insurance data.
Paper introduces exact credible sets for classification problems.
problem No general way to construct exact credible sets for classification.
method Generalized credible set with connection to Neyman--Pearson lemma and randomized decision rule.
result Achieves any preassigned credible level for classification problems.
Transformer architecture improved with credibility mechanism for better model performance.
problem Improving predictive models in tabular data.
method Introducing a credibility mechanism to the Transformer architecture.
result Credibility Transformer leads to superior predictive models compared to state-of-the-art models.
New method for accurate uncertainty estimation in deep learning predictions.
problem Insufficient methods for assessing prediction uncertainty in deep learning.
method Valid non-parametric bootstrap method for deep neural networks.
result Accurate confidence intervals and simultaneous confidence bands for survival data.
This paper develops a new method for online density estimation from noisy data.
problem Estimating probability density function from noisy streaming data.
method Quasi-Bayesian sequential deconvolution using Newton's algorithm.
result Sequential deconvolution estimate fn with large sample asymptotic guarantees. The paper proposes a method to assess survey data credibility without needing many samples, regardless of data dimension.
problem Assessing the credibility of survey data across different dimensions.
method Task-based approach and model-specific distance metric for verifying survey data credibility in regression models.
result The sample complexity of the proposed algorithm is independent of the data dimension, making it more efficient.
The mass, or binding energy, is the basis property of the atomic nucleus. It determines its stability, and reaction and decay rates. Quantifying the nuclear binding is important for understanding the origin of elements in the universe. The astrophysical processes responsible for the nucleosynthesis in stars often take …
EENNs improve inference efficiency but need nested prediction sets for reliable uncertainty estimates.
problem Non-nested prediction sets from standard uncertainty quantification methods in EENNs.
method Introduced anytime-valid confidence sequences (AVCSs) tailored for EENNs.
result AVCSs generate nested prediction sets across EENN exits, addressing the issue of non-nested sets.
Paper compares Bayesian and de-biased estimators for low-rank matrix completion.
problem Predict missing entries in partially observed matrices.
method Bayesian and de-biased estimators comparison.
result De-biased estimator performs similarly to Bayesian estimators but is more stable and can outperform in small samples.
EBLIME enhances model explanations using Bayesian ridge regression.
problem Improving model explanations for black-box machine learning models.
method EBLIME uses Bayesian ridge regression to explain feature importance.
result EBLIME provides more intuitive and accurate feature importance rankings.
Online reviews provide viewpoints on the strengths and shortcomings of products/services, influencing potential customers' purchasing decisions. However, the proliferation of non-credible reviews -- either fake (promoting/ demoting an item), incompetent (involving irrelevant aspects), or biased -- entails the problem o…
New method provides valid confidence intervals for spatial associations.
problem Limited insight into covariate-response relationships in spatial settings.
method Lipschitz-driven uncertainty quantification for spatial association.
result Valid frequentist confidence intervals for associations in spatial settings.
CADR estimator improves inference for contextual bandit data.
problem Valid inference on contextual bandit data.
method CADR estimator for policy value, addressing adaptive data collection challenges.
result CADR provides correct coverage of confidence intervals.
CP4SBI improves the calibration of credible sets in SBI models.
problem Inaccurate credible sets in SBI models lead to underestimation of true parameters.
method Develops a local conformal calibration framework for SBI models.
result Improves the quality of uncertainty quantification for neural posterior estimators.
Unified framework for fair decision-making across diverse groups.
problem Statistical brittleness in fairness testing for small subgroups.
method Size-adaptive hypothesis testing framework.
result Validated approach for interpretable, statistically rigorous decisions.
This project demonstrated a methodology to estimating cooperate credibility with a Natural Language Processing approach. As cooperate transparency impacts both the credibility and possible future earnings of the firm, it is an important factor to be considered by banks and investors on risk assessments of listed firms.…
In many settings, it is important that a model be capable of providing reasons for its predictions (i.e., the model must be interpretable). However, the model's reasoning may not conform with well-established knowledge. In such cases, while interpretable, the model lacks \textit{credibility}. In this work, we formally …
Proposes an alternative method for quantifying uncertainty in complex models.
problem Quantifying uncertainty in complex models and evaluations.
method Infinitesimally regularizes the training loss to assess downstream uncertainty.
result Provides reliable quantification of uncertainty and calibrated confidence intervals.
GP-CATE calibrates CATE intervals in few-placebo trials with Gaussian processes.
problem Calibrating uncertainty intervals for CATE in small-arm trials.
method GP-CATE uses Gaussian processes to model each arm's outcome surface directly.
result GP-CATE achieves calibrated coverage where other methods fail.
Discriminative jackknife estimates deep learning uncertainty.
problem Quantifying uncertainty in deep learning models.
method Discriminative jackknife using influence functions of loss.
result DJ satisfies frequentist coverage and discriminative accuracy.
Study evaluates quality of uncertainty estimates for neural networks.
problem Lack of principled assessment methods for evaluating uncertainty quality in deep learning.
method Statistical methods of frequentist interval coverage, interval width, and expected calibration error.
result Different UQ methods produce markedly different quality uncertainty estimates.
This paper computes exact posterior distributions of mixture weights in hierarchical Bayesian models.
problem Uncertainty in class membership or data-generating processes in heterogeneous data.
method Exact marginalization of mixture weights using dynamic programming and FFT for two components, and joint dynamic program for K >= 3 components.
result Exact posterior distributions of mixture weights are finite mixtures of Beta distributions, providing credible intervals and per-observation local false-discovery rates.
Bayesian framework improves reliability and consistency of model explanations.
problem Inconsistent and unreliable explanations from state-of-the-art methods.
method Developed a novel Bayesian framework for generating local explanations with associated uncertainty.
result Generated explanations are consistent, stable, and provide credible intervals for feature importances.
In this study, we analyzed the activity of monkey V1 neurons responding to grating stimuli of different orientations using inference methods for a time-dependent Ising model. The method provides optimal estimation of time-dependent neural interactions with credible intervals according to the sequential Bayes estimation…
In situations like tax declarations or analyzes of household budgets we would like to automatically evaluate credibility of exogenous variable (declared income) based on some available (endogenous) variables - we want to build a model and train it on provided data sample to predict (conditional) probability distributio…
A new method to estimate local volatility from high-frequency data.
problem Quantitative trading risk management needs a better way to estimate volatility.
method Realized local volatility surface estimated via high-frequency data and Bayesian nonparametric estimation.
result The method can capture counterfactual volatility and improve risk management.
Bayesian principles improve neural additive models for better feature selection and uncertainty.
problem Lack of calibrated uncertainties and feature selection in neural additive models.
method Augmenting NAMs with Bayesian principles to provide credible intervals, feature selection, and interaction ranking.
result Improved performance on tabular datasets and real-world medical tasks.
Proposes a method to assess unobserved confounding effects in causal inference.
problem Assessing unobserved confounding in causal inference studies.
method Copula-based normalizing flows with sensitivity parameter ρ. result Estimates average causal effect (ACE) as a function of unobserved confounding strength.
Develops a new method for sampling from Bayesian credible sets using deep generative quantile learning.
problem Sampling from posterior distributions in high-dimensional spaces with intractable likelihoods.
method Uses deep neural networks to implicitly sample from Bayesian credible sets via a push-forward mapping and Monge-Kantorovich depth.
result Demonstrates improved performance and theoretical consistency of the quantile learning framework.
The paper analyzes uncertainty quantification in sparse Gaussian process regression with a Brownian motion prior.
problem Analyzing uncertainty in sparse Gaussian process regression with a Brownian motion prior.
method Theoretical guarantees and limitations for pointwise credible sets are derived for a rescaled Brownian motion prior with a sparse variational Gaussian process method.
result Theoretical characterization of asymptotic frequentist coverage for credible sets, distinguishing conservative and overconfident cases.
Recent explainability related studies have shown that state-of-the-art DNNs do not always adopt correct evidences to make decisions. It not only hampers their generalization but also makes them less likely to be trusted by end-users. In pursuit of developing more credible DNNs, in this paper we propose CREX, which enco…
The paper tests the credibility of public and private surveys using linear regression and differential privacy.
problem Ensuring the validity of data analysis results from sample surveys using linear regression.
method Designing an algorithm to test the credibility of surveys and extending it to handle LDP.
result The algorithm achieves optimal estimation error bound for ℓ1 linear regression and reduces sample complexity. DABS uses a policy network to select experiments in high-dimensional design spaces.
problem Adaptive factorial screening in high-dimensional discrete design spaces.
method DABS learns a policy network offline to sequentially select experiments, incorporating sparsity and interactions via a spike-and-slab prior.
result DABS achieves superior accuracy and scalability over classical and Bayesian baselines under tight experimental budgets.