Responds to critiques on tests for causal parameter confidence intervals.
problem Testing nominal confidence interval coverage for causal parameters estimated by machine learning.
method Rejoinder to critiques on nearly assumption-free tests.
result Clarifies and supports the original research's approach.
Bagging stabilizes models without distributional assumptions.
problem Stability of machine learning models without distributional assumptions.
method Derives a finite-sample guarantee on bagging stability for any model.
result Guarantee applies to many bagging variants and is optimal.
An assumption-free automatic check of medical images for potentially overseen anomalies would be a valuable assistance for a radiologist. Deep learning and especially Variational Auto-Encoders (VAEs) have shown great potential in the unsupervised learning of data distributions. In principle, this allows for such a chec…
Bounds and sensitivity analysis for causal effects with MNAR confounders.
problem Estimating causal effects with missing outcome data.
method Assumption-free bounds and sensitivity analysis for outcome-independent MNAR.
result Valid bounds and sensitivity analysis methods for causal effect estimation.
For many causal effect parameters of interest, doubly robust machine learning (DRML) estimators ψ^1 are the state-of-the-art, incorporating the good prediction performance of machine learning; the decreased bias of doubly robust estimators; and the analytic tractability and bias reduction of sample splitting wi…
We characterize distributional equivalence in latent-variable models with cycles.
problem Lack of an equivalence characterization for latent-variable causal models with cycles.
method Established graphical criterion for distributional equivalence and developed edge rank constraints.
result First equivalence characterization without structural assumptions for latent-variable models with cycles.
We propose a novel method for clustering data which is grounded in information-theoretic principles and requires no parametric assumptions. Previous attempts to use information theory to define clusters in an assumption-free way are based on maximizing mutual information between data and cluster labels. We demonstrate …
A method to assess sensitivity to unmeasured confounding with sharp bounds.
problem Assessing the impact of unmeasured confounding on causal effects.
method Sets two intuitive parameters to estimate sensitivity intervals.
result Bounds on true causal effects can be tighter than existing methods.
New method bounds hardware noise without assumptions.
problem Estimating hardware noise without assumptions.
method Machine Learning and Conformal Prediction.
result Theoretical upper bounds of fidelity.
Contrast trees assess machine learning accuracy, boosting improves performance.
problem Lack of accuracy assessment for machine learning results.
method Contrast trees and distribution boosting methods.
result Distribution boosting provides an assumption-free method for estimating outcome distributions.
New algorithm reduces offline RL sample complexity for MDPs.
problem Learning optimal policies from offline data in unknown MDPs.
method Adaptive Pessimistic Value Iteration (APVI) algorithm.
result Suboptimality bound nearly matches theoretical limits.
Random feature mapping (RFM) is a popular method for speeding up kernel methods at the cost of losing a little accuracy. We study kernel ridge regression with random feature mapping (RFM-KRR) and establish novel out-of-sample error upper and lower bounds. While out-of-sample bounds for RFM-KRR have been established by …
NMDR estimates complex mixtures of distributions efficiently.
problem Estimating complex finite mixtures of distributions in high-dimensional settings.
method Flexible additive predictors, neural networks, and deep learning optimizers.
result Competitive performance in complex scenarios compared to existing approaches.
Choppy optimizes ranked list truncation using Transformer architecture.
problem Optimal truncation of ranked search results to balance relevance and user cost.
method Assumption-free Transformer model optimizing user-defined IR metrics.
result Choppy improves upon recent state-of-the-art methods.
Privacy concern has been increasingly important in many machine learning (ML) problems. We study empirical risk minimization (ERM) problems under secure multi-party computation (MPC) frameworks. Main technical tools for MPC have been developed based on cryptography. One of limitations in current cryptographically priva…
We give a polynomial-time algorithm for learning neural networks with one layer of sigmoids feeding into any Lipschitz, monotone activation function (e.g., sigmoid or ReLU). We make no assumptions on the structure of the network, and the algorithm succeeds with respect to {\em any} distribution on the unit ball in n …
C-PP-COAD detects anomalies with limited real data, reducing dependency on real calibration data.
problem Limited real calibration data for online anomaly detection.
method Context-aware prediction-powered conformal online anomaly detection (C-PP-COAD).
result Significantly reduces dependency on real calibration data without compromising FDR control.
When estimating finite mixture models, it is common to make assumptions on the mixture components, such as parametric assumptions. In this work, we make no distributional assumptions on the mixture components and instead assume that observations from the mixture model are grouped, such that observations in the same gro…
Paper presents a machine learning method to improve significance tests for misspecified linear models.
problem Misspecification of linear assumptions in social science models leads to inaccurate significance levels.
method Apply machine learning to fit ground truth function, calculate linear approximation, and adjust the estimator.
result The method significantly outperforms linear regression for non-linear ground truth functions.
Adaptive PI by reweighting nonconformity scores improves model uncertainty reflection.
problem CP methods using a constant correction for all test points ignore individual uncertainties.
method QRF learns distribution of nonconformity scores and assigns weights to samples.
result PI lengths more aligned with model uncertainty and improved adaptiveness.
RQR improves prediction intervals for skewed data.
problem Invalid prediction intervals for skewed noise.
method Relaxed Quantile Regression (RQR) for asymmetric noise.
result Improved prediction intervals with desirable qualities.
Proposes new methods for inference in GLMs without assuming model correctness.
problem Inference for GLMs assumes model correctness, leading to uncertainty and bias.
method Develops nonparametric estimands and uses influence curves with flexible procedures.
result Inference for GLM parameters is improved without model correctness assumptions.
Study agnostic feature-based dynamic pricing models with linear policies and noisy valuations.
problem Tackles dynamic pricing with unknown noise and no assumptions on data.
method Studies two agnostic models: linear policy and linear noisy valuation, presenting algorithms and regret bounds.
result Demonstrates no-regret learning is possible under weak assumptions, but noisy feedback is not significantly more useful than bandit feedback.
A new method ReCPE removes the need for a distributional assumption in PU learning.
problem Training binary classifiers with only positive and unlabeled data without negative data.
method Regrouping CPE (ReCPE) that constructs an auxiliary distribution to ensure positive data support is never in negative data support.
result ReCPE improves all state-of-the-art CPE methods on various datasets, indicating the need for the distributional assumption.
We study the dynamic assortment planning problem, where for each arriving customer, the seller offers an assortment of substitutable products and customer makes the purchase among offered products according to an uncapacitated multinomial logit (MNL) model. Since all the utility parameters of MNL are unknown, the selle…
New methods provide stable ranking without assumptions on data distributions.
problem Stability issues in ranking problems with noisy data.
method Developed a stability framework and two ranking operators.
result Guaranteed stability without assumptions on data distributions.
Spofe bridges statistical rigor and interpretability in feature extraction from tabular data.
problem Ensuring statistical rigor and interpretability in feature extraction from complex tabular data.
method Spofe combines kernel principal components and sparse polynomial functions with a multi-objective knockoff selection procedure.
result Spofe consistently outperforms other methods in feature selection for regression and classification tasks.
Efficiently calculates privacy guarantees for 2020 Census data.
problem Evaluate privacy guarantees for 2020 U.S. Census data releases.
method Sieve-accelerated quadrature method to evaluate tail probabilities of high-dimensional convolutions.
result Achieves 1,824-fold speedup over prior methods while maintaining error tolerances.
Study limits of testing algorithms without assumptions, finding key performance bounds.
problem Understanding algorithm performance without making assumptions.
method Exploring fundamental limits of algorithm performance testing.
result Hardness results for evaluating algorithm performance and comparing multiple algorithms.