Establishes statistical and computational bounds for influence diagnostics.
problem Identifying influential datapoints or subsets in machine learning models.
method Finite-sample statistical bounds and computational complexity for influence functions and approximate maximum influence perturbations.
result Established statistical and computational guarantees for influence diagnostics.
Applying machine learning in the health care domain has shown promising results in recent years. Interpretable outputs from learning algorithms are desirable for decision making by health care personnel. In this work, we explore the possibility of utilizing causal relationships to refine diagnostic prediction. We focus…
Proposes a diagnostic method to evaluate factor models using cap-axis integrals.
problem Improving factor model evaluation in low-dimensional spaces.
method Lifts pricing errors into a bridge-alpha curve along the market-capitalization rank axis.
result The cap-axis norm is distinct from Sharpe gain and size exposure.
Proposes a diagnostic method to evaluate factor models using cap-axis integrals.
problem Improving factor model evaluation for low-dimensional models.
method Lifts pricing errors into a bridge-alpha curve along the market-capitalization rank axis.
result The cap-axis norm is distinct from Sharpe gain and size exposure.
AI predicts medical specialty diagnostic choices from EHR records.
problem Predicting timely medical specialty diagnostic workups for patients.
method Ensemble of feed-forward neural networks trained on EHR data.
result Significantly higher accuracy compared to traditional checklists.
Graph-based approach repairs programs from diagnostic feedback.
problem Learning to repair programs from limited labeled data and compiler error messages.
method Introduces program-feedback graph and graph neural network for reasoning, and self-supervised learning with unlabeled programs.
result DrRepair significantly outperforms prior work, achieving high repair rates.
Interpretable deep learning is a fundamental building block towards safer AI, especially when the deployment possibilities of deep learning-based computer-aided medical diagnostic systems are so eminent. However, without a computational formulation of black-box interpretation, general interpretability research rely hea…
Reducing ICD-10 code granularity improves cost model accuracy and stability.
problem High-dimensional regression with ICD-10 codes leads to unstable coefficient estimates.
method Log-linear analytics approach to cost model regularization through diagnostic code merging.
result Reducing ICD-10 code granularity from 7 characters to 6 or fewer improves model interpretability and consistency.
Paper improves predictive distributions for rare events using a simple framework.
problem Local miscalibration of predictive distributions for rare events.
method Semiparametric diagnostic transport maps to correct tail probabilities.
result Semiparametric maps improve predictions for severe weather hazards.
The paper breaks down AUC into cluster-level components for better model diagnostics.
problem Global AUC masks weaknesses in specific subpopulations, leading to financial or operational risks.
method Formal decomposition of AUC into intra- and inter-cluster components, comparing with other performance metrics.
result Allows practitioners to evaluate and diagnose model performance within and across clusters.
The article explains how to estimate confusion matrices for classifiers using unlabeled data.
problem Estimating sensitivity and specificity of binary medical diagnostic tests without gold standard tests.
method Modifying diagnostic test solutions to estimate confusion matrices for classifiers on unlabeled data.
result The approach can be used to estimate accuracy statistics for supervised or unsupervised binary classifiers on unlabeled data.
Language models fail to process hallucinated responses, and this study diagnoses the failure.
problem Language models fail to process hallucinated responses, leading to over-concentration or diffuse attention.
method The study uses forced scoring of benchmark-labeled responses to compute attention shapes and analyze the symmetric component of the degree-normalized attention operator.
result The study proves that every transpose-invariant spectral diagnostic of the attention operator is orientation-blind and bounds the sensitivity of any Lipschitz diagnostic by the asymmetry coefficient \(G\).
New diagnostics detect variability in individual risk estimates from machine learning models in healthcare.
problem Variability in individual risk estimates from machine learning models in healthcare, leading to unreliable treatment decisions.
method Proposed evaluation framework using empirical prediction interval width and empirical decision flip rate diagnostics.
result Randomness in optimization and initialization can lead to substantial individual-level variability in risk estimates, affecting clinical decisions.
Develops a diagnostic framework for interest rate model calibration, showing equivalence to Weighted Least Squares and revealing boundary-dominated leverage and local parameter instability.
problem Calibration of stochastic interest rate models
method Diagnostic framework using non-linear regression and analytical tractability of At-The-Money caps
result Reveals boundary-dominated leverage and local parameter instability
TADDAA improves accuracy diagnostics for variational approximations.
problem Challenges in evaluating the accuracy of variational approximations.
method Uses many short parallel MCMC chains to obtain lower bounds on the error of each posterior functional of interest.
result Validates the practical utility and computational efficiency of TADDAA on various models.
The paper introduces diagnostic transport maps to improve the reliability of rare event predictions.
problem Improper calibration of predictive distributions, especially for rare events.
method Diagnostic transport maps to adjust base model's probabilities for better calibration.
result Diagnostic transport maps improve predictive performance for rare events, including 24-hour rapid intensity change.
Major advances have been made regarding the utilization of artificial intelligence in health care. In particular, deep learning approaches have been successfully applied for automated and assisted disease diagnosis and prognosis based on complex and high-dimensional data. However, despite all justified enthusiasm, over…
It has been argued that in supervised classification tasks, in practice it may be more sensible to perform model selection with respect to some more focused model selection score, like the supervised (conditional) marginal likelihood, than with respect to the standard marginal likelihood criterion. However, for most Ba…
Paper presents a light-weight CNN model for Parkinson's disease diagnosis.
problem Diagnosing Parkinson's disease efficiently and accurately.
method A light-weight CNN model cascading to LSTM for time-series signals.
result The model achieves high-quality results with fewer parameters and operations.
New diagnostic method detects misspecified models in inverse PDE problems.
problem Misleading residual-norm diagnostics in inverse PDE problems.
method Structure-sensitive sequential diagnostic using e-processes.
result Rejects fitted models that produce biased predictions.
AI enhances cancer diagnostics using spectroscopy.
problem Early and accurate cancer diagnosis.
method Combining AI with spectroscopy-based techniques.
result AI improves cancer diagnostics speed and safety.
This paper simplifies deep ReLU networks into local linear models for better interpretability.
problem Limited transparency and interpretability of deep neural networks, especially ReLU networks.
method Local linear representation and equivalent set of local linear models (LLMs).
result Simplified deep ReLU networks for better interpretability and diagnostics.
Spectral measurements reveal hidden representation geometry in language model training.
problem Hidden internal representation in language model training is hard to examine.
method Empirical protocol using activation covariance and per-sample gradient SVD spectra.
result Batch size affects representation geometry, and activation spectra predict token efficiency.
Paper introduces a diagnostic for approximate inference methods.
problem Estimating errors in probabilistic inference algorithms, especially for approximate methods.
method Repeatedly simulate datasets from the prior and perform inference on each, estimating a symmetric KL-divergence.
result A diagnostic for approximate inference methods can be estimated using symmetric KL-divergence.
Paper proposes a diagnostic tool for evaluating model performance out-of-sample.
problem Evaluating model performance on unseen data.
method Uses a finite calibration dataset to assess future losses.
result Provides guarantees under weak assumptions and quantifies distribution shifts.
Machine learning improves diagnostic test accuracy for bovine tuberculosis.
problem Improving diagnostic test sensitivity for bovine tuberculosis.
method Machine learning to assess risk landscapes and predict infection.
result Test sensitivity improved, detecting 240 more infected herds per year.
Recent studies have shown promising results in using Deep Learning to detect malignancy in whole slide imaging. However, they were limited to just predicting positive or negative finding for a specific neoplasm. We attempted to use Deep Learning with a convolutional neural network algorithm to build a lymphoma diagnost…
New bidirectional model predicts magnetohydrodynamics fields and estimates uncertainty.
problem Predicting multiple fields in magnetohydrodynamics with uncertainty.
method Bidirectional autoregressive latent diffusion approach.
result Model can estimate uncertainty without ground truth using self-supervised consistency.
Online symptom checkers have significant potential to improve patient care, however their reliability and accuracy remain variable. We hypothesised that an artificial intelligence (AI) powered triage and diagnostic system would compare favourably with human doctors with respect to triage and diagnostic accuracy. We per…
Quickly adapts fault diagnosis models for industrial machines.
problem Fault diagnostic models trained for lab machines fail on industrial ones.
method Net2Net transformation followed by fine-tuning.
result Models can be quickly adapted for new operating conditions.
Paper presents a probabilistic diagnostic model for identifying and treating supervised learning degradation issues.
problem Degradation problems in supervised learning, including class imbalance, overlapping, small-disjuncts, noisy labels, and sparseness.
method Develops a novel probabilistic diagnostic model to identify and treat degradation issues in supervised learning.
result Early and correct diagnosis of degradation issues allows for selecting appropriate remediation treatments and unbiased performance metrics.
This work proposes validation diagnostics for SBI algorithms using Normalizing Flows.
problem Lack of appropriate validation methods for SBI algorithms with complex, high-dimensional data.
method Develops validation diagnostics based on Normalizing Flows with theoretical guarantees.
result Offers theoretical guarantees on consistency of NF-based estimators.
Machine learning promises to revolutionize clinical decision making and diagnosis. In medical diagnosis a doctor aims to explain a patient's symptoms by determining the diseases \emph{causing} them. However, existing diagnostic algorithms are purely associative, identifying diseases that are strongly correlated with a …
Proposes FACT, a diagnostic for understanding group fairness trade-offs.
problem Group fairness notions often conflict with each other, requiring a cost in model performance.
method Characterizes trade-offs via the fairness-confusion tensor and optimizes accuracy and fairness objectives.
result Demonstrates the use of FACT on synthetic and real datasets to understand accuracy-fairness trade-offs.
The paper analyzes convergence in SGD with momentum and proposes a diagnostic test.
problem Detecting convergence in stochastic gradient descent with momentum.
method Analyzes the transient and stationary phases of SGD with momentum, constructs a statistical diagnostic test.
result The proposed diagnostic test effectively detects convergence in the stationary phase of SGD with momentum.
ABC improves uncertainty quantification in LLMs for clinical diagnostics.
problem Overconfident and poorly calibrated estimates of LLMs in clinical domains.
method Approximate Bayesian Computation (ABC) for likelihood-free inference.
result Improves accuracy by up to 46.9%, reduces Brier scores by 74.4%, and enhances calibration.
New diagnostic tool for assessing approximate Bayesian inference.
problem Assessing the trustworthiness of approximate Bayesian inference.
method Reframe the problem in terms of incompatible conditional distributions and use Gibbs priors.
result The diagnostic tool can discover the inductive bias in various Bayesian models and approximations.
Paper proposes a coupling-based diagnostic for SGD stepsize optimization.
problem Optimizing stepsize for SGD convergence.
method Coupling-based convergence diagnostic for monitoring stationarity.
result Proposed stepsize scheme achieves superior performance across convex and non-convex problems.
Characterizing a patient's progression through stages of sepsis is critical for enabling risk stratification and adaptive, personalized treatment. However, commonly used sepsis diagnostic criteria fail to account for significant underlying heterogeneity, both between patients as well as over time in a single patient. W…
We consider the problem of locating a point-source heart arrhythmia using data from a standard diagnostic procedure, where a reference catheter is placed in the heart, and arrival times from a second diagnostic catheter are recorded as the diagnostic catheter moves around within the heart. We model this situation as a …
Enhances projection pursuit tree classifier with visual diagnostics for better multi-class classification.
problem Rigidity of original algorithm limits performance in complex high-dimensional classification problems.
method Allowing more splits and flexible class groupings in projection pursuit computation, and developing visual diagnostics.
result Demonstrates enhanced classifier performs as intended through interactive visual diagnostics.
The receiver operating characteristic (ROC) curve is a very useful tool for analyzing the diagnostic/classification power of instruments/classification schemes as long as a binary-scale gold standard is available. When the gold standard is continuous and there is no confirmative threshold, ROC curve becomes less useful…
GeoTop resolves topological ambiguity in diagnostic imaging using geometric-topological analysis.
problem Topological equivalence between benign and malignant structures in diagnostic images.
method Combines Topological Data Analysis and Lipschitz-Killing Curvatures to resolve ambiguity.
result Achieves 3.6% accuracy improvement and reduces false positives/negatives by 15-18%.
We speed up Gaussian process cross-validation calculations and improve model diagnostics.
problem Efficiently calculating cross-validation residuals and their covariances in Gaussian processes.
method Generalized fast Gaussian process leave-one-out formulae to multiple-fold cross-validation, highlighting covariance structures.
result Correcting for residual covariances in cross-validation improves back to Maximum Likelihood Estimation.
Study highlights robustness issues in healthcare diagnostic models due to distribution shifts.
problem Robustness of diagnostic models in healthcare is compromised by distribution shifts.
method Theoretical analysis and simulation studies to understand and mitigate shortcuts learned by models.
result Ignoring covariates or using invariant learning approaches leads to non-robust predictors.
The paper introduces a diagnostic method to detect grokking transitions in models before test accuracy improves.
problem Detecting the transition from training to generalization in machine learning models.
method Summarize task-dependent observables as empirical distributions, map them to Wasserstein/quantile coordinates, and analyze using Hankel dynamic mode decomposition.
result The diagnostic method achieves AUROC \(\approx\) 0.93 for grokking-vs-non-grokking discrimination at the run level.
Two new feature selection methods improve breast cancer diagnosis accuracy.
problem Improving breast cancer diagnosis accuracy and reducing dataset dimensions.
method Imperialist Competitive Algorithm (ICA) and Bat Algorithm (BA) integrated with ML algorithms.
result BA-based feature selection method outperforms other methods with 99.12% accuracy.
LADaR framework calibrates machine learning models for instance-wise predictions.
problem Challenges in assessing and calibrating predictive distributions for complex inputs.
method Local Amortized Diagnostics and Reshaping of Conditional Densities (LADaR) framework and extttCal−PIT algorithm. result Achieves better instance-wise calibration than existing methods in galaxy distance estimation.