Online symptom checkers have significant potential to improve patient care, however their reliability and accuracy remain variable. We hypothesised that an artificial intelligence (AI) powered triage and diagnostic system would compare favourably with human doctors with respect to triage and diagnostic accuracy. We per…
AI predicts medical specialty diagnostic choices from EHR records.
problem Predicting timely medical specialty diagnostic workups for patients.
method Ensemble of feed-forward neural networks trained on EHR data.
result Significantly higher accuracy compared to traditional checklists.
Establishes statistical and computational bounds for influence diagnostics.
problem Identifying influential datapoints or subsets in machine learning models.
method Finite-sample statistical bounds and computational complexity for influence functions and approximate maximum influence perturbations.
result Established statistical and computational guarantees for influence diagnostics.
Paper evaluates whether AI is a bubble or a productivity revolution.
problem Determining if AI investments are a bubble or a sustainable technology.
method Hybrid review and diagnostic framework combining asset pricing foundations and modern econometric methods.
result AI investments show both genuine fundamentals and bubble-like fragilities.
Study finds AI can predict diverse cardiac and non-cardiac diagnoses from a single ECG.
problem Narrow focus of ECG analysis models for diverse medical conditions.
method Exploratory study using a single AI model to predict multiple ICD codes.
result Model achieved AUROC scores > 0.8 for 253 cardiac and 172 non-cardiac diagnoses.
Paper detects biases in medical imaging ML models using counterfactual analysis.
problem Bias in medical imaging ML models negatively impacts generalization performance.
method Counterfactual invariance framework combining conditional latent diffusion models and statistical hypothesis testing.
result The method identifies and quantifies biases without direct access to counterfactual data.
AI enhances cancer diagnostics using spectroscopy.
problem Early and accurate cancer diagnosis.
method Combining AI with spectroscopy-based techniques.
result AI improves cancer diagnostics speed and safety.
The paper investigates AI robustness through experiments and statistical analysis.
problem Inaccurate AI predictions can lead to safety and adoption issues.
method Design of experiments framework to study AI classification robustness.
result AI algorithms' robustness is influenced by various factors.
Paper defines AI-specific loss reconstruction problem and introduces CER framework.
problem Reconstructing AI-generated losses, especially in agentic systems.
method CER framework: C (control boundary), E (evidence reconstruction), R (insurance response).
result Defines AI-specific reconstruction problem and operationalizes it.
Interpretable deep learning is a fundamental building block towards safer AI, especially when the deployment possibilities of deep learning-based computer-aided medical diagnostic systems are so eminent. However, without a computational formulation of black-box interpretation, general interpretability research rely hea…
Deep learning ensemble improves Alzheimer vs. Mild Cognitive Impairment diagnosis.
problem Differentiating Alzheimer Disease from Mild Cognitive Impairment.
method Hybrid deep learning ensemble framework using MRI slices, pretrained models, and stacked ensemble learning.
result State-of-the-art accuracy (99.21%) for Alzheimer vs. Mild Cognitive Impairment classification.
This review clarifies XAI for regression models and establishes new theoretical insights.
problem Lack of XAI techniques for regression models, especially in safety-critical applications.
method Clarifies conceptual differences, establishes theoretical insights, provides demonstrations, discusses challenges.
result Novel theoretical insights and demonstrations of XAI for regression models.
Exploring a new method to explain AI models in medical devices.
problem Lack of explainability in AI models used in medical devices.
method Using the Jacobian matrix to measure model response stability to small perturbations.
result A first step towards a perturbation-based explanation of AI models.
Newfluence improves model interpretability in high-dimensional AI models.
problem Challenges in interpreting high-dimensional AI models.
method Introduced Newfluence, an alternative approximation to influence functions.
result Newfluence offers significantly improved accuracy in high-dimensional settings.
The paper introduces logic constraints to improve AI model interpretability.
problem The black box nature of AI models limits their trustworthiness in high-stakes fields.
method The paper extends AI models with logic constraints to make feature importance more interpretable.
result Promising experimental results have been achieved for the Adult dataset.
FreB protocol uses AI to infer hidden parameters with valid confidence regions.
problem Generating biased or overconfident conclusions from AI-generated posterior distributions.
method Frequentist-Bayes (FreB) protocol reshapes AI-generated posterior distributions into valid confidence regions.
result FreB provides valid confidence regions that consistently include true parameters with expected probability.
Develops a framework for quantifying agentic AI model risk using LLM-inferred Bayesian state filters.
problem Quantifying the risk of agentic AI systems due to uncertain beliefs and actions.
method Representing the system as a partially observed Markov decision process with latent states, Bayesian belief updates, control-dependent losses, and tail-risk functionals.
result Develops a rigorous framework for separating uncertainty quantification from risk measurement.
New framework assesses AI hallucinations in inverse problems.
problem Artificial intelligence can produce incorrect details in imaging problems.
method Theoretical framework and algorithms to estimate and assess hallucinations.
result Developed necessary and sufficient conditions for hallucinations and computable bounds.
AIS corrects rollout-training mismatch in quantized RL, improving speed and stability.
problem Rollout-training mismatch in quantized RL causes bias and training collapse.
method Adaptive Importance Sampling (AIS) adjusts gradient correction per batch.
result AIS matches BF16 baseline on most tasks while improving speed.
Study shows GPT's earnings forecasts are human-like but not always accurate.
problem Information friction in AI-generated financial analysis.
method Examined GPT's earnings forecasts following corporate earnings releases and proposed a diagnostic framework.
result GPT's narrative attention is consistent and human-like but not always associated with higher forecast accuracy.
Background: Parkinson's disease (PD) is a prevalent long-term neurodegenerative disease. Though the diagnostic criteria of PD are relatively well defined, the current medical imaging diagnostic procedures are expertise-demanding, and thus call for a higher-integrated AI-based diagnostic algorithm. Methods: In this pape…
Proposes a method to ensure accurate estimation of rare events in AI systems.
problem Lack of efficiency guarantees in black-box systems for rare-event simulation.
method Integrates deep learning with importance sampling to create a statistically guaranteed estimator.
result Demonstrates effective estimation of rare-event probabilities in AI systems.
YRC-Bench benchmarks AI agents learning to collaborate with experts.
problem Learning to recognize when to consult an expert in novel situations.
method Validation strategy and proposer-validator decomposition.
result Insights for future AI safety research.
No feature ranking can be faithful, stable, and complete when features are collinear.
problem The impossibility of creating a feature ranking that is simultaneously faithful, stable, and complete when features are collinear.
method Proving the impossibility, quantifying it for four model classes, resolving it via ensemble averaging (DASH), and machine-verifying it with Lean 4 theorems.
result No method lies outside the dichotomy of faithful-complete methods (unstable, with rankings that flip up to 50% of the time) and ensemble methods (stable, reporting ties for symmetric features).
A new model validation framework for agentic AI systems based on POMDPs.
problem Model validation of agentic AI systems.
method A POMDP-based framework for belief-state, forecast, and policy validation.
result The framework decomposes autonomous decision making into information, beliefs, forecasts, actions, and utility.
STRIDE improves explainable AI by efficiently decomposing feature interactions without subset enumeration.
problem Lack of expressive power and high computational cost in existing XAI frameworks.
method STRIDE uses a functional decomposition approach in RKHS, avoiding subset enumeration and focusing on orthogonal components.
result STRIDE achieves a 3.0 times speedup over TreeSHAP and a high R^2 of 0.93 for feature reconstruction.
We present a practical health-theme machine learning (ML) application concerning `AI for social good' domain for `Producing Good Outcomes' track. In particular, the solution is concerning the problem of a potential elderly adult dementia onset prediction in aging societies. The paper discusses our attempt and encouragi…
New method accounts for uncertainty in medical AI evaluations.
problem Uncertainty in ground truth affects AI model performance estimates.
method Statistical aggregation approach to infer probabilities of medical conditions.
result Performance estimates are significantly lower when uncertainty is accounted for.
Bayesian CNN estimates uncertainty in COVID-19 detection.
problem Uncertainty in deep learning predictions for medical diagnosis.
method Drop-weight based Bayesian Convolutional Neural Networks (BCNN).
result Uncertainty correlates with prediction accuracy.
This work introduces a new metric to assess the fidelity of surrogate models to the underlying data-generating signal.
problem The limitations of fidelity-based explanations in explainable AI.
method Introduces the linearity score λ(f) to quantify the extent of a regression network's linear decodability. result High-fidelity surrogates can underperform compared to simpler models and even linear baselines trained directly on the data.
The field of high-energy physics (HEP), along with many scientific disciplines, is currently experiencing a dramatic influx of new methodologies powered by modern machine learning techniques. Over the last few years, a growing body of HEP literature has focused on identifying promising applications of deep learning in …
Study finds price-based clustering outperforms AI and human methods in stock market analysis.
problem Investigates if AI can improve stock clustering compared to traditional methods.
method Compares price-based, human-informed, and AI-driven clustering methods using synthetic factor models.
result Price-based clustering reduces RMSE by 15.9% relative to GICS and 14.7% relative to LLM embeddings.
Applying machine learning in the health care domain has shown promising results in recent years. Interpretable outputs from learning algorithms are desirable for decision making by health care personnel. In this work, we explore the possibility of utilizing causal relationships to refine diagnostic prediction. We focus…
Survey examines data quality challenges in edge ML.
problem Data quality issues in edge ML due to limited resources and decentralized data.
method Provides a comprehensive survey of existing literature on data quality in edge ML.
result No comprehensive survey of data quality in edge ML exists.
The article explains how to estimate confusion matrices for classifiers using unlabeled data.
problem Estimating sensitivity and specificity of binary medical diagnostic tests without gold standard tests.
method Modifying diagnostic test solutions to estimate confusion matrices for classifiers on unlabeled data.
result The approach can be used to estimate accuracy statistics for supervised or unsupervised binary classifiers on unlabeled data.
Deep ROC analysis improves model selection and interpretation in medical and AI applications.
problem Inadequate performance measures for binary classifiers.
method Deep ROC analysis, translating AUC and partial AUC into balanced average accuracy and post-test measures.
result Deep ROC analysis provides balanced average accuracy, average sensitivity, and average specificity.
Method extracts time-localized clusters to explain deep learning models in ECG analysis.
problem Limited understanding of deep learning models in ECG analysis.
method Extracts time-localized clusters from model's internal representations.
result Enhances trust in AI-driven diagnostics and reveals clinically relevant patterns.
Proposes DCNAR for dynamic causal inference from neural time series.
problem Uncertainty and evolution of causal structure in real-world domains.
method Two-stage neural causal modeling integrating discovery and inference.
result Dynamic causal inferences are more stable and meaningful than alternatives.
Paper introduces a diagnostic for approximate inference methods.
problem Estimating errors in probabilistic inference algorithms, especially for approximate methods.
method Repeatedly simulate datasets from the prior and perform inference on each, estimating a symmetric KL-divergence.
result A diagnostic for approximate inference methods can be estimated using symmetric KL-divergence.
Machine learning improves diagnostic test accuracy for bovine tuberculosis.
problem Improving diagnostic test sensitivity for bovine tuberculosis.
method Machine learning to assess risk landscapes and predict infection.
result Test sensitivity improved, detecting 240 more infected herds per year.
In this paper, we present an effective deep prediction framework based on robust recurrent neural networks (RNNs) to predict the likely therapeutic classes of medications a patient is taking, given a sequence of diagnostic billing codes in their record. Accurately capturing the list of medications currently taken by a …
Graph-based approach repairs programs from diagnostic feedback.
problem Learning to repair programs from limited labeled data and compiler error messages.
method Introduces program-feedback graph and graph neural network for reasoning, and self-supervised learning with unlabeled programs.
result DrRepair significantly outperforms prior work, achieving high repair rates.
The paper analyzes convergence in SGD with momentum and proposes a diagnostic test.
problem Detecting convergence in stochastic gradient descent with momentum.
method Analyzes the transient and stationary phases of SGD with momentum, constructs a statistical diagnostic test.
result The proposed diagnostic test effectively detects convergence in the stationary phase of SGD with momentum.
Paper proposes a coupling-based diagnostic for SGD stepsize optimization.
problem Optimizing stepsize for SGD convergence.
method Coupling-based convergence diagnostic for monitoring stationarity.
result Proposed stepsize scheme achieves superior performance across convex and non-convex problems.
Paper improves predictive distributions for rare events using a simple framework.
problem Local miscalibration of predictive distributions for rare events.
method Semiparametric diagnostic transport maps to correct tail probabilities.
result Semiparametric maps improve predictions for severe weather hazards.
TADDAA improves accuracy diagnostics for variational approximations.
problem Challenges in evaluating the accuracy of variational approximations.
method Uses many short parallel MCMC chains to obtain lower bounds on the error of each posterior functional of interest.
result Validates the practical utility and computational efficiency of TADDAA on various models.
Proposes a diagnostic method to evaluate factor models using cap-axis integrals.
problem Improving factor model evaluation in low-dimensional spaces.
method Lifts pricing errors into a bridge-alpha curve along the market-capitalization rank axis.
result The cap-axis norm is distinct from Sharpe gain and size exposure.
Proposes a diagnostic method to evaluate factor models using cap-axis integrals.
problem Improving factor model evaluation for low-dimensional models.
method Lifts pricing errors into a bridge-alpha curve along the market-capitalization rank axis.
result The cap-axis norm is distinct from Sharpe gain and size exposure.