A recommendation framework helps users choose healthcare interventions.
problem Choice overload in online healthcare communities.
method Multi-Armed Bandit (MAB) approach with innovative model components.
result Our recommendation design outperforms state-of-the-art systems.
Unified RL survey for healthcare AI interventions.
problem Limited real-life application of RL in healthcare.
method Unified technical survey and case studies.
result Bridge between dynamic treatment regimes and mobile health.
New bandit model for healthcare intervention planning.
problem Maximizing patient health with limited monitoring resources.
method Developed Collapsing Bandits model and derived optimal policies.
result 3-order-of-magnitude speedup in algorithm performance.
Study predicts which patients will benefit from digital health interventions.
problem Unclear targeting of patients for digital care management programs.
method Analyzed claims data, combined with sociodemographic and app-generated data. Created two models: cost prediction and impactability classification.
result Random forest model accurately categorized patients as impactable or not, achieving 71.9% accuracy.
AI improves precision health through adaptive interventions.
problem Improving healthcare through personalized and dynamic treatments.
method Reinforcement learning (RL) for adaptive interventions in digital health.
result RL shows promise in dynamic healthcare problems.
Paper improves feature selection for predicting outcomes from observational data.
problem Feature selection for post-intervention outcome prediction from pre-intervention variables in healthcare settings.
method Extends Markov boundary concept to treatment-outcome pairs, uses observational and experimental data.
result Combining observational and experimental data improves feature selection and effect estimation.
NCoRE learns counterfactual representations for combined treatments.
problem Estimating individual response to multiple simultaneous interventions.
method Neural conditional representation with modulators for cross-treatment interactions.
result NCoRE significantly outperforms existing methods in counterfactual treatment effect estimation.
Combines adversarial and interventional robustness for machine learning models.
problem Designing robust models for distribution shifts in machine learning.
method RISe formulation using distributionally robust optimization.
result Demonstrates efficacy of RISe approach with synthetic and real-world datasets.
RL platform enhances user journeys in healthcare apps.
problem Improving user experience and personalization in healthcare apps.
method Reinforcement learning framework for adaptive interventions.
result Significant increase in basket size through personalized recommendations.
A broad spectrum of data from different modalities are generated in the healthcare domain every day, including scalar data (e.g., clinical measures collected at hospitals), tensor data (e.g., neuroimages analyzed by research institutes), graph data (e.g., brain connectivity networks), and sequence data (e.g., digital f…
New framework infers causal shifts in event sequences under out-of-domain interventions.
problem Inferring causal relationships in event sequences without considering out-of-domain interventions.
method Proposes a new causal framework to define ATE, designs an unbiased ATE estimator, and uses a Transformer-based neural network model.
result Demonstrates superior performance in ATE estimation and goodness-of-fit under out-of-domain-augmented point processes.
Study shows auditing fairness of personalized interventions is impossible due to unknown ground truths.
problem Auditing fairness of personalized interventions in social services, education, and healthcare.
method Point-identification of quantities under monotone treatment response assumption, providing sensitivity analysis for violations.
result Proves impossibility of auditing fairness using standard metrics and provides methods for auditing using partially-identified ROC and xROC curves.
Study user engagement in mobile health apps for health workers in resource-poor settings.
problem Detect churn and tailor content for health workers in mobile health apps.
method Probabilistic and survival analysis of behavioral logs.
result Personalized measures of meaningful engagement can enhance health outcomes.
Study finds incorporating fairness in healthcare models doesn't improve performance or net benefit.
problem Addressing health inequities in healthcare through algorithmic fairness.
method Empirical case study using models to estimate atherosclerotic cardiovascular disease risk.
result Incorporating fairness considerations into model training objective does not improve model performance or net benefit.
Simulation framework assesses ROI of chronic disease adherence and policy timing.
problem Uncertainty in ROI of adherence-enhancing interventions under heterogeneous patient behavior and socioeconomic variation.
method Simulation-based framework integrating disease progression, time-varying adherence, and policy timing.
result Early and adaptive interventions yield highest ROI, exceeding 20% under certain conditions.
Neural TPPs improve EHR modelling efficiency.
problem Challenges in modelling irregularly timed, noisy EHRs.
method Proposed neural network parameterizations of Temporal Point Processes (TPPs) for EHRs.
result Neural TPPs outperform non-TPP models on EHRs.
Develops a framework for causal structure learning using both interventional and observational data.
problem Lack of identifiability of causal structures with only observational data.
method Bilevel polynomial optimization (Bloom) framework for causal structure discovery from interventional and observational data.
result Bloom framework provides convergence and optimality guarantees, surpassing other learning algorithms in experiments.
New approach tackles non-Markovian behavior in maternal health programs.
problem Improving adherence and engagement in maternal and child healthcare programs.
method Extending RMABs to non-Markovian settings, using time-series forecasting and TARI policy.
result Significant increase in engagement and content listened compared to existing methods.
Bayesian deep learning predicts uncertainty in EHRs for better healthcare decisions.
problem Lack of interpretability and trustworthiness in deep learning models for EHRs.
method Proposes a Bayesian Neural Network (BNN) model to predict uncertainty in EHRs.
result High uncertainty instances harm model performance; distributions reveal patients for timely intervention.
Paper proposes a new multi-task causal Gaussian process model for better prediction and uncertainty estimation.
problem Learning causal effects of interventions on different subsets of variables in a DAG.
method DAG-GP model that allows information sharing across interventions and experiments on different variables.
result DAG-GP achieves the best fitting performance and faster optimal intervention selection compared to single-task models.
Optimizes data labeling for causal effect estimation with missing outcomes.
problem Estimating causal effects with missing outcome data and budget constraints.
method Optimizes batch sampling probability to minimize variance of causal inference estimator.
result Achieves lower mean-squared error with fewer labeled data points.
The paper proposes a fair reinforcement learning framework to prevent healthcare disparities.
problem Unfair reinforcement learning policies in healthcare can lead to socioeconomically-disadvantaged subgroups being underprivileged.
method The paper introduces a counterfactual fairness framework and a sequential data preprocessing algorithm to achieve fair sequential decision making.
result The proposed approach greatly enhances fair access to counseling in a digital health dataset designed to reduce opioid misuse.
New monitoring method detects ML risk models' performance changes in medical interventions.
problem Monitoring ML risk models in healthcare is complicated by confounding medical interventions.
method Developed a new score-based CUSUM monitoring procedure with dynamic control limits.
result Valid inference is possible if conditional exchangeability or time-constant selection bias hold.
Framework identifies comorbidities for frequent ED and inpatient visits.
problem Reducing resource usage and costs in frequent patients.
method Developed MSAR algorithm to identify comorbidities.
result MSAR identifies conditions most associated with reoccurring ED and inpatient visits.
Optimizes causal effects on unknown graphs using Causal Entropy Optimization.
problem Optimizing causal effects in unknown causal graphs.
method Causal Entropy Optimization (CEO) framework that generalizes Causal Bayesian Optimization (CBO). Incorporates causal structure uncertainty in surrogate models and intervention selection.
result CEO achieves faster convergence to global optimum compared to CBO and improves upon sequential structure learning.
Optimizes risk assessment tools using mixed-integer programming.
problem Challenges in healthcare risk assessment due to label scarcity and asymmetric misclassification costs.
method Jointly optimizes scoring weights and category thresholds via mixed-integer programming (MIP).
result Prevents label-scarce category collapse and achieves more accurate risk categorization.
Proposes a method for generating prediction intervals in dose-response models using conformal prediction.
problem Uncertainty quantification in continuous treatments for personalized healthcare decisions.
method Causal dose-response problem framed as covariate shift, using weighted conformal prediction with propensity estimation and kernel functions.
result Demonstrates the significance of covariate shift assumptions for robust prediction intervals.
Personalized predictive medicine necessitates the modeling of patient illness and care processes, which inherently have long-term temporal dependencies. Healthcare observations, recorded in electronic medical records, are episodic and irregular in time. We introduce DeepCare, an end-to-end deep dynamic neural network t…
Causal thinking improves healthcare decisions from EHRs.
problem Shortcuts in data lead to biased healthcare decisions.
method Step-by-step framework for valid decision making from EHRs.
result Valid decision making requires careful analysis of EHR data.
We propose a flexible method for estimating value functions in reinforcement learning without parametric assumptions.
problem Lack of interpretability in reinforcement learning models, especially in healthcare applications.
method Nonparametric additive model using local kernel regression and basis expansion.
result Personalized, adaptive recommendations for postoperative recovery.
New formalism for decision making combines causal structures with MDPs, improving reinforcement learning performance.
problem Sequential decision making with causal knowledge to improve performance.
method Causal Markov Decision Processes (C-MDPs) and C-UCBVI algorithm exploiting causal structure.
result C-UCBVI achieves an i l d e O ( H S Z T ) ilde{O}(HS\sqrt{ZT}) i l d e O ( H S Z T ) regret bound, independent of actions. The vision for precision medicine is to use individual patient characteristics to inform a personalized treatment plan that leads to the best healthcare possible for each patient. Mobile technologies have an important role to play in this vision as they offer a means to monitor a patient's health status in real-time an…
Large-scale computational experiments, often running over weeks and over large datasets, are used extensively in fields such as epidemiology, meteorology, computational biology, and healthcare to understand phenomena, and design high-stakes policies affecting everyday health and economy. For instance, the OpenMalaria f…
New method estimates policy performance under unobserved confounding.
problem Estimating policy performance when decisions depend on unobserved variables.
method Developed worst-case bounds for robust OPE under unobserved confounding.
result Efficient procedure for computing worst-case bounds, proving statistical consistency.
Life-expectancy is a complex outcome driven by genetic, socio-demographic, environmental and geographic factors. Increasing socio-economic and health disparities in the United States are propagating the longevity-gap, making it a cause for concern. Earlier studies have probed individual factors but an integrated pictur…
Develops scalable methods to assess sensitivity and uncertainty in continuous treatment effects.
problem Estimating effects of continuous-valued interventions from observational data, especially when ignorability and positivity assumptions are violated.
method Continuous treatment-effect marginal sensitivity model (CMSM), scalable algorithm, uncertainty-aware deep models.
result Derives bounds that agree with observed data and a defined level of hidden confounding.
ReRe detects anomalies in real-time for time series data.
problem Real-time anomaly detection for time series data requires human intervention or domain knowledge and high computation complexity.
method ReRe uses two lightweight LSTM models to predict and determine anomalies based on historical data and adaptive thresholds.
result ReRe detects anomalies in real-time without requiring human intervention or domain knowledge.
BEHRT improves disease prediction in EHRs by 8-10%.
problem Early disease detection in EHRs for better patient outcomes.
method Deep neural sequence transduction model for EHRs.
result BEHRT improves average precision by 8.0-10.8% compared to state-of-the-art models.
Model predicts missed doses and targets TB patients more effectively.
problem Improving adherence to TB treatment using digital data.
method Deep learning model trained on 17k TB patients' adherence data.
result Model predicts 21% more patients at risk of missing doses.
The paper develops a method to optimize individualized treatment rules for cost-effectiveness.
problem Developing cost-effective individualized treatment rules for healthcare policy.
method Using conditional random forest and net-monetary-benefit (NMB) to estimate optimal CE-ITR.
result The approach optimizes healthcare resource allocation by maximizing health gains and minimizing costs.
Probabilistic ML improves healthcare data analysis.
problem Insufficient understanding and incomplete data in healthcare.
method Examination of probabilistic machine learning models for healthcare challenges.
result Probabilistic models enhance healthcare data analysis and model building.
A statistical description and model of individual healthcare expenditures in the US has been developed for measuring value in healthcare. We find evidence that healthcare expenditures are quantifiable as an infusion-diffusion process, which can be thought of intuitively as a steady change in the intensity of treatment …
Optimizes consumption, investment, and healthcare spending for aging populations.
problem Maximizing utility in an aging population with changing mortality rates.
method Solves an optimal stochastic control problem using a novel version of Perron's method.
result Endogenous mortality law that is asymptotically exponential in the old-age limit.
Big data analytics improves healthcare through early detection and quality life.
problem Limited access to healthcare data hinders evidence-based decision-making.
method Analysis of healthcare data using various tools and techniques.
result Big data analytics enhances healthcare quality and patient outcomes.
Estimates joint causal effects using single-variable interventions on nonlinear models.
problem Estimating joint causal effects from single-variable interventions.
method Identifiability result and practical estimator for decomposing causal effects.
result Joint effects can be inferred without joint interventional data for nonlinear additive models.
Introduces info intervention to handle causal questions and check counterfactual variables.
problem Controversial interpretation of causal questions for non-manipulable variables and lack of power to check counterfactual variables.
method Intervenes input/output information of causal mechanisms, providing causal diagrams for communication and theoretical focus.
result Causal diagrams based on info intervention provide a new perspective on information transfer as causality.
This paper tackles CRL for multi-node interventions, achieving identifiability guarantees.
problem CRL under unknown multi-node interventions, focusing on single-node assumptions.
method Establishes identifiability results for general latent causal models under stochastic interventions.
result Identifiability up to ancestors using soft interventions, perfect identifiability using hard interventions.
This paper provides a ML framework for diabetes prediction and care management.
problem Diabetes prediction and care management challenges in real-world healthcare.
method Illustrates a Machine Learning framework for T2DM prediction and risk stratification.
result ML models align with physician's disease management steps.