HealthSyn generates synthetic user behavior data for health interventions.
problem Lack of representative data for testing AI health interventions.
method Uses Markov processes to simulate diverse user actions, generating logs for ML algorithms.
result Synthetic data can be used to develop, test, and evaluate ML algorithms and RL-based interventions.
Develops a personalized reinforcement learning algorithm for dyadic health interventions.
problem Personalizing health interventions for dyadic relationships in mobile health.
method Dyadic Reinforcement Learning (dyadic RL), a Bayesian and hierarchical online algorithm.
result Established a regret bound and demonstrated empirical performance through simulations and real data.
Mobile apps and machine learning improve malaria prevention and treatment.
problem High malaria cases and deaths in low-income countries.
method Adaptive interventions using mobile health apps and machine learning.
result Increased malaria testing, adherence, and provider skills.
Develops algorithms to balance personalization and statistical power in mobile health studies.
problem Balancing personalization and statistical power in mobile health studies.
method Develops general meta-algorithms to modify existing bandit algorithms.
result Guarantees sufficient power while improving user well-being.
AI improves precision health through adaptive interventions.
problem Improving healthcare through personalized and dynamic treatments.
method Reinforcement learning (RL) for adaptive interventions in digital health.
result RL shows promise in dynamic healthcare problems.
A recommendation framework helps users choose healthcare interventions.
problem Choice overload in online healthcare communities.
method Multi-Armed Bandit (MAB) approach with innovative model components.
result Our recommendation design outperforms state-of-the-art systems.
RoME optimizes mobile health interventions by modeling user and time-specific effects.
problem Challenges in optimizing mobile health interventions due to participant heterogeneity, nonstationarity, and nonlinear relationships.
method RoME uses a Robust Mixed-Effects contextual bandit algorithm with random effects, network cohesion penalties, and debiased machine learning.
result RoME achieves robust regret bounds even with complex baseline rewards, demonstrating superior performance in simulations and studies.
Due to the recent advancements in wearables and sensing technology, health scientists are increasingly developing mobile health (mHealth) interventions. In mHealth interventions, mobile devices are used to deliver treatment to individuals as they go about their daily lives. These treatments are generally designed to im…
Unified RL survey for healthcare AI interventions.
problem Limited real-life application of RL in healthcare.
method Unified technical survey and case studies.
result Bridge between dynamic treatment regimes and mobile health.
Study user engagement in mobile health apps for health workers in resource-poor settings.
problem Detect churn and tailor content for health workers in mobile health apps.
method Probabilistic and survival analysis of behavioral logs.
result Personalized measures of meaningful engagement can enhance health outcomes.
Meta-learning method for estimating time-varying mHealth intervention effects.
problem Complex mHealth data and uncertain randomization probabilities.
method DR-WCLS meta-learning procedure for causal excursion effects.
result More efficient and consistent estimates of causal excursion effects.
Increasing technological sophistication and widespread use of smartphones and wearable devices provide opportunities for innovative and highly personalized health interventions. A Just-In-Time Adaptive Intervention (JITAI) uses real-time data collection and communication capabilities of modern mobile devices to deliver…
Bayesian ATM improves stability and efficiency in mobile health interventions.
problem Balancing intervention efficacy with user burden in mobile health interventions.
method Bayesian extension to ATM using Kalman filter-style updates.
result Bayesian ATM achieves comparable or improved scalarized returns with lower variance and more stable policy behavior.
BFTS uses Bayesian Additive Regression Trees for improved personalized mobile health interventions.
problem Adapting to complex, non-linear user behaviors in personalized mobile health interventions.
method Bayesian Forest Thompson Sampling (BFTS) integrates Bayesian Additive Regression Trees (BART) into the exploration loop of contextual bandits.
result BFTS achieves state-of-the-art regret on tabular benchmarks and improves engagement rates by over 30% in a behavioral intervention study.
Bayesian networks learn sub-population differences from data.
problem Inference from a single network structure can be misleading when data populations are heterogeneous.
method A mixture of Bayesian networks where component probabilities depend on individual characteristics.
result Identifies both network structures and demographic predictors of sub-population membership.
Italy and the Eurozone are heading in the year 2012 into a financial depression of unprecedented magnitude, with a forthcoming multitude of often contradictory public economic and financial stability emergency interventions whose ultimate endogenous and exogenous effects on public and private health spending and on the…
The opioid epidemic in the United States claims over 40,000 lives per year, and it is estimated that well over two million Americans have an opioid use disorder. Over-prescription and misuse of prescription opioids play an important role in the epidemic. Individuals who are prescribed opioids, and who are diagnosed wit…
GAMBITTS uses GenAI for adaptive interventions, improving decision-making.
problem Adaptive interventions with GenAI-generated content.
method Generator-mediated bandit-Thompson sampling (GAMBITTS).
result GAMBITTS outperforms standard bandit methods in mobile health interventions.
Personalized predictive medicine necessitates the modeling of patient illness and care processes, which inherently have long-term temporal dependencies. Healthcare observations, recorded in electronic medical records, are episodic and irregular in time. We introduce DeepCare, an end-to-end deep dynamic neural network t…
Holdout set improves risk score accuracy without biasing predictions.
problem Updating risk scores can lead to biased estimates when directly applied.
method Use a holdout set of non-intervention population to update risk scores.
result Optimal holdout size reduces adverse outcomes to optimal level.
Although there are millions of transgender people in the world, a lack of information exists about their health issues. This issue has consequences for the medical field, which only has a nascent understanding of how to identify and meet this population's health-related needs. Social media sites like Twitter provide ne…
Agent decides when to measure latent states in RL to improve efficiency.
problem Costly state measurement in RL negatively affects future outcomes.
method Introduces AOMDP with measurement action, uses online RL and sequential Monte Carlo.
result Reduced uncertainty improves sample efficiency and policy value.
New bandit model for healthcare intervention planning.
problem Maximizing patient health with limited monitoring resources.
method Developed Collapsing Bandits model and derived optimal policies.
result 3-order-of-magnitude speedup in algorithm performance.
The field of mobile health aims to leverage recent advances in wearable on-body sensing technology and smart phone computing capabilities to develop systems that can monitor health states and deliver just-in-time adaptive interventions. However, existing work has largely focused on analyzing collected data in the off-l…
Simulation-based inference aids in predicting disease dynamics for health policy.
problem Predicting disease dynamics to inform public health interventions.
method Simulation-based inference using machine learning.
result Potential for efficient interpretable Bayesian inference in epidemiological models.
New method improves mHealth user engagement using Thompson sampling for count data.
problem Optimizing mHealth interventions for distal outcomes through proximal context.
method Combines count data models with Thompson sampling for contextual bandits.
result Improves user engagement in mHealth trials compared to existing methods.
The vision for precision medicine is to use individual patient characteristics to inform a personalized treatment plan that leads to the best healthcare possible for each patient. Mobile technologies have an important role to play in this vision as they offer a means to monitor a patient's health status in real-time an…
Deep learning predicts opioid use disorder risk in patients.
problem Identifying patients at high risk of opioid use disorder.
method Applied LSTM models to analyze electronic health records of opioid users.
result LSTM model outperformed other methods with F1 score of 0.8023 and AUCROC of 0.9369.
Deep learning using neural networks has provided advances in image style transfer, merging the content of one image (e.g., a photo) with the style of another (e.g., a painting). Our research shows this concept can be extended to analyse the design of streetscapes in relation to health and wellbeing outcomes. An Austral…
The aim of clinical effectiveness research using repositories of electronic health records is to identify what health interventions 'work best' in real-world settings. Since there are several reasons why the net benefit of intervention may differ across patients, current comparative effectiveness literature focuses on …
New approach tackles non-Markovian behavior in maternal health programs.
problem Improving adherence and engagement in maternal and child healthcare programs.
method Extending RMABs to non-Markovian settings, using time-series forecasting and TARI policy.
result Significant increase in engagement and content listened compared to existing methods.
Extends Thompson sampling for RL with fewer episodes.
problem Limited episodes in RL settings.
method Batch Bayesian optimization over episodes to learn action bias terms.
result Significantly outperforms standard Thompson sampling.
IntelligentPooling learns personalized mHealth policies from limited data.
problem Challenges in personalizing mHealth policies with limited user data and noise.
method Adaptive use of other users' data to learn personalized policies.
result Achieves 26% lower regret compared to state-of-the-art approaches.
Review of methods enabling causal predictions under hypothetical interventions.
problem Need for predicting outcomes under hypothetical interventions in decision making.
method Systematic review of methods using causal inference for prediction models.
result Identified 13 methods for causal inference from observational data.
Study shows diverse data types improve SARS-COV-2 case surge predictions.
problem Improving pandemic case surge predictions using multimodal data.
method Investigated the effectiveness of biological, public health, and behavioral features.
result Diverse feature sets enhance prediction accuracy, varying by country and phase.
The emergence of an ageing population is a significant public health concern. This has led to an increase in the number of people living with progressive neurodegenerative disorders like dementia. Consequently, the strain this is places on health and social care services means providing 24-hour monitoring is not sustai…
Proposes DRIG for robust predictions using noise interventions.
problem Developing robust prediction models against distribution shifts.
method Distributional Robustness via Invariant Gradients (DRIG) exploiting general noise interventions.
result DRIG yields robust predictions among a data-dependent class of distribution shifts.
Generative model predicts vehicle faults up to 1000 hours in advance.
problem Forecasting vehicle faults for predictive maintenance.
method Generative model trained on US Army data, incorporating real-world factors.
result Highly accurate predictions of time to first fault.
Diabetes is a major public health problem in the United States, affecting roughly 30 million people. Diabetes complications, along with the mental health comorbidities that often co-occur with them, are major drivers of high healthcare costs, poor outcomes, and reduced treatment adherence in diabetes. Here, we evaluate…
Framework identifies comorbidities for frequent ED and inpatient visits.
problem Reducing resource usage and costs in frequent patients.
method Developed MSAR algorithm to identify comorbidities.
result MSAR identifies conditions most associated with reoccurring ED and inpatient visits.
Unified framework for estimating indirect effects in observational studies with unmeasured confounding.
problem Challenges in evaluating indirect effects due to unmeasured confounding and unethical exposures.
method Developed a unified identification and estimation framework using proximal causal inference.
result Unified identification and estimation of PIIE and causal effect of an intervening variable in settings with pervasive unmeasured confounding.
An app-based mHealth intervention uses reinforcement learning to send effective reminder notifications.
problem Designing an effective reinforcement learning algorithm for app-based mHealth interventions.
method Developed a reinforcement learning algorithm to send reminder notifications based on participant likelihood of app engagement.
result The algorithm improved app-based mHealth interventions by reducing participant burden and promoting behavior change.
In many mobile health interventions, treatments should only be delivered in a particular context, for example when a user is currently stressed, walking or sedentary. Even in an optimal context, concerns about user burden can restrict which treatments are sent. To diffuse the treatment delivery over times when a user i…
There is an increasing interest in exploiting mobile sensing technologies and machine learning techniques for mental health monitoring and intervention. Researchers have effectively used contextual information, such as mobility, communication and mobile phone usage patterns for quantifying individuals' mood and wellbei…
Proposes pT-Learning for optimal dynamic treatment regimes in mHealth.
problem Challenges in learning optimal dynamic treatment regimes with large intervention options and infinite time horizon.
method Proximal Temporal consistency Learning (pT-Learning) framework for adaptively adjusting between deterministic and stochastic policies.
result Minimax estimator avoids double sampling issue and can incorporate off-policy data.
It is not clear how to target patients who are most likely to benefit from digital care management programs ex-ante, a shortcoming of current risk score based approaches. This study focuses on defining impactability by identifying those patients most likely to benefit from technology enabled care management, delivered …
Adapts causal inference for high-dimensional treatments like text strings.
problem Predicting effects of interventions with many possible variations.
method Adapts classical causal estimators to high-dimensional treatment spaces, balancing moment errors.
result Shows high-dimensional treatment spaces can be addressed with a single model.
Deep learning models have exhibited superior performance in predictive tasks with the explosively increasing Electronic Health Records (EHR). However, due to the lack of transparency, behaviors of deep learning models are difficult to interpret. Without trustworthiness, deep learning models will not be able to assist i…