Proposes a model to handle mobile health data with irregular measurements.
problem Handling heterogeneous, multi-resolution data in mobile health.
method Individualized dynamic latent factor model for irregular multi-resolution time series data.
result Superior performance compared to existing methods in simulation and smartwatch data applications.
TransFall uses transfer learning to improve activity recognition from mobile sensors.
problem Performance degradation due to platform and user movement differences.
method Two-tier data transformation, label estimation, and model generation layers.
result TransFall enhances activity recognition accuracy for new scenarios.
Proposes a deep spectral Q-learning for mobile health data.
problem Personalized treatment assignment for patients with time-varying covariates.
method Integrates PCA with deep Q-learning for mixed frequency data.
result Mean return converges to optimal under estimated optimal policy.
HealthSyn generates synthetic user behavior data for health interventions.
problem Lack of representative data for testing AI health interventions.
method Uses Markov processes to simulate diverse user actions, generating logs for ML algorithms.
result Synthetic data can be used to develop, test, and evaluate ML algorithms and RL-based interventions.
Study user engagement in mobile health apps for health workers in resource-poor settings.
problem Detect churn and tailor content for health workers in mobile health apps.
method Probabilistic and survival analysis of behavioral logs.
result Personalized measures of meaningful engagement can enhance health outcomes.
Develops a personalized reinforcement learning algorithm for dyadic health interventions.
problem Personalizing health interventions for dyadic relationships in mobile health.
method Dyadic Reinforcement Learning (dyadic RL), a Bayesian and hierarchical online algorithm.
result Established a regret bound and demonstrated empirical performance through simulations and real data.
New method for efficient personalized learning in mobile health.
problem Efficient and personalized learning in mobile health.
method Proposes a novel generative process on kernel composition for online Gaussian Process regression.
result Trajectories of kernel evolutions can be transferred between users to improve learning and kernels are meaningful for mHealth prediction.
Bayesian method for imputing actigraph data from mobile devices.
problem Imputing missing actigraph data from mobile devices.
method Bayesian inference and hierarchical dynamic linear model.
result Statistical learning of time-varying impact of explanatory variables on acceleration.
Mobile apps and machine learning improve malaria prevention and treatment.
problem High malaria cases and deaths in low-income countries.
method Adaptive interventions using mobile health apps and machine learning.
result Increased malaria testing, adherence, and provider skills.
Hidden Markov Models analyze mobile health data to identify APNS states.
problem Subjective self-report measures of APNS lead to errors and biases.
method Exploratory hidden Markov factor models and Stabilized Expectation-Maximization algorithm.
result Identified homogeneous APNS states and dynamic transitions.
The field of mobile health aims to leverage recent advances in wearable on-body sensing technology and smart phone computing capabilities to develop systems that can monitor health states and deliver just-in-time adaptive interventions. However, existing work has largely focused on analyzing collected data in the off-l…
Chagas disease is a neglected disease, and information about its geographical spread is very scarse. We analyze here mobility and calling patterns in order to identify potential risk zones for the disease, by using public health information and mobile phone records. Geolocalized call records are rich in social and mobi…
RoME optimizes mobile health interventions by modeling user and time-specific effects.
problem Challenges in optimizing mobile health interventions due to participant heterogeneity, nonstationarity, and nonlinear relationships.
method RoME uses a Robust Mixed-Effects contextual bandit algorithm with random effects, network cohesion penalties, and debiased machine learning.
result RoME achieves robust regret bounds even with complex baseline rewards, demonstrating superior performance in simulations and studies.
Efficient algorithm for mobile health provides timely physical activity suggestions.
problem Inefficient reinforcement learning for mobile health settings.
method Contextual bandit algorithm with linear mixed effects model and hyper-parameter updating.
result Improves speed and accuracy by up to 99% and 56%.
Bandit algorithms optimize treatment decisions for precision medicine.
problem Optimizing treatment decisions for individual patients based on genetic or molecular profiling.
method Contextual bandit algorithms that consider patient characteristics.
result Bandit algorithms are useful for mobile health and digital phenotyping.
There is an increasing interest in exploiting mobile sensing technologies and machine learning techniques for mental health monitoring and intervention. Researchers have effectively used contextual information, such as mobility, communication and mobile phone usage patterns for quantifying individuals' mood and wellbei…
Develops a method to efficiently use offline data for RL policy optimization.
problem Lack of online data for offline RL in mobile health applications.
method Advantage learning framework using optimal Q-estimators.
result New policy converges faster than existing methods.
Develops algorithms to balance personalization and statistical power in mobile health studies.
problem Balancing personalization and statistical power in mobile health studies.
method Develops general meta-algorithms to modify existing bandit algorithms.
result Guarantees sufficient power while improving user well-being.
The vision for precision medicine is to use individual patient characteristics to inform a personalized treatment plan that leads to the best healthcare possible for each patient. Mobile technologies have an important role to play in this vision as they offer a means to monitor a patient's health status in real-time an…
Bayesian ATM improves stability and efficiency in mobile health interventions.
problem Balancing intervention efficacy with user burden in mobile health interventions.
method Bayesian extension to ATM using Kalman filter-style updates.
result Bayesian ATM achieves comparable or improved scalarized returns with lower variance and more stable policy behavior.
In mobile health (mHealth), reinforcement learning algorithms that adapt to one's context without learning personalized policies might fail to distinguish between the needs of individuals. Yet the high amount of noise due to the in situ delivery of mHealth interventions can cripple the ability of an algorithm to learn …
Generative model predicts menstrual cycle lengths accounting for self-tracking artifacts.
problem Uncertainty in self-tracked health data due to user adherence.
method Hierarchical, generative model using machine learning.
result Model yields state-of-the-art performance in predicting menstrual cycle lengths.
Due to the recent advancements in wearables and sensing technology, health scientists are increasingly developing mobile health (mHealth) interventions. In mHealth interventions, mobile devices are used to deliver treatment to individuals as they go about their daily lives. These treatments are generally designed to im…
Study evaluates how changes in mobility affect COVID-19 case rates.
problem Mixed evidence on mobility-COVID-19 case rate associations.
method Modified treatment policy (MTP) approach with TMLE and Super Learner ensemble.
result Shifts in mobility do not consistently affect subsequent case rates after adjusting for confounders.
Increasing technological sophistication and widespread use of smartphones and wearable devices provide opportunities for innovative and highly personalized health interventions. A Just-In-Time Adaptive Intervention (JITAI) uses real-time data collection and communication capabilities of modern mobile devices to deliver…
We develop an off-policy actor-critic algorithm for learning an optimal policy from a training set composed of data from multiple individuals. This algorithm is developed with a view towards its use in mobile health.
In this paper, we consider a new low-quality label learning problem: learning time series detection models from temporally imprecise labels. In this problem, the data consist of a set of input time series, and supervision is provided by a sequence of noisy time stamps corresponding to the occurrence of positive class e…
Predicts local AQI using mobile sensor data, improving accuracy by 71.654 MSE.
problem Inaccurate AQI data from sparse sensors in developing countries.
method Spatio-temporal GNNs for fine-grained AQI forecasting.
result Significant improvement in AQI prediction accuracy (71.654 MSE reduction).
A new RL framework evaluates dynamic mediation effects over time.
problem Dynamic mediation effects in sequentially assigned treatments.
method Reinforcement Learning framework for decomposition and estimation of causal effects.
result Superior performance demonstrated through numerical studies and real data analysis.
Meta-learning method for estimating time-varying mHealth intervention effects.
problem Complex mHealth data and uncertain randomization probabilities.
method DR-WCLS meta-learning procedure for causal excursion effects.
result More efficient and consistent estimates of causal excursion effects.
Paper develops fine-grain spatiotemporal risk scores using high-resolution mobility data.
problem Developing reliable spatiotemporal risk scores for safe economic reopening.
method Hawkes process-based technique leveraging high-resolution cell-phone location signals.
result Fine-grain spatiotemporal risk scores based on high-resolution mobility data provide useful insights for safe re-opening.
Develops RL algorithm for non-Markovian, non-stationary reward streams.
problem Maximizing rewards from non-Markovian, non-stationary reward streams.
method Uses causal DAG to construct Markov states, solves periodic MDP.
result Optimal state construction maximizes discounted rewards.
New models predict mobility flows as well as complex machine learning but are simpler and interpretable.
problem Incomplete understanding and modeling of human mobility flows.
method Developed simple machine-learned, closed-form models of mobility.
result These models predict mobility flows more accurately than gravity or complex machine/deep learning models.
Proposes an efficient algorithm for mHealth that makes real-time physical activity suggestions.
problem Training complex models efficiently in real-time mHealth applications.
method Streamlined empirical Bayes procedure for fitting linear mixed effects models.
result Improves accuracy and speed over state-of-the-art approaches in mHealth applications.
In this work we investigate intra-day patterns of activity on a population of 7,261 users of mobile health wearable devices and apps. We show that: (1) using intra-day step and sleep data recorded from passive trackers significantly improves classification performance on self-reported chronic conditions related to ment…
Stable health predictions need deconfounding test set features.
problem Stability of predictions in health machine learning is compromised by selection biases.
method Deconfounding the test set features improves prediction stability across different environments.
result Improved stability achieved by deconfounding test set features.
System recommends workouts and predicts success rates using RNNs.
problem Promoting healthy lifestyles through personalized exercise recommendations.
method Two interconnected recurrent neural networks (RNNs) using historical workout data.
result Interconnected-RNN model predicts exercise success rates with improved accuracy.
New testing method for robust actor-critic bandit algorithms.
problem Balancing data collection for app performance and user adherence.
method Modified actor-critic algorithm and novel testing procedure.
result Testing procedure is robust to critic misspecification.
VisitHGNN predicts visit probabilities between neighborhoods and POIs using graph neural networks.
problem Estimating visit probabilities between neighborhoods and POIs for urban planning.
method Heterogeneous, relation-specific graph neural network (VisitHGNN) trained on mobility data.
result Strong predictive performance with high fidelity to observed travel behavior.
New method improves mHealth user engagement using Thompson sampling for count data.
problem Optimizing mHealth interventions for distal outcomes through proximal context.
method Combines count data models with Thompson sampling for contextual bandits.
result Improves user engagement in mHealth trials compared to existing methods.
BFTS uses Bayesian Additive Regression Trees for improved personalized mobile health interventions.
problem Adapting to complex, non-linear user behaviors in personalized mobile health interventions.
method Bayesian Forest Thompson Sampling (BFTS) integrates Bayesian Additive Regression Trees (BART) into the exploration loop of contextual bandits.
result BFTS achieves state-of-the-art regret on tabular benchmarks and improves engagement rates by over 30% in a behavioral intervention study.
Unified RL survey for healthcare AI interventions.
problem Limited real-life application of RL in healthcare.
method Unified technical survey and case studies.
result Bridge between dynamic treatment regimes and mobile health.
Develops a method to denoise and analyze wearable ECGs.
problem Noisy ECGs from wearable devices.
method Statistical model, beat-to-beat representation, factor analysis.
result Upper bound on performance quantified and compared.
The paper tackles batch policy learning in Markov Decision Processes, focusing on average reward maximization.
problem Maximizing long-term average reward in Markov Decision Processes with batch learning.
method Doubly robust estimator for average reward, optimization algorithm for optimal policy, finite-sample regret guarantee.
result The proposed method achieves semiparametric efficiency and provides a finite-sample regret guarantee.
The Markov assumption (MA) is fundamental to the empirical validity of reinforcement learning. In this paper, we propose a novel Forward-Backward Learning procedure to test MA in sequential decision making. The proposed test does not assume any parametric form on the joint distribution of the observed data and plays an…
PFN-TS uses Thompson sampling with PFNs to improve contextual bandit performance.
problem Improving contextual bandit performance using Thompson sampling with prior-data fitted networks.
method PFN-TS converts PFN posterior predictives into mean-reward samples using a subsampled predictive central limit theorem.
result PFN-TS achieves the best average rank across nonlinear synthetic and OpenML classification-to-bandit benchmarks.
ELMV uses ensemble learning to handle missing values in EHR data.
problem Significant missing values in EHR data cause bias and unreliable conclusions.
method ELMV constructs multiple subsets with lower missing rates and uses a support set for ensemble learning.
result ELMV outperforms conventional methods in critical feature identification and outcome prediction.
Bluetooth data predicts depression severity, showing 18.8% extra variance.
problem Predicting depressive symptom severity using Bluetooth data.
method Extracted 49 Bluetooth features from NBDC data, used linear mixed-effect and hierarchical Bayesian linear regression models.
result Hierarchical Bayesian model achieved best prediction metrics (R2=0.526, RMSE=3.891).