Syntax designs adaptive trials for subpopulations with potential benefits.
problem Identifying subpopulations with positive treatment effects in diverse patient populations.
method Adaptive patient recruitment and synthetic control estimation.
result Syntax outperforms conventional trial designs in identifying beneficial subpopulations.
Study evaluates approaches to improve worst-case model performance across patient subpopulations.
problem Improving model accuracy for specific patient subpopulations.
method Comparison of distributionally robust optimization (DRO) and standard learning procedures.
result Standard learning procedures generally outperform DRO approaches for improving model performance across subpopulations.
Study adaptive clinical trial methods for identifying patient subpopulations with treatment benefit.
problem Adaptive identification of patient subpopulations with treatment benefit in clinical trials.
method Proposes AdaGGI and AdaGCPI meta-algorithms for subpopulation construction.
result Empirical investigation of AdaGGI and AdaGCPI performance across various simulation scenarios.
EKG-based models show better stability across patient populations than EHR-based models.
problem Model generalization issues in EHR and EKG-based predictive models.
method Two tests to measure model generalization, comparing EHR and EKG data.
result EKG-based models are more stable across different patient populations.
Study identifies sepsis subpopulations for better ICU prediction.
problem Lack of stratified sepsis subpopulations in ICU EHR predictions.
method Stratified sepsis subpopulations identified using machine learning.
result Machine learning models perform better with stratified subpopulations.
We discovered secular trend bias in a drug effectiveness study for a recently approved drug. We compared treatment outcomes between patients who received the newly approved drug and patients exposed to the standard treatment. All patients diagnosed after the new drug's approval date were considered. We built a machine …
For many complex diseases, there is a wide variety of ways in which an individual can manifest the disease. The challenge of personalized medicine is to develop tools that can accurately predict the trajectory of an individual's disease, which can in turn enable clinicians to optimize treatments. We represent an indivi…
Develops a risk score to assist ECMO planning for critically ill patients with viral or unspecified pneumonia.
problem Lack of a risk score to guide ECMO planning for critically ill patients.
method Leverages machine learning to develop the PEER score.
result PEER score predicts mortality and decompensation in patients eligible for ECMO.
MAGIC uncovers disease heterogeneity across brain scales.
problem Understanding distinct subtypes of brain diseases at different spatial scales.
method Multi-scale Heterogeneity Analysis and Clustering (MAGIC) using semi-supervised clustering.
result Two main subtypes of AD identified with distinct atrophy patterns.
Proposes a method to ensure low losses across all subpopulations in large datasets.
problem Standard practice of minimizing average loss fails to guarantee low losses across all subpopulations in heterogeneous datasets.
method Convex procedure that controls worst-case performance over all subpopulations of a given size with finite-sample convergence guarantees.
result Empirically, the worst-case procedure learns models that do well against unseen subpopulations.
New methods adapt conformal prediction to unknown subpopulation shifts.
problem Failure of conformal prediction under unknown subpopulation shifts.
method Proposes new methods that adapt conformal prediction to unknown subpopulation shifts without explicit subpopulation labels.
result Ensures valid coverage guarantees without explicit knowledge of subpopulation structure.
Machine learning improves CAD management outcomes.
problem Current CAD guidelines do not account for patient-specific characteristics.
method Developed binary classifiers and regression models using patient data.
result Improved health outcomes by 24.11% compared to standard care.
BREEDS benchmarks assess model robustness to subpopulation shifts.
problem Measuring model robustness to novel subpopulation shifts.
method Controlled synthesis of realistic distribution shifts using class structure.
result Validated model sensitivity and effectiveness of robustness interventions.
Boosts test performance with importance sampling for subpopulation issues.
problem Limited ERM performance on data with spurious correlation or subpopulation.
method Importance sampling as a tool to solve subpopulation problems.
result Achieves state-of-the-art performance on benchmark datasets.
Proposes Population Difference Criterion for visually observed subpopulation differences.
problem Statistical significance of visually observed subpopulation differences in high-dimensional and high-signal contexts.
method Balanced permutation approach and bootstrap confidence interval for quantifying uncertainty.
result Balanced permutation approach is more powerful in high-signal contexts.
A new method boosts survival analysis by stratifying patients and removing noise covariates.
problem Weak detection of treatment differences in randomized clinical trials due to patient heterogeneity.
method 5-Step Stratified Testing and Amalgamation Routine (5-STAR) using elastic net Cox regression and conditional inference trees.
result The 5-STAR routine significantly improves power in detecting treatment effects compared to traditional methods.
New method recovers predictions from unobservable source subpopulation in binary classification.
problem Challenging binary classification with unobservable subpopulation in source domain.
method Distribution matching method to estimate subpopulation proportions, rigorous derivation of prediction models.
result Our method outperforms naive benchmarks in synthetic and real-world datasets.
BAICS identifies best arm with fairness constraints on subpopulations.
problem Identify the best arm while ensuring fairness across subpopulations.
method Formulated and solved BAICS problem, analyzed complexity, designed algorithm.
result Algorithm's sample complexity matches theoretical lower bound.
Optimal strategy for A/B/n testing with control in stratified populations.
problem Discovering which arms have higher weighted expectation than the control in stratified populations.
method Sequentially choosing one arm per time step based on weighted subpopulation means.
result The strategy is asymptotically optimal, ensuring correct answers with high probability.
Improves model robustness to shifts in subpopulations.
problem Poor performance of ML models under data distribution shifts.
method Develops group-aware priors (GAP) over neural network parameters.
result Training with GAP yields state-of-the-art performance.
Subpopulation attacks poison data to misclassify naturally distributed points.
problem Improving accuracy of machine learning predictions through adversarial data modification.
method Introducing a novel subpopulation attack framework, using influence functions and gradient optimization.
result Subpopulation attacks are effective and stealthy, making them difficult to defend against.
In the recent literature on estimating heterogeneous treatment effects, each proposed method makes its own set of restrictive assumptions about the intervention's effects and which subpopulations to explicitly estimate. Moreover, the majority of the literature provides no mechanism to identify which subpopulations are …
We consider the problem in regression analysis of identifying subpopulations that exhibit different patterns of response, where each subpopulation requires a different underlying model. Unlike statistical cohorts, these subpopulations are not known a priori; thus, we refer to them as cadres. When the cadres and their a…
New method reduces variance in subpopulation model performance estimates.
problem High variance in subpopulation performance metrics for small groups.
method Using an evaluation model to form model-based metric (MBM) estimates.
result MBMs produce more accurate and lower variance estimates for small subpopulations.
Paper proposes a novel MTL framework for personalized modeling of diverse individuals.
problem Personalized modeling of heterogeneous subpopulations with high-dimensional data.
method Low-rank tensor decomposition for multi-task learning.
result Superior performance compared to benchmarks in diverse subpopulation scenarios.
New split rules improve subpopulation targeting in policy-making.
problem Improving binary classification for subpopulation targeting in policy-making.
method MDFS, PFS, wEFS for maximizing distance and penalizing final splits.
result Proposed methods target more vulnerable subpopulations than classic CART/KD-CART.
The study assesses external validity by evaluating worst-case treatment effects across subpopulations.
problem Underrepresentation of marginalized groups and limited study populations.
method Develops a semiparametrically efficient estimator for worst-case treatment effects (WTE) and uses cross-fitting to guard against brittle findings.
result The proposed framework guards against invalid findings due to unanticipated population shifts.
Bayesian approach clusters survival data for better risk prediction.
problem Identifying subpopulations with distinct risk profiles in survival analysis.
method Bayesian nonparametric approach in a clustered latent space.
result Consistent improvements in predictive performance and interpretability.
URC improves model accuracy without ground truth for new data.
problem Improving model accuracy with new, unseen data without ground truth.
method URC observes and corrects model predictions when training data is not representative of field data.
result URC corrects model bias without retraining or ground truth for some subpopulations.
Early prognosis of Alzheimer's dementia is hard. Mild cognitive impairment (MCI) typically precedes Alzheimer's dementia, yet only a fraction of MCI individuals will progress to dementia, even when screened using biomarkers. We propose here to identify a subset of individuals who share a common brain signature highly p…
DORO improves DRO's performance and stability in tasks with subpopulation shift.
problem DRO's poor performance and instability in tasks with subpopulation shift.
method DORO, a refined risk function that prevents overfitting to outliers.
result DORO improves DRO's performance and stability on large modern datasets.
S2M optimizes mining for diverse data subpopulations.
problem Scalability and uniformity in training sets with many labels and diverse data.
method Doubly-stochastic mining (S2M) computes per-example and minibatch losses on hardest labels/examples.
result S2M ensures good performance across all data subpopulations.
The study assesses ML model robustness under worst-case subpopulations.
problem ML model performance degradation under non-training population.
method Two-stage estimation procedure for evaluating worst-case robustness over subpopulations.
result The method certifies model robustness and prevents unreliable deployments.
System identifies health risks using semantic and machine learning.
problem Identifying risk factors associated with health conditions in subpopulations.
method Developed a combined semantic and machine learning system using a health risk ontology and knowledge graph.
result Dynamic discovery of risk factors and their subpopulations.
This work addresses fairness constraints for multiple subpopulations in machine learning models.
problem Fairness constraints for multiple subpopulations in machine learning models.
method Constraining the expected outcome of subpopulations in kernel regression and decision tree regression, specifically random forests and boosted trees.
result The proposed solution does not affect the computational or memory complexity of decision trees and can be easily integrated post training.
Data augmentation methods improve worst-case model performance.
problem Ensuring fair predictions across subpopulations in large models.
method Linear last layer retraining with data augmentation techniques.
result Optimal worst-group accuracy achieved for Gaussian latent representation distribution.
Models predict probabilities of causation from limited data.
problem Estimating probabilities of causation requires unreliable or impractical experimental and observational data.
method Proposed Exact-MLP and Mask-MLP models trained on reliable subpopulations.
result Models achieve average MAEs of roughly 0.03, reducing MAE by 80%.
The study examines if enforcing fairness helps mitigate bias due to demographic shifts.
problem Bias in ML models due to underrepresented subpopulations in training data.
method Theoretical and simulation analysis of fairness enforcement in target domains.
result Enforcing fairness can lead to the Bayes model in the target domain under certain conditions.
Study causal effects on humans in mixed human-AI systems with unobserved unit types.
problem Estimating causal effects on humans in systems with unobserved unit types and interaction networks.
method Assumed human-AI prior, causal message passing (CMP) framework, subpopulation analysis.
result Consistently recover human-specific causal effects using subpopulations with varying expected human composition and treatment exposure.
Imputation-Powered Inference improves subpopulation efficiency in missing data settings.
problem Complex missing data patterns challenge standard inference methods.
method Imputation-Powered Inference (IPI) combines blackbox imputation with bias correction.
result IPI provides valid and efficient M-estimation under MCAR blockwise missingness.
Two new models forecast multiple subpopulations' mortality, outperforming existing methods.
problem Modeling mortality patterns and trajectories in related populations.
method Adapted multivariate functional principal component analysis techniques.
result The second proposed model outperforms existing methods in forecast accuracy.
New method detects novel node categories in graphs with distribution shifts.
problem Detecting novel node categories in graphs with distribution shifts.
method Recall-Constrained Optimization with Selective Link Prediction (RECO-SLIP).
result RECO-SLIP outperforms existing methods in detecting novel node categories.
Tumors often contain multiple subpopulations of cancerous cells defined by distinct somatic mutations. We describe a new method, PhyloWGS, that can be applied to WGS data from one or more tumor samples to reconstruct complete genotypes of these subpopulations based on variant allele frequencies (VAFs) of point mutation…
GAM generates global explanations of neural networks by mapping prediction landscapes.
problem Lack of interpretability in neural networks.
method GAM (Global Explanations Mapping) method that explains neural network predictions across subpopulations.
result GAM's global explanations match feature weights of interpretable models and are intuitive to practitioners.
We consider the problem in precision health of grouping people into subpopulations based on their degree of vulnerability to a risk factor. These subpopulations cannot be discovered with traditional clustering techniques because their quality is evaluated with a supervised metric: the ease of modeling a response variab…
Proposes a label propagation framework for domain adaptation.
problem Subpopulation shift in machine learning domains.
method Label propagation based on a teacher classifier trained on source domain.
result End-to-end finite-sample guarantees on domain adaptation algorithm.
Develops methods to analyze feature-outcome associations in subpopulations.
problem Challenges in understanding feature-outcome associations in high-dimensional data.
method Geometric decomposition framework using gradient flow and co-monotonicity decomposition.
result Identifies context-dependent patterns and improves statistical power and interpretability.
Motivation: Driver (epi)genomic alterations underlie the positive selection of cancer subpopulations, which promotes drug resistance and relapse. Even though substantial heterogeneity is witnessed in most cancer types, mutation accumulation patterns can be regularly found and can be exploited to reconstruct predictive …