In this paper, we consider the problem of predicting demographics of geographic units given geotagged Tweets that are composed within these units. Traditional survey methods that offer demographics estimates are usually limited in terms of geographic resolution, geographic boundaries, and time intervals. Thus, it would…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,742 papers · 148 categories
Trend · papers per month
48 results for “Demographic and Health Surveys”
IML methods improve survival analysis transparency.
problem Limited interpretability in survival analysis models.
method Adapting IML techniques to survival analysis.
result Enhanced understanding of model predictions and risks.
This paper presents an example of how demographical characteristics of patients influence their susceptibility to certain medical conditions. In this paper, we investigate the association of health conditions to age of patients in a heterogeneous population. We show that besides the symptoms a patients is having, the a…
New methods reduce bias in machine learning predictions for causal inference without extra data.
problem Machine learning predictions from satellite data shrink toward the mean, leading to biased causal estimates.
method Two post-hoc correction methods: Linear Calibration Correction (LCC) and Tweedie's approach, reduce shrinkage-induced bias.
result Tweedie's method yields nearly unbiased treatment-effect estimates, enabling multiple trials with a single map.
SaML guides ML models to avoid survey biases.
problem ML models trained on survey data often ignore survey design metadata.
method Nine-step guideline for incorporating survey design metadata in ML lifecycle.
result SaML provides valid population inference from survey data.
Study identifies key health behaviors linked to adolescent suicide attempts.
problem Understanding health behaviors associated with increased risk of adolescent suicide attempts.
method Cross-sectional data analysis using machine learning algorithms and logistic regression.
result Non-parametric Bayesian tree ensemble model outperforms other models, achieving 80.0% accuracy in goodness-of-fit and 78.2% in predictive accuracy.
Study shows racial bias in health data, which can be reduced with simple techniques.
problem Racial bias in health indicators measured by the Medical Expenditure Panel Survey (MEPS).
method Used publicly available and nationally representative MEPS data to show bias in predictive models for care management.
result Racial bias can be significantly reduced using simple mitigation techniques.
Proposes a framework to create fair IDRs by enforcing demographic parity constraints.
problem Discrimination in IDRs trained on biased data.
method Incorporates DP and CDP constraints into IDR estimation.
result Theoretically optimal IDRs can be efficiently obtained through perturbations.
New models automate support group formation in online health communities.
problem Challenges in traditional support group formation methods for scalability, static categorization, and insufficient personalization.
method Two novel machine learning models: gDMR and gSTM, integrating user content, demographics, and network data.
result Models outperform baselines in predictive accuracy, semantic coherence, and internal group consistency.
MLHO predicts COVID-19 adverse outcomes using past medical records.
problem Predicting adverse outcomes after COVID-19 infection.
method Iterative feature and algorithm selection, sequential representation mining.
result Mean AUC ROC of 0.91 for mortality prediction.
Bayesian model predicts patient survival from sparse EHR data.
problem Analyzing EHR data with few samples and diverse information.
method Nonparametric probabilistic model using Bayesian trees.
result Improved survival trajectory predictions on patient data.
New method generates diverse EHR data types while maintaining privacy.
problem Privacy risks in sharing EHRs across large scales.
method Refined GAN model, feature constraints, and utility measures.
result New model preserves EHR statistics, correlations, and constraints.
Although there are millions of transgender people in the world, a lack of information exists about their health issues. This issue has consequences for the medical field, which only has a nascent understanding of how to identify and meet this population's health-related needs. Social media sites like Twitter provide ne…
Method fuses low and high-resolution data for better health estimates.
problem Improving high-resolution health estimates from mixed data sources.
method Fusion of unbiased low-resolution and potentially biased high-resolution data, learning a distribution consistent with sampling bias.
result Significant reduction in bias in high-resolution estimates.
A lack of information exists about the health issues of lesbian, gay, bisexual, transgender, and queer (LGBTQ) people who are often excluded from national demographic assessments, health studies, and clinical trials. As a result, medical experts and researchers lack a holistic understanding of the health disparities fa…
We present three case studies of organizations using a data science competition to answer a pressing question. The first is in education where a nonprofit that creates smart school budgets wanted to automatically tag budget line items. The second is in public health, where a low-cost, nonprofit women's health care prov…
Life-expectancy is a complex outcome driven by genetic, socio-demographic, environmental and geographic factors. Increasing socio-economic and health disparities in the United States are propagating the longevity-gap, making it a cause for concern. Earlier studies have probed individual factors but an integrated pictur…
Estimates disease prevalence using non-ignorable missing data in health surveys.
problem Estimating disease prevalence in non-representative samples with non-ignorable missing data.
method Connects auxiliary proxy variable framework to label shift setting, uses high-dimensional covariates without generative models.
result Fails to account for non-ignorable missingness can lead to significant misestimations.
AI improves precision health through adaptive interventions.
problem Improving healthcare through personalized and dynamic treatments.
method Reinforcement learning (RL) for adaptive interventions in digital health.
result RL shows promise in dynamic healthcare problems.
Bias in training data affects diagnostic algorithms' performance.
problem Bias in training data leads to biased predictions in diagnostic algorithms.
method Survey of MICCAI 2018 proceedings, analysis of a skin lesions dataset, adversarial training setup.
result Classifier performance varies significantly between subgroups based on age and sex.
Study on privacy-preserving health care models that sacrifice accuracy for data protection.
problem Privacy-preserving models in health care neglect data from the tails, reducing accuracy for small groups.
method Used state-of-the-art differentially private learning methods for clinical prediction tasks.
result Privacy-preserving models in health care exhibit steep tradeoffs between privacy and utility, and disproportionately influence large demographic groups.
Market research is generally performed by surveying a representative sample of customers with questions that includes contexts such as psycho-graphics, demographics, attitude and product preferences. Survey responses are used to segment the customers into various groups that are useful for targeted marketing and commun…
Depression and anxiety are critical public health issues affecting millions of people around the world. To identify individuals who are vulnerable to depression and anxiety, predictive models have been built that typically utilize data from one source. Unlike these traditional models, in this study, we leverage a rich …
Bayesian networks learn sub-population differences from data.
problem Inference from a single network structure can be misleading when data populations are heterogeneous.
method A mixture of Bayesian networks where component probabilities depend on individual characteristics.
result Identifies both network structures and demographic predictors of sub-population membership.
A Longitudinal Attribute-Conditioned Neural Network (LANTERN) framework for modeling health-state transition probabilities in irregular longitudinal data.
problem Estimating long-term care transition probabilities in irregular longitudinal health data.
method A neural network that learns from individual health history, incorporates time elapsed, and conditions on demographic and socioeconomic attributes.
result Improves severe disability discrimination and maintains strong calibration.
Study finds farmers are willing to pay higher premiums for higher coverage in agricultural insurance.
problem Determining the demand factors and WTP for agricultural insurance.
method Conducted a survey of 200 farmers to analyze the impact of socio-demographic variables and premium on insurance purchase decisions.
result Farmers are willing to pay higher premiums for higher coverage in agricultural insurance.
Unified RL survey for healthcare AI interventions.
problem Limited real-life application of RL in healthcare.
method Unified technical survey and case studies.
result Bridge between dynamic treatment regimes and mobile health.
Deep learning using neural networks has provided advances in image style transfer, merging the content of one image (e.g., a photo) with the style of another (e.g., a painting). Our research shows this concept can be extended to analyse the design of streetscapes in relation to health and wellbeing outcomes. An Austral…
With the expeditious advancement of information technologies, health-related data presented unprecedented potentials for medical and health discoveries but at the same time significant challenges for machine learning techniques both in terms of size and complexity. Those challenges include: the structured data with var…
Prediction of disease onset from patient survey and lifestyle data is quickly becoming an important tool for diagnosing a disease before it progresses. In this study, data from the National Health and Nutrition Examination Survey (NHANES) questionnaire is used to predict the onset of type II diabetes. An ensemble model…
Since 2006, deep learning (DL) has become a rapidly growing research direction, redefining state-of-the-art performances in a wide range of areas such as object recognition, image segmentation, speech recognition and machine translation. In modern manufacturing systems, data-driven machine health monitoring is gaining …
TabSODA: Tabular Diffusion based Imputation with Skip Pattern Detection and Ordinal Awarenessstat.ML
TabSODA improves imputation of surveys with skips and ordinal data.
problem Handling structural skips and ordinal responses in survey data.
method TabSODA uses an Elucidated Diffusion Model with skip pattern detection and ordinal awareness.
result TabSODA reduces ordinal missing-at-random (MACE) by up to 23.7% and improves categorical accuracy by up to 9%.
Semiparametric STAR model improves mental health data analysis.
problem Overdispersed, zero-inflated, bounded count data in self-reported mental health surveys.
method STAR transformation and rounding of latent Gaussian model, nonparametric transformation estimation, EM algorithm for maximum likelihood.
result Substantial improvements in goodness-of-fit compared to existing models.
Survey of EEG market and machine learning applications.
problem Improving neurology through data-driven research.
method Comprehensive survey of EEG applications and market.
result Machine learning enhances EEG applications and market growth.
Method completes mixed matrix from complex surveys with heterogeneous missingness.
problem Recovering a mixed dataframe matrix from complex survey sampling with different missingness patterns.
method Two-stage procedure: logistic regression for missingness modeling, and weighted log-likelihood maximization with low-rank constraint.
result The proposed method achieves sublinear convergence and shows superior performance compared to existing methods.
The occurrence of drug-drug-interactions (DDI) from multiple drug dispensations is a serious problem, both for individuals and health-care systems, since patients with complications due to DDI are likely to reenter the system at a costlier level. We present a large-scale longitudinal study (18 months) of the DDI phenom…
Generative model predicts daily activity sequences with duration-aware dynamics.
problem Accurately forecasting granular daily activity sequences for energy demand.
method Hierarchical semi-Markov models with duration-aware dynamics.
result Explicitly modeling activity durations improves predictive performance.
Survey reviews explainability in AI for healthcare, emphasizing trust and transparency.
problem Lack of transparency hinders AI adoption in healthcare.
method Comprehensive literature review to guide explainable AI design.
result Quantitative evaluation metrics are needed for some explainability properties.
Extracting actionable insight from Electronic Health Records (EHRs) poses several challenges for traditional machine learning approaches. Patients are often missing data relative to each other; the data comes in a variety of modalities, such as multivariate time series, free text, and categorical demographic informatio…
Deep learning algorithms have recently produced state-of-the-art accuracy in many classification tasks, but this success is typically dependent on access to many annotated training examples. For domains without such data, an attractive alternative is to train models with light, or distant supervision. In this paper, we…
Malaria Likelihood Prediction By Effectively Surveying Households Using Deep Reinforcement Learningcs.LG
We build a deep reinforcement learning (RL) agent that can predict the likelihood of an individual testing positive for malaria by asking questions about their household. The RL agent learns to determine which survey question to ask next and when to stop to make a prediction about their likelihood of malaria based on t…
The past decade has seen an explosion in the amount of digital information stored in electronic health records (EHR). While primarily designed for archiving patient clinical information and administrative healthcare tasks, many researchers have found secondary use of these records for various clinical informatics tasks…
The paper tackles robust classification trees for distribution shifts, improving accuracy in public health and social work.
problem Learning robust classification trees for high-stakes settings with distribution shifts.
method Mixed-integer robust optimization technology to reformulate as a two-stage linear robust optimization problem.
result Increase of up to 12.48% in worst-case accuracy and 4.85% in average-case accuracy.
Disease prediction or classification using health datasets involve using well-known predictors associated with the disease as features for the models. This study considers multiple data components of an individual's health, using the relationship between variables to generate features that may improve the performance o…
The Nondecreasing Rankstat.ML
Introduces nondecreasing rank for matrices and tensors, developing methods and applications.
problem Finding low-rank approximations for matrices and tensors with monotonic constraints.
method Developed a variant of hierarchical alternating least squares algorithm for finding low ND rank approximations.
result Low ND rank factorizations can be found and interpreted for real-world datasets.
Study decomposes racial healthcare disparities via shifts in mediator distributions.
problem Racial disparities in healthcare expenditures and their underlying drivers.
method Framework decomposing disparities into mediator distribution shifts and residual components, using MEPS data.
result Substantial disparities persist even when mediators are equalized, suggesting unmeasured or structural factors.
Medical imaging models may encode demographic attributes without violating fairness, depending on the approach.
problem Discrimination in medical imaging models due to encoding demographic attributes.
method Examined marginal and class-conditional representation invariance, traditional fairness notions, and counterfactual fairness.
result Demographically invariant models may not necessarily be fair, and encoding demographic attributes can be advantageous.
Study uses ML to predict non-participation in ELSA COVID-19 follow-up studies.
problem Predicting non-participation in follow-up surveys due to various factors.
method Used machine learning algorithms including KNN, RF, AdaBoost, logistic regression, NN, and SVC.
result Random Forest (RF) outperforms other models in balanced accuracy.