Word embeddings are a popular approach to unsupervised learning of word relationships that are widely used in natural language processing. In this article, we present a new set of embeddings for medical concepts learned using an extremely large collection of multimodal medical data. Leaning on recent theoretical insigh…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,051 papers · 148 categories
Trend · papers per month
48 results for “medical concept embedding”
Paper proposes embedding medical concepts from claims data for better risk adjustment models.
problem Lack of efficient representation of medical histories in risk adjustment models.
method Semantic embeddings of medical concepts from diagnostic, procedure, and prescription codes.
result Embedding-based models outperform commercial risk adjustment models in prospective risk score prediction.
Somed2Vec learns medical concept embeddings from SNOMED-CT, improving healthcare analytics.
problem Lack of effective vector representations for medical concepts in healthcare analytics.
method Graph-based representation learning using random walks and Poincaré embeddings on SNOMED-CT.
result Concept embeddings from SNOMED-CT significantly outperform state-of-the-art embeddings.
Proposes a deep learning framework for evaluating patient similarities from EHRs.
problem Evaluating clinical similarities between patients for various healthcare applications.
method A deep learning framework with medical concept embedding, preserving temporal information.
result Significant improvement in patient similarity evaluation over baselines.
The widespread availability of electronic health records (EHRs) promises to usher in the era of personalized medicine. However, the problem of extracting useful clinical representations from longitudinal EHR data remains challenging. In this paper, we explore deep neural network models with learned medical feature embe…
Text2Node maps medical phrases to a taxonomy, overcoming coding standard limitations.
problem Limited data interchangeability between EHR systems due to different coding standards.
method Text2Node uses word and node embeddings, along with mapping functions, to generalize from limited training data.
result Text2Node achieves high accuracy in mapping phrases to a taxonomy, even for unseen concepts.
Machine learning constructs problem-based medical records from electronic health records.
problem Difficulty in finding relevant medical information for clinical questions.
method Knowledge base completion using machine learning on electronic health records.
result Automatic construction of problem-based groupings of medications, procedures, and lab tests.
Enhanced word embedding creates new consumer-friendly health terms.
problem Laymen's health terms are often jargon and hard to understand.
method Developed an enhanced GloVe word embedding technique to generate new consumer-friendly terms.
result New CHV terms generated from consumer-generated text.
MedCAT extracts valuable medical information from unstructured text.
problem Extracting structured information from unstructured biomedical documents.
method Unsupervised machine learning for disambiguation of entities.
result Improved entity detection and linking compared to existing tools.
Framework harmonizes EHR data across institutions for better analysis.
problem Heterogeneity of medical codes and terminologies hinder EHR data analysis.
method MASH (Multi-source Automated Structured Hierarchy) uses neural optimal transport and learned hyperbolic embeddings to align and structure EHR data.
result MASH generates interpretable hierarchical graphs for unstructured local laboratory codes.
Proposes RCVs for explaining deep neural network predictions in medical images.
problem Need for explainable predictions in medical applications.
method Uses continuous concept measures as RCVs in neural network activation space.
result Nuclei texture is a relevant concept in breast cancer grading.
ME2Vec learns medical entity vectors from EHR data.
problem Learning structured information from EHR data.
method Graph-based medical entity embedding using diverse graph embedding techniques.
result ME2Vec outperforms baselines in disease diagnosis prediction.
MedGraph learns patient visit embeddings from EMRs, capturing both attributes and temporal sequences.
problem Limited EMR embedding methods fail to capture patient demographics, utilisation, and code descriptions.
method MedGraph constructs an attributed bipartite graph and uses a point process to model temporal sequences.
result MedGraph outperforms state-of-the-art methods in medical risk prediction tasks.
Automated generation of medical reports from chest x-rays using expert annotations.
problem Generating long, unstructured text from medical images with context and consistency.
method First learn visually-informative medical concepts from raw reports, then use these concepts to auto-generate structured reports from images.
result Validation on OpenI dataset shows auto-generated reports are consistent with manual annotations.
Improves medical note processing by training model on related concepts and global context.
problem Scarce and imbalanced labeled training data limits generalizability of automated abbreviation disambiguation models.
method Data augmentation using related medical concepts and global context information within medical notes.
result Model accuracy improved by almost 14% on CASI dataset and 4% on i2b2 dataset.
Enhances medical code predictions for multi-morbidity patients using text classification.
problem Improving accuracy in predicting medical codes for patients with multiple illnesses.
method Used machine learning techniques, including multi-label medical text classification, to enhance predictions.
result High dimensional embeddings pre-trained on health data significantly improve multi-label classification performance.
Deep learning models predict ICU readmission with varying accuracy.
problem Predicting ICU readmission risk using deep learning architectures.
method Several deep learning architectures including attention-based models, recurrent layers, neural ODEs, and embeddings were trained on MIMIC-III data.
result Attention-based models with neural ODEs achieved highest predictive accuracy.
Deep learning methods exhibit promising performance for predictive modeling in healthcare, but two important challenges remain: -Data insufficiency:Often in healthcare predictive modeling, the sample size is insufficient for deep learning methods to achieve satisfactory results. -Interpretation:The representations lear…
Paper tackles medical question similarity using domain-relevant embeddings.
problem Identifying same-question pairs in medical contexts.
method Semi-supervised pre-training of a neural network on medical question-answer pairs.
result Our model achieves 82.6% accuracy on medical question similarity task.
On Interpretability of Deep Learning based Skin Lesion Classifiers using Concept Activation Vectorscs.LG
Deep learning skin lesion classifier explained using CAVs.
problem Limited acceptance of deep learning CAD systems due to opaque decision-making.
method Mapped human understandable concepts to RECOD model using CAVs.
result Classifier learns and encodes disease-related concepts in its latent representation.
This work abstracts deep neural networks into concept graphs for better interpretability in medical tasks.
problem Lack of interpretability in deep learning models, especially in medical domains.
method Developed a graphical representation of medical image processing models to understand concept-based reasoning.
result Extracted a concept-level graph that reveals the decision-making process of deep learning models.
Hi-RES framework extracts medical relations from articles and EHRs.
problem Manual annotation bottleneck in relation extraction.
method Labeling sentences, creating improved negative samples, using pretrained language models, and combining EHR embeddings.
result Significant accuracy increases in relation extraction, up to 0.998 for disorder-location relations.
A statistical test controls false positives in anomaly localization using diffusion models.
problem Uncertainty and bias in generative models for anomaly localization.
method Selective inference to quantify significance and control false positives.
result The method effectively controls false positive detection rates.
Eliciting semantic similarity between concepts in the biomedical domain remains a challenging task. Recent approaches founded on embedding vectors have gained in popularity as they risen to efficiently capture semantic relationships The underlying idea is that two words that have close meaning gather similar contexts. …
We propose using canonical correlation analysis (CCA) to generate features from sequences of medical billing codes. Applying this novel use of CCA to a database of medical billing codes for patients with diverticulitis, we first demonstrate that the CCA embeddings capture meaningful relationships among the codes. We th…
Framework evaluates medical image classification methods using a probabilistic model and a Twenty Questions paradigm.
problem Lack of detailed understanding of how machine learning methods make decisions in medical imaging.
method Inspired by the Turing Test, uses a probabilistic model and a Twenty Questions paradigm to evaluate classification methods based on task-specific concepts.
result Probabilistic model exposes dataset and method biases, reducing the number of queries needed for confident performance evaluation.
Visual analytics system for comparing medical records using sequence embeddings.
problem Challenges in analyzing medical records due to high dimensionality, irregularity, and sparsity.
method Event and sequence embeddings using autoencoder and self-attention mechanism, with sequence alignment for comparison.
result Demonstrated effectiveness with real-world neonatal ICU dataset.
System suggests clinical concepts in real-time for faster note creation.
problem Efficiently creating structured clinical notes with minimal keystrokes.
method Contextual autocompletion using shallow neural networks.
result Reduces keystrokes by 67% in real hospital environments.
Improves medication name inference for telemedicine and conversational agents.
problem Challenges in mapping user-friendly medication names to standardized ones.
method Entity-boosted two-tower neural network for ranking SMN to DMP.
result State-of-the-art results achieved with improved attention-based ranking.
Tensor networks improve medical image classification performance.
problem Improving medical image classification accuracy.
method Extending tensor networks to medical image analysis, focusing on 2D images.
result Tensor networks achieve comparable performance to deep learning methods with fewer hyperparameters and resources.
Medical Knowledge Integration into Reinforcement Learning Algorithms for Dynamic Treatment Regimesstat.ME
RL algorithms with medical integration improve personalized treatment recommendations.
problem Developing effective personalized treatment strategies for chronic diseases.
method Integrating medical knowledge into RL algorithms for DTR.
result Enhanced treatment recommendations with increased confidence.
Paper uses NLP to cluster patient visits for diagnosis validation.
problem Validating if similar patients receive similar diagnoses.
method Representation of medical visits using word embeddings, clustering patients' visits.
result Stable and separated segments of visits positively validated against diagnoses.
The paper proposes a method to find interpretable subspaces in node embeddings using a knowledge base.
problem Finding interpretable subspaces in unsupervised node embeddings.
method Using a taxonomy of human-understandable concepts from a knowledge base to identify subspaces in node embeddings.
result Low error in finding fine-grained concepts.
Paper detects bias in AI medical models using CART.
problem Ensuring fairness in AI medical decision support systems.
method Uses Classification and Regression Trees (CART) algorithm to identify bias.
result Validated the CART approach in both synthetic and real-world data.
Zero-Shot Learning and its Applications from Autonomous Vehicles to COVID-19 Diagnosis: A Reviewcs.CV
Zero-Shot Learning helps learn new concepts without examples, useful for COVID-19 diagnosis.
problem Learning new concepts without examples, especially in medical imaging.
method Uses existing knowledge and auxiliary information to predict unknown concepts.
result Effective in diagnosing COVID-19 from chest X-rays.
Deep learning detects pneumonia with 36x compression on low-power devices.
problem High accuracy pneumonia detection on low-power embedded devices.
method Structured weight pruning method for compression and maintaining accuracy.
result Up to 36x compression ratio with no accuracy loss.
Paper proposes a graph network for EHR data that learns robust representations.
problem Learning robust representations for EHR data with implicit connections.
method Variationally regularized encoder-decoder graph network.
result Model outperforms existing methods in various EHR predictive tasks.
The paper proposes a deep generative model for complex disease trajectories.
problem Modeling and analyzing complex disease trajectories.
method Deep generative time series approach with semi-supervised latent processes.
result The model can discover novel aspects of diseases and cluster them into new sub-types.
FEET protocol evaluates foundation models across three scenarios.
problem Lack of standardized evaluation protocols for foundation models.
method Structured evaluation protocol across three use cases: frozen, few-shot, and fine-tuned embeddings.
result Demonstrates comprehensive assessment of foundation models' effectiveness.
Deep learning models exhibit state-of-the-art performance for many predictive healthcare tasks using electronic health records (EHR) data, but these models typically require training data volume that exceeds the capacity of most healthcare systems. External resources such as medical ontologies are used to bridge the da…
VICE embeds concepts in a vector space using human data.
problem Developing numerical models for mental representations of object concepts.
method Variational Interpretable Concept Embeddings (VICE) using variational inference and triplet odd-one-out task data.
result VICE outperforms SPoSE at predicting human behavior and provides more reproducible object representations.
Paper detects biases in medical imaging ML models using counterfactual analysis.
problem Bias in medical imaging ML models negatively impacts generalization performance.
method Counterfactual invariance framework combining conditional latent diffusion models and statistical hypothesis testing.
result The method identifies and quantifies biases without direct access to counterfactual data.
ConCare personalizes healthcare predictions by capturing EMR features.
problem Predicting patient outcomes from EMR data with personalization.
method Captures personal characteristics and time-aware distribution in EMR data.
result Improves healthcare prediction accuracy through personalized health context.
New methods identify concepts in trained embeddings reliably without human labels.
problem Identifying interpretable concepts in trained embedding spaces without human labels.
method Explicitly connecting concept discovery to PCA and ICA, proposing novel approaches for dependent concepts.
result Proven methods outperform competitors on a variety of experiments, achieving up to 29% better alignment with ground truth.
This chapter introduces reproducibility in machine learning for medical imaging.
problem Lack of reproducibility in machine learning for medical imaging.
method Distinguishes and defines types of reproducibility, outlines requirements, and discusses utility.
result Discussion on benefits and a plea for a non-dogmatic approach to reproducibility.
The Analysis from Nonlinear Distance Metric to Kernel-based Drug Prescription Prediction Systemcs.LG
The study compares Euclidean and cosine distances in medical drug prescription prediction.
problem Comparing Euclidean and cosine distances in medical drug prescription prediction.
method Established geometric properties and compared distances in real-world medical data.
result Different distances lead to different optimizing nonlinear kernel embedding frameworks.
Automated system extracts medication regimens from medical conversations.
problem Extract relevant medication information from medical conversations.
method QA task approach, combined QA and Information Extraction, data augmentation, public embeddings, pretraining.
result Improved accuracy in extracting dosage and frequency from 54.28 and 37.13 to 89.57 and 45.94.
Data-driven models and computational tools for neurolinguistics: a language technology perspectivecs.LG
Paper reviews neurolinguistics and language technologies, emphasizing mutual enrichment.
problem Understanding brain activity during language processing.
method Brain imaging studies and natural language representations.
result Development of brain-aware natural language representations.