Many important forms of data are stored digitally in XML format. Errors can occur in the textual content of the data in the fields of the XML. Fixing these errors manually is time-consuming and expensive, especially for large amounts of data. There is increasing interest in the research, development, and use of automat…
A deep learning method for XML with autoencoder and ranking loss.
problem XML with large label collections, high complexity, inter-label and feature dependencies, and noisy labels.
method Word-vector-based self-attention, ranking-based AutoEncoder architecture.
result Competitive performance on benchmark datasets.
BERT-XML automates ICD coding from EHR notes using BERT pretraining.
problem Manual ICD coding is time-consuming and expensive in hospitals.
method Trained a BERT model on EHR notes, adapting it for multi-label attention.
result First large-scale ICD-10 classification model using millions of EHR notes.
Paper tackles interpretability in deep learning for multi-label learning.
problem Machine learning models are often hard to interpret.
method Combines deep autoencoder and multi-label classifiers.
result Proposes interpretable label hierarchies and dependencies.
End-to-end learning framework for tree-structured data.
problem Learning models struggle with tree-structured data due to lack of fixed-length vectors.
method Developed a novel framework for generic semantic tree-structured data of arbitrary topology.
result Framework yields comparable performance to standard models with dedicated feature-vectors and outperforms in compositional data.
A simple baseline for extreme multi-label classification using random projections.
problem Automatically annotating data points with relevant labels from a large label vocabulary.
method On-the-fly global embedding using random projections, with an ensemble of learners.
result Competitive accuracy compared to existing methods, with significant speed-up and model-size reduction.
When digitizing a print bilingual dictionary, whether via optical character recognition or manual entry, it is inevitable that errors are introduced into the electronic version that is created. We investigate automating the process of detecting errors in an XML representation of a digitized print dictionary using a hyb…
Concept Relation Discovery and Innovation Enabling Technology (CORDIET), is a toolbox for gaining new knowledge from unstructured text data. At the core of CORDIET is the C-K theory which captures the essential elements of innovation. The tool uses Formal Concept Analysis (FCA), Emergent Self Organizing Maps (ESOM) and…
New method explains classifiers trained on raw hierarchical data.
problem Lack of interpretability in classifiers trained on raw structured data.
method Treating classifiers as subset selection problems, generating interpretable explanations efficiently.
result Computational efficiency and higher-quality explanations compared to existing methods.
Extends neural network approximation to probability measures and tree-structured data.
problem Universal approximation of functions on probability measures and tree-structured domains.
method Proof of neural network density in probability measure spaces and Cartesian products.
result Universal approximation theorem for tree-structured domains, including JSON.
Automates feature extraction from JSON data for machine learning.
problem Manual feature engineering for JSON data is laborious, lossy, and prone to bias.
method Automates feature extraction using Mill.jl and JsonGrinder.jl.
result Creates a differentiable machine learning model from raw JSON samples.
We introduce the simulation tool SABCEMM (Simulator for Agent-Based Computational Economic Market Models) for agent-based computational economic market (ABCEM) models. Our simulation tool is implemented in C++ and we can easily run ABCEM models with several million agents. The object-oriented software design enables th…
Extends deep learning for hierarchical data to improve classification accuracy.
problem Classification with costly features in hierarchical data.
method Extended deep reinforcement learning with hierarchical deep sets and softmax.
result Superior performance on seven datasets, including malicious web domain classification.
Extreme multi-label classification (XMLC) is a problem of tagging an instance with a small subset of relevant labels chosen from an extremely large pool of possible labels. Large label spaces can be efficiently handled by organizing labels as a tree, like in the hierarchical softmax (HSM) approach commonly used for mul…
New weight function improves subtree kernel performance.
problem Improving performance of subtree kernel for tree data.
method Investigated the influence of weight function, defined a new learned weight function.
result Performance of subtree kernel improved when leaf weights vanish.
Enhances explainability of AI models without sacrificing accuracy.
problem Lack of interpretability in black-box models like Deep Neural Networks and Gradient Boosting.
method Co-supervised Local Model Synthesis (SynthTree) using Mixture of Linear Models (MLM).
result Statistical models significantly enhance explainability of AI models.
New method uses SHAP for biomarker identification in CATE models.
problem Identifying predictive biomarkers from observational data.
method Surrogate estimation approach using SHAP values for CATE meta-learners.
result SHAP accurately identifies biomarkers in high-dimensional data.
Software automates metabolomics data analysis for reproducible results.
problem Automating reproducible metabolomics data analysis.
method Object-oriented software engineering, Java, XML database, GUI, version control system.
result MeKDDaM-SAGA successfully guides metabolomics applications.