This chapter focuses on developing datasets for machine learning, addressing data preparation challenges.
problem Challenges in collecting and transforming data for practical machine learning applications.
method Detailed process of dataset development including data collection, transformation, quality evaluation, and distribution.
result Provides insights and practical tools for effective dataset development and management.
New complete panel dataset for LMICs helps analyze innovation and development.
problem Lack of complete data for empirical analyses in LMICs.
method Predictive Mean Matching multiple imputation technique.
result Created a large dataset of 47 variables for 82 LMICs from 2005-2019.
StyleDiff compares unlabeled datasets using disentangled image spaces.
problem Mismatches between development and real-world datasets lead to inaccurate predictions.
method Uses disentangled image spaces and focuses on attributes to compare datasets.
result Accurately detects and presents differences between datasets.
Develops a logifold structure for understanding datasets.
problem Understanding and classifying complex datasets.
method Local-to-global approach using measure-theoretical models.
result Improves accuracy in data classification problems.
A new COVID-19 CT dataset helps develop AI diagnosis models.
problem Lack of publicly available COVID-19 CT datasets due to privacy issues.
method Built an open-sourced COVID-CT dataset and developed AI diagnosis methods.
result Developed AI diagnosis models achieving high accuracy and performance.
GWHD dataset offers 4,700 high-res images of wheat heads.
problem Challenges in wheat head detection from high-resolution imagery.
method Large, diverse dataset with detailed metadata.
result Benchmark for wheat head detection methods.
Shifts dataset evaluates uncertainty in real-world tasks across modalities.
problem Lack of standard datasets for evaluating uncertainty estimation and robustness to distributional shift.
method Proposes Shifts Dataset for evaluation of uncertainty estimates and robustness to distributional shift across tabular, audio, text, and sensor data.
result Baseline results for tabular weather prediction, machine translation, and SDC vehicle motion prediction.
One of the impediments in advancing actuarial research and developing open source assets for insurance analytics is the lack of realistic publicly available datasets. In this work, we develop a workflow for synthesizing insurance datasets leveraging CTGAN, a recently proposed neural network architecture for generating …
Develops methods to control risk in ordinal classification tasks.
problem Controlling risk in ordinal classification tasks.
method Formulated ordinal classification in conformal risk control framework, proposed loss functions and algorithms.
result Demonstrated effectiveness and analyzed differences in risk control methods.
Develops methods to analyze manifold singularities using graph Laplacian.
problem Analyzing geometric properties of singularities in datasets.
method Theory and methods using the graph Laplacian to provide explicit bounds on manifold singularities.
result Explicit bounds on the graph Laplacian for functions near manifold singularities.
Development of interpretable machine learning models for clinical healthcare applications has the potential of changing the way we understand, treat, and ultimately cure, diseases and disorders in many areas of medicine. These models can serve not only as sources of predictions and estimates, but also as discovery tool…
We introduce a new molecular dataset, named Alchemy, for developing machine learning models useful in chemistry and material science. As of June 20th 2019, the dataset comprises of 12 quantum mechanical properties of 119,487 organic molecules with up to 14 heavy atoms, sampled from the GDB MedChem database. The Alchemy…
The paper bounds generalization errors for deep neural networks with Markov datasets.
problem Bounding generalization errors for deep learning with Markov datasets.
method Developed new symmetrization inequalities for Markov chains, using spectral gap of the infinitesimal generator.
result Derived upper bounds on generalization errors for deep neural networks with Markov datasets.
FairGround offers a diverse dataset corpus for fair ML research.
problem Lack of diverse, well-annotated datasets in fair ML research.
method Unified framework and Python package for reproducible fair ML research.
result Advances reproducibility and generalizability of fair ML research.
Study develops a new tool for assessing asphalt pavement conditions using deep learning.
problem Challenges in automated pavement distress detection via road images.
method Developed a hybrid model using YOLO for classification and U-net for segmentation, creating a comprehensive pavement condition tool.
result Created a new asphalt pavement condition index using deep learning.
Interpretable ML models for missing data and visualisation.
problem Understanding and evaluating fairness in ML models.
method Introduced angle-based variants of Learning Vector Quantization (LVQ) models.
result Models can handle missing values and extract knowledge from datasets.
Develops a VAE model for datasets with missing data.
problem Applying VAEs to datasets with missing data.
method A novel latent variable model of a corruption process generating missing data, with a tractable ELBO.
result Improved marginal log-likelihood and better missing data imputation compared to existing approaches.
A transfer learning method builds high-dimensional models using disparate datasets.
problem Building comprehensive prediction models with small sample sizes and limited features.
method Transfer learning approach using external data to build a reduced model and apply calibration equations.
result Proposes a penalized generalized method of moment framework for inference and one-step estimation.
Increasing numbers of software vulnerabilities are discovered every year whether they are reported publicly or discovered internally in proprietary code. These vulnerabilities can pose serious risk of exploit and result in system compromise, information leaks, or denial of service. We leveraged the wealth of C and C++ …
Robust detection and tracking of objects is crucial for the deployment of autonomous vehicle technology. Image based benchmark datasets have driven development in computer vision tasks such as object detection, tracking and segmentation of agents in the environment. Most autonomous vehicles, however, carry a combinatio…
Six AI solutions accurately detect growth plate planes in mice bone scans.
problem Manual, time-consuming, and variable bone growth plate detection in micro-CT scans.
method Prepared and annotated a dataset of 3D μCT scans, organized a challenge, and developed six computer vision solutions.
result Achieved mean absolute error of 1.91±0.87 planes from ground truth.
Develops a framework for consistent clustering algorithm benchmarking.
problem Lack of consistent benchmarking and diverse datasets for clustering algorithms.
method Consistent methodology, aggregated and polished datasets, interactive explorer.
result Introduces a comprehensive framework for testing clustering algorithms.
Machine learning has been an emerging tool for various aspects of infectious diseases including tuberculosis surveillance and detection. However, WHO provided no recommendations on using computer-aided tuberculosis detection software because of the small number of studies, methodological limitations, and limited genera…
FedML aims to improve FL research by providing a library and benchmark.
problem Inconsistent FL algorithm development and performance comparison.
method FedML offers an open research library and benchmark supporting diverse computing paradigms and flexible API design.
result FedML facilitates fair algorithm comparison and development in federated learning.
Developing new ideas and algorithms in the fields of graph processing and relational learning requires public datasets. While Wikidata is the largest open source knowledge graph, involving more than fifty million entities, it is larger than needed in many cases and even too large to be processed easily. Still, it is a …
The sample inefficiency of standard deep reinforcement learning methods precludes their application to many real-world problems. Methods which leverage human demonstrations require fewer samples but have been researched less. As demonstrated in the computer vision and natural language processing communities, large-scal…
We develop methodology for visualization of labeled mixed-featured datasets. We first investigate datasets with continuous features where our Max-Ratio Projection (MRP) method utilizes the group information in high dimensions to provide distinctive lower-dimensional projections that are then displayed using Radviz3D. O…
Study develops an interpretable model for early mortality prediction in elderly MODS patients.
problem High mortality risk in elderly patients with MODS, unsatisfactory current scoring systems.
method Used eXtreme Gradient Boosting with SHapley Additive exPlanations on MIMIC-III, eICU-CRD, and PLAGH-S datasets.
result Interpretable model outperforms baseline models and clinical scores in predicting hospital mortality.
Recent advances in computer vision and deep learning have led to breakthroughs in the development of automated skin image analysis. In particular, skin cancer classification models have achieved performance higher than trained expert dermatologists. However, no attempt has been made to evaluate the consistency in perfo…
DSLOB creates synthetic LOB data for benchmarking forecasting algorithms under distributional shifts.
problem Challenges in dealing with out-of-distribution limit order book data.
method Multi-agent market simulator to create labeled synthetic LOB dataset with and without market stress.
result Demonstrates the need for robust forecasting algorithms to handle distributional shifts.
In many real-world applications, we want to exploit multiple source datasets of similar tasks to learn a model for a different but related target dataset -- e.g., recognizing characters of a new font using a set of different fonts. While most recent research has considered ad-hoc combination rules to address this probl…
Two large medical dialogue datasets for improving healthcare.
problem Improving healthcare through better dialogue systems.
method Building two large-scale medical dialogue datasets: MedDialog-EN and MedDialog-CN.
result The datasets are the largest medical dialogue datasets to date.
The majority of biomedical studies use limited datasets that may not generalize over large heterogeneous datasets that have been collected over several decades. The current paper develops and validates several multimodal models that can predict 1-year mortality based on a massive clinical dataset. Our focus on predicti…
Introduces MLM dataset for multitask learning across multiple languages and modalities.
problem Training and evaluating multitask systems on diverse data.
method Develops a new benchmark dataset with semantic data and modalities.
result Demonstrates challenges in generalizing on diverse data.
The growing role that artificial intelligence and specifically machine learning is playing in shaping the future of wireless communications has opened up many new and intriguing research directions. This paper motivates the research in the novel direction of \textit{vision-aided wireless communications}, which aims at …
New datasets support supervised learning for fungal BGC discovery.
problem Lack of labeled data for fungal BGCs.
method Developed new publicly available datasets for supervised learning.
result Supervised learning outperforms data-driven methods in fungal BGC prediction.
BSAC improves credit scoring models by leveraging autoencoders and addressing imbalanced datasets.
problem Imbalanced and heterogeneous credit scoring datasets.
method Bagging Supervised Autoencoder Classifier (BSAC) that uses autoencoders and undersampling.
result BSAC improves classification of loan applicants, demonstrating robustness and effectiveness.
Develops a fair relational model learning algorithm.
problem Fairness in machine learning models for relational data.
method Fair-A3SL, a fairness-aware structure learning algorithm for relational structures.
result Demonstrates effectiveness in learning fair, interpretable, and expressive structures.
Develops neural network for directed hypergraphs for node classification.
problem Irregular data structure, particularly directed graphs.
method Directed hypergraph neural network and semi-supervised learning method.
result Novel directed hypergraph neural network achieves highest accuracies on node classification tasks.
MCCA extracts shared structure from multiple tensor datasets.
problem Extracting shared structure from multiple tensor datasets.
method Multilinear common component analysis (MCCA) using Kronecker products of mode-wise covariance matrices.
result MCCA constructs a common basis that retains information from multiple tensor datasets.
Multi-task learning (MTL) is a supervised learning paradigm in which the prediction models for several related tasks are learned jointly to achieve better generalization performance. When there are only a few training examples per task, MTL considerably outperforms the traditional Single task learning (STL) in terms of…
Background: Pharmacokinetic evaluation is one of the key processes in drug discovery and development. However, current absorption, distribution, metabolism, excretion prediction models still have limited accuracy. Aim: This study aims to construct an integrated transfer learning and multitask learning approach for deve…
Develops efficient algorithm for distilling supervised and offline RL datasets.
problem Creating synthetic datasets for supervised and offline RL models to match training data performance.
method An efficient algorithm based on matching losses without model training, using randomly sampled regressors.
result Synthetic datasets derived with ildeO(d2) sampled regressors match MSE loss of bounded linear models on training data. A novel resampling technique addresses class imbalance in imbalanced datasets.
problem Class imbalance in real-world datasets, especially in rare event detection.
method Developed two oversampling algorithms: G1Nos 1-Nearest Neighbour.
result Our oversampling algorithms outperform state-of-the-art methods in all metrics.
This review covers learning under concept drift, including detection, understanding, and adaptation.
problem Unforeseeable changes in data distribution over time impact machine learning performance.
method Reviews and analyzes methodologies and techniques for concept drift detection, understanding, and adaptation.
result Establishes a framework for learning under concept drift with three main components.
Technological development aims to produce generations of increasingly efficient robots able to perform complex tasks. This requires considerable efforts, from the scientific community, to find new algorithms that solve computer vision problems, such as object recognition. The diffusion of RGB-D cameras directed the stu…
Develops a method for manifold learning with small sample size datasets.
problem Improving manifold learning performance for multiple tasks with limited samples.
method Uses instance and model transfer to integrate manifold models from similar tasks.
result Successfully estimates manifolds with tiny sample sizes across multiple tasks.
Develops a fair clustering algorithm for datasets with outliers.
problem Fair clustering with outliers in datasets.
method Solves a linear program to identify and exclude outliers, then applies a rounding algorithm to find fair centers.
result Guaranteed approximation of fair radius and clustering cost.