MARVIN offers an open ML environment for automated primitive annotation and execution.
problem Automated machine learning primitive annotation and execution.
method Web-based Python application with Docker containers on Kubernetes.
result Over 400 datasets and challenges from various ML domains.
This paper evaluates AutoML tools for ML tasks.
problem Efficiency in machine learning for ML engineers.
method Evaluation and comparison of AutoML tools on various datasets.
result Performance and advantages/disadvantages of AutoML tools.
System detects overfitting in ML apps, improving quality and efficiency.
problem Overfitting in ML applications during continuous development.
method ease. ml/meter system for automated overfitting detection and measurement.
result Probabilistic overfitting signals for developers to take actions.
Automated ML simplifies machine learning configurations.
problem Difficulty in configuring and selecting ML methods.
method Bi-level learning objective, learning strategy, and evaluation strategy.
result Satisfactory ML configurations generated automatically.
Automated malaria diagnosis from field slides achieves accurate results.
problem Challenges in analyzing field-prepared thin blood film microscopy images.
method Fully automated framework using machine learning, including CNNs trained on diverse field samples.
result Results are close to sufficient for drug resistance monitoring and clinical use-cases.
We introduce a means of automating machine learning (ML) for big data tasks, by performing scalable stochastic Bayesian optimisation of ML algorithm parameters and hyper-parameters. More often than not, the critical tuning of ML algorithm parameters has relied on domain expertise from experts, along with laborious hand…
ADS automates data preparation for ML/AI, reducing human effort.
problem Manual and time-consuming data preparation for ML/AI.
method Data-driven approach using statistics and ML.
result ADS automates data exploration and processing steps.
CodeReef enables sharing ML models across platforms efficiently.
problem Sharing and deploying ML models across different systems efficiently.
method Developed an open platform to share ML components, automate deployment, and benchmark models.
result Demonstrated efficient deployment and benchmarking of ML models across diverse platforms.
Study compares quantum and classical ML in crypto trading, finding hybrid models outperform.
problem Comparing quantum and classical machine learning in crypto trading strategies.
method Backtesting 10 models across multiple crypto assets using classical ML, quantum ML, hybrid models, and transformer models.
result Hybrid quantum models achieve superior performance with 13.99% return and 1.76 Sharpe ratio.
A rigorous ML pipeline for binary classification in biomedical studies, focusing on pancreatic cancer.
problem Handling bias in ML models for complex biomedical data.
method Customizable ML analysis pipeline with 9 algorithms, hyperparameter optimization, and thorough evaluation.
result Comparison of ML algorithms to ExSTraCS, highlighting interpretability and bias handling.
This paper presents an approach for automation of interpretable feature selection for Internet Of Things Analytics (IoTA) using machine learning (ML) techniques. Authors have conducted a survey over different people involved in different IoTA based application development tasks. The survey reveals that feature selectio…
Adapts ISO 26262 for machine learning in automotive software.
problem Conflict between innovation and safety in automotive software development.
method Detailed assessment and adaptation of ISO 26262 for machine learning, analyzing and proposing new requirements.
result Adapted ISO 26262 for machine learning, addressing safety and innovation in automotive software.
This paper automates multi-label classification using an extended AutoML tool.
problem Lack of automated solutions for multi-label classification.
method Extends ML-Plan for multi-class classification to multi-label classification using MEKA.
result The proposed approach yields superb results and performs significantly better than baselines.
Framework optimizes cloud container sizing for ML tasks.
problem Challenges in cloud container configuration for ML services.
method Autonomous scaling using nested-loop Monte Carlo simulation.
result Reduces compute cost and accelerates ML algorithms.
Guidelines for using explainable ML to avoid misuse.
problem Misuse of explainable ML, especially for harmful purposes.
method Proposed guidelines to promote best practices.
result Promote interpretable models and testing methods.
DeepLine automates ML pipeline generation using reinforcement learning.
problem Automatic generation of end-to-end ML pipelines combining multiple algorithms.
method Deep Reinforcement Learning with hierarchical actions filtering.
result DeepLine outperforms state-of-the-art approaches in accuracy and computational cost.
This paper surveys and benchmarks AutoML frameworks.
problem Reducing the need for data scientists in building machine learning applications.
method Survey and benchmark of popular AutoML frameworks on real data sets.
result Evaluation of 137 data sets from established AutoML benchmark suits.
Automated image annotation improves model training accuracy.
problem Training deep learning models with labeled data.
method Combining wireless localization and cameras for automatic image annotation.
result Demonstrated feasibility and benefits of automatic annotation.
Framework for monitoring ML model performance in production without labels.
problem Monitoring real-time prediction quality of ML models in production without labels.
method ML Health framework using diagnostic methods to generate alerts for further investigation.
result The method outperforms standard distance metrics at detecting issues with mismatched data sets.
Satyam simplifies groundtruth collection for machine vision tasks.
problem Difficulty in collecting accurate groundtruth for machine vision systems.
method Crowdsourcing through Amazon Mechanical Turk, automation of task creation and quality control.
result Groundtruth collected by Satyam is comparable to that of trained experts and provides equivalent ML performance.
Automates translating natural language to Verilog for digital design.
problem Manual translation of natural language specifications to Verilog is time-consuming and error-prone.
method Fine-tuned GPT-2 to derive Verilog from English, using a dataset of design tasks.
result GPT-2 achieved 94.8% correct translation across simple and abstract design tasks.
MPP predicts model performance in real-time ML deployments.
problem Lack of labels in production prevents tracking model performance.
method Ensemble of metrics to create a score for prediction quality.
result Automates monitoring and enables scale ML deployments.
MARCO-GE selects clustering algorithms using graph embeddings.
problem Automated selection of clustering algorithms for unseen datasets.
method Transform datasets into graphs, extract latent representations, train a ranking meta-model.
result MARCO-GE outperforms state-of-the-art approaches in algorithm recommendation.
Automates MIPs solution with semi-supervised graph neural networks.
problem Solving recurrent Mixed-Integer Programming (MIP) problems efficiently.
method Semi-supervised Graph Neural Networks (GNNs) for predicting variable values.
result GNNs can solve MIPs with unlabeled data and improve over other ML approaches.
Paper formalizes anti-discrimination law in automated systems.
problem Algorithmic discrimination in legal contexts.
method Decision-theoretic framework grounded in UK anti-discrimination law.
result Introduced 'conditional estimation parity' metric for ML fairness.
This dissertation automates deep learning pipelines and uses meta-learning for better model selection and data augmentation.
problem Challenges in selecting and fine-tuning deep learning pipelines for new datasets.
method Meta-learning for DL pipeline selection and data augmentation, using synthetic data.
result Meta-learned approaches outperform traditional methods in automated DL pipeline selection and data augmentation.
A graph-based evolutionary algorithm automates machine learning workflows.
problem Automated machine learning to reduce manual operations.
method Graph-based architecture for flexible model combinations, evolutionary algorithm with mutation and heredity operators, Bayesian hyper-parameter optimization.
result State-of-the-art performance compared to other AutoML systems.
Recently software development companies started to embrace Machine Learning (ML) techniques for introducing a series of advanced functionality in their products such as personalisation of the user experience, improved search, content recommendation and automation. The technical challenges for tackling these problems ar…
A framework for developing ML systems from ML primitives.
problem Complexity and fragmentation in ML systems development.
method Unified API, ML primitives, AutoML strategies, and pipelines.
result General-purpose, multi-task AutoML system for various data modalities and problem types.
This paper presents preliminary work on learning the search heuristic for the optimal motion planning for automated driving in urban traffic. Previous work considered search-based optimal motion planning framework (SBOMP) that utilized numerical or model-based heuristics that did not consider dynamic obstacles. Optimal…
Machine learning (ML) is increasingly deployed in real world contexts, supplying actionable insights and forming the basis of automated decision-making systems. While issues resulting from biases pre-existing in training data have been at the center of the fairness debate, these systems are also affected by technical a…
Defends against ML inference attacks using adversarial examples.
problem Automated inference attacks using ML classifiers pose privacy and security threats.
method Turns ML classifier vulnerabilities into defenses by adding adversarial noise to public data.
result Adversarial examples can mislead ML classifiers and protect private data.
The preceding three decades have seen the emergence, rise, and proliferation of machine learning (ML). From half-recognised beginnings in perceptrons, neural nets, and decision trees, algorithms that extract correlations (that is, patterns) from a set of data points have broken free from their origin in computational c…
Paper proposes mechanism learning to reverse causal inference in ML.
problem Machine learning models learn associational, not causal, relationships.
method Causally weighted Gaussian mixture models (CW-GMMs).
result CW-GMMs can deconfound observational data for reverse causal inference.
Paper proposes fair ML predictors to avoid discrimination.
problem Discrimination in ML predictors from historical data.
method Proposes two algorithms to adjust ML predictors for fairness.
result Proves fair EO and AA predictors are optimal in performance.
Develops ML-DQA for healthcare data quality assurance.
problem Inconsistent use of real-world data in machine learning projects.
method Develops ML-DQA framework based on RWD best practices.
result Five generalizable practices emerge from ML-DQA implementation.
RODMAN improves ML-based disk failure prediction accuracy in cloud environments.
problem Imperfect data quality in real-world cloud environments degrades ML-based disk failure prediction accuracy.
method RODMAN uses three data preprocessing techniques: failure-type filtering, spline-based data filling, and automated pre-failure backtracking.
result RODMAN significantly improves prediction accuracy compared to no preprocessing.
Paper explores AIaaS on SDI, offering services in smart sectors.
problem Complexity of infrastructures driving AIaaS.
method Proposes architectural scheme based on SDIs with AI-aaS applications.
result Experimental results for three AI-aaS applications.
XSP profiles ML models across hardware and software stacks.
problem Challenges in profiling ML model performance across different layers of the stack.
method XSP uses distributed tracing to aggregate data from various sources and introduces a leveled, iterative measurement approach.
result XSP provides insights into ML model execution not easily discernible otherwise.
Vamsa tracks data usage in Python scripts for ML models.
problem Automatically tracking data used in ML model training.
method Modular system that extracts provenance from Python scripts.
result Vamsa achieves high precision and recall in tracking data usage.
Non-experts have long made important contributions to machine learning (ML) by contributing training data, and recent work has shown that non-experts can also help with feature engineering by suggesting novel predictive features. However, non-experts have only contributed features to prediction tasks already posed by e…
Infrastructure monitors AI/ML radiology models across multiple sites.
problem Monitoring and improving AI/ML radiology models across multiple sites.
method Interactive radiology reporting, centralized cloud system, post-marketing surveillance.
result Efficient monitoring and iterative development of AI/ML models without radiologist burden.
RankML predicts machine learning pipeline performance quickly and accurately.
problem Lack of machine learning experts and high computational costs.
method Meta-learning approach to predict pipeline performance.
result RankML outperforms or matches state-of-the-art approaches with less time and resources.
Machine Learning (ML) has been successfully applied to a wide range of domains and applications. One of the techniques behind most of these successful applications is Ensemble Learning (EL), the field of ML that gave birth to methods such as Random Forests or Boosting. The complexity of applying these techniques togeth…
Proposes a novel Out-of-Bag anomaly detection method for ML systems.
problem Challenges of detecting data anomalies in real-world datasets.
method Model-based approach decomposing unsupervised problem into ensemble models using Out-of-Bag estimates.
result Demonstrates state-of-the-art performance and improved accuracy in ML systems.
Modyn automates continuous ML model training on growing datasets.
problem Continuous model retraining is costly and impractical.
method Data-centric ML platform with policies for continuous training.
result Modyn enables high throughput training with sample-level data selection.
Paper presents deep learning and ML for automated student performance estimation.
problem Evaluation of students' performance during the pandemic.
method In-depth analysis of deep learning and machine learning approaches.
result Better performance across different prediction tasks with fully data-driven approach.
LightAutoML automates ML for a large financial services company.
problem Building high-quality ML models for a complex financial ecosystem.
method Developed an AutoML system tailored to a large European financial services company's unique requirements.
result LightAutoML outperformed experienced data scientists and other open-source solutions.