This paper uses machine learning to assist automation engineers in decision making.
problem Imperfect decision making by automation engineers leads to multiple iterations and increased time for software development.
method Defined challenges and proposed solutions using machine learning for automation engineering, including code classification, finding similar code snippets, and hardware selection.
result Paragraph embedding techniques achieved an F1-score of 72% for classifying automation using code snippets, and autoencoder models for hardware recommendation achieved p@3 and p@5 of 0.79 and 0.95, respectively.
There has been considerable growth and interest in industrial applications of machine learning (ML) in recent years. ML engineers, as a consequence, are in high demand across the industry, yet improving the efficiency of ML engineers remains a fundamental challenge. Automated machine learning (AutoML) has emerged as a …
Deep learning models enhance engineering design automation.
problem Design optimization and customization across various industries.
method Leveraging deep neural networks, GANs, VAEs, and DRL for design synthesis.
result Recent advances in DGMs show promise in structural optimization, materials design, and shape synthesis.
Automates feature extraction for IMU-based activity recognition.
problem Manual feature engineering is time-consuming and limits IMU-based applications.
method FRESH algorithm for automated feature extraction.
result Workflow automates feature extraction from synchronized IMU sensors.
Automates feature extraction from JSON data for machine learning.
problem Manual feature engineering for JSON data is laborious, lossy, and prone to bias.
method Automates feature extraction using Mill.jl and JsonGrinder.jl.
result Creates a differentiable machine learning model from raw JSON samples.
DriveML automates machine learning tasks in R.
problem Manual machine learning tasks are time-consuming and error-prone.
method Automated data preparation, feature engineering, model building, and model explanation.
result DriveML performs best across different parameters compared to other packages.
Paper proposes verifier engineering for improving foundation models.
problem Challenges in providing effective supervision signals for foundation models.
method Leverages automated verifiers to perform verification tasks and deliver feedback.
result Verifier engineering can enhance foundation models' capabilities.
Automated feature engineering improves interpretable models without manual work.
problem Lack of interpretability in complex models causes trust and stability issues.
method Use elastic black-box models to create simpler, interpretable glass-box models.
result Extracted features from complex models improve linear model performance.
ART automates synthetic biology design with machine learning.
problem Long development times in synthetic biology due to ad-hoc engineering.
method Machine learning and probabilistic modeling for systematic design.
result ART provides optimized strain recommendations and production levels.
This paper describes the autofeat Python library, which provides scikit-learn style linear regression and classification models with automated feature engineering and selection capabilities. Complex non-linear machine learning models, such as neural networks, are in practice often difficult to train and even harder to …
This research categorizes AMM designs for secure token exchanges.
problem Designing AMMs for cryptoeconomic systems can lead to financial risks and inefficiencies.
method Developed an AMM taxonomy and proposed three archetypes.
result AMM archetypes meet key requirements for token issuance and exchange.
Automated machine learning (AutoML) aims to find optimal machine learning solutions automatically given a machine learning problem. It could release the burden of data scientists from the multifarious manual tuning process and enable the access of domain experts to the off-the-shelf machine learning solutions without e…
Automates building structural design with reduced mass and carbon footprint.
problem Time-consuming and laborious manual design process for buildings.
method Formulated building structures as graphs, trained end-to-end pipeline with a differentiable simulator.
result Optimal structural designs comparable to GA, with reduced building mass and carbon footprint.
A new framework for generating predictive features in noisy multivariate time series.
problem Predicting noisy multivariate time series with limited user effort.
method Develops a feature programming framework based on spin-gas dynamical Ising models.
result Validated the method on synthetic and real-world datasets.
Quant 4.0 uses AI to automate, explain, and incorporate knowledge in investment.
problem Limitations of deep learning in quant investment.
method Automated AI, Explainable AI, Knowledge-driven AI.
result Improves investment decision-making through automation, interpretability, and prior knowledge integration.
An innovative method optimizes engine calibration to improve efficiency and reduce emissions.
problem Complex engines with many tunable parameters require efficient calibration methods.
method Combines Principal Component Decomposition with constrained Bayesian Optimization to minimize pressure curve deviation.
result Optimal engine calibration found after 64.4s with a 0.017% efficiency gain.
AutoML enhances credit decisions with XAI for better transparency.
problem Transparency in AI-driven financial decisions.
method Combining AutoML and XAI (SHAP) for credit scoring.
result Improved efficiency and accuracy in credit decisions with enhanced transparency.
New inference method improves performance for probabilistic models with varying support.
problem Existing inference engines for probabilistic programs struggle with models where support varies between executions.
method Divide, Conquer, and Combine (DCC) framework for automated inference.
result Substantial performance improvements on three examples compared to existing approaches.
The increasing availability of large but noisy data sets with a large number of heterogeneous variables leads to the increasing interest in the automation of common tasks for data analysis. The most time-consuming part of this process is the Exploratory Data Analysis, crucial for better domain understanding, data clean…
Feature engineering is a crucial step in the process of predictive modeling. It involves the transformation of given feature space, typically using mathematical functions, with the objective of reducing the modeling error for a given target. However, there is no well-defined basis for performing effective feature engin…
Knowledge-based planning (KBP) is an automated approach to radiation therapy treatment planning that involves predicting desirable treatment plans before they are then corrected to deliverable ones. We propose a generative adversarial network (GAN) approach for predicting desirable 3D dose distributions that eschews th…
SAFE automates feature engineering for industrial tasks efficiently and scalably.
problem Efficiency and scalability of automatic feature engineering methods for industrial tasks.
method SAFE (Scalable Automatic Feature Engineering) method, which provides excellent efficiency and scalability.
result SAFE method provides prominent efficiency and competitive effectiveness in industrial tasks.
27 problems identified in automating movie/TV subtitle translation.
problem Challenges in translating movie/TV subtitles.
method Categorized problems into three categories and evaluated translation quality.
result Frontier NLP systems struggle with subtitles and require post-processing.
Seq2Seq models perform well in generating If-Then programs from natural language.
problem Creating If-Then programs for business process automation without technical expertise.
method Modeling If-Then programs as a sequence learning task using Seq2Seq approaches.
result Seq2Seq models can effectively generate If-Then programs from natural language.
A new approach models credit card transactions using HMMs to detect fraud.
problem Detecting credit card fraud using isolated event analysis.
method Model sequences from three perspectives using HMMs and combine likelihoods as features.
result Improved fraud detection effectiveness compared to state-of-the-art methods.
We propose learning flexible but interpretable functions that aggregate a variable-length set of permutation-invariant feature vectors to predict a label. We use a deep lattice network model so we can architect the model structure to enhance interpretability, and add monotonicity constraints between inputs-and-outputs.…
Automates investor/company matching with AI, explaining decisions.
problem Matching companies and investors is hard due to limited data and need for explanations.
method Representation learning for small datasets + parameterized explanation generation.
result System performs well on matching task and explains decisions.
Cardea automates machine learning for EHRs, improving model building efficiency.
problem Lack of a trusted, open-source framework for automated machine learning in EHRs.
method Uses FHIR for data structure, AUTOML frameworks for feature engineering, model selection, and tuning, and an adaptive data assembler.
result Demonstrates framework's effectiveness on 5 prediction tasks, highlighting its flexibility and human competitiveness.
We propose a novel method that makes use of deep neural networks and gradient decent to perform automated design on complex real world engineering tasks. Our approach works by training a neural network to mimic the fitness function of a design optimization task and then, using the differential nature of the neural netw…
In this paper, a Wide Learning architecture is proposed that attempts to automate the feature engineering portion of the machine learning (ML) pipeline. Feature engineering is widely considered as the most time consuming and expert knowledge demanding portion of any ML task. The proposed feature recommendation approach…
Fatal accidents are a major issue hindering the wide acceptance of safety-critical systems using machine-learning and deep-learning models, such as automated-driving vehicles. Quality assurance frameworks are required for such machine learning systems, but there are no widely accepted and established quality-assurance …
This paper presents our contribution to PolEval 2019 Task 6: Hate speech and bullying detection. We describe three parallel approaches that we followed: fine-tuning a pre-trained ULMFiT model to our classification task, fine-tuning a pre-trained BERT model to our classification task, and using the TPOT library to find …
VEST automates feature engineering for time series forecasting.
problem Challenges in time series forecasting with improved performance.
method VEST combines auto-regression with statistical summarization of recent past dynamics.
result VEST significantly improves forecasting performance.
Framework uses LLMs to automate strategy finding in quantitative finance.
problem Brittleness of traditional deep learning models in financial applications.
method Three-stage framework with prompt-engineered LLMs, multimodal agent-based evaluation, and dynamic weight optimization.
result Robust performance in Chinese & US markets, superior risk-adjusted performance.
The paper proposes a method to create robust neural networks for automated driving.
problem Creating neural networks that can accurately predict road conditions and distances.
method The method introduces a non-standard loss function with tolerance to account for label variability and allows for deviations from labels.
result The proposed method results in a neural network that can robustly predict road conditions and distances, even with small label variations.
Efficient deep learning computing requires algorithm and hardware co-design to enable specialization: we usually need to change the algorithm to reduce memory footprint and improve energy efficiency. However, the extra degree of freedom from the algorithm makes the design space much larger: it's not only about designin…
Automates zero-shot classification by scoring and weighting prompts.
problem Improving zero-shot accuracy through prompt ensembling.
method Automatic prompt scoring and weighting method.
result Method outperforms existing techniques on various benchmarks.
This paper presents an approach for automation of interpretable feature selection for Internet Of Things Analytics (IoTA) using machine learning (ML) techniques. Authors have conducted a survey over different people involved in different IoTA based application development tasks. The survey reveals that feature selectio…
We describe GTApprox - a new tool for medium-scale surrogate modeling in industrial design. Compared to existing software, GTApprox brings several innovations: a few novel approximation algorithms, several advanced methods of automated model selection, novel options in the form of hints. We demonstrate the efficiency o…
We develop a new Low-level, First-order Probabilistic Programming Language (LF-PPL) suited for models containing a mix of continuous, discrete, and/or piecewise-continuous variables. The key success of this language and its compilation scheme is in its ability to automatically distinguish parameters the density functio…
Paper presents deep learning and ML for automated student performance estimation.
problem Evaluation of students' performance during the pandemic.
method In-depth analysis of deep learning and machine learning approaches.
result Better performance across different prediction tasks with fully data-driven approach.
A theoretical framework that supports automated construction of dynamic prime models purely from experimental time series data has been invented and developed, which can automatically generate (construct) data-driven models of any time series data in seconds. This has resulted in the formulation and formalisation of ne…
Artificial neural networks (NN) are instrumental in realizing highly-automated driving functionality. An overarching challenge is to identify best safety engineering practices for NN and other learning-enabled components. In particular, there is an urgent need for an adequate set of metrics for measuring all-important …
Application of neural networks to a vast variety of practical applications is transforming the way AI is applied in practice. Pre-trained neural network models available through APIs or capability to custom train pre-built neural network architectures with customer data has made the consumption of AI by developers much…
Study finds transparency and model performance metrics increase trust in AutoML systems.
problem Understanding what information influences trust in AutoML systems.
method Three studies: qualitative interviews, controlled experiment, and card-sorting task.
result Transparency and model performance metrics are most important for establishing trust in AutoML systems.
We propose a novel approach for loss reserving based on deep neural networks. The approach allows for joint modeling of paid losses and claims outstanding, and incorporation of heterogeneous inputs. We validate the models on loss reserving data across lines of business, and show that they improve on the predictive accu…
Automated machine learning (AutoML) has received increasing attention in the recent past. While the main tools for AutoML, such as Auto-WEKA, TPOT, and auto-sklearn, mainly deal with single-label classification and regression, there is very little work on other types of machine learning tasks. In particular, there is a…
Residual generation helps diagnose engine faults using neural networks.
problem Fault diagnosis in engines with unknown classes and limited data.
method Grey-box recurrent neural networks incorporating physical insights.
result Improved fault classification and root cause identification.