Interview study reveals considerations for designing semi-automated bias detection tools.
problem Detecting and mitigating machine learning biases.
method Interview study with 11 machine learning practitioners.
result Four considerations identified for tool design.
We propose a novel method that makes use of deep neural networks and gradient decent to perform automated design on complex real world engineering tasks. Our approach works by training a neural network to mimic the fitness function of a design optimization task and then, using the differential nature of the neural netw…
Automated HPO design using Bayesian optimization and benchmarking.
problem Designing effective hyperparameter optimization algorithms is manual and lacks systematic understanding.
method Formalized space of HPO candidates, Bayesian optimization for search, ablation analysis.
result Simple configurations can perform well in HPO, especially with right parameters.
Efficient deep learning computing requires algorithm and hardware co-design to enable specialization: we usually need to change the algorithm to reduce memory footprint and improve energy efficiency. However, the extra degree of freedom from the algorithm makes the design space much larger: it's not only about designin…
Deep learning models enhance engineering design automation.
problem Design optimization and customization across various industries.
method Leveraging deep neural networks, GANs, VAEs, and DRL for design synthesis.
result Recent advances in DGMs show promise in structural optimization, materials design, and shape synthesis.
Survey of 1000 NAS papers, automating neural architecture design.
problem Designing high-performing neural architectures for various tasks.
method Taxonomy of search spaces, algorithms, and speedup techniques.
result NAS has surpassed human-designed architectures on many tasks.
Automated framework forecasts correlated time series in minutes.
problem Forecasting correlated time series with high accuracy and efficiency.
method Data-driven iterative pruning, zero-shot search, fast parameter adaptation.
result Framework achieves state-of-the-art accuracy and is faster than existing methods.
Proposes PA-DSL for correcting noisy human labels in automated data labeling.
problem Noisy human labels in automated data labeling.
method Uses adjudicated cases to correct noisy human labels and debias analyses.
result Maintains nominal coverage and reduces RMSE by 10-17% relative to using only adjudicated labels.
AutoML aims to automate machine learning tasks, reviewed in this chapter.
problem Automating the design of machine learning systems.
method Historical review and description of main paradigms.
result Major achievements in AutoML have been made in recent years.
This research categorizes AMM designs for secure token exchanges.
problem Designing AMMs for cryptoeconomic systems can lead to financial risks and inefficiencies.
method Developed an AMM taxonomy and proposed three archetypes.
result AMM archetypes meet key requirements for token issuance and exchange.
Optimal design of automated market makers for decentralized exchanges.
problem Maximizing utility for liquidity providers in decentralized exchanges.
method Modeling a risk-averse liquidity provider's optimal strategy and the optimal design of automated market makers.
result The optimal unit trading fee increases with asset volatility.
A framework for faster, better infographic design by non-experts and experts alike.
problem Designing infographics is time-consuming and tedious for non-experts and even professionals.
method Semi-automated infographic framework for structured and flow-based designs, including automatic design ranking and customization options.
result Designers from all expertise levels can generate generic infographic designs faster than existing methods while maintaining quality.
Improved AMM protocol supports diverse loan maturities in DeFi.
problem Challenges in designing AMMs for fixed-income lending with time-related complexities.
method Generalized BondMM protocol to support arbitrary maturities.
result BondMM-A protocol demonstrates superior performance in interest rate stability and financial robustness.
The benefits of automating design cycles for Bayesian inference-based algorithms are becoming increasingly recognized by the machine learning community. As a result, interest in probabilistic programming frameworks has much increased over the past few years. This paper explores a specific probabilistic programming para…
Deciding effective and timely preventive measures against complex social problems affecting relatively low income geographies is a difficult challenge. There is a strong need to adopt intelligent automation based solutions with low cost imprints to tackle these problems at larger scales. Starting with the hypothesis th…
Semantic segmentation remains a computationally intensive algorithm for embedded deployment even with the rapid growth of computation power. Thus efficient network design is a critical aspect especially for applications like automated driving which requires real-time performance. Recently, there has been a lot of resea…
Automates neural network design without training, speeding up search by seconds.
problem Time and effort in hand-designing deep neural networks.
method Predict trained accuracy from untrained network state using activation overlap.
result Search for powerful networks in seconds, verified on various benchmarks.
Automates translating natural language to Verilog for digital design.
problem Manual translation of natural language specifications to Verilog is time-consuming and error-prone.
method Fine-tuned GPT-2 to derive Verilog from English, using a dataset of design tasks.
result GPT-2 achieved 94.8% correct translation across simple and abstract design tasks.
Machine learning (ML) is increasingly deployed in real world contexts, supplying actionable insights and forming the basis of automated decision-making systems. While issues resulting from biases pre-existing in training data have been at the center of the fairness debate, these systems are also affected by technical a…
Automates design of lightweight neural networks for image classification.
problem Designing efficient neural networks for edge devices with limited computational resources.
method Uses the Mesh Adaptive Direct Search (MADS) algorithm to optimize network architecture.
result Achieves comparable performance to standard methods with fewer design trials.
Automates supervised learning pipeline design with matrix and tensor factorization.
problem Designing effective supervised learning pipelines with many choices.
method Uses matrix and tensor factorization to model pipeline search space and develops greedy experiment design protocols.
result Demonstrates the effectiveness of the approach on real-world classification problems.
Automates building structural design with reduced mass and carbon footprint.
problem Time-consuming and laborious manual design process for buildings.
method Formulated building structures as graphs, trained end-to-end pipeline with a differentiable simulator.
result Optimal structural designs comparable to GA, with reduced building mass and carbon footprint.
Paper proposes a new method for efficient hyperparameter optimization.
problem Challenging task of optimizing hyperparameters in machine learning.
method Sequential Uniform Design (SeqUD) strategy for adaptive and efficient exploration of hyperparameter space.
result The proposed SeqUD strategy outperforms existing methods in hyperparameter optimization.
Automates standards design through machine learning.
problem Manual, time-consuming standards design process.
method Reinforcement learning to optimize proposals.
result Streamlines standards design and innovation.
AutoPQ automates quantile forecasting for smart grids, reducing workload and environmental impact.
problem Accurate and unbiased uncertainty quantification in probabilistic forecasting for smart grid operations.
method AutoPQ uses a conditional Invertible Neural Network (cINN) to generate quantile forecasts from point forecasts, automating model selection and hyperparameter optimization.
result AutoPQ outperforms state-of-the-art methods while reducing computational effort and environmental impact.
This paper designs a new on-chain option that amortizes perpetual options for blockchain environments.
problem No equivalent standard for on-chain options exists, leading to high-frequency oracles and liquidation engines failures.
method Develops an amortizing perpetual option contract tailored to blockchain constraints, introducing a decentralized market framework.
result Demonstrates that the new contract functions as a risk primitive for DeFi, enabling applications like endogenous collateralization and de-peg insurance.
Automates model selection for GLMs using optimization.
problem Automating model selection for generalized linear models.
method Mixed-integer conic optimization for feature subset selection and model constraints.
result Optimization of AIC and BIC criteria with multicollinearity constraints.
Automates model comparison in probabilistic programming.
problem Manual derivations for model comparison are error-prone and time-consuming.
method Message passing on a Forney-style factor graph with a custom mixture node.
result Automates Bayesian model averaging, selection, and combination.
ChemCrow enhances LLMs for chemistry tasks, automating complex chemical processes.
problem Limited access to computational chemistry tools for large-language models.
method Integrating 18 expert-designed chemistry tools into an LLM (ChemCrow).
result ChemCrow autonomously plans and executes chemical syntheses and discoveries.
Automates GNN design for molecular property prediction.
problem Designing and tuning GNN architectures for molecular property prediction is labor-intensive.
method Developed a NAS approach to automatically discover high-performing GNN architectures for MPNNs.
result Automatically discovered MPNNs outperform manually designed GNNs in molecular property prediction.
This work presents MeKDDaM-SAGA, computer-aided automation software for implementing a novel knowledge discovery and data mining process model that was designed for performing justifiable, traceable and reproducible metabolomics data analysis. The process model focuses on achieving metabolomics analytical objectives an…
MCD automates counterfactual design searches for multi-modal tasks.
problem Designing for multi-objective goals and complex constraints.
method Model-agnostic counterfactual search method for multi-modal design modifications.
result MCD streamlines and automates counterfactual search, recommending effective design modifications.
Silkswap models stablecoin trading with minimal price impact.
problem Efficient trading of fiat-pegged stablecoins with minimal price impact.
method Silkswap uses an invariant price impact curve for asymmetric trading, derived from a hybrid function.
result Silkswap outperforms Curve Finance in price impact for stablecoin trading.
Optimizes classifiers for varying levels of automation.
problem Supervised learning models often perform worse than human experts on specific instances.
method Focuses on convex margin-based classifiers, showing the problem is NP-hard. For SVMs, the objective function is decomposed into monotone and modular components, allowing efficient algorithms to solve the problem.
result The approach demonstrates that classifiers optimized for varying levels of automation can outperform full automation and human-only models.
Semantic segmentation was seen as a challenging computer vision problem few years ago. Due to recent advancements in deep learning, relatively accurate solutions are now possible for its use in automated driving. In this paper, the semantic segmentation problem is explored from the perspective of automated driving. Mos…
Machine learning has made tremendous progress in recent years and received large amounts of public attention. Though we are still far from designing a full artificially intelligent agent, machine learning has brought us many applications in which computers solve human learning tasks remarkably well. Much of this progre…
Survey on automating geometry problem solving with large models.
problem Automating geometric problem solving with spatial understanding and logical reasoning.
method Synthesizes GPS advancements through benchmark construction, parsing, and reasoning paradigms.
result Unified analytical paradigm and emerging opportunities identified.
Deep-learning CNN automates Cu alloy grain size evaluation.
problem Automating the evaluation of Cu alloy grain size to reduce labor and improve accuracy.
method Deep-learning convolutional neural network (CNN) for automated image acquisition and processing.
result Achieved 91.1% classification accuracy on Cu alloy sub-images.
Review of automation's role in chemical discovery, emphasizing future challenges.
problem Improving automation's contribution to chemical discovery.
method Analysis of exemplary studies and open research directions.
result Future autonomous systems need improvement in data handling, model building, and experiment automation.
Automated medical prognosis has gained interest as artificial intelligence evolves and the potential for computer-aided medicine becomes evident. Nevertheless, it is challenging to design an effective system that, given a patient's medical history, is able to predict probable future conditions. Previous works, mostly c…
TODS automates time series outlier detection with customizable pipelines.
problem Automated detection of outliers in time series data.
method Modular system with 70 primitives for data processing, time series analysis, and detection algorithms. GUI and data-driven searcher for pipeline design.
result Automated discovery and construction of effective outlier detection pipelines.
FedNAS automates federated learning by searching for better architectures.
problem Non-I.I.D. data makes predefined model architectures suboptimal.
method Federated Neural Architecture Search (FedNAS) for collaborative architecture optimization.
result FedNAS searches for better architectures that outperform predefined models.
We explore the competitive effects of reaction time of automated trading strategies in simulated financial markets containing a single exchange with public limit order book and continuous double auction matching. A large body of research conducted over several decades has been devoted to trading agent design and simula…
Build accurate DNN models requires training on large labeled, context specific datasets, especially those matching the target scenario. We believe advances in wireless localization, working in unison with cameras, can produce automated annotation of targets on images and videos captured in the wild. Using pedestrian an…
Integrated Computational Materials Engineering (ICME) aims to accelerate optimal design of complex material systems by integrating material science and design automation. For tractable ICME, it is required that (1) a structural feature space be identified to allow reconstruction of new designs, and (2) the reconstructi…
PyODDS automates outlier detection for new data sources.
problem Manual outlier detection is inefficient and domain-specific.
method Automated end-to-end system with Apache Spark and database support.
result PyODDS optimizes outlier detection pipelines automatically.
We describe GTApprox - a new tool for medium-scale surrogate modeling in industrial design. Compared to existing software, GTApprox brings several innovations: a few novel approximation algorithms, several advanced methods of automated model selection, novel options in the form of hints. We demonstrate the efficiency o…
Automates neural network design for diverse tasks.
problem Designing neural networks for new, under-explored domains.
method Introduces XD-Operations and a weight-sharing scheme to transform standard backbones into search spaces of operations.
result Models using XD-Operations achieve lower error than baseline and expert-designed networks on diverse tasks.