Automation of machine learning model development is increasingly becoming an established research area. While automated model selection and automated data pre-processing have been studied in depth, there is, however, a gap concerning automated model adaptation strategies when multiple strategies are available. Manually…
In this paper, we present a data science automation system called Prediction Factory. The system uses several key automation algorithms to enable data scientists to rapidly develop predictive models and share them with domain experts. To assess the system's impact, we implemented 3 different interfaces for creating pre…
This paper surveys scalable automated alignment methods for LLMs.
problem Scalability issues in traditional human-annotated alignment methods for LLMs.
method Categorizes and discusses various automated alignment methods.
result Emerging automated alignment methods are effective and scalable.
DriveML automates machine learning tasks in R.
problem Manual machine learning tasks are time-consuming and error-prone.
method Automated data preparation, feature engineering, model building, and model explanation.
result DriveML performs best across different parameters compared to other packages.
Challenge aims to develop automated meningioma MRI segmentation models.
problem Lack of automated, objective tools for meningioma assessment.
method Develop and evaluate models on largest annotated dataset.
result Improved care of patients with meningioma through automated segmentation.
This paper uses machine learning to assist automation engineers in decision making.
problem Imperfect decision making by automation engineers leads to multiple iterations and increased time for software development.
method Defined challenges and proposed solutions using machine learning for automation engineering, including code classification, finding similar code snippets, and hardware selection.
result Paragraph embedding techniques achieved an F1-score of 72% for classifying automation using code snippets, and autoencoder models for hardware recommendation achieved p@3 and p@5 of 0.79 and 0.95, respectively.
Automated machine learning simplifies model selection and tuning.
problem Manual tuning of machine learning models by data scientists is time-consuming and requires extensive expertise.
method Review of AutoML techniques including automated feature engineering, model learning, and deep learning.
result Current AutoML techniques can significantly reduce the burden of manual tuning.
Study identifies what healthcare tasks can and should be automated.
problem Undesired consequences of automation in healthcare.
method Quantitative analysis using machine learning models trained on practitioner and expert ratings.
result Developed an analytical tool (Automatability-Desirability Matrix) for policymakers and leaders.
System tackles indeterminacies in automated audio captioning.
problem Word selection and sentence length indeterminacies in automated audio captioning.
method Solves caption generation and sub-indeterminacy problems through multi-task learning to estimate keywords and sentence length.
result Model achieved 20.7 SPIDEr score, significantly outperforming baseline.
Automates deep learning model development for cancer data.
problem Manual design of high-performing deep learning models for cancer data is time-consuming and requires expertise.
method Reinforcement-learning-based neural architecture search with custom building blocks.
result Automated discovery of deep neural network architectures with similar or higher accuracy.
Automated market-making for CBDCs and stable coins on blockchain.
problem Creating fair exchange rates for digital assets on blockchain.
method Developed an innovative approach for generating fair exchange rates.
result Illustrated the approach's efficacy on G-10 currency exchange rates.
Deep-learning CNN automates Cu alloy grain size evaluation.
problem Automating the evaluation of Cu alloy grain size to reduce labor and improve accuracy.
method Deep-learning convolutional neural network (CNN) for automated image acquisition and processing.
result Achieved 91.1% classification accuracy on Cu alloy sub-images.
The automation of posterior inference in Bayesian data analysis has enabled experts and nonexperts alike to use more sophisticated models, engage in faster exploratory modeling and analysis, and ensure experimental reproducibility. However, standard automated posterior inference algorithms are not tractable at the scal…
DRIFT uses RL to automate functional software testing efficiently.
problem Efficient and reliable automated software testing.
method DRIFT employs Q-learning with Graph Neural Networks on symbolic UI representations.
result DRIFT can robustly test software functionalities in a fully automated manner.
Study benchmarks automated sleep staging against human scorers, achieving human-level performance.
problem Lack of standardized comparison between human and automated sleep staging.
method Developed multi-scored datasets and a framework to compare multiple human scorers' consensus.
result Many automated methods can match human scorers' performance, with SimpleSleepNet achieving high F1 scores.
C-FAR automates clustering assessment for neural tracking.
problem Manual assessment of clusters by humans is slow and impractical for large datasets.
method C-FAR uses automated feedback queries to select optimal clustering from multiple algorithms.
result C-FAR produces near-perfect clustering on simulated neural data.
Build accurate DNN models requires training on large labeled, context specific datasets, especially those matching the target scenario. We believe advances in wireless localization, working in unison with cameras, can produce automated annotation of targets on images and videos captured in the wild. Using pedestrian an…
This study optimizes trading and arbitrage in decentralized finance's CPMs, revealing convexity costs and developing efficient strategies.
problem Optimizing trading and arbitrage in decentralized finance's constant product markets (CPMs).
method Developed models for CPMs in competing centralised exchanges, CPMs, and both venues. Derived computationally efficient strategies.
result Accurately estimated convexity costs in CPMs, which are linear in trade size and nonlinear in liquidity depth and exchange rate.
The increasing availability of large but noisy data sets with a large number of heterogeneous variables leads to the increasing interest in the automation of common tasks for data analysis. The most time-consuming part of this process is the Exploratory Data Analysis, crucial for better domain understanding, data clean…
Proposes deep mixture models for probabilistic price movement forecasting in high-frequency trading.
problem Probabilistic forecasting of price movements in high-frequency trading.
method Deep recurrent neural networks with probabilistic mixture models.
result Outperforms benchmark models in both metric-based and simulated trading scenarios.
Real time large scale streaming data pose major challenges to forecasting, in particular defying the presence of human experts to perform the corresponding analysis. We present here a class of models and methods used to develop an automated, scalable and versatile system for large scale forecasting oriented towards saf…
This research compiles knowledge on decentralized exchanges with AMM protocols.
problem Improving and developing AMM-based decentralized exchanges.
method Established a general AMM framework, compared mechanics, discussed security and privacy.
result Illustrated conservation and slippage functions of AMM protocols.
This study improves lung tumor segmentation in mice MRI scans with nnU-Net, reducing annotation needs.
problem Accurate lung tumor segmentation in mice MRI scans for drug discovery.
method Optimized nnU-Net 3D model for lung tumor segmentation with minimal annotations.
result nnU-Net 3D models outperform 2D models in MRI mice scans, requiring fewer annotations.
Study analyzes factors affecting profits in crypto liquidity provision.
problem Liquidity providers lack guidance for developing profitable strategies.
method Developed a measurement model based on impermanent loss to analyze key parameters.
result Uncovered influences of key parameters on LPs' profits.
Automated model tracks mouse behavior in home cages.
problem Confounding analysis in specialized arenas.
method Group Behaviour Model (GBM) using permutation matrix.
result Model captures individual and group behavior.
Software automates metabolomics data analysis for reproducible results.
problem Automating reproducible metabolomics data analysis.
method Object-oriented software engineering, Java, XML database, GUI, version control system.
result MeKDDaM-SAGA successfully guides metabolomics applications.
LASSO-PCA combines LASSO and PCA for automated forecast averaging.
problem Automating the selection of forecast averaging methods and tuning parameters.
method LASSO estimation combined with PCA, using information criteria for parameter selection.
result LASSO-PCA outperforms other methods in forecast error reduction.
This paper presents an approach for automation of interpretable feature selection for Internet Of Things Analytics (IoTA) using machine learning (ML) techniques. Authors have conducted a survey over different people involved in different IoTA based application development tasks. The survey reveals that feature selectio…
Paper formalizes anti-discrimination law in automated systems.
problem Algorithmic discrimination in legal contexts.
method Decision-theoretic framework grounded in UK anti-discrimination law.
result Introduced 'conditional estimation parity' metric for ML fairness.
Automated trading systems on developed and emerging capital markets are studied in this paper. The standard for developed market is automated trading system with 40-days simple moving average. We tested it for the index SIX Industrial for 1000 and 730 trading days of the slovak emerging capital market. The Buy and Hold…
ART automates synthetic biology design with machine learning.
problem Long development times in synthetic biology due to ad-hoc engineering.
method Machine learning and probabilistic modeling for systematic design.
result ART provides optimized strain recommendations and production levels.
New dataset for automated pavement distress classification and density estimation.
problem Challenges in automated pavement distress detection using road images.
method Pavement Image Dataset (PID) method, combining wide-view and top-down view images.
result Accuracy scores of 0.84 for YOLOv2 and 0.65 for Faster R-CNN, suitable for practical applications.
PHOTONAI simplifies machine learning model development in Python.
problem Rapid and efficient machine learning model development.
method Unified framework combining algorithms from different toolboxes, automating repetitive tasks.
result Achieves state-of-the-art solution in medical machine learning.
The benefits of automating design cycles for Bayesian inference-based algorithms are becoming increasingly recognized by the machine learning community. As a result, interest in probabilistic programming frameworks has much increased over the past few years. This paper explores a specific probabilistic programming para…
CausalForge automates causal inference research with formal proofs and self-improvement.
problem Unreliable evaluation of automated research results by large language models.
method Formal proof assistant (Lean) and self-improving agentic pipeline.
result Automated research produces reliable formal proofs and artifacts.
Automates GNN design for molecular property prediction.
problem Designing and tuning GNN architectures for molecular property prediction is labor-intensive.
method Developed a NAS approach to automatically discover high-performing GNN architectures for MPNNs.
result Automatically discovered MPNNs outperform manually designed GNNs in molecular property prediction.
RD-Agent(Q) automates quantitative finance research and development.
problem Challenges in asset return prediction due to high dimensionality and volatility.
method Data-centric multi-agent framework for automated research and development of quantitative strategies.
result Up to 2X higher annualized returns with 70% fewer factors.
Novel AMM model for pegged cryptoassets using nested OU processes.
problem Liquidity and risk management in markets for pegged cryptoassets.
method Multi-level nested Ornstein-Uhlenbeck (OU) processes for exchange rate dynamics, calibrated and filtered AMM model.
result Consistent efficient quotes and improved liquidity provision for pegged cryptoassets.
The growing interest in both the automation of machine learning and deep learning has inevitably led to the development of a wide variety of automated methods for neural architecture search. The choice of the network architecture has proven to be critical, and many advances in deep learning spring from its immediate im…
Optimal algorithm selects biological models without prior info.
problem Determining the correct biological model without prior knowledge.
method Systems biology models and likelihood-free inference.
result Improved model selection performance over conventional methods.
Simplifying machine learning (ML) application development, including distributed computation, programming interface, resource management, model selection, etc, has attracted intensive interests recently. These research efforts have significantly improved the efficiency and the degree of automation of developing ML mode…
Optimizes liquidity provision intervals for profitable AMM participation.
problem Financial losses from poor liquidity provision intervals and reallocation costs.
method Developed a tractable stochastic optimization problem.
result Computes optimal liquidity provision intervals for profitable liquidity concentration.
The paper explores fairness metrics in automated decision-making and their limitations.
problem Discrimination in automated resource allocation decisions.
method Analysis of fairness metrics and distributive justice principles.
result Prominent fairness metrics fail to address egalitarian and sufficiency concerns in resource allocation.
Locally adaptive nearest neighbors improve automated systems' performance and are easier to interpret.
problem Improving automated systems' performance and interpretability.
method Developed a method for k nearest neighbors algorithms to learn locally adaptive metrics.
result Locally adaptive metrics improve performance and are interpretable.
This research categorizes AMM designs for secure token exchanges.
problem Designing AMMs for cryptoeconomic systems can lead to financial risks and inefficiencies.
method Developed an AMM taxonomy and proposed three archetypes.
result AMM archetypes meet key requirements for token issuance and exchange.
Paper proposes verifier engineering for improving foundation models.
problem Challenges in providing effective supervision signals for foundation models.
method Leverages automated verifiers to perform verification tasks and deliver feedback.
result Verifier engineering can enhance foundation models' capabilities.
Automated Budget Constrained Training optimizes model training under time constraints.
problem Balancing model quality and computational cost in constrained time.
method Developed a hyperparameter optimisation algorithm that learns the relationship between hyperparameters, model quality, and computational cost.
result The algorithm optimally decides whether to terminate or continue training, and what hyperparameters to use.
BERT-XML automates ICD coding from EHR notes using BERT pretraining.
problem Manual ICD coding is time-consuming and expensive in hospitals.
method Trained a BERT model on EHR notes, adapting it for multi-label attention.
result First large-scale ICD-10 classification model using millions of EHR notes.