The paper explores fairness metrics in automated decision-making and their limitations.
problem Discrimination in automated resource allocation decisions.
method Analysis of fairness metrics and distributive justice principles.
result Prominent fairness metrics fail to address egalitarian and sufficiency concerns in resource allocation.
Locally adaptive nearest neighbors improve automated systems' performance and are easier to interpret.
problem Improving automated systems' performance and interpretability.
method Developed a method for k nearest neighbors algorithms to learn locally adaptive metrics.
result Locally adaptive metrics improve performance and are interpretable.
New metric to measure liquidity position PNL, delta hedging algorithm for automated market makers.
problem Vulnerability of liquidity positions to price changes in underlying assets.
method Proposes a new metric for measuring PNL, delta hedging algorithm for various AMMs.
result New metric more accurately measures net value change due to price movement.
CAI automates extraction and validation of corporate GHG emission metrics.
problem Manual extraction of corporate GHG emission metrics is labor-intensive and error-prone.
method CAI uses LLMs to automate extraction and validation of metrics from corporate disclosures.
result CAI improves data collection efficiency and accuracy by automating the process.
Evidence suggests Rapid-Eye-Movement (REM) Sleep Behaviour Disorder (RBD) is an early predictor of Parkinson's disease. This study proposes a fully-automated framework for RBD detection consisting of automated sleep staging followed by RBD identification. Analysis was assessed using a limited polysomnography montage fr…
Paper proposes evaluation methods for climate change illustrations.
problem Lack of metrics to compare realism in conditional generative models.
method Adapted and assessed several existing metrics, including FID.
result FID with Inception-V3 embeddings correlates best with human realism.
Develops a deep metric learning approach for detecting bugs in video games.
problem Automated detection of bugs in video games.
method State-State Siamese Networks (S3N) for deep metric learning.
result S3N learns meaningful embeddings to identify various types of bugs.
The paper proposes a method to assess when automated predictions are reliable.
problem Ensuring reliability and safety of automated decision-making in machine learning.
method Clustering to measure distances between outputs and class centroids, defining a safety threshold based on these distances.
result The proposed metric can efficiently determine when automated predictions are acceptable and when they should be deferred.
Automated malaria diagnosis from field slides achieves accurate results.
problem Challenges in analyzing field-prepared thin blood film microscopy images.
method Fully automated framework using machine learning, including CNNs trained on diverse field samples.
result Results are close to sufficient for drug resistance monitoring and clinical use-cases.
One of the longstanding problems in spectral graph clustering (SGC) is the so-called model order selection problem: automated selection of the correct number of clusters. This is equivalent to the problem of finding the number of connected components or communities in an undirected graph. In this paper, we propose AMOS…
Paper formalizes anti-discrimination law in automated systems.
problem Algorithmic discrimination in legal contexts.
method Decision-theoretic framework grounded in UK anti-discrimination law.
result Introduced 'conditional estimation parity' metric for ML fairness.
Challenge aims to develop automated meningioma MRI segmentation models.
problem Lack of automated, objective tools for meningioma assessment.
method Develop and evaluate models on largest annotated dataset.
result Improved care of patients with meningioma through automated segmentation.
Study compares MAPF and MARL algorithms for warehouse automation.
problem Optimizing multi-agent pickup and delivery in warehouse settings.
method Compared conflict-based search (MAPF) and shared experience actor-critic (MARL).
result Comprehensive benchmarking of MAPF and MARL in a simulated warehouse environment.
New metric correlates local topic quality with human judgments.
problem Evaluation of topic models focuses on global metrics, ignoring token-level assignments.
method Proposed a human evaluation task and automated metrics to assess local topic quality.
result Consistency metric correlates best with human judgments of local topic quality.
Automates selection and visualization of model responses in various directions.
problem Manual selection and limited visualization of PDPs.
method Formalizes method for automating PDP selection and extends to arbitrary directions.
result Demonstrates usefulness across model selection, bias detection, and latent space exploration.
Study finds transparency and model performance metrics increase trust in AutoML systems.
problem Understanding what information influences trust in AutoML systems.
method Three studies: qualitative interviews, controlled experiment, and card-sorting task.
result Transparency and model performance metrics are most important for establishing trust in AutoML systems.
Knowledge-based planning (KBP) is an automated approach to radiation therapy treatment planning that involves predicting desirable treatment plans before they are then corrected to deliverable ones. We propose a generative adversarial network (GAN) approach for predicting desirable 3D dose distributions that eschews th…
FLAIR measures LP competitiveness in AMMs, improving LP performance evaluations.
problem LP returns are affected by both market risk and competitive strategies.
method Introduces FLAIR metric to quantify LP competitiveness and assesses its impact on LP returns.
result FLAIR captures dynamic behavior of LPs and differentiates between active provisioning strategies.
Automated rock fragmentation assessment using deep learning and spatial statistics.
problem Assessing post-blast rock fragmentation in real-time.
method Fine-tuned YOLO12l-seg model for instance segmentation, followed by spatial statistics.
result Framework accurately assesses rock fragmentation patterns in real-time.
Study evaluates five LLMs for financial report analysis, revealing performance differences and variability.
problem Lack of understanding in reliability, consistency, and transparency of LLMs in financial analysis.
method Human evaluation, automated similarity metrics, and behavioral diagnostics applied to five transformer-based LLMs over U.S. 10-K filings.
result No single LLM consistently dominates across all evaluation perspectives, highlighting variability and need for interpretability.
Automated method selects best model from many for production systems.
problem Selecting the best model for production systems from a large pool.
method Automated online experimentation mechanism using Bayesian surrogate models.
result Efficiently identifies the best model with small online experiments.
Artificial neural networks (NN) are instrumental in realizing highly-automated driving functionality. An overarching challenge is to identify best safety engineering practices for NN and other learning-enabled components. In particular, there is an urgent need for an adequate set of metrics for measuring all-important …
Proposes a Siamese NN for algorithm selection focusing on alike performing instances.
problem Lack of effective meta-features for algorithm selection via meta-learning.
method Siamese Neural Network architecture with 'Algorithm-Performance Personas' concept.
result Proposed metric outperforms standard performance metrics in training sample selection.
The paper examines statistical properties of IL and LVR in automated market makers.
problem Assessing the performance of automated market makers and their profitability.
method Analysis of random walk properties and statistical integral combined with CFMM mechanics.
result IL and LVR have identical expectation values but different distribution functions for Brownian motion.
Proposes deep mixture models for probabilistic price movement forecasting in high-frequency trading.
problem Probabilistic forecasting of price movements in high-frequency trading.
method Deep recurrent neural networks with probabilistic mixture models.
result Outperforms benchmark models in both metric-based and simulated trading scenarios.
Automates summarizing federal grant audits with machine learning.
problem Manual analysis of large federal grant audits is time-consuming and error-prone.
method Sentence clustering, k-means, proximity to centroids, human input for refinement.
result Automated summaries are comparable to human-generated ones using ROUGE metric.
The paper critiques UBI as ineffective for addressing technological unemployment.
problem Technological unemployment due to automation.
method Empirical data analysis and theoretical projections of UBI's impact.
result UBI is not an effective solution for improving living standards and employability among displaced workers.
AI tool automates blood segmentation from head CT scans after SAH.
problem Accurate volumetric assessment of SAH patients for clinical and prognostic implications.
method Transformer-based Swin UNETR architecture for noncontrast CT scans.
result High accuracy and robust performance across internal and external validation cohorts.
Paper proposes real-time risk metrics for stablecoin protocols.
problem Lack of risk management frameworks for stablecoins.
method Developed two risk metrics: capitalization and liquidity.
result Demonstrated practical benefits of real-time on-chain data.
Automated theorem prover proves non-orderability of groups.
problem Proving non-orderability of groups.
method Generic automated theorem prover with tools like positive cones, torsions, generalised torsions, and cofinal elements.
result Demonstrated automated proof of non-orderability of groups.
In this paper, we present a data science automation system called Prediction Factory. The system uses several key automation algorithms to enable data scientists to rapidly develop predictive models and share them with domain experts. To assess the system's impact, we implemented 3 different interfaces for creating pre…
Facial pain expression is an important modality for assessing pain, especially when the patient's verbal ability to communicate is impaired. The facial muscle-based action units (AUs), which are defined by the Facial Action Coding System (FACS), have been widely studied and are highly reliable as a method for detecting…
Study identifies what healthcare tasks can and should be automated.
problem Undesired consequences of automation in healthcare.
method Quantitative analysis using machine learning models trained on practitioner and expert ratings.
result Developed an analytical tool (Automatability-Desirability Matrix) for policymakers and leaders.
Amazon SageMaker AMT automates machine learning model tuning.
problem Challenging hyperparameter tuning for complex machine learning systems.
method Gradient-free optimization using random search or Bayesian optimization.
result AMT finds the best hyperparameter configurations for models.
This paper surveys scalable automated alignment methods for LLMs.
problem Scalability issues in traditional human-annotated alignment methods for LLMs.
method Categorizes and discusses various automated alignment methods.
result Emerging automated alignment methods are effective and scalable.
This paper uses machine learning to assist automation engineers in decision making.
problem Imperfect decision making by automation engineers leads to multiple iterations and increased time for software development.
method Defined challenges and proposed solutions using machine learning for automation engineering, including code classification, finding similar code snippets, and hardware selection.
result Paragraph embedding techniques achieved an F1-score of 72% for classifying automation using code snippets, and autoencoder models for hardware recommendation achieved p@3 and p@5 of 0.79 and 0.95, respectively.
FLAML automates model selection and hyperparameter tuning with low resource cost.
problem Automating model selection and hyperparameter tuning for ad-hoc datasets and metrics.
method Conducts trials of different configurations on training data, optimizing for low computational cost.
result Significantly outperforms top-ranked AutoML libraries under smaller budget constraints.
Automated machine learning simplifies model selection and tuning.
problem Manual tuning of machine learning models by data scientists is time-consuming and requires extensive expertise.
method Review of AutoML techniques including automated feature engineering, model learning, and deep learning.
result Current AutoML techniques can significantly reduce the burden of manual tuning.
MCU-Net combines U-Net and Monte Carlo Dropout for uncertainty in medical image segmentation.
problem Lack of uncertainty representation in deep learning methods for patient-centered healthcare decisions.
method MCU-Net framework using U-Net and Monte Carlo Dropout with four uncertainty metrics.
result MCU-Net maximizes automated performance and refers truly uncertain cases.
Automation of machine learning model development is increasingly becoming an established research area. While automated model selection and automated data pre-processing have been studied in depth, there is, however, a gap concerning automated model adaptation strategies when multiple strategies are available. Manually…
New automated market makers for multi-asset trading.
problem Liquidity management in multi-asset trading.
method Derived from self-financing transactions and rebalancing principles.
result Constant product market maker as a special case.
Automates VI divergence selection for efficient few-shot learning.
problem Efficiently selecting divergence measures for VI to improve performance.
method Meta-learning algorithm to learn optimal divergence metric and variational parameter initialization.
result Meta-learning approach outperforms standard VI methods across various tasks.
DriveML automates machine learning tasks in R.
problem Manual machine learning tasks are time-consuming and error-prone.
method Automated data preparation, feature engineering, model building, and model explanation.
result DriveML performs best across different parameters compared to other packages.
Automates size normalization for fashion items.
problem Reduce merchandise returns in e-commerce.
method Uses sales data to automate size mapping.
result Automated size mappings comparable to human-generated ones.
This study detects fake and automated accounts on Instagram.
problem Fake engagement on Instagram leads to financial loss and wrong audience targeting.
method Two datasets were created and machine learning algorithms like Naive Bayes, Logistic Regression, Support Vector Machines, Neural Networks, and cost-sensitive genetic algorithm were applied.
result 86% accuracy for automated accounts and 96% for fake accounts were achieved.
This research compiles knowledge on decentralized exchanges with AMM protocols.
problem Improving and developing AMM-based decentralized exchanges.
method Established a general AMM framework, compared mechanics, discussed security and privacy.
result Illustrated conservation and slippage functions of AMM protocols.
Paper uses AI to optimize crypto portfolios, showing better risk-adjusted returns.
problem Managing volatile crypto markets with high volatility.
method Multi-agent system designed to autonomously construct and evaluate crypto-asset allocations.
result Dynamic optimization strategy outperforms static equal weighting strategy in terms of risk-adjusted returns.
Operations is a key challenge in the domain of machine learning pipeline deployments involving monitoring and management of real-time prediction quality. Typically, metrics like accuracy, RMSE etc., are used to track the performance of models in deployment. However, these metrics cannot be calculated in production due …