Survey finds developers iterate in ML workflows, aiming for benchmark.
problem Quantify iteration in ML workflow development.
method Conducted a survey of applied ML literature from five domains.
result Developers iterate in ML workflows, but extent varies by domain.
Helix speeds up iterative ML development by optimizing workflow execution.
problem Inefficient manual tuning of ML workflows.
method Declarative system that optimizes workflow execution end-to-end and across iterations, minimizing runtime per iteration.
result Up to an order of magnitude reduction in cumulative run time compared to state-of-the-art tools.
Develops workflow for synthetic insurance datasets.
problem Lack of realistic publicly available insurance datasets.
method Uses CTGAN neural network architecture to generate tabular data.
result Synthesized datasets evaluated positively in multiple aspects.
This paper analyzes machine learning workflows in climate modeling.
problem Challenges in integrating machine learning with climate modeling.
method Analysis of case studies focusing on design patterns and workflow structure.
result Synthesis of workflow design patterns across diverse projects in ML-enabled climate modeling.
HyperStream processes streaming data with workflow creation.
problem Processing large-scale, real-time data challenges.
method Python-based workflow engine for flexible, robust data processing.
result Overcomes limitations of other computational engines.
GSR optimizes tasks in scientific workflows, improving performance across diverse applications.
problem Uncertainty in task selection and evaluation in scientific workflow optimization.
method Generate-Select-Refine (GSR) framework that alternates between task generation and optimization.
result GSR outperforms existing LLM-based optimizers in various scientific applications.
TensorLayer simplifies deep learning development for researchers and engineers.
problem Developing deep learning systems is complex and time-consuming.
method Offers rich abstractions for neural networks, model and data management, and parallel workflow.
result Boosts efficiency without sacrificing performance or scalability.
Workflow aids experts in understanding binary classifier decisions.
problem Lack of transparency in machine learning model decisions.
method Instance-level explanations and visual representations.
result Workflow helps experts derive useful knowledge and hypotheses.
Deep learning speeds up pressure prediction in carbon storage reservoirs.
problem Accurately forecasting reservoir pressure in geologic carbon storage projects with sparse well data.
method Combining InSAR surface displacement data with deep learning and data assimilation techniques.
result Workflow can predict reservoir pressure with high efficiency and uncertainty quantification.
Qlib aims to integrate AI into quantitative investment.
problem Challenges in applying AI to quantitative investment.
method Design and develop Qlib to accommodate AI-driven workflow.
result Qlib realizes the potential of AI technologies in quantitative investment.
Paper presents a new validation method for simulation workflow.
problem Validation of simulation workflow is challenging and domain-dependent.
method Empirical learning-based validation procedure using AHP and machine learning.
result Validation procedure is semi-automated and efficient.
Paper proposes an active learning method for surgical workflow recognition using long-range temporal dependency.
problem Challenges in automatic surgical workflow recognition due to lack of large-scale labelled datasets.
method NL-RCNet with non-local block for capturing long-range temporal dependency and intra-clip dependency score for selection.
result Our approach outperforms state-of-the-art methods by selecting only 50% of samples for training.
Benchpress streamlines benchmarking structure learning algorithms for probabilistic models.
problem Benchmarking structure learning algorithms for probabilistic graphical models.
method Snakemake workflow for scalable, reproducible benchmarks.
result Demonstrates applicability in five typical data scenarios.
Automates feature extraction for IMU-based activity recognition.
problem Manual feature engineering is time-consuming and limits IMU-based applications.
method FRESH algorithm for automated feature extraction.
result Workflow automates feature extraction from synchronized IMU sensors.
Study uses non-invasive sensors to assess microbial contamination in green salads.
problem Assessing microbial contamination in ready-to-eat green salads.
method Unified spectra analysis workflow with data normalization, feature selection, and partial least squares regression.
result Unified workflow provides efficient estimation of microbial contamination and shelf life.
Paper reviews machine learning in RNASeq DE analysis.
problem Improving accuracy and efficiency in RNASeq DE analysis.
method Illustrates workflow, performs DE analysis, presents machine learning improvements.
result Demonstrates machine learning's role and capabilities in RNASeq DE analysis.
Paper presents a workflow for reliable unsupervised learning in science.
problem Lack of standardization in unsupervised learning workflows for reproducible scientific discoveries.
method Structured workflow including data preparation, modeling, validation, and communication.
result Illustrates the importance of validation in unsupervised learning.
Generative AI agents improve ERP systems by automating complex financial tasks.
problem Static, rule-based workflows limit adaptability and intelligence in ERP systems.
method Introducing Generative Business Process AI Agents (GBPAs) that integrate generative AI with business process modeling and multi-agent orchestration.
result GBPAs achieve up to 40% reduction in processing time and 94% drop in error rate.
Adaptive workflow combines fast amortized inference with MCMC for many datasets.
problem Trade-off between computational speed and sampling accuracy in Bayesian inference.
method Adaptive workflow integrating amortized inference and MCMC with principled diagnostics.
result Efficiency gains with high posterior quality on tens of thousands of datasets.
Researchers found that avoiding synthetic data generation prevents model collapse in machine learning.
problem Model collapse in machine learning where models degenerate over generations.
method Comparing discard and augment workflows, focusing on Linear Regression.
result Theoretical evidence shows that for Linear Regression, test risk is bounded by π²/6 of original data alone.
A new method predicts oil movement in reservoirs using deep learning.
problem Assessing dynamics of multiphase fluid flow in oil reservoirs.
method Metamodel based on Variational Autoencoder and Recurrent Neural Network.
result The Metamodel accurately predicts flow rates, pressure, and fluid saturations.
Audit financial machine learning workflows to detect spurious predictability.
problem Spurious predictability in financial machine learning models.
method Falsification audit testing predictive workflows against synthetic environments.
result Many apparent financial predictions are artifacts, not genuine.
An online framework improves investment management by making incremental updates.
problem Offline investment processes restrict silos from collectively pursuing a unified goal.
method Developed an online algorithm workflow for portfolio management.
result The online framework outperforms market benchmarks and reduces overfitting.
AI uses statistical PQRS workflow for human-machine collaboration.
problem Integrating AI with statistical principles for better results.
method PQRS workflow integrating statistical concepts with AI.
result Reproducibility and interpretability of AI algorithms and results.
Develops a neural surrogate for proton dose calculation using Monte Carlo dropout uncertainty.
problem Computational demand in proton therapy workflows requiring repeated evaluations.
method Integrates Monte Carlo dropout into a neural network surrogate for fast, differentiable dose predictions and uncertainty quantification.
result Shows significant speedups over MC while retaining uncertainty information.
A new method for releasing AI workflows to avoid premature incorrect results.
problem Statistical challenges in releasing AI workflows with adaptive scoring.
method Wrapper that calibrates and accumulates evidence from high-scoring failures.
result Reduces premature incorrect release while still releasing on moderate evidence.
Deep learning model improves seismic rock property estimation.
problem Estimating reservoir rock properties from seismic reflection data.
method Proposes a deep learning-based seismic inversion workflow that models seismic traces spatiotemporally.
result Achieves best performance on SEAM dataset with r2 coefficient of 79.77\% Proposes PCS framework for veridical data science results.
problem Ensuring reliable, reproducible, and transparent data science results.
method PCS workflow with predictability, computability, and stability principles.
result PCS inference procedures demonstrate favorable performance in high-dimensional simulations.
CTS machines improve screen development in printing industries, reducing costs and increasing profitability.
problem Inefficient screen development process in heat transfer printing and labeling.
method Implementation of CTS (computer-to-screen) technology for screen development.
result Reduction in material and operational costs, leading to profitability.
This thesis builds a real-time VaR calculation workflow for crypto derivatives.
problem Managing risk in volatile cryptocurrency markets.
method Applied EMWA, GARCH, and HAR models to forecast volatility; used delta-gamma-theta approach and Cornish-Fisher expansion.
result Real-time VaR estimates with millisecond calculation latencies.
CK simplifies ML model deployment and reproducibility with open APIs and DevOps.
problem Making ML models reproducible and deployable across different environments.
method Decompose complex systems into reusable sub-components with unified APIs and DevOps principles.
result Automatically co-design and optimize ML models for speed, accuracy, energy, and size.
Seismic inversion improved using semi-supervised sequence modeling.
problem Lack of geophysical constraints in machine learning seismic inversion.
method Semi-supervised sequence modeling with recurrent neural networks.
result Achieved 98% correlation between estimated and target elastic impedance.
DeepPhase uses deep learning to recognize surgical phases in cataract surgery videos.
problem Automating surgical workflow analysis for better standardization and post-surgical assessment.
method Deep learning for instrument detection and phase classification in cataract surgery videos.
result DeepPhase models achieve 99% accuracy in instrument detection and 78% in phase recognition.
New method tests independence and learns graphs without manual choices.
problem Testing independence of multivariate random variables is hard.
method Link between independence testing and supervised learning.
result Predictive independence tests outperform current methods.
The paper proposes a ML workflow for B2B sales prediction.
problem Predicting business to business sales outcomes using subjective human evaluations.
method A two-pipeline ML approach on Azure ML, including data enrichment and model training.
result ML predictions improve accuracy and increase sales value.
FinMaster benchmarks LLMs in financial tasks, revealing gaps in reasoning.
problem Challenges in financial tasks, including labor-intensive processes and low error tolerance.
method Developed a comprehensive financial benchmark (FinMaster) with three modules: FinSim, FinSuite, and FinEval.
result LLMs struggle with complex financial reasoning, showing significant accuracy drops.
Client2vec automates banking data analysis tasks.
problem Efficient data analysis and automation for banking applications.
method Marginalized stacked denoising autoencoders on transaction data.
result Vector embeddings represent client behaviors for various tasks.
Study evaluates deep learning methods for dermatology, finding they perform poorly under non-ideal conditions.
problem Lack of robustness of deep learning methods in dermatology under real-world conditions.
method Simulated non-ideal conditions on user-submitted dermatology images.
result Deep learning methods show significant drop in accuracy and prediction changes under non-ideal conditions.
BayesFlow trains neural networks for fast Bayesian inference.
problem Fast Bayesian inference for complex models.
method Amortized neural networks for intractable posterior distributions.
result Fast inference through pre-trained neural networks.
Machine learning and IoT improve steam flood oil production.
problem Optimizing oil production from heavy-oil wells using steam floods.
method Cutting-edge machine learning techniques applied to time-series IoT data.
result 3% improvement in oil production with optimized steam allocation.
Foundation models alter medical data science workflow, challenging veridical data science principles.
problem Foundation models disrupt traditional data science practices in medicine.
method Critically examined the medical foundation model lifecycle and its deviation from veridical data science principles.
result Foundation models challenge veridical data science principles of predictability, computability, and stability.
CAST package aids in spatial prediction models using machine learning.
problem Challenges in applying machine learning for spatial data.
method Developed cross-validation strategies, spatial feature selection, and area of applicability assessment methods.
result Supports more reliable spatial predictions through CAST package.
autoBagging learns to rank bagging workflows for better ML performance.
problem Finding the best bagging workflow for each dataset.
method Metalearning and learning to rank to automatically rank bagging workflows.
result autoBagging outperforms Average Rank and achieves results not statistically different from an ideal model.
Workflow improves credit default prediction using machine learning.
problem Assessing creditworthiness and risk management in lending.
method Data preprocessing with Weight of Evidence, ensemble learning, and hyperparameter optimization.
result Enhanced accuracy in predicting credit default.
Develops methods to improve demand counterfactuals from imperfect proxies.
problem Imperfect proxies in demand models lead to biased counterfactuals and invalid inference.
method Practical toolkit for market-level and individual data, requiring minimal computation.
result Improves substitution prediction and counterfactual performance.
Study benchmarks machine learning for removing EEG artifacts.
problem Removing artifacts from EEGs to improve clinical interpretation.
method Applied various machine learning algorithms to a large artifact recognition dataset.
result Established a benchmark for future research on artifact removal.
A GPU-based workflow for building physics emulators of hypersonic flows
problem Resolving complex physical phenomena in hypersonic flows
method Fully GPU-based workflow integrating accelerated data generation and neural emulators
result Physics emulators remain reliable beyond their training distribution
Workflow uses deep learning to improve geosteering accuracy in Goliat Field.
problem Uncertainty in geological models and forward simulations affects real-time estimations.
method Offline DNN training, online FlexIES with probabilistic estimation.
result Median probabilistic estimation matches proprietary inversion.