Helix speeds up iterative ML development by optimizing workflow execution.
problem Inefficient manual tuning of ML workflows.
method Declarative system that optimizes workflow execution end-to-end and across iterations, minimizing runtime per iteration.
result Up to an order of magnitude reduction in cumulative run time compared to state-of-the-art tools.
Generative AI agents improve ERP systems by automating complex financial tasks.
problem Static, rule-based workflows limit adaptability and intelligence in ERP systems.
method Introducing Generative Business Process AI Agents (GBPAs) that integrate generative AI with business process modeling and multi-agent orchestration.
result GBPAs achieve up to 40% reduction in processing time and 94% drop in error rate.
GSR optimizes tasks in scientific workflows, improving performance across diverse applications.
problem Uncertainty in task selection and evaluation in scientific workflow optimization.
method Generate-Select-Refine (GSR) framework that alternates between task generation and optimization.
result GSR outperforms existing LLM-based optimizers in various scientific applications.
Audit financial machine learning workflows to detect spurious predictability.
problem Spurious predictability in financial machine learning models.
method Falsification audit testing predictive workflows against synthetic environments.
result Many apparent financial predictions are artifacts, not genuine.
Paper presents a new validation method for simulation workflow.
problem Validation of simulation workflow is challenging and domain-dependent.
method Empirical learning-based validation procedure using AHP and machine learning.
result Validation procedure is semi-automated and efficient.
Automates feature extraction for IMU-based activity recognition.
problem Manual feature engineering is time-consuming and limits IMU-based applications.
method FRESH algorithm for automated feature extraction.
result Workflow automates feature extraction from synchronized IMU sensors.
End-to-end portfolio optimization using quantum annealing for financial decision problems.
problem Optimizing financial portfolios with quantum computing constraints.
method Hybrid pipeline combining quantum and classical optimization.
result Quantum-assisted portfolio optimization can achieve competitive returns.
Workflow improves credit default prediction using machine learning.
problem Assessing creditworthiness and risk management in lending.
method Data preprocessing with Weight of Evidence, ensemble learning, and hyperparameter optimization.
result Enhanced accuracy in predicting credit default.
Paper presents a workflow for reliable unsupervised learning in science.
problem Lack of standardization in unsupervised learning workflows for reproducible scientific discoveries.
method Structured workflow including data preparation, modeling, validation, and communication.
result Illustrates the importance of validation in unsupervised learning.
This paper analyzes machine learning workflows in climate modeling.
problem Challenges in integrating machine learning with climate modeling.
method Analysis of case studies focusing on design patterns and workflow structure.
result Synthesis of workflow design patterns across diverse projects in ML-enabled climate modeling.
The paper proposes a ML workflow for B2B sales prediction.
problem Predicting business to business sales outcomes using subjective human evaluations.
method A two-pipeline ML approach on Azure ML, including data enrichment and model training.
result ML predictions improve accuracy and increase sales value.
Gemini uses inexpensive measurements to correct biases in expensive property evaluations.
problem Accurate estimation of materials properties using expensive measurements is hindered in scientific discovery campaigns.
method Gemini is a data-driven model that corrects systematic biases between property evaluation methods using inexpensive measurements.
result Gemini reduces the number of expensive evaluations needed for Bayesian optimization in materials discovery.
Adaptive workflow combines fast amortized inference with MCMC for many datasets.
problem Trade-off between computational speed and sampling accuracy in Bayesian inference.
method Adaptive workflow integrating amortized inference and MCMC with principled diagnostics.
result Efficiency gains with high posterior quality on tens of thousands of datasets.
Researchers found that avoiding synthetic data generation prevents model collapse in machine learning.
problem Model collapse in machine learning where models degenerate over generations.
method Comparing discard and augment workflows, focusing on Linear Regression.
result Theoretical evidence shows that for Linear Regression, test risk is bounded by π²/6 of original data alone.
An online framework improves investment management by making incremental updates.
problem Offline investment processes restrict silos from collectively pursuing a unified goal.
method Developed an online algorithm workflow for portfolio management.
result The online framework outperforms market benchmarks and reduces overfitting.
Differentiable pipeline replaces non-differentiable CAE components for shape optimization.
problem Gradient-based optimization is limited by non-differentiable components in CAE workflows.
method Surrogate models replace non-differentiable pipeline components, enabling gradient-based optimization.
result Gradient-based shape optimization possible without differentiable solvers.
Method generates resource-optimized ML models for different platforms.
problem Deployment of deep learning models on edge platforms requires model reduction and retraining.
method Conditional Neural Architecture Search using Generative Adversarial Networks (GAN)
result Successfully generates resource-optimized ML models for different platforms.
A graph-based evolutionary algorithm automates machine learning workflows.
problem Automated machine learning to reduce manual operations.
method Graph-based architecture for flexible model combinations, evolutionary algorithm with mutation and heredity operators, Bayesian hyper-parameter optimization.
result State-of-the-art performance compared to other AutoML systems.
MOPO-LSI offers a user guide for sustainable investments.
problem Sustainable investment optimization challenges.
method Open-source library for multi-objective portfolio optimization.
result User-friendly guide for MOPO-LSI version 1.0.
Machine Learning (ML) has been successfully applied to a wide range of domains and applications. One of the techniques behind most of these successful applications is Ensemble Learning (EL), the field of ML that gave birth to methods such as Random Forests or Boosting. The complexity of applying these techniques togeth…
Develops workflow for synthetic insurance datasets.
problem Lack of realistic publicly available insurance datasets.
method Uses CTGAN neural network architecture to generate tabular data.
result Synthesized datasets evaluated positively in multiple aspects.
HyperStream processes streaming data with workflow creation.
problem Processing large-scale, real-time data challenges.
method Python-based workflow engine for flexible, robust data processing.
result Overcomes limitations of other computational engines.
CK simplifies ML model deployment and reproducibility with open APIs and DevOps.
problem Making ML models reproducible and deployable across different environments.
method Decompose complex systems into reusable sub-components with unified APIs and DevOps principles.
result Automatically co-design and optimize ML models for speed, accuracy, energy, and size.
A new method for releasing AI workflows to avoid premature incorrect results.
problem Statistical challenges in releasing AI workflows with adaptive scoring.
method Wrapper that calibrates and accumulates evidence from high-scoring failures.
result Reduces premature incorrect release while still releasing on moderate evidence.
The workflow of data scientists normally involves potentially inefficient processes such as data mining, feature engineering and model selection. Recent research has focused on automating this workflow, partly or in its entirety, to improve productivity. We choose the former approach and in this paper share our experie…
Machine learning workflow development is anecdotally regarded to be an iterative process of trial-and-error with humans-in-the-loop. However, we are not aware of quantitative evidence corroborating this popular belief. A quantitative characterization of iteration can serve as a benchmark for machine learning workflow d…
Unified platform for statistical and machine learning in bioinformatics.
problem Workflow inefficiencies in using multiple tools for data analysis.
method Automated hyperparameter optimization, feature importance analysis, statistical tests.
result Accelerates biological discovery workflows with methodological soundness.
Human-in-the-loop data analysis applications necessitate greater transparency in machine learning models for experts to understand and trust their decisions. To this end, we propose a visual analytics workflow to help data scientists and domain experts explore, diagnose, and understand the decisions made by a binary cl…
Improved VQE for large DPO problems in finance.
problem Dynamic Portfolio Optimization (DPO) with many assets.
method Tailored VQE workflow, ISQR routine, VQE Constrained method.
result Achieved financial performance similar to classical methods.
Deep learning model improves seismic rock property estimation.
problem Estimating reservoir rock properties from seismic reflection data.
method Proposes a deep learning-based seismic inversion workflow that models seismic traces spatiotemporally.
result Achieves best performance on SEAM dataset with r2 coefficient of 79.77\% Deep learning speeds up pressure prediction in carbon storage reservoirs.
problem Accurately forecasting reservoir pressure in geologic carbon storage projects with sparse well data.
method Combining InSAR surface displacement data with deep learning and data assimilation techniques.
result Workflow can predict reservoir pressure with high efficiency and uncertainty quantification.
Paper proposes an active learning method for surgical workflow recognition using long-range temporal dependency.
problem Challenges in automatic surgical workflow recognition due to lack of large-scale labelled datasets.
method NL-RCNet with non-local block for capturing long-range temporal dependency and intra-clip dependency score for selection.
result Our approach outperforms state-of-the-art methods by selecting only 50% of samples for training.
Testing (conditional) independence of multivariate random variables is a task central to statistical inference and modelling in general - though unfortunately one for which to date there does not exist a practicable workflow. State-of-art workflows suffer from the need for heuristic or subjective manual choices, high c…
This thesis builds a real-time VaR calculation workflow for crypto derivatives.
problem Managing risk in volatile cryptocurrency markets.
method Applied EMWA, GARCH, and HAR models to forecast volatility; used delta-gamma-theta approach and Cornish-Fisher expansion.
result Real-time VaR estimates with millisecond calculation latencies.
Benchpress streamlines benchmarking structure learning algorithms for probabilistic models.
problem Benchmarking structure learning algorithms for probabilistic graphical models.
method Snakemake workflow for scalable, reproducible benchmarks.
result Demonstrates applicability in five typical data scenarios.
BayesFlow 2 speeds up Bayesian inference for complex models.
problem Slow Bayesian inference for complex models.
method Amortized Bayesian inference with neural networks.
result Streamlined workflow supports broad adoption.
Study uses non-invasive sensors to assess microbial contamination in green salads.
problem Assessing microbial contamination in ready-to-eat green salads.
method Unified spectra analysis workflow with data normalization, feature selection, and partial least squares regression.
result Unified workflow provides efficient estimation of microbial contamination and shelf life.
DeepPhase uses deep learning to recognize surgical phases in cataract surgery videos.
problem Automating surgical workflow analysis for better standardization and post-surgical assessment.
method Deep learning for instrument detection and phase classification in cataract surgery videos.
result DeepPhase models achieve 99% accuracy in instrument detection and 78% in phase recognition.
Study evaluates deep learning methods for dermatology, finding they perform poorly under non-ideal conditions.
problem Lack of robustness of deep learning methods in dermatology under real-world conditions.
method Simulated non-ideal conditions on user-submitted dermatology images.
result Deep learning methods show significant drop in accuracy and prediction changes under non-ideal conditions.
BayesFlow trains neural networks for fast Bayesian inference.
problem Fast Bayesian inference for complex models.
method Amortized neural networks for intractable posterior distributions.
result Fast inference through pre-trained neural networks.
Foundation models alter medical data science workflow, challenging veridical data science principles.
problem Foundation models disrupt traditional data science practices in medicine.
method Critically examined the medical foundation model lifecycle and its deviation from veridical data science principles.
result Foundation models challenge veridical data science principles of predictability, computability, and stability.
A new method predicts oil movement in reservoirs using deep learning.
problem Assessing dynamics of multiphase fluid flow in oil reservoirs.
method Metamodel based on Variational Autoencoder and Recurrent Neural Network.
result The Metamodel accurately predicts flow rates, pressure, and fluid saturations.
Machine learning and IoT improve steam flood oil production.
problem Optimizing oil production from heavy-oil wells using steam floods.
method Cutting-edge machine learning techniques applied to time-series IoT data.
result 3% improvement in oil production with optimized steam allocation.
Study benchmarks machine learning for removing EEG artifacts.
problem Removing artifacts from EEGs to improve clinical interpretation.
method Applied various machine learning algorithms to a large artifact recognition dataset.
result Established a benchmark for future research on artifact removal.
Paper proposes a holistic optimization for civil structures considering uncertainties.
problem Designing civil structures requires integration of material and structural design.
method Holistic optimization combining concrete mixture design and structural simulations.
result Inverted workflow allows consideration of new mixtures and uncertainties.
skfolio optimizes portfolios using Python, integrating machine learning.
problem Fundamental challenge in quantitative finance: robust portfolio optimization.
method Unified framework for diverse allocation strategies, including statistical and machine learning methods.
result Promotes reproducibility and transparency in quantitative finance.
A GPU-based workflow for building physics emulators of hypersonic flows
problem Resolving complex physical phenomena in hypersonic flows
method Fully GPU-based workflow integrating accelerated data generation and neural emulators
result Physics emulators remain reliable beyond their training distribution
Workflow uses deep learning to improve geosteering accuracy in Goliat Field.
problem Uncertainty in geological models and forward simulations affects real-time estimations.
method Offline DNN training, online FlexIES with probabilistic estimation.
result Median probabilistic estimation matches proprietary inversion.