This review discusses challenges and solutions for AI in chemical engineering.
problem Challenges in applying classical machine learning to chemical engineering data.
method Identifying four data characteristics and discussing their applications and solutions.
result Current research extends data science and machine learning to handle chemical engineering data challenges.
Optimal engine operation during a transient driving cycle is the key to achieving greater fuel economy, engine efficiency, and reduced emissions. In order to achieve continuously optimal engine operation, engine calibration methods use a combination of static correlations obtained from dynamometer tests for steady-stat…
Paper uses deep reinforcement learning for better control of rocket engines during start-up phases.
problem Lack of optimal control during transient phases of liquid rocket engines.
method Deep reinforcement learning approach for optimal control of a gas-generator engine's continuous start-up phase.
result Deep reinforcement learning controller achieves highest performance and minimal computational effort.
Paper proposes verifier engineering for improving foundation models.
problem Challenges in providing effective supervision signals for foundation models.
method Leverages automated verifiers to perform verification tasks and deliver feedback.
result Verifier engineering can enhance foundation models' capabilities.
New metrics quantify implementation risk in portfolio backtesting, revealing systematic differences in engine implementations.
problem Systematic divergence in backtested portfolio metrics due to differences in engine implementations.
method Formalized implementation risk, proposed four metrics, executed 15 strategies through five engines, analyzed source-code defects.
result Implementation risk introduces measurable ambiguity in performance attribution, but does not alter investment decisions.
This paper presents an engine able to predict jointly the real-time concentration of the main pollutants harming people's health: nitrogen dioxyde (NO2), ozone (O3) and particulate matter (PM2.5 and PM10, which are respectively the particles whose size are below 2.5 um and 10 um). The engine covers a large part of the …
Predicts coherence from quantum heat engine noise using machine learning.
problem Predicting coherence in quantum heat engines from nonequilibrium fluctuations.
method Developed a machine learning protocol using K-Nearest Neighbor (KNN) model.
result Machine learning successfully predicts coherence from quantum heat engine noise.
A growing interest has been witnessed recently from both academia and industry in building nearest neighbor search (NNS) solutions on top of full-text search engines. Compared with other NNS systems, such solutions are capable of effectively reducing main memory consumption, coherently supporting multi-model search and…
SAFE automates feature engineering for industrial tasks efficiently and scalably.
problem Efficiency and scalability of automatic feature engineering methods for industrial tasks.
method SAFE (Scalable Automatic Feature Engineering) method, which provides excellent efficiency and scalability.
result SAFE method provides prominent efficiency and competitive effectiveness in industrial tasks.
In recent years several trading platforms appeared which provide a backtest engine to calculate historic performance of self designed trading strategies on underlying candle data. The construction of a correct working backtest engine is, however, a subtle task as shown by Maier-Paape and Platen (cf. arXiv:1412.5558 [q-…
Paper discusses challenges in deploying ML models for structural engineering.
problem Challenges in deploying machine learning models for structural engineering applications.
method Illustrates challenges through two examples, focusing on model overfitting, underspecification, training data representativeness, variable omission bias, and cross-validation.
result Highlights the importance of rigorous model validation techniques.
Factor Engine simplifies financial factor computation and analysis in Python.
problem Efficient computation and analysis of financial factors.
method Modular, extensible Python library with decorators, integrates with data science ecosystem.
result Mispricing factors computed by Factor Engine and Stata implementation are highly similar.
Automation engineering is the task of integrating, via software, various sensors, actuators, and controls for automating a real-world process. Today, automation engineering is supported by a suite of software tools including integrated development environments (IDE), hardware configurators, compilers, and runtimes. The…
New method stabilizes tensegrity structures suitable for engineering.
problem Tensegrity structures often have unstable modes unsuitable for engineering.
method Proposes a relationship between rods and strings for full-rank convexity.
result Designs a stable three-rod three-string tensegrity.
The authors seek financial datasets to benchmark feature engineering methods on US market data.
problem Improving predictive models for financial data science competitions.
method Feature engineering methods applied to multivariate time-series data from the US market.
result Predictive power of models tested against Numerai-Signals targets.
This paper introduces Probability Engineering to improve deep learning models.
problem Challenges in traditional probabilistic modeling for AI applications.
method Treats learned probability distributions as engineering artifacts and actively modifies them.
result Improves robustness, efficiency, adaptability, and trustworthiness of deep learning models.
An innovative method optimizes engine calibration to improve efficiency and reduce emissions.
problem Complex engines with many tunable parameters require efficient calibration methods.
method Combines Principal Component Decomposition with constrained Bayesian Optimization to minimize pressure curve deviation.
result Optimal engine calibration found after 64.4s with a 0.017% efficiency gain.
FeatureEnVi aids in feature engineering with visual analytics.
problem Insufficient support for feature engineering in visual analytics tools.
method Stepwise selection and semi-automatic extraction approaches.
result Extracts heavily engineered features evaluated by multiple metrics.
Paper introduces TS-GPT for engineering time series forecasting.
problem Engineering time series require causal operations, unlike linguistic data.
method Innovations representation theory, Generative Pre-trained Transformer.
result TS-GPT effectively forecasts real-time locational marginal prices.
System helps engineers with concept recognition for SEVA.
problem Recognizing systems engineering concepts for SEVA.
method Token classification task, domain expert labeling, pre-trained model fine-tuning, essential datasets creation, knowledge graph construction.
result System successfully recognizes systems engineering concepts.
Can engineering neural networks be approached in a disciplined way similar to how engineers build software for civil aircraft? We present nn-dependability-kit, an open-source toolbox to support safety engineering of neural networks for autonomous driving systems. The rationale behind nn-dependability-kit is to consider…
Paper introduces MTGP for engineering tasks with sparse data.
problem Challenges of data sparsity and varying task correlations in engineering.
method Multi-Task Gaussian Processes (MTGP) framework.
result Improves predictive performance and reduces computational costs.
Survey and new results link hydrodynamics, molecular physics, and financial engineering.
problem Understanding financial engineering topics like Asian options and volatility swaps.
method Linking Kevin waves, Klein-Kramers, and Kolmogorov equations to financial models.
result Corrected the original solution of the Kolmogorov equation.
Feature engineering is a crucial step in the process of predictive modeling. It involves the transformation of given feature space, typically using mathematical functions, with the objective of reducing the modeling error for a given target. However, there is no well-defined basis for performing effective feature engin…
Engine forecasts NO2, O3, PM2.5, PM10 with high accuracy.
problem Accurate long-term air quality forecasting.
method Convolutional LSTM network trained on grid data.
result 4-day forecasts significantly outperform simple benchmarks.
Deep learning models enhance engineering design automation.
problem Design optimization and customization across various industries.
method Leveraging deep neural networks, GANs, VAEs, and DRL for design synthesis.
result Recent advances in DGMs show promise in structural optimization, materials design, and shape synthesis.
Paper integrates ML with physics models for engineering and environmental challenges.
problem Complex science and engineering problems require new methodologies combining physics-based models and ML.
method Structured overview of integrating physics-based models with ML techniques.
result Taxonomy of existing techniques and potential research gaps identified.
Study defines and optimizes bank reliability using LR and PSO.
problem Lack of reliability concept in financial services.
method Logistic Regression (LR) for initial estimation, Particle Swarm Optimization (PSO) for optimization.
result Optimal financial ratios maximize bank reliability.
New framework for 3D spatial topology enumeration and identification.
problem Efficient navigation through complex engineering system topologies.
method Mathematical spatial graph theory to represent, enumerate, and identify unique topological classes.
result Identification of distinctive 3D topological classes for engineering systems.
SCOPE-FE improves feature engineering efficiency for high-dimensional datasets.
problem Expanding and reducing feature space in tabular learning becomes computationally expensive with increased dimensionality.
method SCOPE-FE controls the search space by regulating operator and feature-pair spaces, using OperatorProbing and FeatureClustering.
result SCOPE-FE reduces feature engineering time while maintaining competitive predictive performance.
Transformer models can approximate smooth functions with prompts, enhancing LLMs' dynamic capabilities.
problem Lack of theoretical framework for prompt engineering in transformer models.
method Formal framework demonstrating transformer models can approximate β-times differentiable functions with prompts. result Transformer models can approximate β-times differentiable functions with arbitrary precision using appropriately structured prompts. Oja's rule improves neural network training without engineered tricks.
problem Training deep neural networks with biological constraints.
method Incorporating Oja's plasticity rule into error-driven training.
result Stable, efficient learning in feedforward and recurrent architectures.
UQE uses LLMs to analyze unstructured data efficiently.
problem Efficient analytics on unstructured data.
method Proposes UQE, a query engine that uses LLMs to interpret UQL queries.
result Demonstrates efficient analytics on various unstructured data types.
The ubiquitous availability of wearable sensors is responsible for driving the Internet-of-Things but is also making an impact on sport sciences and precision medicine. While human activity recognition from smartphone data or other types of inertial measurement units (IMU) has evolved to one of the most prominent daily…
Bayesian optimization simplifies bioprocess engineering experiments.
problem Complex biological systems and experimental uncertainty.
method Adapts classical Bayesian optimization for bioprocess engineering.
result Provides accessible introduction to Bayesian optimization for practitioners.
Aircraft engine manufacturers collect large amount of engine related data during flights. These data are used to detect anomalies in the engines in order to help companies optimize their maintenance costs. This article introduces and studies a generic methodology that allows one to build automatic early signs of anomal…
Complex black-box predictive models may have high performance, but lack of interpretability causes problems like lack of trust, lack of stability, sensitivity to concept drift. On the other hand, achieving satisfactory accuracy of interpretable models require more time-consuming work related to feature engineering. Can…
Adds layers to NNs to protect them from reverse engineering.
problem Extracting the underlying model of a Neural Network.
method Introducing parasitic layers that approximate a noisy identity mapping with a Convolutional NN.
result The protected NN's predictions remain mostly unchanged while making reverse-engineering more complex.
We introduce a general procedure called `reverse engineering' that can be used to construct infinite families of smooth 4-manifolds in a given homeomorphism type. As one of the applications of this technique, we produce an infinite family of pairwise nondiffeomorphic 4-manifolds homeomorphic to CP^2#3(-CP^2).
Bayesian inference engines improve density estimation accuracy and scalability.
problem Constructing accurate and scalable probability density functions.
method Bayesian inference engines (no-U-turn sampling and expectation propagation) with binning strategy.
result Density estimates have excellent comparative performance and scale well to large sample sizes.
A shallow Bi-LSTM model forecasts Bitcoin prices using engineered features.
problem Lack of high-quality historical Bitcoin data for deep learning models.
method Proposed a shallow Bi-LSTM model with feature engineering on Bitcoin data.
result A shallow deep neural network outperforms other models in Bitcoin price forecasting.
ABM automates feature engineering and variable selection for loss-based models.
problem Improving model performance through better feature engineering and variable selection.
method ABM uses group and fused lasso regularization to automatically select cutting points and variables.
result ABM integrates feature engineering, variable selection, and model training.
We model GitHub interactions as a temporal knowledge graph for software engineering questions.
problem Insufficient performance of existing temporal models on extrapolated queries and time prediction.
method Introduced an extension to current temporal models using relative temporal information.
result Improved performance on extrapolated queries and time prediction.
Mean Field Games applied to finance and economics.
problem Modeling large populations in financial and economic systems.
method Mean Field Game theory applied to specific financial and economic scenarios.
result New applications in bitcoin mining, energy markets, and macro-economics.
VEST automates feature engineering for time series forecasting.
problem Challenges in time series forecasting with improved performance.
method VEST combines auto-regression with statistical summarization of recent past dynamics.
result VEST significantly improves forecasting performance.
Researchers simulate and estimate a market model with a matching engine to understand its impact on order submission and management.
problem The impact of a matching engine on the modeling of order submission and management in financial markets.
method Simulation of a 10-variate Hawkes process with rules for different order types, including limit orders, to compare model parameters with the original order generating process.
result Practical considerations, not directly related to model specification, can significantly distort the true model specification in an asynchronous trading environment.
Review of MLMC in financial engineering, focusing on option pricing and risk management.
problem Efficient estimation of financial risks and option prices using Monte Carlo methods.
method Incorporation of importance sampling and adaptive sampling algorithms in MLMC framework.
result Hybrid algorithms reduce overall variance in estimating financial risks and option prices.
Machine learning recently has been used to identify the governing equations for dynamics in physical systems. The promising results from applications on systems such as fluid dynamics and chemical kinetics inspire further investigation of these methods on complex engineered systems. Dynamics of these systems play a cru…