Paper proposes verifier engineering for improving foundation models.
problem Challenges in providing effective supervision signals for foundation models.
method Leverages automated verifiers to perform verification tasks and deliver feedback.
result Verifier engineering can enhance foundation models' capabilities.
In recent years several trading platforms appeared which provide a backtest engine to calculate historic performance of self designed trading strategies on underlying candle data. The construction of a correct working backtest engine is, however, a subtle task as shown by Maier-Paape and Platen (cf. arXiv:1412.5558 [q-…
Unified understanding of neural networks on group operations verified.
problem Understanding and verifying neural networks trained on group operations.
method Investigated one-hidden-layer neural networks trained on binary operation of finite groups, revealing structure and providing a compact proof of model performance.
result Verified explanation applies to a large fraction of networks trained on the symmetric group S5, providing a >=95% accuracy bound for 45% of models.
Inference-Time Scaling can be extended to domains prone to systematic failure using intrinsic statistics.
problem Scaling inference time in domains prone to systematic failure
method Intrinsic Selection (iS), Intrinsic Particle Filtering (iPF), and Particle Distillation (dPF)
result Intrinsic Selection improves engineering design selection by 20% and pass@1 by 6.1 points on average.
CBMs improve interpretability in RUL prediction for aircraft engines.
problem Lack of interpretability in deep learning models for asset prognostics.
method Concept Bottleneck Models (CBMs) for RUL prediction.
result CBMs achieve comparable or superior performance to black-box models while being more interpretable.
This paper improves MI-based BCIs by applying transfer learning across all components.
problem Reducing calibration effort for new subjects in MI-based BCIs.
method Proposes TL in spatial filtering, feature engineering, and classification blocks, and adds data alignment.
result Integrating data alignment and sophisticated TL significantly improves classification performance and reduces calibration effort.
This research optimizes fluid-dynamic designs using deep learning and active learning.
problem Expensive and limited empirical design verification for fluid dynamics.
method Applied a deep learning architecture to predict and optimize fluid dynamics performance.
result Reduced the number of required simulation data points from ~8000 to 625.
Extends DCP framework to Hadamard manifolds for geodesically convex functions.
problem Verifying convexity in nonlinear programs on Hadamard manifolds.
method Introduces Disciplined Geodesically Convex Programming (DGCP) framework, defining compositions and transformations for geodesically convex functions.
result Allows verification of geodesic convexity for a broader range of functions, including statistical estimators and matrix-valued optimization.
Recurrent neural networks (RNNs) are powerful constructs capable of modeling complex systems, up to and including Turing Machines. However, learning such complex models from finite training sets can be difficult. In this paper we empirically show that RNNs can learn models of computer peripheral devices through input a…
BiLRP explains deep similarity models by decomposing scores into feature contributions.
problem Verifying meaningful patterns in complex similarity models.
method Augmenting similarity scores with feature explanations using LRP.
result BiLRP robustly explains deep neural network features and historical document similarities.
A new estimator reduces variance in slate bandit OPE.
problem Large action spaces in slate bandits cause high variance in OPE.
method Develops Latent IPS (LIPS) to optimize slate abstractions for low variance and bias.
result LIPS substantially outperforms existing estimators in scenarios with non-linear rewards and large slate spaces.
Autonomous vehicles are highly complex systems, required to function reliably in a wide variety of situations. Manually crafting software controllers for these vehicles is difficult, but there has been some success in using deep neural networks generated using machine-learning. However, deep neural networks are opaque …
The study develops a logic reasoner to verify MS case management specifications.
problem Ensuring correctness and solvability of abstract clinical work products.
method Developed a logic reasoner using UML class and state diagrams, SPIN, and ODM.
result Formal representations of UML diagrams proved consistent for MS case management.
A new method improves cross-domain sentiment analysis by learning weighted domain-invariant representations.
problem Label distribution changes across domains harm domain adaptation in DIRL.
method Proposes WDIRL, a modification to DIRL that learns weighted domain-invariant representations.
result Empirical studies show the effectiveness of WDIRL in cross-domain sentiment analysis.
Deep learning speeds up engine calibration for varied driving conditions.
problem Optimizing engine operation during transient driving cycles for better fuel economy and emissions.
method Parallel simulation-driven machine learning using a physics-based engine simulator.
result Deep neural network surrogate model predicts engine performance and emissions accurately and quickly.
Deep learning has been successfully used in numerous applications because of its outstanding performance and the ability to avoid manual feature engineering. One such application is electroencephalogram (EEG) based brain-computer interface (BCI), where multiple convolutional neural network (CNN) models have been propos…
This review discusses challenges and solutions for AI in chemical engineering.
problem Challenges in applying classical machine learning to chemical engineering data.
method Identifying four data characteristics and discussing their applications and solutions.
result Current research extends data science and machine learning to handle chemical engineering data challenges.
Extracts StarCraft II tournament data for AI and ML studies.
problem Lack of accessible esports data for scientific use.
method Gathered and processed StarCraft II tournament replays using an API parser library.
result The largest publicly available StarCraft II esports dataset.
Paper uses deep reinforcement learning for better control of rocket engines during start-up phases.
problem Lack of optimal control during transient phases of liquid rocket engines.
method Deep reinforcement learning approach for optimal control of a gas-generator engine's continuous start-up phase.
result Deep reinforcement learning controller achieves highest performance and minimal computational effort.
In recent years, car makers and tech companies have been racing towards self driving cars. It seems that the main parameter in this race is who will have the first car on the road. The goal of this paper is to add to the equation two additional crucial parameters. The first is standardization of safety assurance --- wh…
QABBA improves time series storage efficiency while preserving shape information.
problem Efficient storage and shape preservation of time series data.
method Quantized symbolic time series approximation (QABBA) using ABBA technique.
result QABBA achieves a new state-of-the-art on Monash regression dataset.
Engine predicts real-time air quality with high resolution.
problem Real-time prediction of air pollutants for health monitoring.
method Combines official data, models, land cover, traffic data for high-resolution predictions.
result Engine produces predictions with resolution of a few dozen meters.
New metrics quantify implementation risk in portfolio backtesting, revealing systematic differences in engine implementations.
problem Systematic divergence in backtested portfolio metrics due to differences in engine implementations.
method Formalized implementation risk, proposed four metrics, executed 15 strategies through five engines, analyzed source-code defects.
result Implementation risk introduces measurable ambiguity in performance attribution, but does not alter investment decisions.
Develops a surrogate model for predicting system responses using GDMaps and geometric harmonics.
problem Predicting responses of engineering systems and complex physical phenomena with uncertainties.
method Grassmannian diffusion maps (GDMaps) and geometric harmonics for low-dimensional representation and function extension.
result Accurate predictions of system responses in various examples, demonstrating the technique's potential for uncertainty quantification.
We introduce a method to infer lead-lag networks of agents' actions in complex systems. These networks open the way to both microscopic and macroscopic states prediction in such systems. We apply this method to trader-resolved data in the foreign exchange market. We show that these networks are remarkably persistent, w…
AutoKE automates embedding physical knowledge into neural networks for complex engineering problems.
problem Complex physical equations in engineering problems.
method AutoKE framework using deep neural networks, equation parsing, automatic differentiation, adaptive weights, and NAS.
result Automatically embeds physical knowledge into neural networks for complex equations efficiently.
This paper proposes a new algorithmic framework, predictor-verifier training, to train neural networks that are verifiable, i.e., networks that provably satisfy some desired input-output properties. The key idea is to simultaneously train two networks: a predictor network that performs the task at hand,e.g., predicting…
Cardea automates machine learning for EHRs, improving model building efficiency.
problem Lack of a trusted, open-source framework for automated machine learning in EHRs.
method Uses FHIR for data structure, AUTOML frameworks for feature engineering, model selection, and tuning, and an adaptive data assembler.
result Demonstrates framework's effectiveness on 5 prediction tasks, highlighting its flexibility and human competitiveness.
Predicts coherence from quantum heat engine noise using machine learning.
problem Predicting coherence in quantum heat engines from nonequilibrium fluctuations.
method Developed a machine learning protocol using K-Nearest Neighbor (KNN) model.
result Machine learning successfully predicts coherence from quantum heat engine noise.
A growing interest has been witnessed recently from both academia and industry in building nearest neighbor search (NNS) solutions on top of full-text search engines. Compared with other NNS systems, such solutions are capable of effectively reducing main memory consumption, coherently supporting multi-model search and…
Automated feature engineering improves interpretable models without manual work.
problem Lack of interpretability in complex models causes trust and stability issues.
method Use elastic black-box models to create simpler, interpretable glass-box models.
result Extracted features from complex models improve linear model performance.
SAFE automates feature engineering for industrial tasks efficiently and scalably.
problem Efficiency and scalability of automatic feature engineering methods for industrial tasks.
method SAFE (Scalable Automatic Feature Engineering) method, which provides excellent efficiency and scalability.
result SAFE method provides prominent efficiency and competitive effectiveness in industrial tasks.
Paper discusses challenges in deploying ML models for structural engineering.
problem Challenges in deploying machine learning models for structural engineering applications.
method Illustrates challenges through two examples, focusing on model overfitting, underspecification, training data representativeness, variable omission bias, and cross-validation.
result Highlights the importance of rigorous model validation techniques.
Factor Engine simplifies financial factor computation and analysis in Python.
problem Efficient computation and analysis of financial factors.
method Modular, extensible Python library with decorators, integrates with data science ecosystem.
result Mispricing factors computed by Factor Engine and Stata implementation are highly similar.
Automation engineering is the task of integrating, via software, various sensors, actuators, and controls for automating a real-world process. Today, automation engineering is supported by a suite of software tools including integrated development environments (IDE), hardware configurators, compilers, and runtimes. The…
New method stabilizes tensegrity structures suitable for engineering.
problem Tensegrity structures often have unstable modes unsuitable for engineering.
method Proposes a relationship between rods and strings for full-rank convexity.
result Designs a stable three-rod three-string tensegrity.
The authors seek financial datasets to benchmark feature engineering methods on US market data.
problem Improving predictive models for financial data science competitions.
method Feature engineering methods applied to multivariate time-series data from the US market.
result Predictive power of models tested against Numerai-Signals targets.
This paper introduces Probability Engineering to improve deep learning models.
problem Challenges in traditional probabilistic modeling for AI applications.
method Treats learned probability distributions as engineering artifacts and actively modifies them.
result Improves robustness, efficiency, adaptability, and trustworthiness of deep learning models.
An innovative method optimizes engine calibration to improve efficiency and reduce emissions.
problem Complex engines with many tunable parameters require efficient calibration methods.
method Combines Principal Component Decomposition with constrained Bayesian Optimization to minimize pressure curve deviation.
result Optimal engine calibration found after 64.4s with a 0.017% efficiency gain.
FeatureEnVi aids in feature engineering with visual analytics.
problem Insufficient support for feature engineering in visual analytics tools.
method Stepwise selection and semi-automatic extraction approaches.
result Extracts heavily engineered features evaluated by multiple metrics.
Paper introduces TS-GPT for engineering time series forecasting.
problem Engineering time series require causal operations, unlike linguistic data.
method Innovations representation theory, Generative Pre-trained Transformer.
result TS-GPT effectively forecasts real-time locational marginal prices.
System helps engineers with concept recognition for SEVA.
problem Recognizing systems engineering concepts for SEVA.
method Token classification task, domain expert labeling, pre-trained model fine-tuning, essential datasets creation, knowledge graph construction.
result System successfully recognizes systems engineering concepts.
Can engineering neural networks be approached in a disciplined way similar to how engineers build software for civil aircraft? We present nn-dependability-kit, an open-source toolbox to support safety engineering of neural networks for autonomous driving systems. The rationale behind nn-dependability-kit is to consider…
Study on TVL computation in DeFi protocols, proposing verifiable metrics.
problem Lack of standardization and verifiability in TVL computation.
method Systematic study of 939 DeFi projects, analyzing methodologies and proposing vTVL.
result 240 protocols use repeated balance queries, limiting verifiability.
Graph Neural Networks improve machine learning on relational databases.
problem Training machine learning models on relational databases requires costly data extraction and feature engineering.
method Uses Graph Neural Networks to extract features from relational databases.
result Outperforms state-of-the-art automatic feature engineering methods.
Paper introduces MTGP for engineering tasks with sparse data.
problem Challenges of data sparsity and varying task correlations in engineering.
method Multi-Task Gaussian Processes (MTGP) framework.
result Improves predictive performance and reduces computational costs.
Survey and new results link hydrodynamics, molecular physics, and financial engineering.
problem Understanding financial engineering topics like Asian options and volatility swaps.
method Linking Kevin waves, Klein-Kramers, and Kolmogorov equations to financial models.
result Corrected the original solution of the Kolmogorov equation.
Verify spiral minimal product structure using Takahashi Theorem.
problem Verify spiral minimal product structure.
method Using Takahashi Theorem with full computational details.
result Verify spiral minimal product structure.