Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,051 papers · 148 categories

Trend · papers per month

7.9%15.8%23.7%31.6% · Jun 202019922001200920182026
48 results for ML Optimization

We translate ML pipelines into neural networks to optimize multiple models together.

problem Isolated training of ML pipelines limits joint optimization of multiple models.
method Propose translating ML pipelines into neural networks and fine-tuning them jointly.
result Fine-tuning translated pipelines increases final accuracy.

Paper presents ML-VAMP for efficient multi-layer inference with exact performance analysis.

problem Inference in multi-layer deep neural networks with non-convex optimization.
method ML-VAMP algorithm for MAP and MMSE estimates, with performance predictions in high dimensions.
result ML-VAMP achieves Bayes-optimal MSE under certain conditions, providing exact performance characterization.

Mixed-integer optimization improves fairness and transparency in machine learning models.

problem Ensuring fairness and transparency in machine learning models deployed in sensitive areas.
method Embedding responsible ML considerations directly into the learning process using mixed-integer optimization.
result MIO enables the learning of inherently transparent models that can incorporate fairness or other constraints.

New method quantifies uncertainty for near-optimal ML algorithms.

problem Uncertainty quantification for near-Bayes optimal ML algorithms.
method Developed a martingale posterior to recover Bayesian posterior from ML algorithms.
result Proved practical uncertainty quantification method applicable to general ML algorithms.

System detects overfitting in ML apps, improving quality and efficiency.

problem Overfitting in ML applications during continuous development.
method ease. ml/meter system for automated overfitting detection and measurement.
result Probabilistic overfitting signals for developers to take actions.

Proposes a game-theoretic framework for ML trust regulation.

problem Lack of coordination between ML model builders and regulators.
method Formulates trustworthy ML as a multi-objective multi-agent optimization problem and introduces regulation games and ParetoPlay.
result Enables efficient enforcement of ML model specifications without discouraging participation.

Optimal contracts help principals delegate data collection in decentralized ML.

problem Dealing with information asymmetries in decentralized ML.
method Design of optimal and near-optimal contracts addressing uncertainty in model quality and performance.
result Simple linear contracts achieve 1-1/e fraction of optimal utility.

Optimizes VAE hyperparameters for efficient training and manifold discovery.

problem Efficiently optimizing hyperparameters in VAEs for complex data.
method Latent Bayesian Optimization (zBO) for hyperparameter trajectory optimization.
result Demonstrated improved performance in finding joint rotationally invariant representations.

Study uses AI and ML to predict and optimize corrosion resistance of aluminum alloys.

problem Corrosion resistance of aluminum alloys in marine environments.
method Investigated two ML approaches: direct and inverse, using Random Forest, neural network, and Gaussian Process Regression.
result Gaussian Process Regression with hybrid kernel functions provided superior predictive performance.

We identify a strong equivalence between neural network based machine learning (ML) methods and the formulation of statistical data assimilation (DA), known to be a problem in statistical physics. DA, as used widely in physical and biological sciences, systematically transfers information in observations to a model of …

2017-10-19abs ↗pdf ↗

Paper optimizes stock option forecasting using ML models and improved trading strategies.

problem Improving accuracy of stock option predictions and trading decisions.
method Application of Recurrent Neural Networks (RNN), Long Short-Term Memory (LSTM), and Quasi-Reversibility Method (QRM).
result Optimized stock option investment results through improved trading strategies and model combination.

This paper introduces multi-objective hyperparameter optimization in machine learning.

problem Optimizing machine learning pipelines for multiple objectives, not just accuracy.
method Survey of optimization strategies and applications in multi-objective hyperparameter optimization.
result The importance and utility of multi-objective hyperparameter optimization in applied machine learning.

Myia compiler optimizes ML models with efficient AD for array programming.

problem Efficient automatic differentiation for array programming in ML.
method Introduces a new graph-based IR that supports function calls, higher-order functions, and recursion.
result Myia compiler enables efficient AD using source transformation without a tape, supporting higher-order derivatives.

DP-LSSGD improves privacy-preserving ML models by smoothing out noise.

problem Privacy-preserving ML models have lower utility than non-private ones.
method DP-LSSGD uses Laplacian smoothing to improve utility of DP-SGD.
result DP-LSSGD achieves the same DP guarantee as DP-SGD but with better stability and generalization.

What is a systematic way to efficiently apply a wide spectrum of advanced ML programs to industrial scale problems, using Big Models (up to 100s of billions of parameters) on Big Data (up to terabytes or petabytes)? Modern parallelization strategies employ fine-grained operations and scheduling beyond the classic bulk-…

2013-12-30abs ↗pdf ↗

A rigorous ML pipeline for binary classification in biomedical studies, focusing on pancreatic cancer.

problem Handling bias in ML models for complex biomedical data.
method Customizable ML analysis pipeline with 9 algorithms, hyperparameter optimization, and thorough evaluation.
result Comparison of ML algorithms to ExSTraCS, highlighting interpretability and bias handling.

This article improves communication efficiency in distributed ML over wireless networks.

problem Achieving high ML inference accuracy at scale with zero communication latency.
method Optimizing communication payload types, techniques, scheduling, and ML architectures.
result Communication-efficient and distributed learning frameworks are presented.

New method optimizes ML models under poisoned data, improving robustness.

problem Vulnerability of ML models to poisoned data attacks.
method Multiobjective bilevel optimization to consider hyperparameter learning and attack effects.
result Current approaches underestimate model robustness and regularization benefits.

Meta-learning symbolic default hyperparameters from dataset properties.

problem Empirical hyperparameter optimization is slow and requires manual configuration.
method Evolutionary algorithm to learn symbolic hyperparameter formulas from dataset properties.
result Meta-learning finds viable symbolic defaults for ML algorithms.

This paper reviews ML applications in finance, enhancing asset pricing models.

problem Limitations of traditional asset pricing models in complex market dynamics.
method Exploring ML models including supervised, unsupervised, semi-supervised, and reinforcement learning.
result Enhanced return prediction and portfolio optimization through ML integration.

CK simplifies ML model deployment and reproducibility with open APIs and DevOps.

problem Making ML models reproducible and deployable across different environments.
method Decompose complex systems into reusable sub-components with unified APIs and DevOps principles.
result Automatically co-design and optimize ML models for speed, accuracy, energy, and size.

New ML-based detection improves PMH signal detection in load-modulated MIMO systems.

problem Detecting PMH signals without prior CSI is challenging and computationally expensive.
method Proposes HEM-ML and HEM-KD schemes using EM and KD-tree for efficient detection.
result Achieves comparable detection results to optimal ML detector with reduced complexity.

VisEvol uses evolutionary optimization to find optimal hyperparameters for machine learning models.

problem Finding the best hyperparameters for complex machine learning models is computationally intensive and challenging.
method VisEvol employs evolutionary optimization, storing performant models and improving others through crossover and mutation processes.
result VisEvol generates a voting ensemble of models with improved predictive performance.

The study examines backward compatibility issues in ML systems, especially with noisy data.

problem Backward compatibility challenges in ML systems, especially with noisy data.
method Empirical analysis of ML systems across different architectures and datasets, focusing on data shifts and noise.
result Backward compatibility issues arise even without data shift due to optimization stochasticity and training on large-scale noisy datasets can significantly decrease compatibility.

Machine Learning (ML) has been successfully applied to a wide range of domains and applications. One of the techniques behind most of these successful applications is Ensemble Learning (EL), the field of ML that gave birth to methods such as Random Forests or Boosting. The complexity of applying these techniques togeth…

2017-06-28abs ↗pdf ↗

Given a graph in which a few vertices are deemed interesting a priori, the vertex nomination task is to order the remaining vertices into a nomination list such that there is a concentration of interesting vertices at the top of the list. Previous work has yielded several approaches to this problem, with theoretical re…

2016-07-05abs ↗pdf ↗