Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

6341,2691,9032,537 · Jun 202019922001200920172026
48 results for DOE and ML

The study examines how experimental design choices affect machine learning model performance.

problem Lack of guidelines on choosing experimental designs and machine learning models.
method 12 experimental designs, 7 families of predictive models, 7 test functions, 8 noise settings.
result Guidelines for practical applications of DOE and ML are provided.

AI methods are energy-intensive, but efficiency alone isn't enough for sustainability.

problem AI methods are energy-intensive and contribute to climate change.
method Critically examines the limitations of efficiency in improving environmental sustainability of AI.
result Efficiency alone is insufficient to address the environmental impacts of AI.

Training large machine learning (ML) models with many variables or parameters can take a long time if one employs sequential procedures even with stochastic updates. A natural solution is to turn to distributed computing on a cluster; however, naive, unstructured parallelization of ML algorithms does not usually lead t…

2013-12-19abs ↗pdf ↗

Interpretable ML methods for better decision-making with explanations.

problem Lack of transparency in black-box ML models.
method Use of Formal Concept Analysis and cooperative game theory to assess attribute importance and reduce attribute count.
result Developed methods to assess attribute importance and reduce attribute count in ML models.

Develops Active Fourier Auditor to estimate ML model properties without reconstructing them.

problem Verifying and auditing properties of Machine Learning models in real-world applications.
method A new framework that quantifies ML model properties using Fourier coefficients, without reconstructing the model.
result Active Fourier Auditor (AFA) is more accurate and sample-efficient than baselines for estimating robustness, individual fairness, and group fairness.

We introduce TzK (pronounced "task"), a conditional probability flow-based model that exploits attributes (e.g., style, class membership, or other side information) in order to learn tight conditional prior around manifolds of the target observations. The model is trained via approximated ML, and offers efficient appro…

2018-11-05abs ↗pdf ↗

PIML model improves hydrological predictions by blending physics and ML.

problem Hydrological models either lack predictive accuracy or fail to maintain physical consistency.
method Physics Informed Machine Learning (PIML) that integrates physics-based models and ML algorithms.
result PIML model outperforms both physics-based and ML models in predicting streamflow and evapotranspiration.

Develops fair feature importance scores for tree-based models to interpret fairness.

problem Ensuring fairness in machine learning models, especially tree-based ones.
method Inspired by decision trees, proposes a novel fair feature importance score based on mean decrease in group bias.
result Valid interpretations of fairness for tree-based ensembles and surrogates of other ML systems.

Mixed-integer optimization improves fairness and transparency in machine learning models.

problem Ensuring fairness and transparency in machine learning models deployed in sensitive areas.
method Embedding responsible ML considerations directly into the learning process using mixed-integer optimization.
result MIO enables the learning of inherently transparent models that can incorporate fairness or other constraints.

LiuBei is a resilient ML algorithm that tolerates Byzantine workers and servers without trusting any component.

problem Byzantine failures in distributed ML solutions.
method Byzantine-resilient ML algorithm that aggregates gradients and replicates parameter servers, using a filtering mechanism and scatter/gather protocol.
result LiuBei achieves Byzantine resilience to both servers and workers and guarantees convergence, with an accuracy loss of around 5% and a 24% convergence overhead.

This study examines how data types affect ML algorithms' performance in Bitcoin price prediction.

problem Improving the accuracy of Bitcoin price forecasts for financial gain.
method Constructed continuous and trend data from Bitcoin's historical data, applied various ML algorithms, and compared their performance using accuracy and AUC.
result Data type significantly impacts ML algorithms' performance in Bitcoin price prediction.

Develops statistical inference for ML-discovered heterogeneous treatment effects.

problem ML algorithms may fail to accurately ascertain heterogeneous treatment effects in practical settings.
method Neyman's repeated sampling framework, dividing sample into groups, estimating average treatment effects, constructing confidence intervals.
result Valid methodology for estimating and testing heterogeneous treatment effects without relying on ML algorithm properties.

Most modern supervised statistical/machine learning (ML) methods are explicitly designed to solve prediction problems very well. Achieving this goal does not imply that these methods automatically deliver good estimators of causal parameters. Examples of such parameters include individual regression coefficients, avera…

2016-07-30abs ↗pdf ↗

Transformations of macroeconomic data affect machine learning forecasts, especially with regularization and nonlinearity.

problem The impact of data transformations on machine learning forecasts in macroeconomic contexts.
method Review and propose new data transformations, empirically evaluate their effects, and compare traditional and moving average rotations.
result Traditional factors should almost always be included as predictors, and moving average rotations can provide important gains.

Study shows competition feedback can make ML predictors biased towards specific user groups.

problem How competition affects machine learning predictors and user prediction quality.
method Flexible model of competing ML predictors, empirical and mathematical analysis.
result Competition causes predictors to specialize for specific sub-populations at the cost of general performance.

We present SmartChoices, an approach to making machine learning (ML) a first class citizen in programming languages which we see as one way to lower the entrance cost to applying ML to problems in new domains. There is a growing divide in approaches to building systems: on the one hand, programming leverages human expe…

2018-10-01abs ↗pdf ↗

New methods for better uncertainty prediction in ML.

problem Insufficient calibration in machine learning regression.
method Conditional calibration with respect to input features (adaptivity).
result Consistency and adaptivity are complementary, and good consistency does not guarantee good adaptivity.

With the widespread use of machine learning (ML) techniques, ML as a service has become increasingly popular. In this setting, an ML model resides on a server and users can query it with their data via an API. However, if the user's input is sensitive, sending it to the server is undesirable and sometimes even legally …

2018-08-01abs ↗pdf ↗

Machine learning outperforms crowd investors in predicting loan defaults and investment returns.

problem Determining if machine learning can outperform human decision-making in crowd lending.
method Using data from Prosper.com, a sophisticated ML algorithm was trained to predict loan defaults and investment returns.
result The ML algorithm outperforms crowd investors in predicting loan defaults and investment returns, especially for risky loans.

Igeood detects out-of-distribution samples using information geometry.

problem Out-of-distribution (OOD) detection in machine learning systems.
method Igeood uses the Fisher-Rao geodesic distance to detect OOD samples from any pre-trained neural network.
result Igeood outperforms state-of-the-art methods on various network architectures and datasets.

SplitEasy trains ML models on mobile devices without server data transfer.

problem Training complex DL models on resource-limited mobile devices.
method Split learning approach where sensitive layers are trained locally, computationally intensive layers on server.
result SplitEasy trains models on mobile devices with minimal data transfer, near-constant time per sample.

New ML algorithms improve model interpretability without sacrificing performance.

problem Lack of interpretability in complex machine learning models.
method Developed new algorithms based on fANOVA framework, including GAMI-Lin-T and GAMI-Net.
result GAMI-Lin-T and GAMI-Net perform comparably to EBM and better in interpretability.

Paper proposes a transfer learning approach for decentralized QoE estimation.

problem Challenges in QoE model development due to small datasets, user diversity, and IPR/privacy concerns.
method A transfer learning-based ML model training approach that allows decentralized local models to share generic indicators and customize them further.
result The approach shows advantages of stacking various generic and specific models with corresponding weight factors.

Study on theoretical limits of 0\ell_0 sparse-regression algorithms using Fl RDT.

problem Understanding the performance limits of 0\ell_0 norm based optimization algorithms in compressed sensing and sparse regression.
method Utilized Fully lifted random duality theory (Fl RDT) to analyze the maximum-likelihood (ML) decoding performance.
result Uncovered phase-transition (PT) and descending 0\ell_0 (d0\ell_0) curves that separate successful and unsuccessful algorithm performance.

Machine learning improves official statistics but needs rigorous validation.

problem Lack of methodological robustness in machine learning for official statistics.
method Total Machine Learning Error (TMLE) framework to validate ML models.
result TMLE addresses representativeness and measurement errors in ML models.

This paper presents a ML-based receiver for SDR that outperforms conventional methods.

problem Complexity and performance issues in multiuser detection.
method Supervised learning for direct symbol detection without parameter estimation.
result The ML-based receiver achieves similar or better performance than SIC and MMSE receivers.

Method provides statistical guarantees for identifying subgroups in ML studies.

problem Bias and noise in estimating conditional average treatment effects (CATE).
method Develops uniform confidence bands (GATES) for estimating group average treatment effects (GATEs).
result Identifies subgroups with statistical guarantees, regardless of effect size.

The study examines if enforcing fairness helps mitigate bias due to demographic shifts.

problem Bias in ML models due to underrepresented subpopulations in training data.
method Theoretical and simulation analysis of fairness enforcement in target domains.
result Enforcing fairness can lead to the Bayes model in the target domain under certain conditions.

Machine learning (ML) has become a commodity in our every-day lives. We routinely ask ML empowered smartphones to suggest lovely food places or to guide us through a strange place. ML methods have also become standard tools in many fields of science and engineering. A plethora of ML applications transform human lives a…

2018-05-14abs ↗pdf ↗

Paper proposes a new ML approach to estimate g-vulnerability without estimating conditional probabilities.

problem Estimating information leakage in black-box systems with large output domains.
method Developed a novel ML-based approach to estimate g-vulnerability without estimating conditional probabilities.
result The proposed method outperforms frequentist approach when dealing with large output domains.

The rise of Big Data has led to new demands for Machine Learning (ML) systems to learn complex models with millions to billions of parameters, that promise adequate capacity to digest massive datasets and offer powerful predictive analytics thereupon. In order to run ML algorithms at such scales, on a distributed clust…

2015-12-31abs ↗pdf ↗

AutoML serves as the bridge between varying levels of expertise when designing machine learning systems and expedites the data science process. A wide range of techniques is taken to address this, however there does not exist an objective comparison of these techniques. We present a benchmark of current open source Aut…

2018-08-17abs ↗pdf ↗

This research assesses uncertainty quantification and sensitivity analysis for DTs in nuclear fuel performance.

problem Understanding the reliability and performance of advanced nuclear fuels using DTs.
method Introduces ML-based uncertainty quantification and sensitivity analysis methods applied to BISON fuel performance code.
result Demonstrates the effectiveness of DTs in multi-criteria decision-making for nuclear fuel performance.