Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

2845688521,136 · Jun 202019922001200920172026
48 results for Data Driven

Optimal data-driven formulations are found for learning and decision-making with historical data.

problem Designing optimal learning and decision-making formulations from historical data.
method Define a yardstick for measuring formulation quality, then construct an optimal formulation that is uniformly closer to the true cost.
result Existence of three distinct out-of-sample performance regimes with corresponding optimal formulations.

WeatherBench provides a dataset and metrics for comparing data-driven weather forecasts.

problem Lack of a common dataset and evaluation metrics for data-driven weather forecasting.
method Publicly available dataset derived from ERA5, simple evaluation metrics.
result Baseline scores from various forecasting methods provided for comparison.

A new method for support vector regression using a data-driven insensitive parameter.

problem Determining an optimal insensitive parameter in support vector regression.
method A data-driven approach to approximate the insensitive parameter by minimizing a generalized loss function based on the likelihood principle.
result The proposed method outperforms traditional support vector regression methods and has lower computational costs.

Proposes data-driven methods for estimating conditional expectations.

problem Estimating conditional expectations when underlying density is unknown.
method Data-driven techniques to directly estimate conditional expectations from training data.
result Extends data-driven method to solve nonlinear equations in stochastic optimization.

Hybridizes physical and data-driven methods for predicting physicochemical properties.

problem Predicting physicochemical properties accurately using limited data.
method Distills physical method predictions into a prior model and combines with sparse experimental data using Bayesian inference.
result Significant improvements in predicting activity coefficients at infinite dilution compared to baselines and ensemble methods.

This research designs a data-driven partition to test independence between continuous variables.

problem Testing independence between continuous random variables.
method Empirical log-likelihood statistic and data-driven tree-structured partition.
result Strongly consistent test of independence over probability families.

Study integrates machine learning with SAA for optimizing decisions based on uncertain parameters and covariates.

problem Optimizing decisions under uncertain parameters and covariates.
method Data-driven frameworks integrating machine learning prediction models within SAA for scenario generation.
result Consistent and asymptotically optimal solutions under certain conditions, with finite sample guarantees.

Data-driven method for option pricing using historical asset prices.

problem Tackling the gap between historical asset prices and risk-neutral option pricing.
method Identifying a pricing kernel process, solving utility maximization and functional optimization problems using deep learning.
result Demonstrated the efficiency of the data-driven option pricing methodology.

Data-driven approach learns effective equations for phase field interfaces.

problem Learning accurate equations for phase field interface dynamics.
method Data-driven identification of partial differential equations from phase field data.
result Data-driven equations outperform analytical approximations in certain regimes.

New framework for data-driven hyperparameter tuning with structured loss.

problem Statistical foundations for multi-dimensional hyperparameter tuning remain limited.
method General framework using real algebraic geometry for semi-algebraic function classes.
result First general guarantees for multi-dimensional hyperparameter tuning.

Most structure inference methods either rely on exhaustive search or are purely data-driven. Exhaustive search robustly infers the structure of arbitrarily complex data, but it is slow. Data-driven methods allow efficient inference, but do not generalize when test data have more complex structures than training data. I…

2019-06-17abs ↗pdf ↗

RCUKF combines data-driven modeling and Bayesian estimation for accurate system state estimation.

problem Challenges in obtaining reliable process models for complex systems.
method Integrates reservoir computing with unscented Kalman filtering.
result Demonstrated effectiveness on benchmark problems and real-time vehicle trajectory estimation.

MAD framework learns operators from physics-embedded data efficiently.

problem Data-driven methods require costly labeled datasets and model-driven techniques face efficiency-accuracy trade-offs.
method Integrates physical laws with data-driven learning to generate physics-embedded analytical solutions and synthetic data.
result Eliminates dependence on experimental or simulated training data, enabling efficient operator learning across multi-parameter systems.

A hybrid method combines model-based and data-driven approaches for multiscale constitutive responses.

problem High computational costs and inaccuracies in nonlinear multiscale methods.
method Hybrid methodology combining model-based constitutive laws, data-driven corrections, and computational multiscale approaches.
result Model-data-driven approach improves macroscale simulations with similar accuracy and computational cost.

A framework for analyzing regularizers to ensure trustworthy theory-driven model estimation.

problem Uncertain choice of regularizers can compromise the interpretability of deep grey-box models.
method Adapting neural net architecture and training objective to analyze regularizer behavior empirically.
result Empirical analysis of regularizers helps in making a justified choice for trustworthy theory-driven model estimation.

Data-driven Distributionally Robust Optimization (DD-DRO) via optimal transport has been shown to encompass a wide range of popular machine learning algorithms. The distributional uncertainty size is often shown to correspond to the regularization parameter. The type of regularization (e.g. the norm used to regularize)…

2017-05-19abs ↗pdf ↗

The MEM method uses data-driven priors for linear inverse problems, proving convergence and estimating differences.

problem Linear inverse problems with approximate priors.
method Maximum Entropy on the Mean (MEM) method with data-driven priors.
result Empirical mean convergence and estimates for prior differences based on epigraphical distance.

This paper analyzes data-driven Newsvendor problems and finds a wide range of possible regrets.

problem Guessing the number drawn from an unknown distribution with asymmetric costs.
method Unified analysis using the notion of clustered distributions and new lower bounds.
result The entire spectrum of achievable regrets from 1/n1/\sqrt{n} to 1/n1/n is possible.

End-to-end framework optimizes constrained trajectories using data-driven methods.

problem Optimizing trajectories under constraints with limited dynamics knowledge.
method Data-driven approach decomposes trajectories into function basis, uses maximum a posteriori for optimization, and incorporates linear constraints.
result Commanding results in aeronautics and sailing route optimization.

In this work, we provide an efficient and realistic data-driven approach to simulate astronomical images using deep generative models from machine learning. Our solution is based on a variant of the generative adversarial network (GAN) with progressive training methodology and Wasserstein cost function. The proposed so…

2019-09-26abs ↗pdf ↗

GNPs learn operators on non-Euclidean geometries using neural networks.

problem Learning operators on complex geometries like manifolds.
method Geometric Neural Operators (GNPs) that incorporate geometric properties.
result GNPs can estimate metrics, solve PDEs, and learn LB operators on manifolds.

Method verifies if observed data fits Lévy-Driven Ornstein-Uhlenbeck process.

problem Verifying if observed data fits Lévy-Driven Ornstein-Uhlenbeck process.
method Estimating parameters and approximating the driving process to test CAR(1) Lévy-driven hypothesis.
result Demonstrates method's effectiveness through simulations and real data examples.

Develops scenario theory for multi-criteria decision making.

problem Need for robustness assessment with multiple criteria and datasets.
method Collectively treats risks associated with individual criteria for multi-criteria decision problems.
result More accurate robustness certificates and sharper quantification of simultaneous criterion satisfaction.

A complex-valued convolutional network (convnet) implements the repeated application of the following composition of three operations, recursively applying the composition to an input vector of nonnegative real numbers: (1) convolution with complex-valued vectors followed by (2) taking the absolute value of every entry…

2015-03-11abs ↗pdf ↗

Bayesian imaging uses neural networks to learn prior knowledge from data.

problem Performing Bayesian inference in imaging problems with limited prior knowledge.
method Constructs a data-driven prior on a sub-manifold of the image space using neural networks, and performs Bayesian computation on this manifold.
result Established the existence and well-posedness of the posterior distribution and moments, and demonstrated superior performance compared to existing methods.

Paper proposes MA-BERT for efficient data-driven ATM models.

problem Long training time and need for large datasets in data-driven ATM models.
method Multi-Agent Bidirectional Encoder Representations from Transformers (MA-BERT) and transfer learning framework.
result MA-BERT saves training time and achieves high performance with little data.

Framework improves data-driven ROMs for complex systems using Bayesian operator inference.

problem Improving the quality of data-driven reduced-order models for complex dynamical systems.
method Develops an active learning framework using Bayesian operator inference to identify and select training parameters.
result The proposed adaptive sampling strategy consistently yields more stable and accurate ROMs than random sampling.

InVAErt networks use data-driven methods for system synthesis and identifiability analysis.

problem Model synthesis and identifiability analysis for complex systems.
method Deterministic encoder and decoder, normalizing flow, variational encoder, loss function penalty coefficients, latent space sampling.
result Validation through various system types, demonstrating effectiveness of the framework.

Designs a robust data-driven decision-making model to handle multiple overfitting sources.

problem Overfitting in data-driven models due to statistical error, data noise, and data misspecification.
method Holistic distributionally robust optimization formulation combining Kullback-Leibler and Lévy-Prokhorov approaches.
result Guaranteed holistic protection against statistical error, data noise, and data misspecification.

Study compares data-driven vs model-based MRS quantification strategies, focusing on resilience to out-of-distribution effects.

problem Resilience to out-of-distribution effects in data-driven MRS quantification.
method Compared three data-driven strategies (supervised regression, self-supervised learning, test-time adaptation) against model-based fitting tools.
result Test-time adaptation proved most resilient to out-of-distribution effects, while self-supervised learning achieved intermediate performance.