Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,051 papers · 148 categories

Trend · papers per month

4749471,4211,894 · Jun 202019922001200920182026
48 results for data driven learning

This paper reviews data-driven optimization techniques for decision-making under uncertainty.

problem Decision-making under uncertainty in the era of big data and deep learning.
method Comprehensive review of data-driven distributionally robust optimization, chance constrained program, robust optimization, and scenario-based optimization.
result Identification of potential research opportunities in closed-loop data-driven optimization and scenario-based optimization leveraging deep learning.

WeatherBench provides a dataset and metrics for comparing data-driven weather forecasts.

problem Lack of a common dataset and evaluation metrics for data-driven weather forecasting.
method Publicly available dataset derived from ERA5, simple evaluation metrics.
result Baseline scores from various forecasting methods provided for comparison.

Optimal data-driven formulations are found for learning and decision-making with historical data.

problem Designing optimal learning and decision-making formulations from historical data.
method Define a yardstick for measuring formulation quality, then construct an optimal formulation that is uniformly closer to the true cost.
result Existence of three distinct out-of-sample performance regimes with corresponding optimal formulations.

Proposes data-driven methods for estimating conditional expectations.

problem Estimating conditional expectations when underlying density is unknown.
method Data-driven techniques to directly estimate conditional expectations from training data.
result Extends data-driven method to solve nonlinear equations in stochastic optimization.

Data-driven approach learns effective equations for phase field interfaces.

problem Learning accurate equations for phase field interface dynamics.
method Data-driven identification of partial differential equations from phase field data.
result Data-driven equations outperform analytical approximations in certain regimes.

MAD framework learns operators from physics-embedded data efficiently.

problem Data-driven methods require costly labeled datasets and model-driven techniques face efficiency-accuracy trade-offs.
method Integrates physical laws with data-driven learning to generate physics-embedded analytical solutions and synthetic data.
result Eliminates dependence on experimental or simulated training data, enabling efficient operator learning across multi-parameter systems.

GNPs learn operators on non-Euclidean geometries using neural networks.

problem Learning operators on complex geometries like manifolds.
method Geometric Neural Operators (GNPs) that incorporate geometric properties.
result GNPs can estimate metrics, solve PDEs, and learn LB operators on manifolds.

Study integrates machine learning with SAA for optimizing decisions based on uncertain parameters and covariates.

problem Optimizing decisions under uncertain parameters and covariates.
method Data-driven frameworks integrating machine learning prediction models within SAA for scenario generation.
result Consistent and asymptotically optimal solutions under certain conditions, with finite sample guarantees.

Enhances data-driven models with physics knowledge for better system dynamics.

problem Improving generalization and interpretability in complex physical system modeling.
method EVGP (Explicit Variational Gaussian Process) model that incorporates domain knowledge into data-driven models.
result The EVGP model outperforms purely data-driven models when using prior domain knowledge.

Data-driven method for option pricing using historical asset prices.

problem Tackling the gap between historical asset prices and risk-neutral option pricing.
method Identifying a pricing kernel process, solving utility maximization and functional optimization problems using deep learning.
result Demonstrated the efficiency of the data-driven option pricing methodology.

DL-PDE discovers PDEs from noisy, sparse data using neural networks and sparse regressions.

problem Discovering PDEs from noisy, sparse data.
method Combines neural networks and sparse regressions to discover PDEs from meta-data generated by a neural network.
result Achieves satisfactory results in real-world engineering settings with noisy and limited data.

Compressed sensing improves MRI scans with data-driven learning.

problem Challenges in applying compressed sensing from research to clinical practice.
method Data-driven learning to address challenges of hand-crafted priors, tuning parameters, and long reconstruction times.
result Compressed sensing can have greater clinical impact with data-driven learning.

Paper proposes MA-BERT for efficient data-driven ATM models.

problem Long training time and need for large datasets in data-driven ATM models.
method Multi-Agent Bidirectional Encoder Representations from Transformers (MA-BERT) and transfer learning framework.
result MA-BERT saves training time and achieves high performance with little data.

Hybridizes physical and data-driven methods for predicting physicochemical properties.

problem Predicting physicochemical properties accurately using limited data.
method Distills physical method predictions into a prior model and combines with sparse experimental data using Bayesian inference.
result Significant improvements in predicting activity coefficients at infinite dilution compared to baselines and ensemble methods.

Framework improves data-driven ROMs for complex systems using Bayesian operator inference.

problem Improving the quality of data-driven reduced-order models for complex dynamical systems.
method Develops an active learning framework using Bayesian operator inference to identify and select training parameters.
result The proposed adaptive sampling strategy consistently yields more stable and accurate ROMs than random sampling.

New method identifies physical processes and parameters from data.

problem Current data-driven methods assume known or linear model parameters, limiting realistic process identification.
method Combines data-driven and data-assimilation methods for simultaneous process and parameter identification.
result Successfully identifies physical processes and infers model parameters for nonlinear models.

Study compares data-driven vs model-based MRS quantification strategies, focusing on resilience to out-of-distribution effects.

problem Resilience to out-of-distribution effects in data-driven MRS quantification.
method Compared three data-driven strategies (supervised regression, self-supervised learning, test-time adaptation) against model-based fitting tools.
result Test-time adaptation proved most resilient to out-of-distribution effects, while self-supervised learning achieved intermediate performance.

A hybrid method combines model-based and data-driven approaches for multiscale constitutive responses.

problem High computational costs and inaccuracies in nonlinear multiscale methods.
method Hybrid methodology combining model-based constitutive laws, data-driven corrections, and computational multiscale approaches.
result Model-data-driven approach improves macroscale simulations with similar accuracy and computational cost.

A new framework for optimizing interventions with limited data.

problem Small data, default intervention data, unmodeled objectives, unforeseen consequences.
method Bandit data-driven optimization combining online bandit learning and offline predictive analytics.
result PROOF algorithm achieves no-regret and superior performance in simulations and real-world application.

This paper emphasizes the need for uncertainty quantification in data-driven ML models for nuclear engineering.

problem Uncertainty in ML predictions due to data noise, model architecture, and stochastic training.
method Explains and compares uncertainties in physics-based and data-driven models, and presents techniques to quantify ML prediction uncertainties.
result The importance of uncertainty quantification in ML models for nuclear engineering applications.

Bayesian imaging uses neural networks to learn prior knowledge from data.

problem Performing Bayesian inference in imaging problems with limited prior knowledge.
method Constructs a data-driven prior on a sub-manifold of the image space using neural networks, and performs Bayesian computation on this manifold.
result Established the existence and well-posedness of the posterior distribution and moments, and demonstrated superior performance compared to existing methods.

Study identifies and analyzes spurious correlations in data-driven models.

problem Spurious correlations in data-driven models are unreliable and hard to detect.
method Collect and analyze synthetic datasets generated from causal graphs to investigate spurious correlations.
result Patterns connecting spurious correlation hypotheses and model design choices were observed.

This research designs a data-driven partition to test independence between continuous variables.

problem Testing independence between continuous random variables.
method Empirical log-likelihood statistic and data-driven tree-structured partition.
result Strongly consistent test of independence over probability families.

Paper examines vulnerabilities in data-driven pricing schemes.

problem Vulnerability of clustering-oriented pricing schemes to malicious user behavior.
method Defined a notion of disguising to identify strategic behaviors of malicious users, characterized sensitivity zones to evaluate malicious user percentages, conducted cost benefit analysis.
result Concluded with a vulnerability analysis of data-driven pricing schemes.

RCUKF combines data-driven modeling and Bayesian estimation for accurate system state estimation.

problem Challenges in obtaining reliable process models for complex systems.
method Integrates reservoir computing with unscented Kalman filtering.
result Demonstrated effectiveness on benchmark problems and real-time vehicle trajectory estimation.

InVAErt networks use data-driven methods for system synthesis and identifiability analysis.

problem Model synthesis and identifiability analysis for complex systems.
method Deterministic encoder and decoder, normalizing flow, variational encoder, loss function penalty coefficients, latent space sampling.
result Validation through various system types, demonstrating effectiveness of the framework.

Data-driven Distributionally Robust Optimization (DD-DRO) via optimal transport has been shown to encompass a wide range of popular machine learning algorithms. The distributional uncertainty size is often shown to correspond to the regularization parameter. The type of regularization (e.g. the norm used to regularize)…

2017-05-19abs ↗pdf ↗

AI-driven tax policies improve economic equality and productivity.

problem Lack of appropriate economic data and limited opportunity to experiment.
method Two-level deep reinforcement learning approach to learn dynamic tax policies from observational data.
result AI-driven tax policies improve the trade-off between equality and productivity by 16%.

A new framework optimizes manufacturing decisions with less data and time.

problem Optimizing complex systems with multiple conflicting objectives.
method Data-driven Bayesian optimization using sequential learning.
result The proposed algorithm achieves the actual Pareto front with less data.

Differentiable Algorithm Networks (DAN) enable composable robot learning.

problem Training robots to learn from limited data and imperfect models.
method Composable architecture of neural network modules, each encoding a differentiable robot algorithm and model, trained end-to-end from data.
result DAN modules adapt to one another and compensate for imperfect models and algorithms, achieving best overall system performance.