Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,341 papers · 148 categories

Trend · papers per month

9.9%19.8%29.7%39.5% · Jun 202019922001200920182026
48 results for empirical optimization

Examines optimal risk sharing with realistic risk attitudes, finding risk seeking in certain subdomains.

problem Optimal risk sharing with empirically realistic risk attitudes.
method Allows for risk-seeking agents, generalizes expected utility, and uses counter-monotonic improvement theorem.
result First empirical results on optimal risk sharing with realistic risk attitudes.

New approach avoids excess empirical risk in domain generalization.

problem Learning models that generalize to unseen distributions from diverse data sets.
method Minimizes penalty under constraint of optimal empirical risk, leveraging rate-distortion theory.
result Significant improvements in domain generalization performance across multiple methods.

A new method approximates expected empirical loss for stochastic deep learning tasks.

problem Determining optimal step sizes for stochastic gradient descent in deep learning.
method Applying one-dimensional function fitting to noisy losses of vertical cross sections to approximate expected empirical loss.
result The method leads to a robust and straightforward optimization method that performs well across datasets and architectures.

We solve robust optimization problems using Wasserstein balls and apply it to mean-CVaR optimization.

problem Distributionally robust optimization with Wasserstein ambiguity sets.
method Transformed robust optimization into non-robust with penalty term, selecting ambiguity set size.
result Impressive results in robust mean-CVaR optimization compared to other strategies.

This paper tightens the law of the iterated logarithm for empirical KL_inf, applicable to unbounded data.

problem Developing nonasymptotic concentration bounds for empirical KL_inf with optimal constants and rates.
method Presenting a tight law of the iterated logarithm for empirical KL_inf, applicable to unbounded data.
result A tight law of the iterated logarithm for empirical KL_inf, applicable to unbounded data.

Paper develops efficient algorithms for robust optimization across multiple groups.

problem Minimizing maximal empirical risk across distinct groups in robust optimization.
method Develops ALEG and ALEM algorithms for two-level finite-sum convex-concave minimax optimization.
result Achieves ε-accuracy with complexity O(m√(nlnm/ε)) and outperforms state-of-the-art methods.

New algorithms achieve uniform stability for empirical risk minimization.

problem Designing uniformly stable optimization algorithms for empirical risk minimization.
method Black-box conversion of smooth optimization algorithms and development of Mirror Descent for smooth optimization.
result Optimal algorithms with uniform stability and convergence rates for smooth optimization.

The study provides theoretical guarantees for the statistical performance of optimal decision trees.

problem Theoretical limits on the statistical performance of globally optimal decision trees.
method Sharp oracle inequalities and uniform concentration framework based on Rademacher complexity.
result Derivation of minimax optimal rates for piecewise sparse heterogeneous anisotropic Besov space.

Optimizes SGLD noise structure for better generalization bounds.

problem Improving generalization bounds for large models trained with SGLD.
method Manipulates the noise structure in SGLD to optimize information-theoretical bounds.
result Optimal noise covariance is the square root of the expected gradient covariance under certain constraints.

Empirical study finds robust optimization can improve portfolio performance in Indian markets.

problem Comparing robust optimization to Markowitz model for portfolio performance.
method Three robust optimization models (box, ellipsoidal, separable uncertainty sets) tested on Indian market data.
result Robust optimization can be a viable alternative to Markowitz model in real market setups.

Disputes the empirical Fisher approximation for natural gradient descent.

problem The empirical Fisher approximation fails to capture second-order information in general.
method Comparison of empirical Fisher and Fisher information matrices.
result The empirical Fisher does not generally approximate the Fisher or Hessian.

A new SGD framework reduces empirical risk by favoring higher loss observations.

problem Minimizing empirical risk in machine learning problems.
method Develops a biased gradient estimator for stochastic optimization.
result Minimizes an ordered modification of the empirical average loss.

New DNN method accelerates image processing optimization.

problem Optimizing large-scale inverse problems in image processing.
method Trains a deep neural network to learn parameters for scaled gradient projection method.
result Significantly improves convergence rate of optimization methods.

Enhances flexibility in data reweighting with optimal transport and maximum entropy principles.

problem Adapting empirical distributions to predefined constraints on moments, tail behavior, etc.
method Nonparametric distributional constraints, maximum entropy principle, optimal transport.
result Maximum entropy weight adjusted empirical distribution close to a specified distribution in optimal transport metric.

Study sharp convergence rates of empirical UOT for spatio-temporal point processes.

problem Statistical analysis of UOT for spatio-temporal point processes.
method Empirical plug-in estimators for Kantorovich-Rubinstein distance between intensity measures.
result Sharp convergence rates of empirical UOT in terms of intrinsic dimensions of measures.

Dual optimization connects ERM-fDR to normalization function.

problem Empirical risk minimization with f-divergence regularization.
method Dual formulation, Legendre-Fenchel transform, implicit function theorem, nonlinear ODE.
result Computational method to calculate normalization function efficiently.

Paper studies convergence rates from surrogate risk minimizers to Bayes optimal classifier.

problem Analyzing the convergence rates of surrogate risk minimizers to the Bayes optimal classifier.
method Introducing consistency intensity to characterize surrogate loss functions and using it to derive convergence rates.
result Empirical surrogate risk minimizers converge faster to the Bayes optimal classifier under certain conditions.

Empirical analysis of gradient descent optimizers in Deep RL.

problem Performance degradation in gradient descent methods for Deep RL.
method Analysis of various gradient descent optimizers and their hyperparameters.
result Adaptive optimizers have a narrow effective learning rate window, diverging in other cases.

Empirical study shows Randomized Signature Methods improve portfolio optimization in financial markets.

problem Drift estimation in non-linear, non-parametric financial markets is challenging.
method Applied Randomized Signature Methods for non-linear, non-parametric drift estimation in multi-variate financial markets.
result Randomized Signature Methods provide features on the same scale and improve portfolio optimization in real-world settings.

The study optimizes portfolios under transaction costs and model uncertainty, showing the effectiveness of turnover penalization.

problem Optimizing portfolios under transaction costs and model uncertainty.
method Theoretical and empirical analysis linking turnover penalization to covariance shrinkage, incorporating transaction costs and parameter uncertainty.
result Turnover penalization is more effective than shrinkage methods in constructing well-performing portfolios.

Understanding optimal prompts for binary sequence predictors is challenging.

problem Finding good prompts for binary sequence predictors is difficult.
method Viewing prompting as finding the best conditioning sequence on a near-optimal sequence predictor, using empirical and statistical analysis.
result Optimal prompts can be better understood given the pretraining distribution, which is not usually available.

NHGD solves bilevel optimization problems with reduced computational time.

problem Solving bilevel optimization problems with high computational cost.
method Exploits statistical structure of inner optimization to use empirical Fisher matrix as Hessian surrogate, enabling parallel optimization and approximation.
result NHGD achieves error bounds and sample complexity guarantees matching state-of-the-art methods, with significantly reduced computational time.

Develops a method for robust optimization with exact coverage confidence intervals.

problem Statistical inference and distributionally robust solutions for stochastic optimization problems.
method Generalized empirical likelihood framework based on ff-divergence balls.
result Provides a principled method for choosing distributional uncertainty regions for exact coverage.

Optimal algorithms for online convex optimization with missing sub-gradient observations.

problem Online convex optimization with noisy or missing sub-gradient observations.
method Adaptive algorithms using sub-gradient descent with minimax optimal regret guarantees.
result Achieves tight minimax optimal regret bounds with empirical property estimation.

The study bounds the utility of empirically optimal portfolios using stock return data.

problem Maximizing expected ratio of portfolio utility to best asset utility.
method High probability utility bounds derived from Lipschitz or Hölder continuous utility functions.
result Utility bounds depend on utility function, number of assets, and observations.

A new sequential method estimates Poisson means in streaming data, achieving optimality and efficiency.

problem Estimating Poisson means in a streaming, or online, framework.
method A quasi-Bayesian approach based on Newton's algorithm for a sequential estimate.
result Established frequentist guarantees including consistency and asymptotic optimality.

Study shows optimal rates for estimating Wasserstein metric and measures.

problem Minimax optimal estimation of Wasserstein metric between probability measures.
method Analyzes the minimax rates for estimating the Wasserstein-1 metric and probability measures.
result Minimax optimal rates for estimating Wasserstein metric and measures are multiplicatively equivalent.

The paper analyzes high-dimensional linear regression using parametric empirical Bayes methods.

problem Estimation of i.i.d. priors in high-dimensional Bayesian linear regression with random design.
method Parametric empirical Bayes estimation, variational lower bound maximization, phase transition analysis.
result The vEB estimator is information theoretically optimal up to p=o(n2/3)p=o(n^{2/3}) but sub-optimal in higher dimensions.