Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,341 papers · 148 categories

Trend · papers per month

8152330 · Jun 202019922001200920182026
48 results for Sub-sampled Hessian

New methods for non-convex optimization using inexact Hessian approximations.

problem Optimization of non-convex functions with inexact Hessian information.
method Trust-region and cubic regularization methods with inexact Hessian approximations.
result Iteration complexity to achieve ε-approximate second-order optimality.

New optimization methods reduce computational complexity for large-scale problems.

problem Optimizing large sums of functions with high-dimensional parameters.
method Sub-sampling Hessian and gradient, using random matrix concentration and RandNLA.
result Locally Q-linear and Q-superlinear convergence rates for sub-sampled Newton methods.

A new optimization method for faster convergence.

problem Optimization problems, especially those involving self-concordant functions.
method Newton Sketch: approximate Newton step using randomly projected Hessian.
result Super-linear convergence with exponential probability for self-concordant functions.

Novel Newton method for large-scale kernel methods using random features.

problem Efficiently solving large-scale finite-sum minimization problems in RKHS.
method Randomized feature-based Newton method for empirical risk minimization.
result Local superlinear and global linear convergence of the method.

New insights into learning rates and batch sizes for neural networks using random matrix theory.

problem Understanding how batch size affects learning rates in neural networks.
method Random matrix theory applied to spiked, field-dependent random matrices.
result Analytical expressions for maximal learning rates as a function of batch size.

Active covariance estimation using random sub-sampling of variable subsets.

problem Estimating covariance matrices for partially observed random vectors.
method Unbiased covariance estimator under a model of partially observed variables and active learning framework.
result Derivation of error bounds revealing relations between sub-sampling probabilities and covariance matrix entries.

Paper analyzes Nyström regularization for time series forecasting with sequential sub-sampling.

problem Learning rate analysis of Nyström regularization for ττ-mixing time series.
method Banach-valued Bernstein inequality and integral operator approach for ττ-mixing sequences.
result Almost optimal learning rates for Nyström regularization with sequential sub-sampling.

LOUPE optimizes MRI sub-sampling patterns using machine learning.

problem Optimizing sub-sampling patterns for MRI scans to improve reconstruction accuracy.
method End-to-end learning strategy combining sub-sampling pattern optimization and reconstruction model training.
result LOUPE yields more accurate reconstructions compared to standard under-sampling schemes.

Efficient bandit exploration for various distributions without distribution-specific tuning.

problem Optimizing exploration in multi-armed bandit models for different distributions.
method Sub-sampling Duelling Algorithms (SDA) with Random Block sampling for efficient exploration.
result Achieves asymptotically optimal regret for Bernoulli, Gaussian, and Poisson distributions.

This study addresses the challenges of dynamic mini-batch sub-sampling in neural network training.

problem Challenges in training neural networks due to dynamic mini-batch sub-sampling.
method Distinguishes between static and dynamic sub-sampling, recasting optimization to find SNN-GPPs.
result SNN-GPPs are less susceptible to sub-sampling-induced discontinuities and better approximate true optima.

This paper shows using sub-sample estimates can improve optimization results in large-scale problems.

problem Large-scale optimization problems with uncertain parameters often lead to suboptimal solutions due to mis-specifications or extreme sample characteristics.
method The paper introduces the use of sub-sample estimates to reduce errors in stochastic optimization models, providing theoretical analysis and numerical examples.
result Sub-sample optimization can achieve improved results over full-sample solution estimates in large-scale problems.

The question of how to incorporate curvature information in stochastic approximation methods is challenging. The direct application of classical quasi- Newton updating techniques for deterministic optimization leads to noisy curvature estimates that have harmful effects on the robustness of the iteration. In this paper…

2014-01-27abs ↗pdf ↗

New method uses PDMPs with sub-sampling for efficient sampling from posterior distributions.

problem Efficient sampling from posterior distributions with limited data access.
method Approximate simulation of PDMPs with sub-sampling and stochastic gradient estimation.
result Stochastic-gradient PDMPs are efficient and robust compared to Langevin dynamics.

Efficiently estimate risk of large portfolios using MLMC and sub-sampling.

problem Estimating risk of large portfolios with high computational cost.
method Apply Multilevel Monte Carlo (MLMC) with adaptive inner sampling and sub-sampling strategy.
result Sub-sampling strategy reduces computational complexity without portfolio size increase.

New algorithm reduces Newton's method's per-iteration cost while maintaining similar convergence rates.

problem Minimizing a sum of functions over a convex set with large nn and pp.
method Sub-sampling and low-rank approximation for a randomized batch algorithm.
result Comparable convergence rate to Newton's method with much smaller per-iteration cost.

Paper introduces efficient online sub-sampling for RL with function approximation, reducing policy updates.

problem Efficiently managing computation complexity in RL with general function approximation.
method Online sub-sampling framework that measures information gain and guides exploration.
result Policy updates reduced to polylog(K)\propto\operatorname{poly}\log(K) times for near-optimal regret.

The Inverse Bagging Algorithm detects anomalies by identifying sub-samples rich in known data.

problem Detecting anomalies in data sets with a well-modeled process and an unknown PDF.
method Uses inverse bootstrap aggregating to identify sub-samples rich in the known process and classify events.
result The method avoids modifying the kinematic distributions of the well-modeled process.

Efficiently approximates statistical leverage scores for faster KRR.

problem Accurately estimating statistical leverage scores for fast KRR.
method Analytic formula for statistical leverage scores, leveraging kernel spectral density.
result Linear time approximation with theoretical guarantees, significantly faster than existing methods.

Adapts to high dimensions for estimating conditional moments.

problem Estimation and inference in high-dimensional settings with unknown intrinsic dimension.
method Sub-sampled kk-NN ZZ-estimator, adaptive data-driven sub-sampling.
result Estimation error of n1/(d+2)n^{-1/(d+2)} and asymptotic normality with n1/(d+2)n^{1/(d+2)} rate.

Improved MCMC for rare events in hidden Markov models.

problem Slow inference and prediction for rare latent states in hidden Markov models.
method Targeted sub-sampling (TASS) over-samples rare latent states, reducing variance in gradient estimation.
result Substantial gains in predictive and inferential accuracy on real and synthetic examples.

Bayesian realized EGARCH models improve tail risk forecasting.

problem Forecasting tail risks in financial markets.
method Developed a Bayesian framework for realized EGARCH models, incorporating multiple realized volatility measures and using robust adaptive Metropolis algorithm for estimation.
result Standardized skewed Student-t distribution and sub-sampled realized range models outperform other models in tail risk forecasting.

Bayesian realized-GARCH models forecast financial tail risks using two-sided Weibull distribution.

problem Forecasting financial tail risks in volatile markets.
method Adaptive Bayesian Markov Chain Monte Carlo for estimation and forecasting, incorporating sub-sampled realized range and variance.
result Realized-GARCH models with two-sided Weibull distribution outperform other models in tail risk forecasting.

End-to-end analysis of SGD for STL with adaptive sub-sampling.

problem Designing SGD for STL with statistical guarantees without prior knowledge of source quality.
method Mixed-sample SGD procedure that alternates between source and target data, maintaining transfer guarantees.
result Mixed-sample SGD converges to a target-adaptive solution with 1/T1/\sqrt{T} rate.

This paper extends Newton's method to distributed learning, avoiding saddle points and handling Byzantine workers.

problem Avoiding saddle points in distributed non-convex optimization, especially in the presence of Byzantine workers.
method Extends cubic-regularized Newton method to distributed framework, addressing communication bottlenecks and Byzantine attacks.
result The method achieves improved iteration complexity compared to first-order methods, with a 25% improvement in experiments.

Paper proposes an efficient bandit-based algorithm for hyperparameter optimization.

problem Efficiently evaluating hyperparameters in deep learning models with large search spaces.
method Sub-Sampling (SS) algorithm combined with Bayesian Optimization (BOSS).
result Theoretical proof of optimality and empirical validation of superior performance.

New criteria detect anomaly detection algorithms without labeled data.

problem Lack of labeled data for evaluating anomaly detection algorithms.
method Developed two new criteria based on Excess-Mass and Mass-Volume curves, and a feature sub-sampling methodology.
result Empirically validated new criteria outperform classical ROC and PR curves in non-labeled data scenarios.

A novel distributed adaptive NN classifier for large data sets.

problem Handling large and distributed data for efficient classification.
method Distributed adaptive nearest neighbor classifier with stochastic tuning parameter selection and early stopping rule.
result Achieves nearly optimal convergence rate under large sub-sample sizes.

The study proves that certain noncompact Hessian manifolds are diffeomorphic to R^n.

problem Characterizing complete noncompact Hessian manifolds with nonnegative Hessian sectional curvature.
method Using a geometric flow on noncompact affine Riemannian manifolds, constructing Hessian metrics, and proving diffeomorphism.
result Complete noncompact Hessian manifolds with nonnegative Hessian sectional curvature are diffeomorphic to R^n if their tangent bundle has maximal volume growth.

New Hessian estimates for heat equations on manifolds.

problem Estimating Hessian matrices for heat-type equations on Riemannian manifolds.
method Using Bismut-Stroock Hessian formula, with explicit coefficients and delay/growth rate functions.
result Novel backward weak Harnack inequality and precise pointwise Hessian estimates for eigenfunctions.

Characterizes and describes selfsimilar Hessian manifolds with homothetic vector fields.

problem Understanding the structure and properties of selfsimilar Hessian manifolds.
method Characterization and description of selfsimilar manifolds with homothetic vector fields.
result Any selfsimilar Hessian manifold with a potential homothetic vector field is locally isomorphic to a product of radiant Hessian manifolds.

This paper enhances stability selection by evaluating overall results robustness and identifying optimal regularization values.

problem Improving the robustness and reliability of high-dimensional variable selection.
method Developed a stability estimator to evaluate stability of stability selection results, calibrating key parameters.
result Identified optimal regularization value and improved stability of variable selection.