Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

95190285380 · Jun 202019922001200920172026
48 results for Quadratic approximation

Recently, deep learning has achieved huge successes in many important applications. In our previous studies, we proposed quadratic/second-order neurons and deep quadratic neural networks. In a quadratic neuron, the inner product of a vector of data and the corresponding weights in a conventional neuron is replaced with…

2018-07-31abs ↗pdf ↗

The paper debiases mini-batch approximations in deep learning for more accurate optimization and uncertainty quantification.

problem Bias in mini-batch approximations distorts the shape of quadratic approximations used in deep learning.
method Developed and evaluated debiasing strategies for mini-batch approximations.
result Debiasing strategies improve the accuracy of second-order optimization and uncertainty quantification in deep learning.

Closed-form polynomial approximations replace MLPs in transformers, enabling new interpretability methods.

problem Replacing MLPs with polynomial approximations for transformer models.
method Theoretical derivation of closed-form least-squares approximations of MLPs and GLUs using polynomial functions.
result Polynomial approximations explain over 95% of MLP and GLU outputs' variance, enabling interpretability.

The paper proves signatures of non-geometric rough paths can approximate functionals uniformly.

problem Approximating functionals of non-geometric rough paths.
method Extending rough paths with time and quadratic variation terms, proving uniform approximation.
result Linear functionals of extended signatures uniformly approximate continuous functionals.

QLA improves Bayesian uncertainty estimation for DNNs without increasing computational cost.

problem Overconfident out-of-distribution predictions from DNNs.
method Proposes Quadratic Laplace Approximation (QLA) to improve Bayesian uncertainty quantification.
result QLA yields modest yet consistent uncertainty estimation improvements over Linearized Laplace Approximation (LLA) on five regression datasets.

Market maker optimizes SPX and VIX spread using quadratic rough Heston model.

problem Maximizing profit from SPX and VIX spread while managing inventory risk.
method Uses quadratic rough Heston model to optimize multi-asset market making problem, approximating high-dimensional optimization.
result Asymptotic closed-form solution for optimization problem.

A new method automatically and dynamically sets learning rates in deep learning.

problem Determining the appropriate learning rate in deep learning tasks is challenging and often subjective.
method Local Quadratic Approximation (LQA) to automatically and dynamically set learning rates.
result The proposed method leads to nearly optimal learning rates in a computationally efficient way.

Method solves complex optimization problems with high probability bounds.

problem Nonlinear equality constrained stochastic optimization problems.
method Step-search sequential quadratic programming method.
result High-probability bound on iteration complexity for first-order stationarity.

New findings on kernel regression in the quadratic regime, improving understanding of machine learning models.

problem Understanding kernel ridge regression in the quadratic asymptotic regime.
method Extended study of kernel regression to the quadratic regime, establishing approximation bounds and spectral distributions.
result Broad class of inner-product kernels exhibit behavior similar to a quadratic kernel, with precise asymptotic training and test errors characterized.

New algorithm learns LQR with O(T)O(\sqrt{T}) regret using Langevin dynamics and excitation.

problem Learning LQR with a O(T)O(\sqrt{T}) regret bound.
method Thompson sampling with Langevin dynamics and excitation mechanism.
result Achieved O(T)O(\sqrt{T}) regret bound for LQR learning.

In the setting of exponential investors and uncertainty governed by Brownian motions we first prove the existence of an incomplete equilibrium for a general class of models. We then introduce a tractable class of exponential-quadratic models and prove that the corresponding incomplete equilibrium is characterized by a …

2013-10-10abs ↗pdf ↗

Paper uses Koopman operator and Nyström method for efficient nonlinear control.

problem Control of nonlinear dynamical systems.
method Combines Koopman operator framework with Nyström approximation for kernel methods.
result Theoretical guarantees on the convergence rates of the approximated Riccati operator and regulator objective.

A sampling-based optimization method for quadratic functions is proposed. Our method approximately solves the following nn-dimensional quadratic minimization problem in constant time, which is independent of nn: $z^*=\min_{\mathbf{v} \in \mathbb{R}^n}\langle\mathbf{v}, A \mathbf{v}\rangle + n\langle\mathbf{v}, \mathr…

2016-08-25abs ↗pdf ↗

We study the space of "link maps": the space of maps of a disjoint union of compact, closed manifolds P_1, . . ., P_k into a manifold N whose images are pairwise disjoint. We apply the manifold calculus of functors developed by Goodwillie and Weiss to study the difference between it and its linear and quadratic approxi…

2007-02-06abs ↗pdf ↗

New lower bounds improve logistic log-likelihood optimization and inference.

problem Designing computationally tractable lower bounds for logistic log-likelihoods.
method Developed a piece-wise quadratic lower bound that uniformly improves tangent quadratic minorizers.
result Improves the speed of convergence and accuracy of variational Bayes approximations.

QENDy learns quadratic dynamics from nonlinear systems data.

problem Identifying governing equations of highly nonlinear dynamical systems.
method QENDy embeds nonlinear dynamics into a quadratic feature space, requiring trajectory data and preselected basis functions.
result QENDy accurately identifies quadratic dynamics and outperforms SINDy and deep learning methods.

The Mean-Variance Criterion is equivalent to Second-order Stochastic Dominance under symmetric Elliptical distributions.

problem Determining the equivalence of Mean-Variance Criterion and Stochastic Dominance Criteria.
method Analyzing under symmetric and Skew-Elliptical distributions using Monte Carlo simulations.
result The Mean-Variance Criterion does not coincide with Second-order Stochastic Dominance for some types of risk-averse investors.

PDHAMS improves sampling for discrete distributions with quadratic potential functions.

problem Sampling discrete distributions efficiently and accurately.
method Integrates a second-order approximation of the potential function and uses Gaussian integral trick.
result PDHAMS yields superior performance compared to other methods.

Quadratic points of a surface in the projective 3-space are the points which can be exceptionally well approximated by a quadric. They are also singularities of a 3-web in the elliptic part and of a line field in the hyperbolic part of the surface. We show that generically the index of the 3-web at a quadratic point is…

2017-11-29abs ↗pdf ↗

We consider the problem of numerical approximation for forward-backward stochastic differential equations with drivers of quadratic growth (qgFBSDE). To illustrate the significance of qgFBSDE, we discuss a problem of cross hedging of an insurance related financial derivative using correlated assets. For the convergence…

2010-04-13abs ↗pdf ↗

Model liquidity premia using a risk-sharing economy with quadratic costs.

problem Understanding the cross-section of liquidity premia earned by assets with different trading costs.
method Developed a risk-sharing economy model with quadratic transaction costs, leading to matrix-valued Riccati equations for equilibrium.
result Calibrated model to time series data, revealing liquidity premia across assets with varying trading costs.

A new method improves adversarial robustness and interpretability with reduced training time.

problem Adversarial attacks on deep neural networks.
method A novel regularizer incorporating first and second order information via a quadratic approximation to the adversarial loss.
result Single iteration of the proposed regularizer achieves stronger robustness than prior methods.

Computable Stein discrepancies have been deployed for a variety of applications, ranging from sampler selection in posterior inference to approximate Bayesian inference to goodness-of-fit testing. Existing convergence-determining Stein discrepancies admit strong theoretical guarantees but suffer from a computational co…

2018-06-20abs ↗pdf ↗

This research proves that quadratic regularized optimal transport can approximate the Laplace-Beltrami operator on smooth manifolds.

problem Approximating the Laplace-Beltrami operator using optimal transport with quadratic regularization.
method Deriving first-order optimal potentials and analyzing the convergence of discrete Laplace operators.
result The discrete Laplace operators converge to the Laplace-Beltrami operator on smooth manifolds.