Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,932 papers · 148 categories

Trend · papers per month

161321482642 · Jun 202019922001200920172026
48 results for second-order variational analysis

The paper explores parabolic regularity in geometric variational analysis.

problem Developing calculus rules and computation formulas for second-order generalized differential constructions.
method Introducing and applying the concept of parabolic regularity to geometric aspects of second-order variational analysis.
result Established new calculus rules and computation formulas for second-order generalized differential constructions.

Paper shows no spurious local minima in a specific matrix factorization problem.

problem Optimization of 1\ell_1-norm rank-one symmetric matrix factorization.
method Second-order variational analysis to study the landscape of the problem.
result Any second-order stationary point is globally optimal.

New analysis shows Bayesian model averaging is suboptimal under misspecification.

problem Generalization performance of Bayesian model averaging under model misspecification.
method Novel second-order PAC-Bayes bounds to analyze generalization performance.
result New Bayesian-like algorithms with better generalization performance.

Paper improves particle variational inference by optimizing generalization error bound.

problem Improving the diversity of models in particle variational inference to enhance generalization.
method Develops a new second-order Jensen inequality with a repulsion term based on the loss function, leading to a tighter generalization error bound.
result The proposed PVI optimizes the generalization error bound directly, improving performance compared to existing methods.

Schwarzian derivative connects to Euler-Lagrange equations in variational calculus.

problem Understanding the relationship between the Schwarzian derivative and variational equations.
method Analyzing the Schwarzian derivative as a first integral and Euler-Lagrange operator for specific variations.
result The Schwarzian derivative is both a first integral and the Euler-Lagrange operator for a certain class of variations.

Systems of ordinary differential equations (or dynamical forms in Lagrangian mechanics), induced by embeddings of smooth fibered manifolds over one-dimensional basis, are considered in the class of variational equations. For a given non-variational system, conditions assuring variationality (the Helmholtz conditions) o…

2017-09-22abs ↗pdf ↗

In the recent years, Riemannian shape analysis of curves and surfaces has found several applications in medical image analysis. In this paper we present a numerical discretization of second order Sobolev metrics on the space of regular curves in Euclidean space. This class of metrics has several desirable mathematical …

2015-06-29abs ↗pdf ↗

Stein variational gradient descent (SVGD) was recently proposed as a general purpose nonparametric variational inference algorithm [Liu & Wang, NIPS 2016]: it minimizes the Kullback-Leibler divergence between the target distribution and its approximation by implementing a form of functional gradient descent on a reprod…

2018-06-08abs ↗pdf ↗

The quantification of diversification benefits due to risk aggregation plays a prominent role in the (regulatory) capital management of large firms within the financial industry. However, the complexity of today's risk landscape makes a quantifiable reduction of risk concentration a challenging task. In the present pap…

2009-10-13abs ↗pdf ↗

Paper examines risk measure expansions under FGM dependence, improving accuracy at extreme levels.

problem Capturing higher-order tail behavior and dependence effects in risk measures.
method Second-order asymptotic expansions using extreme value theory and regular variation theory.
result Second-order approximations reduce approximation errors, especially at extreme confidence levels.

We propose a second-order (Hessian or Hessian-free) based optimization method for variational inference inspired by Gaussian backpropagation, and argue that quasi-Newton optimization can be developed as well. This is accomplished by generalizing the gradient computation in stochastic backpropagation via a reparametriza…

2015-09-09abs ↗pdf ↗

The article concerns the problem if a~given system of differential equations is identical with the Euler--Lagrange system of an~appropriate variational integral. Elementary approach is applied. The main results involve the determination of the first--order variational integrals related to the second--order Euler--Lagra…

2014-08-24abs ↗pdf ↗

Second-order optimizers retain residual information after data deletion, affecting machine unlearning.

problem Residual information in second-order optimizers after data deletion.
method Comparison of first-order and second-order learners, eigendecomposition analysis.
result Second-order optimizers retain residual information, not detectable by first-order analysis.

The elastica is a curve in R3\R^3 that is stationary under variations of the integral of the square of the curvature. Elastica is viewed as a dynamical system that arises from the second order calculus of variations, and its quantization is discussed.

2015-07-06abs ↗pdf ↗

Derives formulae for general permutation equivariant layers and presents a second order graph variational encoder.

problem Tackles the limitation of previous equivariant neural networks by considering permutations of matrices.
method Derives formulae for general permutation equivariant layers, including matrix permutations. Presents a second order graph variational encoder.
result Latent distribution of equivariant generative models must be exchangeable.

New variational model preserves image contrasts and features using Weingarten map minimization.

problem Image reconstruction with preservation of contrasts and features.
method Variational model with L1L^1 norm of Weingarten map, ADMM algorithm, gradient descent.
result The proposed models preserve image contrasts and features efficiently.

The paper explores solving inverse problems for ODEs with and without constraints.

problem Understanding when second order ODEs can represent Lagrangian models with or without constraints.
method Geometric techniques to address the inverse problem for both constrained and unconstrained systems of second order ODEs.
result The constrained case presents more ambiguities and complexities than the unconstrained one.

Geometric framework analyzes bias in variational inference for posterior functionals.

problem Analyzing the bias of posterior functionals under variational approximations.
method Developed a geometric framework to evaluate the bias of posterior functionals using the variational tangent space.
result The leading-order bias of a posterior functional is determined by its component orthogonal to the variational tangent space.

It is proved that the set of geodesic circles in two dimensions may be given a variational description and the explicit form of it is presented. In the limit case of the Euclidean geometry a certain claim of uniqueness of such description is proved. A formal notion of 'spin' force is discovered as a by-product of the v…

2014-07-23abs ↗pdf ↗

New framework explains deep neural networks using variational spline theory.

problem Understanding functions learned by deep neural networks.
method Developed a variational framework and function space.
result Deep ReLU networks are solutions to regularized data fitting problems over the proposed function space.

We show how the homogeneous variational bicomplex provides a useful formalism for describing a number of properties of single-integral variational problems, and we introduce a subsequence of one of the rows of the bicomplex which is locally exact with respect to the variational derivative. We are therefore able to reco…

2006-12-20abs ↗pdf ↗

A first-order model for a stock market assigns to each stock a return parameter and a variance parameter that depend only on the rank of the stock. A second-order model assigns these parameters based on both the rank and the name of the stock. First- and second-order models exhibit stability properties that make them a…

2013-02-15abs ↗pdf ↗

Paper uses second-order differential geometry to study stochastic mechanics.

problem Stochastic differential equations and their symmetries.
method Develops second-order differential geometry to study symmetries of SDEs and constructs stochastic mechanics.
result Establishes stochastic Lagrangian and Hamiltonian mechanics and their relations with HJB equations.

In this paper, we study a second order variational problem for locally convex hypersurfaces, which is the affine invariant analogue of the classical Plateau problem for minimal surfaces. We prove existence, regularity and uniqueness results for hypersurfaces maximizing affine area under appropriate boundary conditions.

2004-05-28abs ↗pdf ↗

Second-order guarantees for federated learning algorithms.

problem Non-convex optimization in federated learning with saddle-points as bottlenecks.
method Drawing on recent results on second-order optimality in centralized and decentralized settings, establish second-order guarantees for federated learning algorithms.
result Established second-order guarantees for federated learning algorithms.

Unified kernel framework extends to stochastic systems, improving numerical stability.

problem Extending kernel methods to stochastic dynamical systems with diffusion.
method Unified kernel framework, Feynman-Kac path-integral representations, collocation-based computational framework.
result Kernel equivalence under uniform ellipticity assumptions and improved numerical stability with moderate diffusion.

We introduce a class of maps from an affine flat into a Riemannian manifold that solve an elliptic system defined by the natural second order elliptic operator of the affine structure and the nonlinear Riemann geometry of the target. These maps are called affine harmonic. We show an existence result for affine harmonic…

2009-02-15abs ↗pdf ↗

Motivated by applications in computational anatomy, we consider a second-order problem in the calculus of variations on object manifolds that are acted upon by Lie groups of smooth invertible transformations. This problem leads to solution curves known as Riemannian cubics on object manifolds that are endowed with norm…

2011-12-29abs ↗pdf ↗