Two new algorithms improve federated optimization under second-order similarity.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Most of the existing approaches focus on specific visual tasks while ignoring the relations between them. Estimating task relation sheds light on the learning of high-order semantic concepts, e.g., transfer learning. How to reveal the underlying relations between different visual tasks remains largely unexplored. In th…
New characterization of second-order stochastic dominance with applications in risk management.
The aim of this paper is twofold. First, we extend the results of [33] concerning the existence and uniqueness of second-order reflected 2BSDEs to the case of two obstacles. Under some regularity assumptions on one of the barriers, similar to the ones in [10], and when the two barriers are completely separated, we prov…
We construct, for a second-order homogeneous Lagrangian in two independent variables, a differential 2-form with the property that it is closed precisely when the Lagrangian is null. This is similar to the property of the 'fundamental Lepage equivalent' associated with first-order Lagrangians defined on jets of section…
Bandit algorithms have been predominantly analyzed in the convex setting with function-value based stationary regret as the performance measure. In this paper, motivated by online reinforcement learning problems, we propose and analyze bandit algorithms for both general and structured nonconvex problems with nonstation…
The paper studies connections in superintegrable systems, revealing geometric insights.
A new method for pricing options with stochastic volatility and jumps.
In this paper we study a class of physical systems that combine a finite number of mechanical and thermodynamic observables. We call them finite dimensional thermo-mechanical systems. We introduce these systems by means of simple examples. The evolution equations of the involved observables are obtained in each example…
Fractal Lipschitz-Killing curvature measures C^f_k(F,.), k = 0, ..., d, are determined for a large class of self-similar sets F in R^d. They arise as weak limits of the appropriately rescaled classical Lipschitz-Killing curvature measures C_k(F_r,.) from geometric measure theory of parallel sets F_r for small distances…
In our previous works, we introduced, for each (super)manifold, a commutative algebra of densities. It is endowed with a natural invariant scalar product. In this paper, we study geometry of differential operators of second order on this algebra. In the more conventional language they correspond to certain operator pen…
We analyze stochastic gradient algorithms for optimizing nonconvex problems. In particular, our goal is to find local minima (second-order stationary points) instead of just finding first-order stationary points which may be some bad unstable saddle points. We show that a simple perturbed version of stochastic recursiv…
We consider a fourth order partial differential equation in n-dimensional space introduced by Abreu in the context of Kähler metrics on toric orbifolds. Similarity solutions depending only on the radial coordinate in R^n are determined in terms of a second order ordinary differential equation. A local asymptotic analys…
New method provides tighter robustness guarantees for adversarial attacks.
Single-site Markov Chain Monte Carlo (MCMC) is a variant of MCMC in which a single coordinate in the state space is modified in each step. Structured relational models are a good candidate for this style of inference. In the single-site context, second order methods become feasible because the typical cubic costs assoc…
Large-scale distributed training of deep neural networks suffer from the generalization gap caused by the increase in the effective mini-batch size. Previous approaches try to solve this problem by varying the learning rate and batch size over epochs and layers, or some ad hoc modification of the batch normalization. W…
Investor optimizes wealth in a market with non-traded endowment, deriving expansions up to second order.
Derives a new formula for optimal stopping problems with exploding derivatives.
We present the Variational Adaptive Newton (VAN) method which is a black-box optimization method especially suitable for explorative-learning tasks such as active learning and reinforcement learning. Similar to Bayesian methods, VAN estimates a distribution that can be used for exploration, but requires computations th…
New insights on pruning deep networks by preserving function locality.
This work addresses the {\em singularity formation} of complete non-compact solutions to the conformally flat Yamabe flow whose conformal factors have {\em cylindrical behavior at infinity}. Their singularity profiles happen to be {\em Yamabe solitons}, which are {\em self-similar solutions} to the fast diffusion equat…
Factorization machines (FMs) are a supervised learning approach that can use second-order feature combinations even when the data is very high-dimensional. Unfortunately, despite increasing interest in FMs, there exists to date no efficient training algorithm for higher-order FMs (HOFMs). In this paper, we present the …
We prove that any planar 4-web defines a unique projective structure in the plane in such a way that the leaves of the foliations are geodesics of this projective structure. We also find conditions for the projective structure mentioned above to contain an affine symmetric connection, and conditions for a planar 4-web …
We consider dynamic sublinear expectations (i.e., time-consistent coherent risk measures) whose scenario sets consist of singular measures corresponding to a general form of volatility uncertainty. We derive a càdlàg nonlinear martingale which is also the value process of a superhedging problem. The superhedging strate…
Second-order economic theory considers new variables to improve price volatility predictions.
Second-order optimizers retain residual information after data deletion, affecting machine unlearning.
Exact second-order optimization for deep learning reduces computational cost and improves performance.
SOLBP extends efficient inference to uncertain Bayesian networks.
Developed a theory of local convexity for second order differential equations on Lie algebroids.
We analyze geometry of the second order differential operators, having in mind applications to Batalin--Vilkovisky formalism in quantum field theory. As we show, an exhaustive picture can be obtained by considering pencils of differential operators acting on densities of all weights simultaneously. The algebra of densi…
Paper examines risk measure expansions under FGM dependence, improving accuracy at extreme levels.
Negative step sizes improve second-order methods for neural networks.
Simplified argument for second order estimate in quaternionic Calabi-Yau problem.
Paper studies second order tail probabilities in risk models.
A dynamical system on the total space of the fibre bundle of second order accelerations, , is defined as a third order vector field on , called semispray, which is mapped by the second order tangent structure into one of the Liouville vector field. For a regular Lagrangian of second order we prove that …
Paper studies second order symmetric parallel tensors in generalized f.pk-space forms.
We define Cayley structures as a field of Cayley's ruled cubic surfaces over a four dimensional manifold and motivate their study by showing their similarity to indefinite conformal structures and their link to differential equations. In particular, for Cayley structures an extension of certain notions defined for inde…
We derive a second-order ordinary differential equation (ODE) which is the limit of Nesterov's accelerated gradient method. This ODE exhibits approximate equivalence to Nesterov's scheme and thus can serve as a tool for analysis. We show that the continuous time ODE allows for a better understanding of Nesterov's schem…
The paper proposes a GP-based method for discovering second-order particle dynamics models.
Paper generalizes connections between Lie groups and affine connections.
In this present paper, we study geometric structures of rank two prolongations of implicit second-order partial differential equations (PDEs) for two independent and one dependent variables and characterize the type of these PDEs by the topology of fibers of the rank two prolongations. Moreover, by using properties of …
For incomplete sub-Riemannian manifolds, and for an associated second-order hypoelliptic operator, which need not be symmetric, we identify two alternative conditions for the validity of Gaussian-type upper bounds on heat kernels and transition probabilities, with optimal constant in the exponent. Under similar conditi…
In this paper, we study stochastic non-convex optimization with non-convex random functions. Recent studies on non-convex optimization revolve around establishing second-order convergence, i.e., converging to a nearly second-order optimal stationary points. However, existing results on stochastic non-convex optimizatio…
AdamQLR optimizes Adam with K-FAC heuristics, achieving comparable performance to tuned benchmarks.
The quantification of diversification benefits due to risk aggregation plays a prominent role in the (regulatory) capital management of large firms within the financial industry. However, the complexity of today's risk landscape makes a quantifiable reduction of risk concentration a challenging task. In the present pap…
We show that, for mechanical system with external forces, the equations of deviations of solution curves of the corresponding Lagrange equations,determine a nonlinear connection on the second order osculator (second order tangent) bundle. In particular, Jacobi equations in Finsler and Riemann spaces determine such a no…
Efficient Bayesian FL method improves predictive accuracy and uncertainty estimates.
A first-order model for a stock market assigns to each stock a return parameter and a variance parameter that depend only on the rank of the stock. A second-order model assigns these parameters based on both the rank and the name of the stock. First- and second-order models exhibit stability properties that make them a…