In this paper, we investigate the popular deep learning optimization routine, Adam, from the perspective of statistical moments. While Adam is an adaptive lower-order moment based (of the stochastic gradient) method, we propose an extension namely, HAdam, which uses higher order moments of the stochastic gradient. Our …
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “Higher Order Moments”
Improved GAN performance using higher-order Wasserstein moments.
problem Stabilizing and enhancing GANs for better mode coverage and stability.
method Deriving and training a GAN with a modified Wasserstein distance using higher-order moments.
result Training a GAN with higher-order Wasserstein moments improves performance, even with increased computational cost.
Paper tackles stochastic control with mean and higher-order moments, finding Nash equilibria.
problem Time-inconsistent stochastic control problems with mean and higher-order moments.
method Developed closed-loop and open-loop Nash equilibrium controls using PDEs and maximum principles.
result Identical closed-loop and open-loop Nash equilibria controls, independent of state value and random path.
Paper tackles non-convex optimization for higher moments in portfolio management.
problem Complexity of higher moments in optimization problems.
method Method of successive convex approximation.
result Solves mean-variance-skewness problem using non-convex optimization.
The paper examines higher moments in insurance, focusing on coskewness and its impact on actuarial quantities.
problem The impact of higher-order moments on actuarial applications, particularly expected shortfall and life annuity valuation.
method Derives analytical bounds for mixed moments under unspecified dependence structure, applies copula-based mixture model.
result Coskewness and odd-order mixed moments exhibit a monotonic relationship with expected shortfall and annuity premiums.
Sharp inequalities in unit ball with constraints on moments.
problem Establishing Sobolev trace inequalities with constraints.
method Constructing smooth test functions for higher order moments.
result Almost optimal Sobolev trace inequalities for 2nd and 4th orders.
The moments of spatial probabilistic systems are often given by an infinite hierarchy of coupled differential equations. Moment closure methods are used to approximate a subset of low order moments by terminating the hierarchy at some order and replacing higher order terms with functions of lower order ones. For a give…
Paper characterizes equilibrium strategies for stochastic control with higher-order moments.
problem Stochastic control problems with higher-order moments.
method Novel characterization of time-consistent control problems, deriving equilibrium conditions via BSDEs.
result Derives sufficient and necessary conditions for an open-loop Nash equilibrium control (ONEC) in a novel way.
Paper provides Edgeworth expansions for network moments, improving accuracy of sampling distributions.
problem Accurate descriptions of sampling distributions of network moment statistics.
method Edgeworth expansion applied to studentized network moment statistics.
result Higher-order accurate approximation to sampling CDF of network moment statistics.
New proof of Sobolev inequality with constraints on sphere.
problem Improving Sobolev inequality on sphere with constraints.
method Careful study of extremal problem on sphere.
result Explicit determination of constant in second order moments case.
Paper proposes an efficient algorithm to handle high-order portfolio moments.
problem Designing portfolios with high-order moments (skewness and kurtosis) is computationally challenging.
method Proposes a SCA algorithm framework for solving high-order portfolios efficiently.
result Demonstrates the efficiency of the proposed algorithm through numerical experiments.
Betas are possibly the most frequently applied tool to analyze how securities relate to the market. While in very widespread use, betas only express dynamics derived from second moment statistics. Financial returns data often deviate from normal assumptions in the sense that they have significant third and fourth order…
Paper examines risk measure expansions under FGM dependence, improving accuracy at extreme levels.
problem Capturing higher-order tail behavior and dependence effects in risk measures.
method Second-order asymptotic expansions using extreme value theory and regular variation theory.
result Second-order approximations reduce approximation errors, especially at extreme confidence levels.
The paper improves CR Sobolev inequalities and classifies minimizers.
problem Higher-order CR Sobolev inequalities on the CR sphere.
method Improvement through vanishing higher order moments of the volume element.
result New direct proof of minimizers' classification and existence of minimizers in .
New invariants detect Fano varieties' K-stability.
problem Detecting K-stability in Fano varieties.
method Introducing valuative invariants based on higher moments.
result Can detect K-stability of Fano varieties.
Approximates discounted moments for financial products using polynomial expansions.
problem Approximating discounted moments of stochastic processes for financial applications.
method High-order power series expansion of the infinitesimal generator.
result Error decreases to around 10 to 100 times machine precision for higher orders.
New method quantifies uncertainty in denoising models.
problem Uncertainty quantification in denoising models.
method Derives a relation between posterior moments and derivatives, uses it for efficient uncertainty quantification.
result Efficient computation of principal components and full marginal distributions of the posterior.
The learning of domain-invariant representations in the context of domain adaptation with neural networks is considered. We propose a new regularization method that minimizes the discrepancy between domain-specific latent feature representations directly in the hidden activation space. Although some standard distributi…
Framework predicts nonlinear system responses using GFDT and generative models.
problem Predicting higher-order moments of nonlinear stochastic systems to small perturbations.
method Combining GFDT with generative modeling to estimate score function directly from data.
result Accurately captures nonlinear and non-Gaussian features of system responses.
Learning rate needs to decrease with higher data moments for effective ICA in high dimensions.
problem Slower convergence of ICA in high-dimensional data with high-order moments.
method High-dimensional ODE analysis of ICA algorithm under controlled moment structure.
result Critical learning rate threshold for effective ICA when moments are high.
Proposes DWMD for better matching of hidden representations across domains.
problem Measuring data distribution discrepancy between semantically related domains for feature representation matching.
method DWMD, a moment-based probability distribution metric that explicitly orders and weights higher-order moments.
result DWMD is error-free and can strictly reflect distribution differences without feature distribution assumptions.
A classical result of Aubin states that the constant in Moser-Trudinger-Onofri inequality on can be imporved for furnctions with zero first order moments of the area element. We generalize it to higher order moments case. These new inequalities bear similarity to a sequence of Lebedev-Milin type inequa…
Yau's Affine-Normal Descent for Large-Scale Unrestricted Higher-Moment Portfolio Optimizationq-fin.PM
Algorithm tackles large-scale portfolio optimization with higher moments, improving computational efficiency.
problem Optimizing portfolios with higher moments (variance, skewness, kurtosis) for large asset universes is computationally infeasible.
method Developed a structure-exploiting algorithm based on Yau's affine-normal descent, working directly with return matrix.
result Algorithm avoids explicit higher-order tensors and exploits quartic structure for efficient computation.
Optimizes mixture models without parametrizing distributions using tensor decomposition.
problem Estimating conditionally-independent mixture models in high dimensions.
method Alternating least squares optimization scheme for tensor decomposition.
result Competitive performance and applicability to various models and applications.
Spectral learning extends matrix methods to tensors for better latent variable modeling.
problem Limitations of matrix-based spectral methods in capturing non-Gaussian data.
method Extend spectral decomposition to tensor-based methods for higher-order moments.
result Tensor decomposition can identify latent effects missed by matrix methods.
Study on martingale property and moment explosions in signature volatility models.
problem Analyzing the martingale property and moment explosions in signature volatility models.
method Fine analysis of the explosion time of a signature stochastic differential equation.
result The price process is a true martingale if and only if the order of the linear form is odd and a correlation parameter is negative.
Expectation Propagation (EP) provides a framework for approximate inference. When the model under consideration is over a latent Gaussian field, with the approximation being Gaussian, we show how these approximations can systematically be corrected. A perturbative expansion is made of the exact but intractable correcti…
The paper classifies various higher moments portfolio optimization methods.
problem Optimizing portfolios with higher moments like skewness and kurtosis.
method Review of different optimization paradigms including utility and multi-objective approaches.
result Comparison of advantages and disadvantages of various methods.
Many nonlinear extensions of the Kalman filter, e.g., the extended and the unscented Kalman filter, reduce the state densities to Gaussian densities. This approximation gives sufficient results in many cases. However, this filters only estimate states that are correlated with the observation. Therefore, sequential esti…
A perturbative approach is used to derive approximations of arbitrary order to estimate high percentiles of sums of positive independent random variables that exhibit heavy tails. Closed-form expressions for the successive approximations are obtained both when the number of terms in the sum is deterministic and when it…
Study improves BN TTA under distribution shift using higher-order asymptotics.
problem Improving BN TTA for changing data distributions.
method Integrates Edgeworth expansion and saddlepoint approximation with one-step M-estimation.
result Derives optimal weighting parameter for minimized mean-squared error.
We develop and implement a novel fast bootstrap for dependent data. Our scheme is based on the i.i.d. resampling of the smoothed moment indicators. We characterize the class of parametric and semi-parametric estimation problems for which the method is valid. We show the asymptotic refinements of the proposed procedure,…
The hidden tail of empirical distributions is analyzed using extreme value theory.
problem Understanding the bias between in-sample mean and true statistical mean for large .
method Extreme value theory applied to empirical distributions and their moments.
result The hidden moment of order 0 for power law distributions follows an exponential distribution with expectation .
Realized moments of higher order computed from intraday returns are introduced in recent years. The literature indicates that realized skewness is an important factor in explaining future asset returns. However, the literature mainly focuses on the whole market and on the monthly or weekly scale. In this paper, we cond…
Waiting time analysis of foreign currency exchange rates: Beyond the renewal-reward theoremphysics.data-an
We evaluate the average waiting time between observing the price of financial markets and the next price change, especially in an on-line foreign exchange trading service for individual customers via the internet. Basic technical idea of our present work is dependent on the so-called renewal-reward theorem. Assuming th…
In the first part of the paper, comprising section 1 through 6, we introduce a sequence of functions in the tangent bundle TM of any smooth two-dimensional manifold M with smooth Riemannian metric g that correspond to the higher order Schwarzians of the linearized geodesic flow. With these functions and a classical the…
The paper introduces moment multicalibration for estimating uncertainty across subgroups.
problem Ensuring fairness and accurate uncertainty estimation in predictions across different subgroups.
method Develops a method for multicalibration of higher moments, enabling point predictions and interval estimation.
result Moment multicalibration allows for valid prediction intervals that are fair across various subgroups.
A method to estimate high order derivatives of data distributions from samples.
problem Estimating high order derivatives of data distributions efficiently and accurately.
method Generalizing denoising score matching via Tweedie's formula to estimate higher order derivatives.
result Models trained with the proposed method can approximate second order derivatives more efficiently and accurately than via automatic differentiation.
Hedging strategies and minimal variance portfolios for European and exotic options in a Levy marketq-fin.PM
This paper presents hedging strategies for European and exotic options in a Levy market. By applying Taylor's Theorem, dynamic hedging portfolios are con- structed under different market assumptions, such as the existence of power jump assets or moment swaps. In the case of European options or baskets of European optio…
Double machine learning provides -consistent estimates of parameters of interest even when high-dimensional or nonparametric nuisance parameters are estimated at an rate. The key is to employ Neyman-orthogonal moment equations which are first-order insensitive to perturbations in the nuisance param…
Study shows different types of volatility and skewness changes affect stock prices.
problem Different types of volatility and skewness changes affect stock prices.
method Used intraday data for individual stocks to analyze cross-section of asset returns.
result Idiosyncratic transitory and persistent shocks to volatility and skewness are priced differently in stock returns.
Homotopy moment mapsmath.DG
Associated to any manifold equipped with a closed form of degree >1 is an `L-infinity algebra of observables' which acts as a higher/homotopy analog of the Poisson algebra of functions on a symplectic manifold. In order to study Lie group actions on these manifolds, we introduce a theory of homotopy moment maps. Such a…
We introduce features for massive data streams. These stream features can be thought of as "ordered moments" and generalize stream sketches from "moments of order one" to "ordered moments of arbitrary order". In analogy to classic moments, they have theoretical guarantees such as universality that are important for lea…
Parametric Risk Parityq-fin.RM
Any optimization algorithm based on the risk parity approach requires the formulation of portfolio total risk in terms of marginal contributions. In this paper we use the independence of the underlying factors in the market to derive the centered moments required in the risk decomposition process when the modified vers…
Roy's `Safety First' criterion for selecting one risky asset from many is adapted to the case of non-normal returns, via Cornish Fisher expansion. The resulting investment objective is consistent with first order stochastic dominance, and is equal to the Sharpe ratio for the case of normal returns. An investor selectin…
Moment Pooling reduces latent space dimensions in machine learning models.
problem High-dimensional latent spaces in machine learning models are hard to interpret.
method Moment Pooling extends Deep Sets networks to arbitrary multivariate moments.
result Latent dimensions as small as 1 can achieve similar performance to higher dimensions.
Second-order estimator improves continuous-time policy evaluation.
problem Estimating value surfaces from discrete data with time-inhomogeneous dynamics.
method Moment-matching coefficients for high-order generator regression.
result Second-order estimator consistently outperforms Bellman baseline.
We consider the dynamics of a linear stochastic approximation algorithm driven by Markovian noise, and derive finite-time bounds on the moments of the error, i.e., deviation of the output of the algorithm from the equilibrium point of an associated ordinary differential equation (ODE). We obtain finite-time bounds on t…