Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

5101520 · Jun 202019922001200920172026
48 results for Time-Averaged Log-Likelihood

A new MFG framework for evolving clusters from Gaussian mixtures.

problem Evolutionary clustering of time-dependent Gaussian mixtures.
method Control-theoretic framework based on Mean Field Games (MFG) with coupled HJB and Fokker-Planck systems.
result MFG dynamics recover classical EM algorithm trajectories with mass conservation.

We analyze the question whether sliding window time averages applied to stationary increment processes converge to a limit in probability. The question centers on averages, correlations, and densities constructed via time averages of the increment x(t,T)=x(t+T)-x(t)and the assumption is that the increment is distribute…

2008-04-06abs ↗pdf ↗

In modern portfolio theory, the balancing of expected returns on investments against uncertainties in those returns is aided by the use of utility functions. The Kelly criterion offers another approach, rooted in information theory, that always implies logarithmic utility. The two approaches seem incompatible, too loos…

2009-02-17abs ↗pdf ↗

Geometric Brownian motion (GBM) is a model for systems as varied as financial instruments and populations. The statistical properties of GBM are complicated by non-ergodicity, which can lead to ensemble averages exhibiting exponential growth while any individual trajectory collapses according to its time-average. A com…

2012-09-20abs ↗pdf ↗

Study mass transport in low-diffusivity using Lagrangian coordinates.

problem Mass preserving transport of passive tracers in low-diffusivity limit.
method Lagrangian coordinates, time-averaged diffusion equation, weighted manifold structure.
result Leading order asymptotics extend to dominant nontrivial singular value in low-diffusivity limit.

Paper proposes a mean-field gradient descent for zero-sum games, proving convergence to Nash equilibrium.

problem Finding mixed Nash equilibria in zero-sum games with multiple players.
method Mean-field gradient descent dynamics with time-averaging, incorporating exponentially discounted gradients.
result Exponential convergence rate to mixed Nash equilibrium with respect to total variation metric.

Since the pioneering work of Ghys, Langevin and Walczak among others, it has been known that several methods of dynamical systems theory can be adopted to study of foliations. Our aim in this paper is to investigate complexity of foliations, by generalising existence problem of time averages in dynamical systems theory…

2018-10-17abs ↗pdf ↗

Voluntary insurance contracts constitute a puzzle because they increase the expectation value of one party's wealth, whereas both parties must sign for such contracts to exist. Classically, the puzzle is resolved by introducing non-linear utility functions, which encode asymmetric risk preferences; or by assuming the p…

2015-07-16abs ↗pdf ↗

We provide a surprising new application of classical approximation theory to a fundamental asset-pricing model of mathematical finance. Specifically, we calculate an analytic value for the correlation coefficient between exponential Brownian motion and its time average, and we find the use of divided differences greatl…

2010-06-10abs ↗pdf ↗

The paper develops a new theory to understand deep learning optimization.

problem Understanding the dynamics of optimization in deep learning, especially in the edge of stability regime.
method Developed a central flow differential equation to describe the time-averaged trajectory of oscillatory optimizers.
result Central flows can predict long-term optimization trajectories with high numerical accuracy.

A new VIS approach improves log-likelihood estimation in latent variable models.

problem Challenges in achieving high log-likelihood with VI for complex posterior distributions.
method Uses forward χ2χ^2 divergence to optimize proposal distribution for better log-likelihood estimation.
result Consistently outperforms state-of-the-art baselines in log-likelihood and parameter estimation.

The Contrastive Divergence (CD) algorithm has achieved notable success in training energy-based models including Restricted Boltzmann Machines and played a key role in the emergence of deep learning. The idea of this algorithm is to approximate the intractable term in the exact gradient of the log-likelihood function b…

2016-03-17abs ↗pdf ↗

The Restricted Boltzmann Machines (RBM) can be used either as classifiers or as generative models. The quality of the generative RBM is measured through the average log-likelihood on test data. Due to the high computational complexity of evaluating the partition function, exact calculation of test log-likelihood is ver…

2015-10-08abs ↗pdf ↗

A resolution of the St. Petersburg paradox is presented. In contrast to the standard resolution, utility is not required. Instead, the time-average performance of the lottery is computed. The final result can be phrased mathematically identically to Daniel Bernoulli's resolution, which uses logarithmic utility, but is …

2010-11-19abs ↗pdf ↗

The paper introduces Robust Correlated Equilibrium for games with time-varying costs and proposes an algorithm to achieve it.

problem Games with time-varying costs and disturbances.
method Proposes Robust Correlated Equilibrium and a decentralized algorithm to learn optimal strategies.
result The algorithm converges to the Robust Correlated Equilibrium, showing no regret for each controller.

We explain SSL objectives as log-likelihoods in a data curation model.

problem Lack of understanding of SSL objectives as log-likelihoods.
method Formulate SSL objectives as a log-likelihood in a generative model of data curation.
result SSL methods can be understood as lower-bounds on a principled log-likelihood.

Maximum likelihood training improves the performance of score-based diffusion models.

problem Training score-based diffusion models with maximum likelihood.
method Trained by minimizing a weighted combination of score matching losses, with a specific weighting scheme that bounds negative log-likelihood.
result Maximum likelihood training improves the log-likelihood of score-based diffusion models across multiple datasets.

We present a rigorous study of the short maturity asymptotics for Asian options with continuous-time averaging, under the assumption that the underlying asset follows the Constant Elasticity of Variance (CEV) model. We present an analytical approximation for the Asian options prices which has the appropriate short matu…

2017-02-11abs ↗pdf ↗

This work evaluates deep generative models using RD curves, providing a more comprehensive quality assessment.

problem Quantitative evaluation of deep generative models is challenging, especially for implicit models.
method Proposes using rate distortion (RD) curves to evaluate and compare deep generative models, approximating the entire curve with similar computations to log-likelihood estimation.
result Approximating the entire RD curve provides a more comprehensive quality assessment than scalar-valued metrics.

A new method normalizes EBM training by introducing a learnable parameter.

problem Training energy-based models with maximum likelihood is challenging due to intractable normalisation constants.
method Proposes a self-normalised log-likelihood (SNL) objective that introduces a learnable parameter representing the normalisation constant.
result The SNL objective is a lower bound of the log-likelihood and can be directly optimised using stochastic gradient techniques.

Noise-Contrastive Estimation improves efficiency for estimating log-likelihood of complex point processes.

problem Estimating log-likelihood of complex multivariate point processes is computationally expensive.
method Noise-Contrastive Estimation adapted for multivariate point processes, with provable guarantees.
result Our method achieves similar log-likelihood with fewer evaluations and less time.

In this work, a deep learning-based method for log-likelihood ratio (LLR) lossy compression and quantization is proposed, with emphasis on a single-input single-output uncorrelated fading communication setting. A deep autoencoder network is trained to compress, quantize and reconstruct the bit log-likelihood ratios cor…

2019-03-11abs ↗pdf ↗

Flow-based generative models (Dinh et al., 2014) are conceptually attractive due to tractability of the exact log-likelihood, tractability of exact latent-variable inference, and parallelizability of both training and synthesis. In this paper we propose Glow, a simple type of generative flow using an invertible 1x1 con…

2018-07-09abs ↗pdf ↗

The MAP estimate's log-likelihood sub-optimality is hard to bound in general.

problem Bounding the expected log-likelihood sub-optimality of MAP for exponential families.
method Interpreting MAP as stochastic mirror descent and analyzing convergence rates.
result Current convergence results do not apply to standard examples of exponential families.

In this article we use rate-distortion theory, a branch of information theory devoted to the problem of lossy compression, to shed light on an important problem in latent variable modeling of data: is there room to improve the model? One way to address this question is to find an upper bound on the probability (equival…

2019-04-12abs ↗pdf ↗

The log-likelihood loss in heteroscedastic neural networks can lead to poor parameter estimates.

problem Capturing aleatoric uncertainty in deep learning models.
method Examine the log-likelihood loss in conjunction with gradient-based optimizers and propose an alternative formulation, ββ-NLL.
result Using an appropriate ββ largely mitigates the issue of poor parameter estimates.