Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,932 papers · 148 categories

Trend · papers per month

230459689918 · Jun 202019922001200920172026
48 results for discrete normalized advantage functions

DNAF accelerates DQL for efficient resource allocation in network slicing.

problem Efficient resource allocation in network slicing with varying demands.
method Introduced discrete normalized advantage functions (DNAF) into DQL, using a k-nearest neighbor algorithm for discrete action space.
result DNAF-based DQL converges faster through simulations.

DIF extends NF with stochastic discrete latent variables for better density estimation.

problem Improving density estimation with discontinuities and fine details.
method Discretely indexed flows as an extension of Normalizing Flows with stochastic latent variables.
result DIF inherit good computational behavior of NF and can capture distributions with discontinuities.

The paper analyzes the randomized midpoint method for Langevin diffusions, revealing biases and asymptotic properties.

problem Analyzing biases and asymptotic properties of the randomized midpoint method for Langevin diffusions.
method Characterization of stationary distribution and asymptotic normality for numerical integration.
result The step-size needs to go to zero for the method to be asymptotically unbiased.

New formulae identify discrete probability laws without needing normalization constants.

problem Characterizing non-normalized discrete probability distributions.
method Derive explicit formulae for mass functions using Stein's method.
result Developed tools for solving statistical problems without normalization constants.

A new method reparameterizes Gaussian noise for better flexibility and performance.

problem Improving the Gumbel-Softmax for better flexibility and performance.
method Invertible Gaussian Reparameterization (IGR) using modified softmax and transformations.
result IGR outperforms Gumbel-Softmax in various experiments.

The paper develops approximations for Pearson's chi-square statistic and applies them to confidence intervals.

problem Finding confidence intervals for strictly convex functions of discrete distribution weights.
method Non-asymptotic local normal approximation for multinomial probabilities, deriving bounds and coupling inequalities.
result Developed methods to find confidence intervals for negative entropy of discrete distributions.

A new method for discrete data normalizing flows using latent transformations.

problem Challenges in parameterizing bijective transformations for discrete data.
method Predict a distribution over latent transformations to make the marginal likelihood differentiable.
result Discrete-data normalizing flows can be trained using gradient-based learning with unbiased score function estimation.

Inspired by the Weierstrass representation of smooth affine minimal surfaces with indefinite metric, we propose a constructive process producing a large class of discrete surfaces that we call discrete affine minimal surfaces. We show that they are critical points of an affine area functional defined on the space of qu…

2008-03-10abs ↗pdf ↗

simpcomp is an extension to GAP, the well known system for computational discrete algebra. It allows the user to work with simplicial complexes. In the latest version, support for simplicial blowups and discrete normal surfaces was added, both features unique to simpcomp. Furthermore, new functions for constructing cer…

2011-05-26abs ↗pdf ↗

New algorithm learns value and advantage functions for continuous-time Markov processes without structural assumptions.

problem Learning value and advantage functions for continuous-time Markov processes without structural assumptions.
method Proposes Sobolev-prox fitted qq-learning algorithm based on Hilbert-space positive definiteness and boundedness properties of Bellman operators.
result Identifies ellipticity as a key structural property enabling reinforcement learning for Markov diffusions.

Flow based models such as Real NVP are an extremely powerful approach to density estimation. However, existing flow based models are restricted to transforming continuous densities over a continuous input space into similarly continuous distributions over continuous latent variables. This makes them poorly suited for m…

2019-03-18abs ↗pdf ↗

Paper develops Bayesian inference for discrete-choice mnp models with Gaussian priors.

problem Estimating parameters of discrete-choice multinomial probit models with Gaussian priors.
method Adapts Fasano and Durante's results to a specific mnp model with zero mean and independent Gaussian priors, simplifying posterior distribution parameters and providing a new variational algorithm.
result Simplified expressions for posterior distribution parameters and a novel variational algorithm.

SGD converges to critical points of normalized margin in late-stage training for homogeneous neural networks.

problem Analyzing the implicit bias of SGD on homogeneous neural networks.
method Interpreting SGD dynamics as an Euler-like discretization of a conservative field flow associated with the normalized classification margin.
result Normalized SGD iterates converge to the set of critical points of the normalized margin at late-stage training.

Woodbury transformations improve deep generative models with efficient invertibility and determinant calculation.

problem Efficiently invertible and determinant-calculable functions for deep generative models.
method Introducing Woodbury transformations that leverage matrix identities for efficient invertibility and determinant calculation.
result Woodbury transformations enable high-dimensional interactions, efficient sampling, and likelihood evaluation, outperforming other flow architectures.

New discrete-time model shows insider trading dynamics.

problem Modeling insider trading with discrete time and noise traders.
method Formulated as a game with three types of traders, including an insider, noise traders, and a market maker. Proved existence of sequential Kyle equilibrium for various distributions and information flows.
result Equilibria exist in mixed strategies but not in pure strategies, unlike in Kyle's original model.

Arguably, the two most popular accelerated or momentum-based optimization methods in machine learning are Nesterov's accelerated gradient and Polyaks's heavy ball, both corresponding to different discretizations of a particular second order differential equation with friction. Such connections with continuous-time dyna…

2019-03-11abs ↗pdf ↗

TriTPP models enable faster and more flexible event data modeling.

problem Inflexibility and slow sampling in traditional TPP models.
method Triangular Maps and Normalizing Flows for parallel sampling and likelihood computation.
result TriTPP models achieve orders of magnitude faster sampling while maintaining flexibility.

A new method for categorical variational inference using discrete normalizing flows.

problem Challenges in optimizing variational approximations for discrete latent variables.
method Differentiable reparameterization using a mixture of discrete normalizing flows.
result Improves optimization of evidence lower bound and reduces sensitivity to hyperparameters.

A new method uses normalizing flows to approximate optimal transport between empirical distributions.

problem Learning an optimal transport map between two empirical distributions.
method Relaxing the Monge formulation of optimal transport, using normalizing flows to approximate the solution.
result The method provides a good approximation of the true optimal transport.

Discrete flows extend normalizing flows to discrete data, improving various applications.

problem Applying normalizing flows to discrete data distributions.
method Developed discrete autoregressive and bipartite flows, showing their effectiveness on various discrete data tasks.
result Discrete autoregressive flows outperform autoregressive baselines on synthetic discrete distributions and Potts models.

Normalizing flows are a powerful class of generative models for continuous random variables, showing both strong model flexibility and the potential for non-autoregressive generation. These benefits are also desired when modeling discrete random variables such as text, but directly applying normalizing flows to discret…

2019-01-29abs ↗pdf ↗

We describe discrete restricted Boltzmann machines: probabilistic graphical models with bipartite interactions between visible and hidden discrete variables. Examples are binary restricted Boltzmann machines and discrete naive Bayes models. We detail the inference functions and distributed representations arising in th…

2013-01-15abs ↗pdf ↗

New method learns disentangled discrete representations using categorical variational autoencoders.

problem Learning disentangled representations from discrete latent spaces.
method Replaced standard Gaussian VAE with a categorical VAE to mitigate rotational invariance.
result Categorical distributions improve learning of disentangled representations.

Ubiquitous anomalies endanger the security of our system constantly. They may bring irreversible damages to the system and cause leakage of privacy. Thus, it is of vital importance to promptly detect these anomalies. Traditional supervised methods such as Decision Trees and Support Vector Machine (SVM) are used to clas…

2019-04-04abs ↗pdf ↗

Asymptotic net is an important concept in discrete differential geometry. In this paper, we show that we can associate affine discrete geometric concepts to an arbitrary non-degenerate asymptotic net. These concepts include discrete affine area, mean curvature, normal and co-normal vector fields and cubic form, and the…

2008-05-14abs ↗pdf ↗

TROLL improves RL for LLMs by replacing clipping with a trust region projection.

problem Clipping in RL for LLMs causes instability and suboptimal performance.
method TROLL uses a discrete differentiable trust region projection to replace clipping, balancing computational cost and effectiveness.
result TROLL consistently outperforms PPO-like clipping in training speed, stability, and final success rates.

The study classifies discrete pseudomanifolds with up to 2d+7 vertices.

problem Understanding discrete pseudomanifolds with a small number of vertices.
method Proved existence of at least 2(d+1) vertices, classified up to 2d+6 vertices, established equivalence with edge graphs of flag normal pseudomanifolds.
result Every flag normal d-pseudomanifold with at most 2d+7 vertices is either a simplicial d-sphere or a flag triangulation of the (d-2)-fold suspension of RP^2.

Paper proposes a new generative model for discrete distributions using flows on submanifolds.

problem Discretization issues and complex statistical dependencies in discrete data.
method Continuous normalizing flows on factorizing discrete measures, geodesic flow matching.
result Efficient training and broad applicability demonstrated through experiments.

Study shows how insurance processes converge to a specific model for better ruin probability calculations.

problem Calculating ruin probabilities in insurance processes.
method Proved convergence of insurance processes to a generalized Ornstein-Uhlenbeck process, derived approximations for ruin probabilities.
result Discrete-time insurance surplus processes converge weakly to a generalized Ornstein-Uhlenbeck process, providing insights for ruin theory.

Discrete diffusion models improve data generation for discrete data like language and graphs.

problem Adapting diffusion models to discrete state spaces for better data generation.
method Formulated as CTMCs, used uniformization of continuous Markov chains for sampling.
result Derive guarantees for sampling from any distribution on a hypercube, aligning with state-of-the-art achievements.

Library learns Bayesian networks from mixed data without discretization.

problem Learning Bayesian networks from mixed data (discrete and continuous variables).
method Proposes an algorithm for structural and parameter learning of Bayesian networks from mixed data using a mixed MI score function and Gaussian approximation. Offers two graph structure enumeration algorithms.
result Advantages in solving approximation and gap recovery problems on synthetic and real datasets.

We derive the exact solution of a one-dimensional Markov functional model with log-normally distributed interest rates in discrete time. The model is shown to have two distinct limiting states, corresponding to small and asymptotically large volatilities, respectively. These volatility regimes are separated by a phase …

2010-07-05abs ↗pdf ↗

New method combines value function decomposition and policy gradients for cooperative multi-agent reinforcement learning.

problem Challenges in cooperative multi-agent reinforcement learning, especially credit assignment and large action spaces.
method Decomposed Soft Actor-Critic (mSAC) method with Q network architecture, discrete probabilistic policy, and counterfactual advantage function.
result Significantly outperforms policy-based approach COMA and achieves competitive results with SOTA value-based approach Qmix.

We present sparse topical coding (STC), a non-probabilistic formulation of topic models for discovering latent representations of large collections of data. Unlike probabilistic topic models, STC relaxes the normalization constraint of admixture proportions and the constraint of defining a normalized likelihood functio…

2012-02-14abs ↗pdf ↗

We propose a novel time discretization for the log-normal SABR model and derive its asymptotic properties.

problem Analyzing the log-normal SABR model's time-discretized behavior and implied volatility surface.
method We use the Euler-Maruyama scheme for time discretization and derive asymptotic properties in the limit of large number of time steps.
result We derive an exact representation of the implied volatility surface for arbitrary maturity and strike in the asymptotic regime.

Let E be the Engel group and D be a rank 2 bracket generating left invariant distribution with a Lorentzian metric, which is a nondegenerate metric of index 1. In this paper, we first prove that timelike normal extremals are locally maximizing. Second, we obtain a parametrization of timelike, spacelike, lightlike norma…

2015-07-27abs ↗pdf ↗