Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

180359539718 · Jun 202019922001200920172026
48 results for Discrete Product Distributions

We describe discrete restricted Boltzmann machines: probabilistic graphical models with bipartite interactions between visible and hidden discrete variables. Examples are binary restricted Boltzmann machines and discrete naive Bayes models. We detail the inference functions and distributed representations arising in th…

2013-01-15abs ↗pdf ↗

We derive relations between theoretical properties of restricted Boltzmann machines (RBMs), popular machine learning models which form the building blocks of deep learning models, and several natural notions from discrete mathematics and convex geometry. We give implications and equivalences relating RBM-representable …

2012-06-02abs ↗pdf ↗

Improved sample and time complexity for identifying mixtures of product distributions.

problem Identifying a mixture of kk product distributions from statistics.
method Combining robust tensor decomposition and Hadamard extensions to bound the condition number of key matrices.
result Achieved sample complexity and run-time complexity of (1/ζ)O(k)(1/ζ)^{O(k)} for n2k1n \geq 2k-1.

A new gradient estimator for categorical distributions reduces bias and variance.

problem Intractability of gradients for categorical distributions in discrete latent variable models.
method CatLog-Derivative trick and IndeCateR gradient estimator.
result IndeCateR reduces bias and variance of gradients for categorical distributions.

Efficiently estimate Boolean product distribution parameters from truncated samples.

problem Estimating parameters of Boolean product distributions from truncated samples.
method Introducing fatness of truncation set, using membership queries, and adapting Stochastic Gradient Descent.
result Efficiently learn Boolean product distributions from truncated samples with small sample complexity.

Sum-Product Networks (SPNs) can be regarded as a form of deep graphical models that compactly represent deeply factored and mixed distributions. An SPN is a rooted directed acyclic graph (DAG) consisting of a set of leaves (corresponding to base distributions), a set of sum nodes (which represent mixtures of their chil…

2019-12-05abs ↗pdf ↗

We consider the problem of inference in discrete probabilistic models, that is, distributions over subsets of a finite ground set. These encompass a range of well-known models in machine learning, such as determinantal point processes and Ising models. Locally-moving Markov chain Monte Carlo algorithms, such as the Gib…

2018-07-04abs ↗pdf ↗

In sustained growth with random dynamics stationary distributions can exist without detailed balance. This suggests thermodynamical behavior in fast growing complex systems. In order to model such phenomena we apply both a discrete and a continuous master equation. The derivation of elementary rates from known stationa…

2016-11-21abs ↗pdf ↗

A new method for generative modeling of discrete data using geometric latent subspaces.

problem Learning generative models for discrete data with statistical dependencies.
method Geometric latent-subspace framework in exponential parameter space of product manifolds of categorical distributions.
result Low-dimensional latent space encodes statistical dependencies and accurately models high-dimensional discrete data.

GBS uses machine learning to design products based on consumer preferences.

problem Designing products to meet consumer preferences.
method GBS is a discrete choice experiment that uses machine learning to adaptively construct paired comparison questions.
result GBS outperforms existing methods in accuracy and sample efficiency.

Proves finite measure implies product structure for certain discrete subgroups.

problem Classifying discrete subgroups with finite Bowen-Margulis-Sullivan measure.
method Product structure of leafwise measures and high entropy method.
result Proves virtually a product structure for certain subgroups.

The paper analyzes the probabilistic structure of DDPMs and bounds their sampling error.

problem Understanding and controlling errors in discrete-time DDPMs.
method Structural analysis of score functions, Schrödinger's problem, and FBSDEs.
result Explicit upper bound for total variation distance between sampling and target distributions.

Study of discrete analogues of Atiyah sequence in principal bundles.

problem Discrete analogues of vector bundles and connections in principal bundles.
method Analysis in two categories: fiber bundles with sections and local Lie groupoids, defining discrete curvature and splittings.
result Correspondence between splittings of discrete Atiyah sequence and discrete connections with trivial curvature.

Paper improves likelihood estimation for discrete distributions.

problem Computing profile maximum likelihood for discrete distributions.
method New bounds on Bethe and Sinkhorn permanents for low rank matrices.
result Achieves an approximation factor of exp(-O(sqrt(n) log n)) in polynomial time.

Researchers create spectral triples for twisted crossed products using Kasparov's external product.

problem Constructing spectral triples for twisted crossed products.
method Using Kasparov's external product, the construction of spectral triples for twisted crossed products is achieved.
result The construction of spectral triples for twisted crossed products is possible under suitable assumptions.

Paper proposes a method to estimate consumer valuations from bundle sales data.

problem Estimating consumer valuations from bundle sales data using classical methods is challenging.
method Proposes an approach using EM algorithm and Monte Carlo simulation to estimate consumer valuations from bundle sales data.
result The approach can recover the distribution of consumers' valuations and is robust to unobserved no-purchases and clustered market segments.

Bayesian reinforcement learning (BRL) encodes prior knowledge of the world in a model and represents uncertainty in model parameters by maintaining a probability distribution over them. This paper presents Monte Carlo BRL (MC-BRL), a simple and general approach to BRL. MC-BRL samples a priori a finite set of hypotheses…

2012-06-27abs ↗pdf ↗

Branching Flows generates sequences of varying lengths using binary trees.

problem Generating sequences of unknown lengths or fixed elements.
method A generative modeling framework that evolves states over binary trees, controlling sequence length.
result Branching Flows can generate sequences of varying lengths and mix different types of state spaces.

We propose simple conditions equivalent to the discreteness of the spectrum of the Laplace-Beltrami operator on a class of Riemannian manifolds close to warped products. For this class of manifolds we establish a relationship between discreteness of the spectrum and stochastic incompleteness.

2007-01-20abs ↗pdf ↗

Novel approach for estimating joint probability densities using tensor decompositions and dictionaries.

problem Estimating joint probability densities of mixed discrete and continuous variables.
method Low-rank tensor decomposition combined with dictionary learning.
result Better classification and lower error rates compared to existing methods.

The abstract discusses compact quotients of Riemannian products by discrete subgroups, generalizing Inoue-Bombieri surfaces.

problem Compact quotients of Riemannian products by discrete subgroups.
method Study of compact quotients of a Riemannian product Rqimes(N,gN)\mathbb{R}^q imes (N, g_N) by discrete subgroups ΓΓ of Sim(Rq)imesIsom(N)\mathrm{Sim}(\mathbb{R}^q) imes \mathrm{Isom}(N).
result The construction is equivalent to LCP manifolds and provides a Bieberbach-type rigidity result.

We introduce Network Maximal Correlation (NMC) as a multivariate measure of nonlinear association among random variables. NMC is defined via an optimization that infers transformations of variables by maximizing aggregate inner products between transformed variables. For finite discrete and jointly Gaussian random vari…

2016-06-15abs ↗pdf ↗

We prove the formula TC(GH)=max{TC(G),TC(H),cd(G×H)}TC(G\ast H)=\max\{TC(G), TC(H), cd(G\times H)\} for the topological complexity of the free product of discrete groups with cohomological dimension >2.

2017-10-12abs ↗pdf ↗

New algorithms test independence with fewer samples by using predictive information.

problem Testing independence of distributions with limited samples.
method Augmented distribution testing framework that incorporates predictive information.
result Optimal sample complexity achieved, matching lower bounds.

Paper proposes a new generative model for discrete distributions using flows on submanifolds.

problem Discretization issues and complex statistical dependencies in discrete data.
method Continuous normalizing flows on factorizing discrete measures, geodesic flow matching.
result Efficient training and broad applicability demonstrated through experiments.

The paper extends statistical estimation techniques under differential privacy.

problem Establishing sample complexity bounds for estimation tasks under differential privacy.
method Proposes analogues of Le Cam's method, Fano's inequality, and Assouad's lemma under central differential privacy.
result Optimal sample complexity bounds for discrete distribution estimation under total variation and 2\ell_2 distances.

Joint distributions over many variables are frequently modeled by decomposing them into products of simpler, lower-dimensional conditional distributions, such as in sparsely connected Bayesian networks. However, automatically learning such models can be very computationally expensive when there are many datapoints and …

2012-12-12abs ↗pdf ↗

Discrete Green's functions are the inverses or pseudo-inverses of combinatorial Laplacians. We present compact formulas for discrete Green's functions, in terms of the eigensystems of corresponding Laplacians, for products of regular graphs with or without boundary. Explicit formulas are derived for the cycle, torus, a…

2003-09-04abs ↗pdf ↗

This paper analyzes the bias of inexact MCMC methods in high dimensions.

problem Understanding the bias of inexact MCMC methods in high-dimensional spaces.
method Establishing bounds on Wasserstein distances between inexact MCMC methods and target distributions.
result The asymptotic bias of ULA and uHMC depends on key quantities related to the target distribution or the stationary probability measure of the scheme.

The paper analyzes rates of convergence for optimal transport map estimators using barycentric projections.

problem Estimating optimal transport maps from data sampled according to two distributions.
method Comprehensive analysis of rates of convergence for plug-in estimators defined via barycentric projections.
result New stability estimate for barycentric projections under minimal smoothness assumptions.

Paper develops a gradient-like proposal for discrete distributions without requiring natural differentiability.

problem Lack of natural differentiability in proposal distributions for discrete distributions.
method Locally-balanced proposal combined with Newton's series expansion for efficient exploration.
result Method guarantees convergence rate and outperforms alternatives in various experiments.

We study differential operators, whose coefficients define noncommutative algebras. As algebra of coefficients, we consider crossed products, corresponding to action of a discrete group on a smooth manifold. We give index formulas for Euler, signature and Dirac operators twisted by projections over the crossed product.…

2009-06-19abs ↗pdf ↗