Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

246491737982 · Jun 202019922001200920172026
48 results for partition function estimation

Exchangeable graphs arise via a sampling procedure from measurable functions known as graphons. A natural estimation problem is how well we can recover a graphon given a single graph sampled from it. One general framework for estimating a graphon uses step-functions obtained by partitioning the nodes of the graph accor…

2014-12-05abs ↗pdf ↗

New method reduces Gibbs partition function estimation complexity.

problem Estimating partition functions of Gibbs distributions.
method Doubly-adaptive MCMC with adaptive cooling schedule and mean estimator.
result Outperforms state-of-the-art algorithms in computational complexity and robustness.

Partition functions of probability distributions are important quantities for model evaluation and comparisons. We present a new method to compute partition functions of complex and multimodal distributions. Such distributions are often sampled using simulated tempering, which augments the target space with an auxiliar…

2016-03-07abs ↗pdf ↗

Greedy training of recursive partitioning estimators faces a computational barrier when the true function doesn't satisfy a specific property.

problem Computational inefficiency of greedy training for recursive partitioning estimators.
method Analysis of greedy training for sparse regression functions over binary features.
result Greedy training requires exponential samples when the true function doesn't satisfy a specific property (MSP), but only logarithmic samples when it does.

Given iidiid observations from an unknown absolute continuous distribution defined on some domain ΩΩ, we propose a nonparametric method to learn a piecewise constant function to approximate the underlying probability density function. Our density estimate is a piecewise constant function defined on a binary partition o…

2014-04-05abs ↗pdf ↗

Paper proposes a new method to learn EBMs and their partition function.

problem Intractability of exact MLE for EBMs due to partition function computation.
method Jointly learns an energy model and its log-partition function using neural networks.
result First tractable method for optimizing sparsemax loss in large spaces.

The output scores of a neural network classifier are converted to probabilities via normalizing over the scores of all competing categories. Computing this partition function, ZZ, is then linear in the number of categories, which is problematic as real-world problem sets continue to grow in categorical types, such as …

2015-08-07abs ↗pdf ↗

AIS method improves estimation of RBM partition function with reduced computational cost.

problem Efficiently estimating partition function of RBMs for large systems.
method Annealed Importance Sampling (AIS) with optimized initialization.
result Good estimation of partition function Z with reduced computational cost.

Develops an MS-inspired algorithm for regression mode finding and space partitioning.

problem Finding local modes of regression functions and partitioning input space.
method Mean-shift-inspired algorithm for iterative gradient ascent.
result Proves convergence and rates of convergence for estimated local modes.

A new method for high-dimensional functional regression reduces multicollinearity and improves interpretability.

problem Multicollinearity, overfitting, and interpretability in high-dimensional functional linear models.
method Partition-based functional ridge regression framework.
result Improved numerical stability and enhanced interpretability without explicit variable selection.

New algorithms improve convergence rates for non-log-concave sampling and log-partition estimation.

problem Efficiently sampling from non-log-concave distributions and estimating their log-partition function.
method Analysis of information-based complexity, study of polynomial-time sampling algorithms.
result Optimal rates for sampling and log-partition estimation sometimes exceed those for optimization.

MPF method improves parameter estimation in probabilistic models.

problem Difficulty in fitting probabilistic models due to intractable partition function.
method Minimum Probability Flow (MPF) method for parameter estimation.
result MPF outperforms existing techniques in convergence time and accuracy.

New methods improve Monte Carlo estimation of partition functions.

problem Estimating the normalization constant of complex distributions.
method Annealing through paths of distributions to estimate partition functions.
result Optimal path for estimation is arithmetic, improving efficiency.

The Restricted Boltzmann Machines (RBM) can be used either as classifiers or as generative models. The quality of the generative RBM is measured through the average log-likelihood on test data. Due to the high computational complexity of evaluating the partition function, exact calculation of test log-likelihood is ver…

2015-10-08abs ↗pdf ↗

Localized transfer learning improves nonparametric regression performance.

problem Improving nonparametric regression performance on target tasks.
method Localized transfer learning framework that models heterogeneity and partition covariate space into cells.
result Sharp minimax rates show local transfer mitigates the curse of dimensionality.

In this paper, we introduce a novel method to generate interpretable regression function estimators. The idea is based on called data-dependent coverings. The aim is to extract from the data a covering of the feature space instead of a partition. The estimator predicts the empirical conditional expectation over the cel…

2019-07-04abs ↗pdf ↗

Recent research has made significant progress on the problem of bounding log partition functions for exponential family graphical models. Such bounds have associated dual parameters that are often used as heuristic estimates of the marginal probabilities required in inference and learning. However these variational est…

2012-07-11abs ↗pdf ↗

Paper presents an efficient algorithm for estimating Lipschitz functions from noisy data.

problem Estimating unknown Lipschitz functions from noisy observations.
method Extends max-affine methods to Lipschitz setting using nonlinear feature expansion and adaptive partitioning.
result Achieves minimax convergence rate with respect to intrinsic dimension, up to logarithmic factors.

We propose a black-box algorithm called {\it Adversarial Variational Inference and Learning} (AdVIL) to perform inference and learning on a general Markov random field (MRF). AdVIL employs two variational distributions to approximately infer the latent variables and estimate the partition function of an MRF, respective…

2019-01-24abs ↗pdf ↗

In this paper, we investigate a divide and conquer approach to Kernel Ridge Regression (KRR). Given n samples, the division step involves separating the points based on some underlying disjoint partition of the input space (possibly via clustering), and then computing a KRR estimate for each partition. The conquering s…

2016-08-05abs ↗pdf ↗

Topological recursion recovers a specific partition function for colored knots.

problem Recovering the extended Ooguri-Vafa partition function for colored HOMFLY-PT polynomials of torus knots.
method Applying topological recursion to the spectral curve of colored HOMFLY-PT polynomials of torus knots.
result Topological recursion reproduces the n-point functions of the extended Ooguri-Vafa partition function.

GPU-accelerated particle methods outperform neural samplers in LFT benchmarks.

problem High-dimensional multimodal sampling problems in lattice field theory.
method GPU-accelerated particle Monte Carlo methods (Sequential Monte Carlo and nested sampling).
result These methods match or outperform neural samplers in sample quality and wall-clock time.

Partition Tree estimates conditional densities for mixed continuous and categorical variables.

problem Estimating conditional densities for mixed data types.
method Tree-based framework modeling conditional distributions as piecewise-constant densities on adaptive partitions, minimizing conditional negative log-likelihood.
result Improved probabilistic prediction compared to CART-style trees and state-of-the-art methods.

Proposes SPFB method for optimizing partition functions in stochastic learning.

problem Optimizing partition functions in stochastic learning settings.
method Stochastic Gradient Bound (SPFB) method based on upper-bounding the partition function with a quadratic surrogate.
result Sub-linear convergence rate of SPFB method and efficient training of deep learning models.

Divide-and-conquer framework speeds up black-box inference for large data.

problem Computational intractability of uncertainty quantification for expensive data simulation.
method Divide data into partitions, train on a subset, bootstrap on partitions, combine results.
result Feasibility of estimating max-stable process parameters with tens of thousands of locations.

ConvNets improve nonstationary covariance estimation for large-scale spatial data.

problem Estimating nonstationary spatial covariance functions on large scales.
method Convolutional Neural Networks (ConvNets) for subregion identification and selection.
result Enhanced accuracy in parameter estimation using ConvNet-based partitioning.

Study on estimating Gaussian mean from coarse data, resolving identifiability and computational efficiency questions.

problem Estimating the mean of a Gaussian distribution from coarse data (sets containing true samples rather than exact values).
method Analyzes the conditions for mean identifiability and computable estimation under convex partitions.
result Resolves the identifiability and computational efficiency questions for Gaussian mean estimation from coarse data.

Annealed importance sampling (AIS) is a common algorithm to estimate partition functions of useful stochastic models. One important problem for obtaining accurate AIS estimates is the selection of an annealing schedule. Conventionally, an annealing schedule is often determined heuristically or is simply set as a linear…

2015-02-18abs ↗pdf ↗

We study 4-dimensional higher-derivative conformal higher spin (CHS) fields generalising Weyl graviton and conformal gravitino. They appear, in particular, as "induced" theories in the AdS/CFT context. We consider their partition function on curved Einstein-space backgrounds like (A)dS or sphere and Ricci-flat spaces. …

2013-09-03abs ↗pdf ↗

A new method for state space partitioning in block particle filtering reduces bias and variance.

problem Overcoming the curse of dimensionality in non-linear, non-Gaussian state space estimation.
method Formulates state space partitioning as a clustering problem and uses spectral clustering with constraints.
result The proposed method effectively groups correlated state variables into smaller blocks, reducing bias and variance.

Improved supervised EM learning for shared kernel models with feature space partitioning.

problem Lack of rigour in EM derivation and high computational complexity.
method Detailed derivation of EM for Gaussian shared kernel model, feature space partitioning to reduce complexity.
result Improved performance at reduced complexity achieved.

RBM and DBM are represented as 2D tensor networks, revealing their expressive power and efficiency.

problem Understanding and optimizing RBM and DBM models.
method Representing RBM and DBM as 2D tensor networks and developing an efficient tensor network contraction algorithm.
result The proposed algorithm for computing partition functions is more accurate than state-of-the-art methods.

A new algorithm, Regular Tree Search, tackles non-convex simulation optimization problems.

problem Non-convex objective functions in simulation optimization.
method Integrates adaptive sampling with recursive partitioning of the search space.
result Proves global convergence and reliably identifies the global optimum.

The abstract conjectures a link between knot homologies and quiver partition functions.

problem Understanding the relationship between knot homologies and quiver partition functions.
method Interpreting quiver nodes as holomorphic curves with boundary on the knot conormal, and studying recursion relations.
result Generalized quiver partition functions are related to knot homologies.

We study approximations of the partition function of dense graphical models. Partition functions of graphical models play a fundamental role is statistical physics, in statistics and in machine learning. Two of the main methods for approximating the partition function are Markov Chain Monte Carlo and Variational Method…

2017-11-05abs ↗pdf ↗