Generalizes moment-matching for exponential families with conditioning or hidden data.
problem Generalizing moment-matching conditions for exponential families with conditioning or hidden data.
method First-principles explanation and self-contained derivation of generalized moment-matching conditions.
result Derives generalized moment-matching conditions for conditional exponential families and hidden data.
CEP improves inference efficiency and accuracy by conditional moment matching.
problem Intractable moment matching in EP.
method Conditional expectation propagation (CEP) performs conditional moment matching and expectation.
result CEP achieves better inference quality and efficiency.
Normal distributions ensure asymptotic variance reduction in moment matching Monte Carlo.
problem Asymptotic variance reduction in general integration problems.
method Characterization of conditions for asymptotic variance reduction using normal distributions.
result Asymptotic variance reduction is guaranteed for normal distributions in moment matching Monte Carlo.
Develops efficient methods for approximating densities of financial models with jumps.
problem Approximating densities of affine jump diffusions with state-independent jump intensities.
method Recursive approach for deriving closed-form solutions to moments, constructing density approximations via moment matching.
result Superior computational efficiency and precision in option pricing and simulation compared to existing techniques.
Framework generates causal probabilities from observational data.
problem Generating causal probabilities from observational data.
method Moment-matching graph-networks for causal inference.
result Automated sampling of latent space conditional probability distributions.
New SQ lower bounds for NGCA without requiring chi-squared condition.
problem Proving SQ hardness for NGCA under moment-matching conditions.
method General SQ lower bound methodology applied to NGCA under moment-matching conditions.
result Proved near-optimal SQ lower bounds for NGCA without chi-squared condition.
Paper identifies tensor ranks via prior predictive matching, solving system of equations.
problem Determining the latent dimensions (ranks) in tensor factorization models.
method Prior predictive moment matching to transform moment matching conditions into a log-linear system of equations.
result Identifies which tensor models have identifiable ranks and derives rank estimators.
Unified framework for FDR control in knockoffs, validating Gaussian knockoffs.
problem Asymptotic FDR control in knockoffs with user-specified distributions.
method Unified theoretical framework, three conditions on approximate knockoff statistics, Gaussian knockoffs generator based on moments matching.
result Gaussian knockoffs generator achieves asymptotic FDR control.
The paper uses moment matching method for pricing spread options under Lévy models.
problem Pricing spread options under Lévy models with mean-variance mixture.
method Moment matching method applied to Lévy models with mean-variance mixture.
result Obtains semi-closed form formulas for spread option prices.
Unified framework for imitation learning via moment matching.
problem Closing the gap between imitation and real-world performance.
method Classifying imitation learning algorithms based on reward or action-value moment matching, considering adversarial divergences.
result Derivation of bounds on policy performance for all algorithms in each class, and introduction of moment recoverability.
A new method approximates option pricing in stochastic interest rate markets.
problem Approximating option pricing in markets with stochastic interest rates.
method Gaussian moment matching technique applied to a conditional Black \& Scholes formula.
result The method performs remarkably well, even compared to other techniques.
Paper introduces new approximations for lognormal sums, matching comonotonicity and moments.
problem Approximating sums of lognormal random variables accurately.
method Introduces new approximations based on weighted distribution theory, emphasizing comonotonicity and moment matching.
result Approximations perform better than classical methods, especially in the right tail of the distribution.
Analysis of Vlasov plasma dynamics using matched pair Lie-Poisson formulation.
problem Understanding the dynamics of Vlasov plasma and its kinetic moments.
method Hamiltonian (Lie-Poisson) analysis and matched pair decomposition.
result Observation of mutual interactions between subdynamics in Vlasov plasma.
A new method for generating samples without training, using smoothed score matching.
problem Generating samples efficiently and without training.
method Moment-matched score-smoothed overdamped Langevin dynamics (MM-SOLD).
result The method enables fast, robust, training-free sampling with competitive sample fidelity and diversity.
New method improves sampling from noisy energy models.
problem Training and sampling challenges in Energy-Based Models.
method Pseudo-Gibbs sampling with moment matching.
result Effective sampling from clean model using noisy DSM-trained model.
Proposes DWMD for better matching of hidden representations across domains.
problem Measuring data distribution discrepancy between semantically related domains for feature representation matching.
method DWMD, a moment-based probability distribution metric that explicitly orders and weights higher-order moments.
result DWMD is error-free and can strictly reflect distribution differences without feature distribution assumptions.
We consider moment matching techniques for estimation in Latent Dirichlet Allocation (LDA). By drawing explicit links between LDA and discrete versions of independent component analysis (ICA), we first derive a new set of cumulant-based tensors, with an improved sample complexity. Moreover, we reuse standard ICA techni…
Unified view of label shift estimation methods.
problem Label distribution changes but class-conditional distributions remain the same.
method Unified view of two approaches: BBSE and MLLS.
result Unified framework and theoretical characterization of MLLS.
Study shows Poisson boundary matches hyperbolic boundary for certain groups.
problem Identifying Poisson boundary for hyperbolic groups without moment conditions.
method Proved using finite entropy random walks and extended to groups with WPD elements.
result Poisson boundary matches hyperbolic boundary for specified groups.
Efficiently simulates SABR model with novel sampling methods.
problem Sampling integrated variance and terminal forward price in SABR model.
method Moment-matched shifted lognormal approximation for integrated variance, CEV approximation for terminal forward price.
result Enhanced simulation scheme is highly efficient, accurate, and reliable.
Completely random measures (CRM) represent the key building block of a wide variety of popular stochastic models and play a pivotal role in modern Bayesian Nonparametrics. A popular representation of CRMs as a random series with decreasing jumps is due to Ferguson and Klass (1972). This can immediately be turned into a…
Q-MMR evaluates policies using reweighted rewards and moment matching.
problem Off-policy evaluation in finite-horizon MDPs.
method Q-MMR learns scalar weights for data points via a moment matching objective against a value-function discriminator class.
result Data-dependent finite-sample guarantee with a dimension-free error bound.
We introduce three novel semi-parametric extensions of probabilistic canonical correlation analysis with identifiability guarantees. We consider moment matching techniques for estimation in these models. For that, by drawing explicit links between the new models and a discrete version of independent component analysis …
Improved KL bounds and Wasserstein guarantees for diffusion flow matching under minimal conditions.
problem Theoretical convergence properties of Brownian motion based diffusion flow matching.
method Refined analysis under Kullback-Leibler and 2-Wasserstein distances.
result State-of-the-art scaling in KL convergence bounds under minimal conditions.
The learning of domain-invariant representations in the context of domain adaptation with neural networks is considered. We propose a new regularization method that minimizes the discrepancy between domain-specific latent feature representations directly in the hidden activation space. Although some standard distributi…
New method speeds up SDE inference by matching moments to FPK equation.
problem Efficiency of sampling schemes in high-dimensional SDEs.
method Direct approximation of Fokker-Planck-Kolmogorov equation by matching moments.
result Fast, scalable inference in high-dimensional latent spaces.
GANs learn distributions by matching low-degree moments.
problem Understanding when GANs learn the target distribution efficiently.
method Theoretical analysis and empirical observation of GAN training process.
result GANs can learn notable distributions by matching polynomially many low-degree moments.
IMM generates high-quality samples in few steps with stable training.
problem Slow inference and instability in generating high-quality samples using diffusion models and Flow Matching.
method Inductive Moment Matching (IMM) is a new generative model for one- or few-step sampling with a single-stage training procedure.
result IMM achieves state-of-the-art 2-step FID of 1.98 on CIFAR-10 for a model trained from scratch.
Conditional DGP learns effective kernels from low-fidelity data.
problem Learning effective kernels for multi-fidelity regression.
method Conditional DGP with moment matching for implicit kernel approximation.
result Effective kernels are learned from lower-fidelity data, improving multi-fidelity regression.
SkMM selects data for finetuning by balancing bias and variance.
problem Balancing bias and variance in high-dimensional finetuning.
method Gradient sketching for bias reduction and moment matching for variance reduction.
result Gradient sketching selects samples efficiently and accurately.
A new filter reduces density fitting to a linear solve, improving performance on nonlinear systems.
problem Nonlinear Bayesian filtering challenges in representing belief distributions.
method Combines score matching with Stein's identity to avoid partition function evaluation.
result The Score Kalman Filter (SKF) outperforms existing methods on nonlinear systems.
Method learns statistics of return distributions via neural networks and maximum mean discrepancy.
problem Learning probability distributions in reinforcement learning.
method Maximum mean discrepancy (MMD) for learning unrestricted statistics of return distributions.
result Method outperforms standard distributional RL baselines on Atari games.
This paper compares VaR estimation methods under tail misspecification, finding importance sampling underestimates VaR.
problem Tail misspecification in VaR estimation.
method Importance sampling and moment-based VaR bracketing.
result Importance sampling underestimates VaR under heavy-tailed returns, while moment-based methods are robust.
Classical scaling is shown to be optimal under various noisy conditions.
problem Consistency of classical scaling under general noise conditions.
method Established using finite fourth moments of noise, derived convergence rates, and matching minimax lower bounds.
result Classical scaling achieves minimax optimality in recovering true configuration from noisy dissimilarities.
Enhances ROM simulation for multivariate systems with exact Kollo skewness.
problem Modeling multivariate systems with high dimensions and specific higher moments.
method Extends Random Orthogonal Matrix simulation to match target Kollo skewness.
result Established conditions and developed a general approach for constructing admissible values.
A note proves the binary perceptron's capacity is less than 0.847.
problem Determining the capacity of the binary perceptron.
method Conditional first moment method combined with known results on the spherical perceptron.
result Proves the binary perceptron's capacity is less than 0.847.
The Gaussian mixture model is a classic technique for clustering and data modeling that is used in numerous applications. With the rise of big data, there is a need for parameter estimation techniques that can handle streaming data and distribute the computation over several processors. While online variants of the Exp…
We study discretizations of polynomial processes using finite state Markov processes satisfying suitable moment matching conditions. The states of these Markov processes together with their transition probabilities can be interpreted as Markov cubature rules. The polynomial property allows us to study such rules using …
Unified approach to domain generalization by aligning gradients and Hessians.
problem Developing models that generalize well across unseen domains.
method Moment Alignment, extending transfer measure to DG, aligning derivatives across domains.
result Moment Alignment unifies gradient and Hessian matching approaches, improving generalizability.
This paper provides guarantees for DFM models using KL divergence.
problem Ensuring generative models match target distributions efficiently.
method Using KL divergence and Brownian motion bridge for generative models.
result Non-asymptotic guarantees for DFM models under specific conditions.
Unified framework for distribution shift estimation, explanation, and improvement.
problem Estimating, explaining, and improving model performance on target domains with distribution shift.
method Entropic Projection Alignment (EPA) aligns source and target distributions by matching moments and minimizing KL divergence.
result EPA consistently outperforms state-of-the-art baselines while offering computational efficiency.
This work develops efficient methods for computing moments of Gaussian mixtures.
problem Efficient computation of moments for Gaussian mixtures with large dimensions.
method Theory and numerical methods for implicit computations with moment tensors of Gaussian mixtures.
result Reduced computational and storage costs for moment tensors of Gaussian mixtures.
Theoretical models applied to option pricing should take into account the empirical characteristics of the underlying financial time series. In this paper, we show how to price basket options when assets follow a shifted log-normal process with jumps capable of accommodating negative skewness. Our technique is based on…
CCVFM uses coreset to improve generative models by refining residual flows.
problem Generating multimodal distributions from scratch is challenging.
method Augments hierarchical rectified flow with a data-informed source distribution using a coreset.
result CCVFM achieves competitive few-step generation without a learned noise-to-data map.
A new method for training diffusion models using likelihood matching.
problem Training efficient and accurate diffusion models.
method Likelihood Matching approach, quasi-likelihood approximation, score and Hessian estimation.
result Consistent matching of first two transitional moments between diffusion steps.
The well known maximum-entropy principle due to Jaynes, which states that given mean parameters, the maximum entropy distribution matching them is in an exponential family, has been very popular in machine learning due to its "Occam's razor" interpretation. Unfortunately, calculating the potentials in the maximum-entro…
A new metric assesses latent variable models using data and model moments.
problem Difficulty in assessing the quality of unsupervised learning models.
method A moment-matching metric using matrix norms to compare data and model moments.
result The proposed metric is faster and has less variance than alternative methods.
Tropical curves match to special Lagrangian shapes.
problem Connecting tropical geometry to special Lagrangian shapes.
method Gluing construction that matches tropical local models to Lagrangian shapes.
result Locally planar tropical curves can be realized as special Lagrangian limits.