Particle-based variational inference offers a flexible way of approximating complex posterior distributions with a set of particles. In this paper we introduce a new particle-based variational inference method based on the theory of semi-discrete optimal transport. Instead of minimizing the KL divergence between the po…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “Particle Transport”
Stein transport improves Bayesian inference with faster convergence and reduced variance.
problem Efficiently approximating posterior distributions in Bayesian inference.
method A novel Bayesian inference method using Stein transport, which pushes particles along a curve of tempered distributions.
result Stein transport reaches posterior approximations faster and more accurately than Stein variational gradient descent (SVGD).
A method for optimal Bayesian filtering using progressive particle flow and optimal transport maps.
problem Optimizing Bayesian filtering with deterministic particles to avoid degeneration.
method Progressive flow of particles through a sequence of sub-steps, each using an optimal transport map to replace non-equally weighted particles with equally weighted ones.
result The method avoids particle degeneration and simplifies the filtering process by not requiring inversions or monotonicity constraints.
USD algorithm transports distributions with or without mass conservation.
problem Transporting distributions with different masses.
method Particle descent algorithm using Sobolev-Fisher discrepancy.
result USD converges to target distribution in MMD sense.
A new ensemble filter uses transport maps and MMD optimization for high-dimensional data assimilation.
problem High-dimensional data assimilation challenges in ensemble filtering.
method Optimized Maximum Mean Discrepancy (MMD) for transport map construction.
result Significant improvement in robustness and posterior approximation.
Differentiable PF via entropy-regularized OT for better inference.
problem Non-differentiability of traditional PF resampling methods.
method Entropy-regularized optimal transport for differentiable resampling.
result Convergent differentiable PF method with improved gradient estimates.
A new algorithm for optimizing probability distributions converges linearly.
problem Optimizing functionals over families of probability distributions.
method Variational transport: particle-based algorithm approximating Wasserstein gradient descent.
result Variational transport converges linearly to the global minimum of the objective functional.
A new algorithm computes Wasserstein barycenters without entropic regularization.
problem Computing Wasserstein barycenters efficiently and accurately.
method Free-support algorithm based on particle flow and Riemannian geometry.
result The algorithm avoids entropic regularization and is computationally tractable.
Generative algorithms learn high-dimensional data efficiently and generate new samples.
problem Learning from scarce high-dimensional data.
method Lipschitz-regularized gradient flows and particle-based algorithms.
result Correctly transports gene expression data points with high dimensionality.
The concepts of relative velocity and acceleration, deviation velocity and acceleration and relative momentum of point particles in spaces (manifolds), the tangent bundle of which is equipped with a transport along paths, are introduced. If the tangent bundle is endowed also with a metric, it gives rise also to the not…
Optimal transport calibrates machine learning models for particle physics simulations.
problem Discrepancies between simulation and experimental data limit machine learning effectiveness.
method A model calibration approach based on optimal transport applied to high-dimensional simulations.
result Calibrated high-dimensional representations enable proper calibration of various downstream quantities.
Transport away your problems: Calibrating stochastic simulations with optimal transportphysics.data-an
The paper uses optimal transport to calibrate stochastic simulations.
problem Improper fidelity of stochastic simulators in scientific applications.
method Optimal transport theory applied to neural network corrections.
result Calibrated stochastic simulations improve fidelity to reality.
We present a particle flow realization of Bayes' rule, where an ODE-based neural operator is used to transport particles from a prior to its posterior after a new observation. We prove that such an ODE operator exists. Its neural parameterization can be trained in a meta-learning framework, allowing this operator to re…
We show that stochastic interpolation flow maps are Lipschitz with a sharp constant.
problem High dimensional sampling and transport problems.
method Investigating stochastic interpolation flow for generating data samples.
result Stochastic interpolation flow maps are Lipschitz with a sharp constant matching optimal transport maps.
On the Global Convergence of Gradient Descent for Over-parameterized Models using Optimal Transportmath.OC
Many tasks in machine learning and signal processing can be solved by minimizing a convex function of a measure. This includes sparse spikes deconvolution or training a neural network with a single hidden layer. For these problems, we study a simple minimization method: the unknown measure is discretized into a mixture…
PDDS samples from unnormalized densities using iterative particle scheme.
problem Sampling from unnormalized probability densities.
method Iterative particle scheme with novel score matching loss.
result Asymptotically consistent estimates for multimodal and high-dimensional tasks.
New neural method calculates EMD for particle physics data.
problem Metric for particle collider events based on Wasserstein metric.
method Neural network architecture estimating EMD using Kantorovich-Rubinstein duality.
result Differentiable way to calculate EMD for geometric fitting.
We call a manifold with torsion and nonmetricity the metric-affine manifold. The nonmetricity leads to a difference between the auto parallel line and the extreme line, and to a change in the expression of the Frenet transport and moving basis. The torsion leads to a change in the Killing equation. We also need to add …
Optimizes signal detection in particle physics by decorrelating classifiers.
problem Systematic errors in background models can mislead signal detection.
method Use optimal transport to decorrelate classifiers from protected variables, then apply semiparametric mixture model.
result Decorrelation and signal enrichment improve the stability, robustness, and power of signal detection tests.
New emulator bridges simulators using conditional optimal transport.
problem Bridging simulators with minimal distortion.
method Flow-based approach to learn likelihood transport, COT-FM for optimal matching.
result Emulator accurately captures full correction between simulators.
In a coordinate free form are found the (deviation) equations satisfied by the (infinitesimal) deviation vector, relative velocity, relative momentum, relative acceleration and relative energy of two point particles in a differentiable manifold the tangent bundle of which is endowed with a linear transport along paths,…
Sobolev Descentcs.LG
We study a simplification of GAN training: the problem of transporting particles from a source to a target distribution. Starting from the Sobolev GAN critic, part of the gradient regularized GAN family, we show a strong relation with Optimal Transport (OT). Specifically with the less popular dynamic formulation of OT …
Machine learning for graph-based representations of three-dimensional discrete fracture networksphysics.geo-ph
Structural and topological information play a key role in modeling flow and transport through fractured rock in the subsurface. Discrete fracture network (DFN) computational suites such as dfnWorks are designed to simulate flow and transport in such porous media. Flow and transport calculations reveal that a small back…
Jointly estimates flow fields and particle properties from Lagrangian data.
problem Estimating flow fields and particle properties from sparse, noisy Lagrangian data.
method Data assimilation framework coupling Eulerian and Lagrangian models.
result Joint estimation of flow fields and particle properties in various flow regimes.
Paper uses optimal transport for Bayesian filtering, deriving new EnKF and FPF formulations.
problem Bayesian filtering for nonlinear systems with non-Gaussian observations.
method Optimal transport theory applied to Bayes' law, constructing Brenier maps.
result New variational formulations of EnKF and FPF for non-Gaussian settings.
AFT combines AIS, SMC, and NFs for better Monte Carlo estimates.
problem Estimating normalizing constants of complex probability distributions.
method Annealed Flow Transport (AFT) integrates AIS, SMC, and normalizing flows.
result AFT improves Monte Carlo estimates of normalizing constants and expectations.
Study validates numerical method for singular FBSDEs convergence.
problem Solving singular FBSDEs and associated PDEs.
method Particles approximation for transport operator and tree approximation for diffusion operator.
result Convergence rate of numerical method proved under reasonable conditions.
New sampling method uses gradient-free IPS with RKHS velocity field.
problem Efficient sampling from unnormalized target densities.
method Gradient-free interacting particle systems (IPS) with RKHS velocity field.
result IPS produce high-quality samples from various target distributions.
A new method improves Bayesian filtering in nonlinear systems.
problem Bayesian filtering in nonlinear dynamical systems with non-Gaussian posteriors.
method Transport maps with block-triangular structure and gradient flows for MMD minimization.
result Accurate approximation of non-Gaussian posteriors without particle collapse.
CRAFT improves on existing methods for sampling complex distributions.
problem Sampling from complex probability distributions.
method Combines SMC with variational inference using normalizing flows.
result Improves on Annealed Flow Transport Monte Carlo and MCMC-based Stochastic Normalizing Flows.
Two SVGD variants achieve fast convergence with provable guarantees.
problem Understanding and improving SVGD's performance with finite particles.
method Introducing virtual particles and novel stochastic approximations.
result Provable fast convergence rates for finite-particle SVGD variants.
Gaussian Process Hydrodynamicsphysics.flu-dyn
Gaussian Process Hydrodynamics approximates fluid flow equations using probabilistic kernels.
problem Approximating fluid flow equations with fewer particles and uncertainty estimates.
method Lagrangian particle-based approach with Gaussian Process (GP) prior and physics-informed kernels.
result GPH requires fewer particles and provides uncertainty estimates.
A new method de-randomizes MCMC dynamics using the Stein operator.
problem Estimating complex target distributions in Bayesian inference.
method De-randomized kernel-based particle samplers that discretize the fiber-gradient Hamiltonian flow.
result GSVGD de-randomizes complex MCMC dynamics, maintaining high sample quality.
New gradient flows for non-negative and probability measures combining optimal transport and interaction forces.
problem Optimizing non-negative and probability measures using interaction forces and optimal transport.
method Interaction-Force Transport (IFT) gradient flows and their spherical variant, developed via infimal convolution of Wasserstein and spherical MMD tensors, with a particle-based optimization algorithm.
result The spherical IFT gradient flow provides global exponential convergence guarantees for both MMD and KL energy.
Extracts coarse-grained PDEs from microscopic simulations.
problem Discovering effective PDEs for macro-scale processes from microscopic data.
method Combining neural networks with equation-free numerics and data-driven approaches.
result Efficiently discovers macro-scale PDEs from microscopic simulations.
Controlled interacting particle systems such as the ensemble Kalman filter (EnKF) and the feedback particle filter (FPF) are numerical algorithms to approximate the solution of the nonlinear filtering problem in continuous time. The distinguishing feature of these algorithms is that the Bayesian update step is implemen…
New gradient flows improve high-dimensional sampling.
problem Sampling from high-dimensional target densities.
method Introducing Radon--Wasserstein gradient flows.
result Linear scaling in particles and dimensions.
Deep Neural Operator Driven Real Time Inference for Nuclear Systems to Enable Digital Twin Solutionsstat.ML
DeepONet accelerates nuclear DT inference with high accuracy and efficiency.
problem Real-time prediction and model evaluation in nuclear systems.
method Deep Neural Operator (DeepONet) for surrogate modeling.
result DeepONet outperforms traditional ML methods in accuracy and speed.
ATPF combines PF and EnKF for better inference in complex systems.
problem Weight degeneracy in PF and approximation errors in EnKF.
method Adversarial learning to improve posterior matching and incorporate kernel methods for optimization.
result ATPF provides theoretical guarantees and practical advantages over PF and EnKF.
A new method solves high-dimensional MFGs using particle-based flow matching.
problem Solving high-dimensional Mean-Field Games (MFGs) is computationally challenging.
method Proposes a particle-based deep Flow Matching (FM) method to update particles and train a flow neural network.
result Proves convergence of the scheme to a stationary point sublinearly and linearly under convexity assumptions.
New method uses Wasserstein loss for data unfolding, offering better accuracy than classical techniques.
problem Removing noise or artifacts from measurements in physics experiments.
method Alternative formulation using Wasserstein loss, developing a convergent algorithm.
result Optimal transport approach offers robust, accurate performance compared to classical techniques, especially in cases with significant binning artifacts.
Recently, some works have suggested methods to combine variational probabilistic inference with Monte Carlo sampling. One promising approach is via local optimal transport. In this approach, a gradient steepest descent method based on local optimal transport principles is formulated to transform deterministically point…
Neural solver computes Wasserstein geodesics and velocity fields efficiently.
problem Computing Wasserstein geodesics and velocity fields efficiently.
method Sample-based neural network approach to solve the minimax problem.
result Directly samples from target distribution and estimates velocity field.
We give a new probabilistic construction of solutions to real Monge-Ampère equations in R^n satisfying the second boundary value problem with respect to a given target convex body P) which fits naturally into the theory of optimal transport. More precisely, certain beta-deformed permanental (bosonic) N-particle point p…
Generative method avoids function estimation for data generation.
problem Challenges in function estimation for generative models.
method Deterministic point transport with gradient descent.
result Data generation possible without function estimation.
Higher Gauge Theorymath.DG
Just as gauge theory describes the parallel transport of point particles using connections on bundles, higher gauge theory describes the parallel transport of 1-dimensional objects (e.g. strings) using 2-connections on 2-bundles. A 2-bundle is a categorified version of a bundle: that is, one where the fiber is not a ma…
New theorem connects probabilistic permanental point processes to Monge-Ampère equation.
problem Probabilistic interpretation of Monge-Ampère equation boundary value problem.
method Large deviation principles and optimal transport theory.
result Explicit rate function for permanental point processes large deviation.
Survey of diffusion and optimal transport methods in machine learning.
problem Design and analysis of time-evolving probability distributions in machine learning.
method Switch from Eulerian to Lagrangian representation through vector fields.
result Both diffusion methods and optimal transport offer computational advantages.