d3p package enables efficient Bayesian inference with differential privacy.
problem Efficiently performing Bayesian inference under differential privacy constraints.
method Differentially private variational inference for flexible probabilistic models.
result Achieves significant speed-up in runtime for complex models.
Efficiently solves high-dimensional ODEs with probabilistic methods.
problem Solving high-dimensional ODEs with uncertainty quantification.
method Probabilistic numerical algorithm based on independence assumptions or Kronecker structure.
result Efficient probabilistic solutions for ODEs with millions of dimensions.
ICON learns differential equation operators from examples, revealing probabilistic inference.
problem Learning operators for differential equations from limited examples.
method Probabilistic operator learning using ICON architectures trained on diverse datasets.
result ICON implicitly performs Bayesian inference on solution operators.
New probabilistic method speeds up calibration of complex models.
problem Calibrating large-scale differential equation models efficiently.
method Probabilistic approach to computing local sensitivities.
result Significantly reduces computational effort for iterative gradient-based calibration.
Unified framework for differentiable graph partitioning with probabilistic cuts.
problem Lack of general guarantees and principled gradients in prior probabilistic relaxations of graph cuts.
method Unified probabilistic framework covering a wide class of cuts, including Normalized Cut, with tight analytic upper bounds.
result Rigorous, numerically stable foundation for scalable, differentiable graph partitioning.
We investigate learning of the differential geometric structure of a data manifold embedded in a high-dimensional Euclidean space. We first analyze kernel-based algorithms and show that under the usual regularizations, non-probabilistic methods cannot recover the differential geometric structure, but instead find mostl…
ProGen improves spatiotemporal forecasting with SDEs and diffusion models.
problem Complex spatial and temporal dependencies in spatiotemporal data.
method ProGen uses Stochastic Differential Equations and diffusion-based generative models.
result ProGen outperforms state-of-the-art models on traffic datasets.
Probabilistic method combines space and time uncertainties in PDEs.
problem Separate treatment of space and time in PDE solvers obscures interactions and error quantification.
method Gaussian process interpretation of finite difference methods interacting with probabilistic ODE solvers.
result Joint quantification of space- and time-uncertainty possible without sacrificing ODE solver performance.
The paper improves ODE solvers by integrating diverse information types.
problem Improving accuracy and physical meaningfulness of ODE solutions.
method Leveraging probabilistic solvers to include second-order information and physical conservation laws.
result Solutions become more accurate and physically meaningful with additional information.
Prob-GParareal adds uncertainty quantification to PinT solvers for differential equations.
problem Uncertainty in numerical solutions of differential equations.
method Prob-GParareal uses Gaussian processes to model Parareal correction function, providing probabilistic forecasts.
result Prob-GParareal yields accurate and robust probabilistic forecasts on various ODE systems.
Probabilistic numerics expands numerical tasks with black box methods.
problem Difficult conditioning of random variables in numerical tasks.
method Construct probabilistic numerical methods based on final outputs, extrapolating limiting quantities.
result Higher orders of convergence achieved in various numerical tasks.
Probabilistic proof of smooth boundaries in optimal stopping problems.
problem Continuous differentiability of time-dependent optimal boundaries in optimal stopping problems.
method Local probabilistic arguments for a wider range of conditions.
result First probabilistic proof of continuous differentiability under general conditions.
Probabilistic modeling is iterative. A scientist posits a simple model, fits it to her data, refines it according to her analysis, and repeats. However, fitting complex models to large data is a bottleneck in this process. Deriving algorithms for new models can be both mathematically and computationally challenging, wh…
DALTON improves ODE parameter estimation by learning from noisy data.
problem High sensitivity to parameters in ODEs produces unreliable parameter estimates.
method Data-adaptive probabilistic likelihood approximation for ODEs.
result DALTON produces more accurate parameter estimates than existing methods.
Improved MUSE boosts performance and reduces error in Bayesian inference.
problem Hierarchical Bayesian inference problems
method Implicit differentiation applied to MUSE algorithm
result Significant speedup and improved accuracy compared to Hamiltonian Monte Carlo
This book is a graduate-level introduction to probabilistic programming. It not only provides a thorough background for anyone wishing to use a probabilistic programming system, but also introduces the techniques needed to design and build these systems. It is aimed at people who have an undergraduate-level understandi…
Fast algorithm solves BVPs in linear time with probabilistic uncertainty.
problem Solving boundary value problems efficiently and accurately.
method Gauss--Markov prior tailored to BVPs, linear-time computation.
result Probabilistic solution with linear time complexity and comparable quality.
Probabilistic solvers improve stability for stiff systems.
problem Performance penalties for small steps in stiff systems.
method Probabilistic exponential integrators that include fast linear dynamics in the prior.
result Proven L-stability and probabilistic error accounting.
Simplifies efficient estimation via automatic differentiation and probabilistic programming.
problem Constructing efficient estimators for complex statistical models.
method Automatic differentiation applied to statistical functionals, avoiding the need to derive efficient influence functions.
result Users can generate efficient estimators with minimal code, simplifying the process for non-experts.
We develop a new Low-level, First-order Probabilistic Programming Language (LF-PPL) suited for models containing a mix of continuous, discrete, and/or piecewise-continuous variables. The key success of this language and its compilation scheme is in its ability to automatically distinguish parameters the density functio…
Hamiltonian Monte Carlo (HMC) is arguably the dominant statistical inference algorithm used in most popular "first-order differentiable" Probabilistic Programming Languages (PPLs). However, the fact that HMC uses derivative information causes complications when the target distribution is non-differentiable with respect…
New method combines ODE solvers with Bayesian inference for efficient model training.
problem Combining ODE solvers with Bayesian inference for efficient model training.
method Probabilistic state space model using extended Kalman filter for joint inference from differential equations and data.
result Efficient approximate Bayesian inference on latent force and ODE solution.
Develops algorithm to differentiate Metropolis-Hastings for optimization.
problem Optimizing intractable densities with discrete components.
method Fuses stochastic automatic differentiation with Markov chain coupling schemes.
result Unbiased and low-variance gradient estimator for intractable densities.
Kernel density matrices simplify probabilistic deep learning.
problem Representing joint probability distributions of continuous and discrete variables.
method Extending density matrices to a reproducing kernel Hilbert space.
result Versatile representation for marginal and joint probability distributions.
Develops effective adversarial attacks on probabilistic forecasting models.
problem Adversarial attacks on neural models outputting probability distributions.
method Effective generation of adversarial attacks through Monte-Carlo estimation and Bayesian conditioning.
result Demonstrates successful generation of attacks with small input perturbations.
Estimates chirp signal frequencies using probabilistic models.
problem Estimating instantaneous frequencies of chirp signals when true forms are unknown.
method Non-linear Gaussian processes and stochastic filters/smothers for posterior estimation.
result The method outperforms state-of-the-art methods on synthetic and real-world datasets.
New solver avoids memory issues for long differential equations.
problem Memory constraints in adaptive probabilistic ODE solvers.
method Fixed memory demands adaptive probabilistic solver using robust state estimation.
result Eliminates memory issues for long time series simulations.
Simplified explanation of DDPMs for machine learning.
problem Complexity in explaining DDPMs and missing rationale.
method Six simple steps to explain DDPMs.
result Clear rationale for each step of DDPM formulation.
PGBM creates probabilistic predictions efficiently.
problem Creating probabilistic predictions for large-scale data.
method Approximates leaf weights as random variables, learns moments via stochastic tree ensemble update equations.
result PGBM offers significant speedup and accuracy improvements over existing methods.
Deep learning improves probabilistic PPDE solution accuracy.
problem Approximating solutions to path-dependent PDEs with limited basis selection.
method Deep learning for conditional expectation estimation with error bounds.
result Deep learning yields more accurate PPDE solutions, especially in high dimensions.
We deliver a call to arms for probabilistic numerical methods: algorithms for numerical tasks, including linear algebra, integration, optimization and solving differential equations, that return uncertainties in their calculations. Such uncertainties, arising from the loss of precision induced by numerical calculation …
Exact Bayesian inference for discrete models using probability generating functions.
problem Discrete statistical models with infinite support and continuous priors.
method Probabilistic programming language with automatic differentiation and probability generating functions.
result Genfer tool provides exact solutions for a wide range of inference problems.
EiNets improve PCs for scalable probabilistic modeling.
problem Scalability issues in training PCs on real-world data.
method Combining einsum operations for speedups and memory savings; simplifying EM for PCs.
result EiNets can scale to large datasets like SVHN and CelebA.
PRISM provides real-time SLAM with uncertainty estimates for agent and map states.
problem Lack of uncertainty estimates and real-time capability in SLAM.
method Combines differentiable rendering and 6-DoF dynamics, uses approximations for Bayesian inference.
result Runs at 10Hz real-time with similar accuracy to state-of-the-art SLAM.
We introduce a fully probabilistic framework of consumer product choice based on quality assessment. It allows us to capture many aspects of marketing such as partial information asymmetry, quality differentiation, and product placement in a supermarket.
Paper develops a new probabilistic method for American options using entropy regularization.
problem Finding optimal stopping times for American options with entropy regularization.
method Entropy-regularized penalization scheme based on Doob-Meyer-Mertens decomposition and reflected backward stochastic differential equations.
result Explicit convergence rates and policy improvement algorithm for American options.
This short note highlights some links between two lines of research within the emerging topic of trustworthy machine learning: differential privacy and robustness to adversarial examples. By abstracting the definitions of both notions, we show that they build upon the same theoretical ground and hence results obtained …
This paper tackles Bayesian system identification with probabilistic numerical methods.
problem Accurately modeling nonlinear dynamic systems from noisy data.
method Probabilistic Sequential Monte Carlo (SMC) combined with probabilistic numerical integration.
result Efficient identification of latent states and system parameters from noisy measurements.
Bayesian-SINDy learns differential equations from noisy data quickly.
problem Learning correct model equations from limited and noisy data.
method Bayesian-SINDy framework using Gaussian approximations.
result Bayesian-SINDy is more robust and accurate in learning correct model equations from noisy data.
We study a probabilistic numerical method for the solution of both boundary and initial value problems that returns a joint Gaussian process posterior over the solution. Such methods have concrete value in the statistics on Riemannian manifolds, where non-analytic ordinary differential equations are involved in virtual…
Grad-TTS models speech from text using diffusion probabilistic techniques.
problem Creating high-quality speech from text input.
method Score-based decoder with stochastic differential equations for noise-to-speech transformation.
result Grad-TTS produces mel-spectrograms from text input with competitive quality.
In a recent paper, the authors proposed a general methodology for probabilistic learning on manifolds. The method was used to generate numerical samples that are statistically consistent with an existing dataset construed as a realization from a non-Gaussian random vector. The manifold structure is learned using diffus…
Paper efficiently infers differential parameters in time-varying models using time score matching.
problem Efficiently inferring differential parameters in time-varying probabilistic models.
method Directly estimates the differential parameter using time score matching and proves consistency of the method.
result Consistent estimation of parameter derivatives in high-dimensional settings.
EMFs combine deep learning and probabilistic models for better density estimation.
problem Combining domain-specific knowledge with general-purpose deep learning.
method Alternating transformations with structured layers that embed domain-specific inductive biases.
result EMFs induce desirable properties like multimodality and hierarchical coupling.
Fenrir uses probabilistic numerics to simplify solving initial value problems.
problem Solving initial value problems in ordinary differential equations.
method Probabilistic numerics and Gauss--Markov regression.
result The method simplifies parameter estimation in ODEs, making it easier and more robust.
Proposes a new model for RANS simulations with uncertainty.
problem Uncertainty in Reynolds-averaged Navier-Stokes simulations.
method Data-driven closure model with aleatoric uncertainty, Bayesian formulation, sparse indirect data.
result Accurate probabilistic predictions, even in regions of model error.
A new method for efficient inference in probabilistic programs with mixed support.
problem Challenges in inference for programs with both continuous and discrete latent variables.
method Stochastic gradient Markov Chain Monte Carlo algorithms.
result Outperforms existing composing inference baselines and works almost as well as inference in marginalized versions.
CheXpert++ improves CheXpert's accuracy and usability for medical radiology reports.
problem Infeasibility of obtaining ground truth labels for medical data.
method BERT-based approximation of CheXpert, addressing speed, differentiability, and probabilistic output.
result Achieves 99.81% parity with CheXpert, significantly faster, differentiable, and probabilistic.