Bayesian ODEs with Gaussian processes infer unknown dynamics from data.
problem Estimating unknown continuous-time system dynamics from data.
method Bayesian nonparametric model using Gaussian processes, sparse variational inference, probabilistic shooting.
result Posterior predictive uncertainty scores outperform alternative methods on multiple ODE learning tasks.
Generative sampler learns velocity fields for efficient posterior inference.
problem Sampling from complex posterior distributions in high dimensions.
method Generative multivariate posterior sampler via flow matching, learning a velocity field for a deterministic transport map.
result Conditional Brenier map enables fast generation of credible sets with theoretical consistency guarantees.
The EM training algorithm of the classical i-vector extractor is often incorrectly described as a maximum-likelihood method. The i-vector model is however intractable: the likelihood itself and the hidden-variable posteriors needed for the EM algorithm cannot be computed in closed form. We show here that the classical …
We build a model using Gaussian processes to infer a spatio-temporal vector field from observed agent trajectories. Significant landmarks or influence points in agent surroundings are jointly derived through vector calculus operations that indicate presence of sources and sinks. We evaluate these influence points by us…
BALLAST optimizes Lagrangian observer placement for ocean vector fields.
problem Optimizing Lagrangian observer placement for time-dependent ocean vector fields.
method Bayesian active learning with look-ahead amendment for sea-drifter trajectories using a physics-informed spatio-temporal Gaussian process surrogate model.
result Noticeable benefits of BALLAST-aided observer placement strategies on synthetic and high-fidelity ocean models.
Bayesian Gaussian Process ODEs enhanced with normalizing flows for improved flexibility and accuracy.
problem Limitations of standard Gaussian Process ODEs in modeling complex scenarios.
method Introducing normalizing flows to reparameterize the ODE vector field, developing a data-driven variational learning algorithm.
result Improved accuracy and uncertainty estimates for Bayesian Gaussian Process ODEs.
The paper revisits and improves on a Bayesian relevance vector machine method for small sample sizes.
problem Statistical modeling with small sample sizes relative to the number of covariates.
method Introduces a new class of global-local priors and provides theoretical properties.
result Results on posterior consistency and contraction rates are provided.
Deep Bayesian neural nets can use simpler weight approximations without sacrificing performance.
problem The need for complex weight posterior approximations in deep Bayesian neural networks.
method Theoretical and empirical analysis of mean-field variational inference in deep networks.
result Mean-field variational weight posteriors in deep networks can induce similar function-space distributions as complex approximations in shallower networks.
This paper proposes a new method to improve VI approximations by capturing dependence between blocks using vector copulas.
problem Improving variational inference accuracy for complex models with challenging posteriors.
method Using vector copulas to model dependence between multivariate blocks, with learnable transport maps for flexible marginals.
result The proposed method produces more accurate posterior approximations than existing methods at limited computational cost.
Topic models are Bayesian models that are frequently used to capture the latent structure of certain corpora of documents or images. Each data element in such a corpus (for instance each item in a collection of scientific articles) is regarded as a convex combination of a small number of vectors corresponding to `topic…
Bayesian framework for sphere regression using Gaussian fields.
problem Nonparametric regression on the sphere with Gaussian priors.
method Isotropic Gaussian field priors, harmonic structure, exact posterior distributions, optimal spectral truncation, posterior contraction rates.
result Sharp posterior contraction rates for Gaussian priors with polynomially decaying angular power spectra.
TopoFisher learns topological summaries by maximizing Fisher information, improving parameter efficiency and inference quality.
problem Simulation-based inference misses key information in low-order statistics, especially for non-Gaussian fields.
method TopoFisher uses a differentiable persistent-homology pipeline that learns topological summaries by maximizing local Gaussian Fisher information.
result TopoFisher recovers much of the available information and outperforms fixed topological vectorizations in weak gravitational lensing.
The paper analyzes contraction rates for GP regression approximations.
problem Computational infeasibility of exact GP posterior in large-scale applications.
method Lanczos and conjugate gradient approximations of the posterior mean.
result Minimax contraction rates for these approximations in large-scale applications.
Geometric framework analyzes bias in variational inference for posterior functionals.
problem Analyzing the bias of posterior functionals under variational approximations.
method Developed a geometric framework to evaluate the bias of posterior functionals using the variational tangent space.
result The leading-order bias of a posterior functional is determined by its component orthogonal to the variational tangent space.
Neural attention (NA) has become a key component of sequence-to-sequence models that yield state-of-the-art performance in as hard tasks as abstractive document summarization (ADS) and video captioning (VC). NA mechanisms perform inference of context vectors; these constitute weighted sums of deterministic input sequen…
MFVI can overestimate predictive variance compared to the exact posterior
problem MFVI underestimates posterior variance
method Analyzing conjugate Bayesian Linear Regression
result MFVI can overestimate predictive variance compared to the exact posterior
The paper analyzes how Gaussian kernel parameters affect posterior covariance in Gaussian processes.
problem Understanding the influence of Gaussian kernel parameters on posterior covariance in Gaussian processes.
method Geometric analysis and a posteriori error estimation techniques from adaptive finite element methods.
result The bandwidth parameter and spatial distribution of observations significantly influence posterior covariance and its matrix.
Paper transforms torse-forming vector fields into simpler forms.
problem Generalizing vector fields and their transformations.
method Present techniques to transform torse-forming vector fields into simpler cases.
result Concrete examples of transformations are provided.
Study shows TAP free energy minimization provides better posterior inference in high-dimensional linear models.
problem Deviation from true posterior mean and underestimation of posterior uncertainty in variational inference.
method Minimization of TAP free energy in a high-dimensional asymptotic framework, showing geometric and statistical properties.
result Local minimizer of TAP free energy provides consistent estimate of posterior marginals and correctly calibrated posterior inference.
The paper proves that certain modified conformal vector fields are trivial on compact and non-compact manifolds.
problem Proving triviality of modified conformal vector fields on Riemannian manifolds.
method Analyzing properties of homothetic, conformal, and gradient vector fields on compact and non-compact manifolds.
result Established conditions under which m-modified conformal vector fields are trivial. The position vector field x is the most elementary and natural geometric object on a Euclidean submanifold M. The position vector field plays very important roles in mathematics as well as in physics. Similarly, the tangential component x^T of the position vector field is the most natural vector field tangent to the …
Bayesian neural networks ignore data in infinite units limit.
problem Pathological behavior of posterior in over-parameterized networks.
method Mean-field variational inference in infinite hidden units limit.
result Posterior mean converges to zero, ignoring data.
Conformal vector fields on LCP manifolds are orthogonal and Killing.
problem Understanding conformal vector fields on specific geometric manifolds.
method Analyzing properties of conformal vector fields on compact locally conformally product manifolds.
result Conformal vector fields are orthogonal to the flat distribution and Killing.
For a submanifold M in a Euclidean space, the tangential component x^T of the position vector field x of M is the most natural vector field tangent to the Euclidean submanifold, called the canonical vector field of M. In this article, first we prove that the canonical vector field of every Euclidean submanifold is alwa…
We conduct non-asymptotic analysis on the mean-field variational inference for approximating posterior distributions in complex Bayesian models that may involve latent variables. We show that the mean-field approximation to the posterior can be well-approximated relative to the Kullback-Leibler divergence discrepancy m…
Study on vector fields on Lie groups reveals surprising algebraic coincidences.
problem Characterizing vector fields on Lie groups with Riemannian metrics.
method Algebraic and geometric analysis of left-invariant vector fields on nilpotent Lie groups.
result Spaces of Killing, one-harmonic, and conformal vector fields coincide with the center of the Lie algebra on nilpotent Lie groups.
Study biharmonic vector fields and unit vector fields on Riemannian manifolds.
problem Determine the equivalence of biharmonicity and harmonicity for vector fields and unit vector fields on Riemannian manifolds.
method Analyze biharmonic vector fields and unit vector fields on (M,g) with pseudo-Riemannian g-natural metrics on TM and T1M. result Contrary to Sasaki metric, biharmonicity and harmonicity are not equivalent for large classes of g-natural metrics on TM. Develops a new method for sampling from Bayesian credible sets using deep generative quantile learning.
problem Sampling from posterior distributions in high-dimensional spaces with intractable likelihoods.
method Uses deep neural networks to implicitly sample from Bayesian credible sets via a push-forward mapping and Monge-Kantorovich depth.
result Demonstrates improved performance and theoretical consistency of the quantile learning framework.
A new particle algorithm improves mean-field variational inference.
problem Efficiently approximating nonparametric posterior distributions in machine learning.
method Introduces PArticle VI (PAVI), a novel particle-based algorithm for nonparametric mean-field approximation.
result Obtains non-asymptotic error bounds for PArticle VI, providing the first end-to-end guarantee for particle-based MFVI.
This short report establishes some basic properties of smooth vector fields on product manifolds. The main results are: (i) On a product manifold there always exists a direct sum decomposition into horizontal and vertical vector fields. (ii) Horizontal and vertical vector fields are naturally isomorphic to smooth famil…
Defines quaternionic k-vector fields on quaternionic Kähler manifolds.
problem No specific problem stated; focuses on definition and properties.
method Introduced a modified Dirac operator to define quaternionic k-vector fields.
result Calculated the dimension of quaternionic k-vector fields on HPn. Stein transport improves Bayesian inference with faster convergence and reduced variance.
problem Efficiently approximating posterior distributions in Bayesian inference.
method A novel Bayesian inference method using Stein transport, which pushes particles along a curve of tempered distributions.
result Stein transport reaches posterior approximations faster and more accurately than Stein variational gradient descent (SVGD).
Wide BNNs with odd activations fail to approximate data under mean-field inference.
problem Theoretical limitations of mean-field variational inference in wide, deep Bayesian neural networks.
method Analysis of mean-field variational inference in fully-connected BNNs with odd activation functions and Gaussian likelihood.
result The optimal mean-field variational posterior predictive distribution converges to the prior predictive distribution as network width increases.
Study on generalized derivations in polynomial vector fields Lie algebras.
problem Understanding generalized derivations in specific Lie sub-algebras of polynomial vector fields.
method Analysis of Lie sub-algebras containing constant and Euler vector fields, under specified conditions.
result Characterization of generalized derivations in the studied Lie sub-algebras.
Study on Einstein solitons with specific vector fields and their properties.
problem Characterizing Einstein solitons with gradient, solenoidal, or concircular vector fields.
method Explicitly express the function λ by gradient vector field V and deduce geometric properties under certain curvature conditions.
result Explicit expressions for λ and geometric properties of Einstein solitons.
Word2vec (Mikolov et al., 2013) has proven to be successful in natural language processing by capturing the semantic relationships between different words. Built on top of single-word embeddings, paragraph vectors (Le and Mikolov, 2014) find fixed-length representations for pieces of text with arbitrary lengths, such a…
Investigates point spectra of vector fields and their properties.
problem Understanding the point spectra of vector fields.
method Define and study point spectra, prove properties under isometries, and analyze compactly supported fields.
result Point spectra are well-behaved under isometries and trivial for compactly supported fields.
We consider four dimensional lie groups equipped with left invariant Lorentzian Einstein metrics, and determine the harmonicity properties of vector fields on these spaces. In some cases, all these vector fields are critical points for the energy functional restricted to vector fields. We also classify vector fields de…
Examining singularities of commuting vector fields on submanifolds.
problem Understanding singularities of commuting vector fields on submanifolds.
method Analyzing real submanifolds within Kähler manifolds.
result Characterized singularities of commuting vector fields.
Vector fields invariant under Lie group action are finitely generated by polynomial fields.
problem Understanding invariant vector fields under Lie group actions.
method Analyzing the module of smooth vector fields invariant under a linear action of a compact Lie group.
result The module of invariant vector fields is finitely generated by polynomial fields.
The paper proves non-existence of torqued and anti-torqued vector fields on hyperbolic spaces.
problem Existence of torqued and anti-torqued vector fields on hyperbolic spaces.
method Analyzing the properties of conformal scalar functions and their impact on the existence of vector fields.
result Non-existence of proper torqued and anti-torqued vector fields on hyperbolic spaces.
We introduce G_2-vector fields, Rochesterian 1-forms and Rochesterian vector fields on manifolds with a closed G_2-structure as analogues of symplectic vector fields, Hamiltonian functions and Hamiltonian vector fields respectively, and we show that the spaces of G_2-vector fields and of Rochesterian vector fields are …
Enhances Hamiltonian systems stability through generalized double bracket vector fields.
problem Stabilizing already stable points in Hamiltonian systems.
method Generalized double bracket vector fields on Poisson manifolds with pseudo-Riemannian metrics.
result Enhanced equilibria stability through dissipation terms.
Compact parameterization improves Bayesian neural network performance.
problem Improving performance of Bayesian neural networks using variational methods.
method Restricting variational distribution to a k-tied Normal distribution with low-rank factorization.
result Compact parameterization improves signal-to-noise ratio and convergence speed.
Study classifies harmonic vector fields on 3-manifolds.
problem Classifying harmonic unit vector fields on 3-manifolds.
method Investigates under mild curvature assumptions, classifying vector fields and manifolds.
result Classifies both vector fields and manifolds supporting them.
Braided vector fields on spatial subdomains homeomorphic to the cylinder play a crucial role in applications such as solar and plasma physics, relativistic astrophysics, fluid and vortex dynamics, elasticity, and bio-elasticity. Often the vector field's topology -- the entanglement of its field lines -- is non-trivial,…
Study proves conformal vector fields on certain Finsler manifolds are Killing fields.
problem Characterizing conformal vector fields on compact homogeneous Finsler manifolds.
method Analyzes properties of conformal vector fields and homogeneous Finsler metrics.
result Conformal vector fields on compact homogeneous Finsler manifolds are Killing fields.
Indices of vector fields and 1-forms studied for singular varieties and actions.
problem Understanding indices of vector fields and 1-forms in various contexts.
method Generalization to singular varieties and actions of finite groups.
result New insights into indices of vector fields and 1-forms.