tvGP-VAE models tensor-valued latent variables with Gaussian processes for better data structure representation.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
A new approach simplifies multitask Gaussian processes without rank approximations.
Method estimates noise variance in Gaussian process regression.
New kernel models multi-output Gaussian processes accurately.
uGMM-NN integrates probabilistic reasoning into neural networks.
DSPPs improve predictive distributions in scalable regression tasks.
Improves Bayesian optimization using Gaussian process Thompson sampling.
Paper calculates KL divergence for isotropic Gaussian-Markov fields.
Paper proposes a new GPR-HS framework for accurate VCV estimation in global equity indices.
A new Weyl prior is proposed for Bayesian statistics, offering a more canonical choice for parameter α.
We introduce a method for non-uniform random number generation based on sampling a physical process in a controlled environment. We demonstrate one proof-of-concept implementation of the method that reduces the error of Monte Carlo integration of a univariate Gaussian by 1068 times while doubling the speed of the Monte…
Information-theoretic measures such as the entropy, cross-entropy and the Kullback-Leibler divergence between two mixture models is a core primitive in many signal processing tasks. Since the Kullback-Leibler divergence of mixtures provably does not admit a closed-form formula, it is in practice either estimated using …
New framework models complex spatial data with basis functions and graphical vectors.
Most signal processing problems involve the challenging task of multidimensional probability density function (PDF) estimation. In this work, we propose a solution to this problem by using a family of Rotation-based Iterative Gaussianization (RBIG) transforms. The general framework consists of the sequential applicatio…
The total variation distance is a core statistical distance between probability measures that satisfies the metric axioms, with value always falling in . This distance plays a fundamental role in machine learning and signal processing: It is a member of the broader class of -divergences, and it is related to …
DLFM models complex systems with uncertainty, outperforming traditional methods.
We develop an automated variational method for inference in models with Gaussian process (GP) priors and general likelihoods. The method supports multiple outputs and multiple latent functions and does not require detailed knowledge of the conditional likelihood, only needing its evaluation as a black-box function. Usi…
Improved sample efficiency for private learning of Gaussian mixtures.
We utilize copulas to constitute a unified framework for constructing and optimizing variational proposals in hierarchical Bayesian models. For models with continuous and non-Gaussian hidden variables, we propose a semiparametric and automated variational Gaussian copula approach, in which the parametric Gaussian copul…
Study assesses drought and late-frost risks in Bavaria using vine copulas.
SVGP KAN integrates sparse variational GP with KANs for scalable probabilistic inference.
A new method for learning Gaussian Mixture Models using gradient descent.
Paper uses Gaussian processes and neural nets to model sub-km wind accurately.
The paper offers a unified approach to the study of three locally adaptive estimation methods in the context of univariate time series from both theoretical and empirical points of view. A general procedure for the computation of critical values is given. The underlying model encompasses all distributions from the expo…
Study learns a projection and function in Gaussian models.
New SQ lower bounds for NGCA without requiring chi-squared condition.
In this study we suggest a portfolio selection framework based on option-implied information and multivariate non-Gaussian models. The proposed models incorporate skewness, kurtosis and more complex dependence structures among stocks log-returns than the simple correlation matrix. The two models considered are a multiv…
We study distributed estimation of a Gaussian mean under communication constraints in a decision theoretical framework. Minimax rates of convergence, which characterize the tradeoff between the communication costs and statistical accuracy, are established in both the univariate and multivariate settings. Communication-…
We derive generalization error bounds for stationary univariate autoregressive (AR) models. We show that imposing stationarity is enough to control the Gaussian complexity without further regularization. This lets us use structural risk minimization for model selection. We demonstrate our methods by predicting interest…
In deterministic optimization, line searches are a standard tool ensuring stability and efficiency. Where only stochastic gradients are available, no direct equivalent has so far been formulated, because uncertain gradients do not allow for a strict sequence of decisions collapsing the search space. We construct a prob…
In deterministic optimization, line searches are a standard tool ensuring stability and efficiency. Where only stochastic gradients are available, no direct equivalent has so far been formulated, because uncertain gradients do not allow for a strict sequence of decisions collapsing the search space. We construct a prob…
DCK improves air quality index prediction with probabilistic spatial models.
Undirected graphical models, or Markov networks, are a popular class of statistical models, used in a wide variety of applications. Popular instances of this class include Gaussian graphical models and Ising models. In many settings, however, it might not be clear which subclass of graphical models to use, particularly…
A boosting method improves nonparametric density estimation without smoothing assumptions.
In this paper we introduce the concept of conic martingales}. This class refers to stochastic processes having the martingale property, but that evolve within given (possibly time-dependent) boundaries. We first review some results about the martingale property of solution to driftless stochastic differential equations…
Parameter estimation for model-based clustering using a finite mixture of normal inverse Gaussian (NIG) distributions is achieved through variational Bayes approximations. Univariate NIG mixtures and multivariate NIG mixtures are considered. The use of variational Bayes approximations here is a substantial departure fr…
PySAD offers a unified Python framework for efficient streaming anomaly detection.
While Gaussian probability densities are omnipresent in applied mathematics, Gaussian cumulative probabilities are hard to calculate in any but the univariate case. We study the utility of Expectation Propagation (EP) as an approximate integration method for this problem. For rectangular integration regions, the approx…
Study benchmarks TSC algorithms in distinguishing diffusions using the likelihood ratio test.
Study learns Gaussian mixtures from censored data.
Gaussian Process (GP) models are often used as mathematical approximations of computationally expensive experiments. Provided that its kernel is suitably chosen and that enough data is available to obtain a reasonable fit of the simulator, a GP model can beneficially be used for tasks such as prediction, optimization, …
Most brain disorders are very heterogeneous in terms of their underlying biology and developing analysis methods to model such heterogeneity is a major challenge. A promising approach is to use probabilistic regression methods to estimate normative models of brain function using (f)MRI data then use these to map variat…
We develop Square Root Graphical Models (SQR), a novel class of parametric graphical models that provides multivariate generalizations of univariate exponential family distributions. Previous multivariate graphical models [Yang et al. 2015] did not allow positive dependencies for the exponential and Poisson generalizat…
A defining feature of non-stationary systems is the time dependence of their statistical parameters. Measured time series may exhibit Gaussian statistics on short time horizons, due to the central limit theorem. The sample statistics for long time horizons, however, averages over the time-dependent parameters. To model…
We study a class of weakly identifiable location-scale mixture models for which the maximum likelihood estimates based on i.i.d. samples are known to have lower accuracy than the classical error. We investigate whether the Expectation-Maximization (EM) algorithm also converges slowly for these m…
A new SBI framework for trawl processes efficiently estimates parameters from large datasets.
This paper aims to solve a basic problem in distributed statistical inference: how many machines can we use in parallel computing? In kernel ridge regression, we address this question in two important settings: nonparametric estimation and hypothesis testing. Specifically, we find a range for the number of machines und…
G-GLN extends GLNs to multiple regression and density modeling.