Bayesian evidence computation revisited for model selection with improper priors.
problem Model selection with improper priors and their impact on Bayesian evidence computation.
method Employing improper priors in model selection problems, distinguishing between Bayesian evidence and fake evidences.
result Diffuse priors asymptotically to infinity do not recover the area under the likelihood.
A fundamental problem arising in many areas of machine learning is the evaluation of the likelihood of a given observation under different nominal distributions. Frequently, these nominal distributions are themselves estimated from data, which makes them susceptible to estimation errors. We thus propose to replace each…
A new method reduces dimensionality for better likelihood-free parameter estimation.
problem Estimating parameters from data with no closed-form likelihood.
method Combines reconstruction map estimation with dimension-reduction techniques.
result The proposed method outperforms existing techniques in accuracy and efficiency.
In this paper, we study the effects of different prior and likelihood choices for Bayesian matrix factorisation, focusing on small datasets. These choices can greatly influence the predictive performance of the methods. We identify four groups of approaches: Gaussian-likelihood with real-valued priors, nonnegative prio…
New method estimates Schrödinger bridges using ML techniques.
problem Finding most likely stochastic evolution between two distributions.
method Equivalence with maximum likelihood estimation, numerical Gaussian process approach.
result Direct application of ML techniques for SBP estimation.
In this paper, we empirically study models for pricing Italian sovereign bonds under a reduced form framework, by assuming different dynamics for the short-rate process. We analyze classical Cox-Ingersoll-Ross and Vasicek multi-factor models, with a focus on optimization algorithms applied in the calibration exercise. …
A new approach uses partial likelihood to improve tree-based density estimation and inference.
problem Inference on tree-based models suffers from overfitting and reduced efficiency due to data-independent partitioning.
method Proposes a partial likelihood approach to data-dependent partitioning of tree-based models.
result Significant gains in estimation accuracy and computational efficiency from adopting partial likelihood.
Latent class model (LCM), which is a finite mixture of different categorical distributions, is one of the most widely used models in statistics and machine learning fields. Because of its non-continuous nature and the flexibility in shape, researchers in practice areas such as marketing and social sciences also frequen…
Paper proposes efficient and accurate initialization and EM algorithm for PL mixture models.
problem Initialization issues and combinatorial complexity in PL likelihood maximization.
method Initialization algorithm and EM algorithm for true log-likelihood maximization.
result Proposed algorithm provides accurate initial estimates and efficiently maximizes true log-likelihood.
Recent work has shown that deep generative models can assign higher likelihood to out-of-distribution data sets than to their training data (Nalisnick et al., 2019; Choi et al., 2019). We posit that this phenomenon is caused by a mismatch between the model's typical set and its areas of high probability density. In-dis…
Algorithm bounds causal queries under selection bias.
problem Selection bias affects causal analysis.
method Proposes a new algorithm to address both identifiable and unidentifiable causal queries.
result The likelihood of available data is unimodal, enabling bounds on causal queries.
Financial econometrics has become an increasingly popular research field. In this paper we review a few parametric and nonparametric models and methods used in this area. After introducing several widely used continuous-time and discrete-time models, we study in detail dependence structures of discrete samples, includi…
The problem of estimating the number of sources and their angles of arrival from a single antenna array observation has been an active area of research in the signal processing community for the last few decades. When the number of sources is large, the maximum likelihood estimator is intractable due to its very high c…
A new framework bridges classical and machine learning methods for reliable inference from complex models.
problem Intractable likelihood functions in complex systems make classical statistics ineffective for likelihood-free inference.
method Likelihood-Free Frequentist Inference (LF2I) framework that combines classical statistics and machine learning.
result Valid confidence sets with near finite-sample validity can be constructed for any parameter value.
Deep learning improves Bayes factor computation for likelihood-free models.
problem Computing Bayes factors for likelihood-free models is challenging.
method Proposes a deep learning estimator of Bayes factors using simulated data.
result Establishes consistency of the Deep Bayes Factor estimator.
GenUQ uses generative models to estimate uncertainty in operator learning.
problem Uncertainty quantification in stochastic operator models.
method Introduces a measure-theoretic approach with a generative hyper-network.
result Outperforms other UQ methods in various example problems.
A test for neural networks identifies genetic associations.
problem Testing complex associations in neural networks.
method Sieve quasi-likelihood ratio test for neural networks with one hidden layer.
result The test statistic has an asymptotic chi-squared distribution.
A new method of moments estimator goes beyond data reweighting.
problem Estimation of moment restrictions and conditional moment restrictions.
method Kernel Method of Moments (KMM) based on maximum mean discrepancy.
result KMM achieves competitive performance on conditional moment restriction tasks.
A new method improves fitting neural data with spiking network models.
problem Fitting spiking network models to neural activity does not produce realistic data.
method Augment log-likelihood with dissimilarity terms measured by summary statistics and optimized via back-propagation.
result The new method generates more realistic neural activity statistics and improves network connectivity inference.
We leverage neural networks as universal approximators of monotonic functions to build a parameterization of conditional cumulative distribution functions (CDFs). By the application of automatic differentiation with respect to response variables and then to parameters of this CDF representation, we are able to build bl…
Model-based clustering is widely-used in a variety of application areas. However, fundamental concerns remain about robustness. In particular, results can be sensitive to the choice of kernel representing the within-cluster data density. Leveraging on properties of pairwise differences between data points, we propose a…
NPE improves scalability and efficiency for ERGMs.
problem Scalability and efficiency issues in Bayesian ERGM estimation.
method Neural posterior estimation (NPE) for ERGMs using neural network density estimation.
result NPE provides more efficient and scalable inference for ERGMs.
Paper extends LME models to allow sign constraints on coefficients with SDTN random effects.
problem Inference with sign constraints on random effects in LME models.
method Proposes SDTN distribution for random effects and develops likelihood-based approaches for estimation.
result Proposed constrained model improves real-world interpretations and achieves satisfactory performance.
Proposes a new prior for VAEs to improve out-of-distribution detection.
problem Probabilistic generative models struggle with out-of-distribution detection.
method Introduces an exponentially tilted Gaussian prior for VAEs.
result Achieves state-of-the-art results on ROC-AUC metric.
We propose a new approach to address the text classification problems when learning with partial labels is beneficial. Instead of offering each training sample a set of candidate labels, we assign negative-oriented labels to the ambiguous training examples if they are unlikely fall into certain classes. We construct ou…
Efficiently estimates missing data parameters without iterations.
problem Randomly missing data in statistics and bioinformatics.
method Novel algorithms for maximum likelihood estimation.
result Less time-consuming and superior estimation performance.
Survey and clarify manifold-supported data in deep generative models.
problem Understanding why some DGMs succeed or fail at low-dimensional data.
method Formal analysis and new model connections.
result DGMs on autoencoder representations minimize Wasserstein distance.
New algorithm improves Gaussian process hyperparameter tuning for large datasets.
problem Scalable hyperparameter tuning for Gaussian processes on large datasets.
method Estimates smoothness and length-scale parameters in Matern kernel using novel loss functions.
result Improved uncertainty quantification over traditional methods.
Gaussian processes (GPs) have been proven to be powerful tools in various areas of machine learning. However, there are very few applications of GPs in the scenario of multi-view learning. In this paper, we present a new GP model for multi-view learning. Unlike existing methods, it combines multiple views by regularizi…
New method for efficient inference over complex parameter spaces.
problem Challenges in Bayesian inference for high-dimensional, intractable likelihoods.
method Arbitrary Marginal Neural Ratio Estimation (AMNRE) for simulation-based inference.
result Efficient inference over arbitrary subsets of parameters without numerical integration.
Probabilistic Latent Semantic Analysis is a novel statistical technique for the analysis of two-mode and co-occurrence data, which has applications in information retrieval and filtering, natural language processing, machine learning from text, and in related areas. Compared to standard Latent Semantic Analysis which s…
Ranking data arises in a wide variety of application areas but remains difficult to model, learn from, and predict. Datasets often exhibit multimodality, intransitivity, or incomplete rankings---particularly when generated by humans---yet popular probabilistic models are often too rigid to capture such complexities. In…
Neural surrogate predicts SPN rates from token trajectories.
problem Challenging parameter estimation in SPNs with covariates.
method 1D Convolutional Residual Network trained on Gillespie-simulated SPN realizations.
result Surrogate predicts rate-function coefficients with RMSE = 0.043.
Bayesian neural networks use temperature adjustments to improve predictive performance.
problem Lack of theoretical generalization guarantees for Bayesian neural networks.
method Temperature adjustments to balance likelihood and prior regularization.
result Improved predictive performance through temperature adjustments.
ML surrogates speed up Bayesian inverse problem solving.
problem Infer source location from noisy acoustic wave equation data.
method Use neural network as surrogate for PDE, apply MCMC to posterior.
result Accurately infers source location from noisy data.
Paper develops a novel approach for classifying high-dimensional mixed data.
problem Handling datasets with both categorical and continuous variables of high dimensions.
method Location model with Gaussian conditional distributions, kernel smoothing for bandwidth choice, penalized likelihood estimation.
result Competitive performance of the proposed classifier demonstrated through simulations and real data.
The statistical analysis of discrete data has been the subject of extensive statistical research dating back to the work of Pearson. In this survey we review some recently developed methods for testing hypotheses about high-dimensional multinomials. Traditional tests like the χ2 test and the likelihood ratio test ca…
In recent years there has been a flurry of works on learning Bayesian networks from data. One of the hard problems in this area is how to effectively learn the structure of a belief network from incomplete data- that is, in the presence of missing values or hidden variables. In a recent paper, I introduced an algorithm…
Bayesian calibration improves ABMs for predicting travel patterns.
problem Calibrating ABMs for accurate travel pattern predictions.
method Gaussian Process emulator with deep learning dimensionality reduction for high-dimensional, non-stationary data.
result Improved accuracy in predicting travel patterns using traffic flow data.
Advances in deep learning for spatio-temporal event modeling.
problem Limitations of traditional parametric models in capturing nonstationary dynamics.
method Integration of deep neural architectures to model conditional intensity function and influence kernels.
result Deep influence kernel approach enhances expressiveness and statistical explainability.
Improved VAEs by training a contrastive prior to match posterior.
problem Prior hole problem in VAEs, leading to poor image generation.
method Introduced a contrastive energy-based prior and trained it using noise contrastive estimation.
result Significant improvement in VAE generative performance on various datasets.
New bounds for score matching in polynomial exponential families.
problem Understanding the sample complexity of score matching for polynomial exponential families.
method Non-asymptotic sample complexity analysis for score matching.
result First finite sample bounds for score matching in polynomial exponential families.
In this paper, we model the dependencies among the items that are recommended to a user in a collaborative-filtering problem via a Gaussian Markov Random Field (MRF). We build upon Besag's auto-normal parameterization and pseudo-likelihood, which not only enables computationally efficient learning, but also connects th…
TMLE improves unbiased estimation in public health studies.
problem Improving unbiased estimation in observational studies.
method Targeted Maximum Likelihood Estimation (TMLE) integrates machine learning and statistical theory.
result TMLE has been adopted by researchers worldwide, especially outside the US.
Unified framework for binary responses using AUC loss and low-rank constraint.
problem Statistical inefficiency and shared structure in fitting multiple binary responses.
method Pairwise AUC loss aggregation with low-rank constraint, scalable projected gradient descent.
result Unified framework outperforms likelihood-based approaches in challenging settings.
This paper improves sampling from complex distributions using Langevin dynamics.
problem Pathological behaviors in normalizing flows for complex distributions.
method A Metropolis adjusted Langevin algorithm (MALA) to sample in the latent space.
result The method preserves tractability of the likelihood and works with any pre-trained NF network.
Corrects pseudo log-likelihood method issues in various applications.
problem Log-likelihood function unbounded issues in pseudo log-likelihood methods.
method Provided a counterexample and corrected algorithms in previous literature.
result Ensured well-definedness of maximum pseudo log-likelihood estimation.
Novel mutual information bound improves statistical inference rates.
problem Improving statistical inference rates in Bayesian nonparametrics.
method Introduces a novel mutual information bound.
result Improved contraction rates for fractional posteriors.