A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Adjustment reduces bias in widely applicable Bayesian information criterion.
New criterion improves predictive evaluation in weighted inference scenarios.
The paper derives an equation linking WAIC and WBIC for singular models.
Bayesian model selection via mean-field variational approximation improves efficiency and accuracy.
LS improves model selection for singular statistical models.
We introduce a new criterion to determine the order of an autoregressive model fitted to time series data. It has the benefits of the two well-known model selection techniques, the Akaike information criterion and the Bayesian information criterion. When the data is generated from a finite order autoregression, the Bay…
A statistical model or a learning machine is called regular if the map taking a parameter to a probability distribution is one-to-one and if its Fisher information matrix is always positive definite. If otherwise, it is called singular. In regular statistical models, the Bayes free energy, which is defined by the minus…
A new criterion HBIC improves model selection for factor analysis with missing data.
In this paper, we provide new complexity results for algorithms that learn discrete-variable Bayesian networks from data. Our results apply whenever the learning algorithm uses a scoring criterion that favors the simplest model able to represent the generative distribution exactly. Our results therefore hold whenever t…
SplitWise enhances stepwise regression by adaptively encoding numeric predictors into binary features.
Factorized Information Criterion (FIC) is a recently developed information criterion, based on which a novel model selection methodology, namely Factorized Asymptotic Bayesian (FAB) Inference, has been developed and successfully applied to various hierarchical Bayesian models. The Dirichlet Process (DP) prior, and one …
Paper uses referenced thermodynamic integration for Bayesian model selection in a complex COVID-19 transmission model.
We test three common information criteria (IC) for selecting the order of a Hawkes process with an intensity kernel that can be expressed as a mixture of exponential terms. These processes find application in high-frequency financial data modelling. The information criteria are Akaike's information criterion (AIC), the…
Proposes SNML for selecting word2vec Skip-gram dimensionality.
A new criterion selects models in overparameterized settings.
Safe Bayesian optimization method using information theory.
We use the GARCH model with a fat-tailed error distribution described by a rational function and apply it for the stock price data on the Tokyo Stock Exchange. To determine the model parameters we perform the Bayesian inference to the model. The Bayesian inference is implemented by the Metropolis-Hastings algorithm wit…
Expands Bayesian experiment design framework to account for model discrepancies.
We investigate the problem of estimating the causal effect of a treatment on individual subjects from observational data, this is a central problem in various application domains, including healthcare, social sciences, and online advertising. Within the Neyman Rubin potential outcomes model, we use the Kullback Leibler…
Develops a distributed least squares approximation method for regression problems.
We derive a new Bayesian Information Criterion (BIC) by formulating the problem of estimating the number of clusters in an observed data set as maximization of the posterior probability of the candidate models. Given that some mild assumptions are satisfied, we provide a general BIC expression for a broad class of data…
Bayesian nonparametrics improves data-driven risk optimization under distributional uncertainty.
We consider the bridge linear regression modeling, which can produce a sparse or non-sparse model. A crucial point in the model building process is the selection of adjusted parameters including a regularization parameter and a tuning parameter in bridge regression models. The choice of the adjusted parameters can be v…
New method improves experimental design under model misspecification.
The ultimate goal of optimization is to find the minimizer of a target function.However, typical criteria for active optimization often ignore the uncertainty about the minimizer. We propose a novel criterion for global optimization and an associated sequential active learning strategy using Gaussian processes.Our crit…
Enhances predictive models against misspecification and outliers.
New active learning strategy improves decision-making accuracy.
Novel approach to learn CTBNs from data with minimal interventions.
ICAL improves deep learning model accuracy and NLL with optimized batch labeling.
Paper improves feature selection accuracy using transfer learning.
SIC detects elbows in error curves automatically.
AutoGMM automates Gaussian mixture modeling in Python.
We consider the problem of transforming samples from one continuous source distribution into samples from another target distribution. We demonstrate with optimal transport theory that when the source distribution can be easily sampled from and the target distribution is log-concave, this can be tractably solved with c…
Bayesian BIC for multi-trial data improves VAR model order selection.
Evaluation of the marginal likelihood plays an important role in model selection problems. The widely applicable Bayesian information criterion (WBIC) and singular Bayesian information criterion (sBIC) give approximations to the log marginal likelihood, which can be applied to both regular and singular models. When the…
Bayesian methods improve OoD detection in deep networks.
Stable random variables are motivated by the central limit theorem for densities with (potentially) unbounded variance and can be thought of as natural generalizations of the Gaussian distribution to skewed and heavy-tailed phenomenon. In this paper, we introduce stable graphical (SG) models, a class of multivariate st…
A family of parsimonious shifted asymmetric Laplace mixture models is introduced. We extend the mixture of factor analyzers model to the shifted asymmetric Laplace distribution. Imposing constraints on the constitute parts of the resulting decomposed component scale matrices leads to a family of parsimonious models. An…
Bayesian CART models improve insurance claims frequency prediction and interpretation.
Bayesian framework improves variance component estimation in MET data.
Bayesian approach scores influential training examples for model predictions.
Bayesian optimal design of experiments (BODE) has been successful in acquiring information about a quantity of interest (QoI) which depends on a black-box function. BODE is characterized by sequentially querying the function at specific designs selected by an infill-sampling criterion. However, most current BODE method…
A common strategy for sparse linear regression is to introduce regularization, which eliminates irrelevant features by letting the corresponding weights be zeros. However, regularization often shrinks the estimator for relevant features, which leads to incorrect feature selection. Motivated by the above-mentioned issue…
The modelling of data on a spherical surface requires the consideration of directional probability distributions. To model asymmetrically distributed data on a three-dimensional sphere, Kent distributions are often used. The moment estimates of the parameters are typically used in modelling tasks involving Kent distrib…
Experimental design is crucial for inference where limitations in the data collection procedure are present due to cost or other restrictions. Optimal experimental designs determine parameters that in some appropriate sense make the data the most informative possible. In a Bayesian setting this is translated to updatin…
Entropy Search (ES) and Predictive Entropy Search (PES) are popular and empirically successful Bayesian Optimization techniques. Both rely on a compelling information-theoretic motivation, and maximize the information gained about the of the unknown function; yet, both are plagued by the expensive computatio…
New method corrects Laplace/BIC errors in singular models, revealing effective dimension.
Bayesian model clusters brain activity time series.