We propose the supervised hierarchical Dirichlet process (sHDP), a nonparametric generative model for the joint distribution of a group of observations and a response variable directly associated with that whole group. We compare the sHDP with another leading method for regression on grouped data, the supervised latent…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,657 papers · 148 categories
Trend · papers per month
48 results for “Dirichlet regression”
TPBS models improve robustness to overfitting with localized Dirichlet energy regularization.
problem Global Dirichlet energy-based regularization fails for TPBS models due to perfect interpolation.
method Propose local Dirichlet energy regularization and two inference estimators.
result TPBS models outperform neural networks in overfitting regimes and maintain competitive performance otherwise.
We propose Dirichlet Process mixtures of Generalized Linear Models (DP-GLM), a new method of nonparametric regression that accommodates continuous and categorical inputs, and responses that can be modeled by a generalized linear model. We prove conditions for the asymptotic unbiasedness of the DP-GLM regression mean fu…
Bayesian framework improves robustness in nonlinear regression models.
problem Measurement error, model misspecification, and distributional misspecification in regression analyses.
method Joint Dirichlet process prior on latent covariate-response distribution, updating with posterior pseudo-samples.
result Improved stability and consistency in estimators under increasing measurement error.
The paper introduces a new model to correct bias in treatment effect estimates due to sample selection.
problem Bias in treatment effect estimates due to sample selection.
method Type 2 Tobit Bayesian Additive Regression Trees (TOBART-2) with Dirichlet Process Mixture distribution and soft trees.
result Corrects bias in treatment effect estimates by accounting for nonlinearities and model uncertainty.
Proposes a new method for robust uncertainty quantification in regression tasks.
problem Robust uncertainty estimation for deep neural networks in regression tasks.
method Generalized Auxiliary Uncertainty Estimator (AuxUE) scheme, considering both aleatoric and epistemic uncertainties.
result DIDO method provides robust uncertainty estimates in noisy inputs, scalable to image-level and pixel-wise tasks.
Corrected moment-based methods improve inference in topic model regression.
problem Inferential difficulties in topic model plug-in workflow for regression.
method Corrected spectral moment methods for LDA, response-weighted word moments.
result Direct identification of regression coefficients without estimating topic shares.
Causal Inference with the Instrumental Variable Approach and Bayesian Nonparametric Machine Learningstat.ML
Bayesian nonparametric machine learning improves instrumental variable inference.
problem Estimating causal effects with nonlinear relationships.
method Bayesian Additive Regression Trees (BART) for estimating functions and Dirichlet Process mixtures for error terms.
result Dramatic improvements in inference with nonlinear data, no manual tuning required.
We propose a novel "tree-averaging" model that utilizes the ensemble of classification and regression trees (CART). Each constituent tree is estimated with a subset of similar data. We treat this grouping of subsets as Bayesian ensemble trees (BET) and model them as an infinite mixture Dirichlet process. We show that B…
We use the theory of normal variance-mean mixtures to derive a data augmentation scheme for models that include gamma functions. Our methodology applies to many situations in statistics and machine learning, including Multinomial-Dirichlet distributions, Negative binomial regression, Poisson-Gamma hierarchical models, …
New methods for predicting compositional data using conformal prediction.
problem No well-established methods for constructing valid prediction sets in compositional data.
method Investigated three conformal prediction-based approaches for Dirichlet regression models.
result HDR approximation approach is robust in terms of coverage, while grid discretization reduces overcoverage.
Geometric Occam's Razor shapes deep learning solutions.
problem Understanding the regularization in over-parameterized neural networks.
method Analyzing the geometric model complexity and Dirichlet energy in neural networks.
result Over-parameterized neural networks are implicitly regularized by geometric model complexity.
From Partial Exchangeability to Predictive Probability: A Bayesian Perspective on Classificationstat.ME
Bayesian model improves classification performance with flexible uncertainty modeling.
problem Improving classification performance with flexible uncertainty modeling.
method Combines Gaussian process and Dirichlet process priors for latent function and link function, respectively.
result Outperforms standard logistic regression on simulated data.
Develops Bayesian inference methods for gamma models.
problem Challenges in inference for models with gamma functions.
method Data augmentation scheme using Exponential Reciprocal Gamma distributions.
result Scalable EM and MCMC algorithms developed.
This paper extends transfer learning for linear regression to uncertain domain information.
problem Transfer learning for linear regression with uncertain domain information.
method A Dirichlet process is used to infer latent domain information from regression coefficients. A novel framework considers the joint distribution of variables.
result The proposed method controls bias better than previous pseudo-labelling approaches.
nnLDA combines neural and probabilistic methods for better topic modeling with side information.
problem Lack of integration of auxiliary information in traditional topic models.
method nnLDA integrates side information through a neural prior mechanism, optimizing both neural and probabilistic components.
result nnLDA outperforms traditional models in topic coherence, perplexity, and classification.
We propose a family of multivariate Gaussian process models for correlated outputs, based on assuming that the likelihood function takes the generic form of the multivariate exponential family distribution (EFD). We denote this model as a multivariate generalized Gaussian process model, and derive Taylor and Laplace al…
Efficient Parameter Estimation for Bayesian Network Classifiers using Hierarchical Linear Smoothingcs.LG
A new method for efficient BNC parameter estimation outperforms HDP smoothing.
problem Efficiently estimating parameters for Bayesian network classifiers to match or exceed random forest performance.
method Uses log-linear regression to approximate hierarchical Dirichlet process (HDP) smoothing, making the approach simpler and faster.
result Our method outperforms HDP smoothing while being orders of magnitude faster and competitive with random forests.
A new LDA model with covariates for mixed-membership clusters.
problem Modeling mixed-membership clusters in discrete data with covariates.
method Negative binomial regression embedded within LDA, slice sampling within Gibbs sampling.
result Model successfully retrieves true parameter values and predicts cluster abundances using covariates.
Count data take on non-negative integer values and are challenging to properly analyze using standard linear-Gaussian methods such as linear regression and principal components analysis. Generalized linear models enable direct modeling of counts in a regression context using distributions such as the Poisson and negati…
Ribbon: Scalable Approximation and Robust Uncertainty Quantification
problem Reliably quantifying predictive uncertainty for complex models
method Ribbon, a scalable approximation to Dirichlet-reweighted bootstrap uncertainty
result Asymptotically equivalent to a flat-prior Laplace approximation under correct likelihood specification, recovers robust sandwich covariance under misspecification
In this paper, we study the problem of deriving fast and accurate classification algorithms with uncertainty quantification. Gaussian process classification provides a principled approach, but the corresponding computational burden is hardly sustainable in large-scale problems and devising efficient alternatives is a c…
Supervised Topic Modelsstat.ML
We introduce supervised latent Dirichlet allocation (sLDA), a statistical model of labelled documents. The model accommodates a variety of response types. We derive an approximate maximum-likelihood procedure for parameter estimation, which relies on variational methods to handle intractable posterior expectations. Pre…
RL learns to ignore factors in factor investing portfolios.
problem Combining factor investing and reinforcement learning for optimal portfolio allocation.
method RL agent learns through sequential allocations based on firms' characteristics using Dirichlet distributions.
result RL-based portfolios are very close to equally-weighted allocations, indicating agnostic factor learning.
Bayesian Additive Regression Trees (BART) is a fully Bayesian approach to modeling with ensembles of trees. BART can uncover complex regression functions with high dimensional regressors in a fairly automatic way and provide Bayesian quantification of the uncertainty through the posterior. However, BART assumes IID nor…
Bayesian nonparametrics improves data-driven risk optimization under distributional uncertainty.
problem Improving out-of-sample performance in machine learning models due to distributional uncertainty.
method Combining Bayesian nonparametric theory and decision-theoretic preferences to propose a robust optimization criterion.
result The proposed robust optimization procedure provides favorable statistical guarantees and tractable approximations.
Robust Bayesian Inference for Measurement Error Misspecification: The Berkson and Classical Casesstat.ME
Bayesian framework tackles measurement error in covariates.
problem Misleading inference due to corrupted covariates.
method Bayesian Nonparametric Learning framework robust to misspecification.
result General framework for Classical and Berkson error models.
Derive Dirichlet scalar curvature energy functional variation formula
problem Dirichlet scalar curvature energy functional
method First variation formula
result Introduce Dirichlet-Einstein metrics
A regression algorithm uses Green's function and covariance matrix for predictive distributions.
problem Regression and uncertainty quantification for machine learning.
method Green's function theory, Bayesian approach, covariance matrix of normalized Green's function.
result The covariance matrix provides predictive distributions with mean and confidence intervals.
Solves a specific Dirichlet problem on Hermitian manifolds.
problem Solving Dirichlet problem for Monge-Ampère type equations on Hermitian manifolds.
method Solves the Dirichlet problem for Monge-Ampère type equations for -plurisubharmonic functions on Hermitian manifolds.
result Solves a specific Dirichlet problem on Hermitian manifolds.
Trapezoids uniquely identified by their Dirichlet Laplace spectrum.
problem Identifying trapezoids based on their spectral properties.
method Analyzing the Dirichlet Laplace spectrum of non-obtuse trapezoids.
result Non-obtuse trapezoids are uniquely determined by their Dirichlet Laplace spectrum.
Study classifies ruled surfaces critical to Dirichlet energy.
problem Identifying ruled surfaces critical to Dirichlet energy.
method Explicit parametrization of ruled surfaces.
result Classification of ruled surfaces as critical points of Dirichlet energy.
Study non-linear Dirichlet-to-Neumann map for Poincaré-Einstein fillings.
problem Non-linear Dirichlet-to-Neumann map for Poincaré-Einstein fillings.
method Description of range in terms of Dirichlet-to-Neumann tensor, construction of hypersurface invariants.
result Unique conformally invariant Dirichlet-to-Neumann hypersurface invariants for Poincaré-Einstein fillings.
LDTA expands LDA's topic modeling capacity with tree-structured priors.
problem Limited expressiveness of Dirichlet priors in LDA for complex topic relationships.
method Introduces Latent Dirichlet-Tree Allocation (LDTA) with Dirichlet-Tree (DT) priors, and develops universal mean-field variational inference and Expectation Propagation.
result LDTA enables expressive, tree-structured priors over topic proportions, expanding modeling capacity of LDA.
Solves a specific Dirichlet problem for Lagrangian mean curvature equations.
problem Solving the Dirichlet problem for Lagrangian mean curvature equations.
method Solves the Dirichlet problem for Lagrangian mean curvature equations on uniformly convex domains.
result Solves the Dirichlet problem for Lagrangian mean curvature equations.
The Dirichlet problem for degenerate fully nonlinear elliptic equations on Riemannian manifoldsmath.AP
Solves a specific Dirichlet problem on Riemannian manifolds.
problem Dirichlet problem for degenerate fully nonlinear elliptic equations on Riemannian manifolds.
method Derives existence of -solutions under appropriate assumptions.
result Existence of -solutions.
Study compares eigenvalues on spherically symmetric manifolds to Euclidean balls.
problem Comparing eigenvalues on spherically symmetric manifolds to Euclidean balls.
method Examines Dirichlet Laplace eigenvalues on balls of spherically symmetric manifolds and Euclidean space.
result Eigenvalues on spherically symmetric manifolds are smaller for small radii, but larger for hyperbolic spaces.
Study on geometry of Dirichlet distributions using Fisher-Rao metric.
problem Understanding the geometry of Dirichlet distributions.
method Analysis of Fisher-Rao metric on Dirichlet distribution parameter space.
result Geodesic completeness and negative sectional curvature of the space.
Graph Laplacians adapt to different manifold dimensions, while Dirichlet energies converge to a tensorized Dirichlet energy.
problem Understanding machine learning methods for data with varying intrinsic dimensions.
method Γ-convergence of graph Dirichlet energies and spectral convergence of graph Laplacians on intersecting manifolds of varying dimensions.
result Normalized Dirichlet energy converges to a tensorized Dirichlet energy that adapts to all dimensions simultaneously.
Topic models are widely used to discover the latent representation of a set of documents. The two canonical models are latent Dirichlet allocation, and Gaussian latent Dirichlet allocation, where the former uses multinomial distributions over words, and the latter uses multivariate Gaussian distributions over pre-train…
Discriminative classifier for compositional data using hierarchical mixture of Generalized Dirichlet models.
problem Classifying compositional data, especially in spam detection and color space identification.
method Hierarchical mixture of discriminative Generalized Dirichlet classifiers, using variational approximation for parameter learning.
result First time a variational upper-bound for Generalized Dirichlet mixture is proposed in literature.
The paper finds universal inequalities for eigenvalues on hyperbolic spaces.
problem Eigenvalues of the Dirichlet Laplacian on conformally flat Riemannian manifolds.
method Establishes universal inequalities for eigenvalues of the Dirichlet Laplacian on hyperbolic spaces.
result Establishes universal inequalities for eigenvalues of the Dirichlet Laplacian on hyperbolic spaces.
Geodesic balls with non-negative Ricci curvature have a sharp lower bound on their first Dirichlet eigenvalue.
problem Finding a sharp lower bound for the first Dirichlet eigenvalue of geodesic balls.
method Quantitative explicit inequality linking the width of geodesic balls to the spectral gap.
result A quantitative inequality relating the width of geodesic balls to the spectral gap between the first Dirichlet eigenvalue and its lower bound.
Paper solves Dirichlet problem for -convex hypersurfaces with curvature constraints.
problem Solving the Dirichlet problem for -convex hypersurfaces with prescribed curvature.
method Proved existence of a graphic hypersurface satisfying the prescribed curvature equation with homogeneous boundary condition, obtained an interior curvature estimate.
result Existence of a graphic hypersurface satisfying the prescribed curvature equation with homogeneous boundary condition.
This paper uses natural language processing to create the first machine-coded democracy index, which I call Automated Democracy Scores (ADS). The ADS are based on 42 million news articles from 6,043 different sources and cover all independent countries in the 1993-2012 period. Unlike the democracy indices we have today…
Study gauge freedoms in elastic wave equations and Dirichlet-to-Neumann map.
problem Recover stiffness tensor and density from Dirichlet-to-Neumann map.
method Analyze invariance under coordinate transformations and gauge freedoms.
result Present gauge freedoms in the Dirichlet-to-Neumann map for Riemannian elastic wave equation.
New portfolios outperform traditional methods by using factor weights.
problem Improving portfolio allocation in markets driven by factors.
method Factor-weighted Dirichlet portfolios outperform uniform Dirichlet portfolios.
result Factor-weighted portfolios outperform uniformly sampled portfolios in market returns.
Estimates eigenvalues of poly-Laplace operator on lattice subgraphs.
problem Estimating eigenvalues of poly-Laplace operator on subgraphs of lattice graphs.
method Introduced discrete poly-Laplace operator, derived upper and lower bounds for eigenvalues.
result Poly-Laplace eigenvalues are at least squares of lower-order poly-Laplace eigenvalues.