The problem of learning tree-structured Gaussian graphical models from independent and identically distributed (i.i.d.) samples is considered. The influence of the tree structure and the parameters of the Gaussian distribution on the learning rate as the number of samples increases is discussed. Specifically, the error…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,657 papers · 148 categories
Trend · papers per month
48 results for “tree-structured”
New tree structure for pseudo-Anosovs from interval maps.
problem Understanding pseudo-Anosovs from interval maps.
method Tree structure on pseudo-Anosovs using rational numbers.
result Deepened dictionary between invariants.
Study a risk model with tree-structured Poisson-Markov random field for rainfall events.
problem Dependence between rainfall frequencies in insurance portfolios.
method Tree-structured Markov random field with Poisson marginals.
result Asymptotic results for portfolio risk and risk allocation.
Paper presents a new method for learning hyperbolic representations using tree structures.
problem Learning faithful low-dimensional hyperbolic embeddings of data.
method Metric-first approach to learn tree structure, then embed into hyperbolic manifold.
result Novel fast algorithm TreeRep learns tree approximating original metric.
The paper uses tensor decompositions to improve neural network models for tree data.
problem Encoding structural knowledge from tree-structured data efficiently.
method Introduces new aggregation functions using Canonical and Tensor-Train decompositions.
result Proposed models outperform traditional methods on tree classification tasks.
Paper tackles robust estimation of tree-structured Ising models without side information.
problem Learning tree-structured Ising models with flipped signs of variables.
method Proves unidentifiability, proposes an algorithm with logarithmic sample complexity and polynomial run-time complexity.
result Empirically demonstrates robustness of proposed algorithm in the flipped signs setting.
New method solves tree-structured Schrödinger Bridge problems.
problem Computing Schrödinger Bridge between tree-structured distributions.
method Iterative Markovian Fitting (IMF) procedure for tree-structured costs.
result Extends IMF to tree-structured Schrödinger Bridge problems.
We define the beta diffusion tree, a random tree structure with a set of leaves that defines a collection of overlapping subsets of objects, known as a feature allocation. A generative process for the tree structure is defined in terms of particles (representing the objects) diffusing in some continuous space, analogou…
Exact learning of tree-structured models with side info and noise.
problem Learning tree-structured graphical models with side information and noise.
method Probabilistic tools from strong large deviations theory.
result Exact asymptotics of structure learning from samples.
Improved Bayesian optimization for conditional parameter spaces.
problem Efficient global optimization of expensive-to-evaluate functions in conditional parameter spaces.
method Additive tree-structured covariance function for conditional parameter optimization.
result Significantly improved sample-efficiency and wider applicability compared to existing methods.
While learning models are typically studied for inputs in the form of a fixed dimensional feature vector, real world data is rarely found in this form. In order to meet the basic requirement of traditional learning models, structural data generally have to be converted into fix-length vectors in a handcrafted manner, w…
New tree-structured Markov fields with Poisson marginals for counting variables.
problem Counting variables with complex dependencies.
method Tree-structured Markov random fields with Poisson marginals.
result Straightforward sampling and joint probability calculations.
Novel covariance function improves Bayesian optimization efficiency.
problem Efficient global optimization of expensive black-box functions.
method Additive tree-structured covariance function and parallel optimization algorithm.
result Significantly outperforms state-of-the-art methods in conditional parameter optimization.
In this paper we develop a bubble tree structure for a degenerating class of Riemannian metrics satisfying some global conformal bounds on compact manifolds of dimension 4. Applying the bubble tree structure, we establish a gap theorem, a finiteness theorem for diffeomorphism type for this class, and a diameter bound f…
We provide high probability finite sample complexity guarantees for hidden non-parametric structure learning of tree-shaped graphical models, whose hidden and observable nodes are discrete random variables with either finite or countable alphabets. We study a fundamental quantity called the (noisy) information threshol…
This work considers the problem of learning the structure of multivariate linear tree models, which include a variety of directed tree graphical models with continuous, discrete, and mixed latent variables such as linear-Gaussian models, hidden Markov models, Gaussian mixture models, and Markov evolutionary trees. The …
The paper tackles high-dimensional Bayesian optimization using tree-structured additive models.
problem Scaling Bayesian Optimization to high-dimensional problems.
method Tree-structured additive models with hybrid graph learning and zooming-based algorithms.
result Demonstrates faster model learning and reduced model complexity in high-dimensional settings.
Tree-Structured Boosting: Connections Between Gradient Boosted Stumps and Full Decision Treesstat.ML
Additive models, such as produced by gradient boosting, and full interaction models, such as classification and regression trees (CART), are widely used algorithms that have been investigated largely in isolation. We show that these models exist along a spectrum, revealing never-before-known connections between these t…
Innovative PGMs match neural networks, revealing precise approximations during forward propagation.
problem Lack of precise semantics and probabilistic interpretation in neural networks.
method Constructing infinite tree-structured PGMs that correspond to neural networks.
result DNNs perform precise approximations of PGM inference during forward propagation.
In this paper, learning of tree-structured Gaussian graphical models from distributed data is addressed. In our model, samples are stored in a set of distributed machines where each machine has access to only a subset of features. A central machine is then responsible for learning the structure based on received messag…
SGA: A Robust Algorithm for Partial Recovery of Tree-Structured Graphical Models with Noisy Samplesstat.ML
Improved algorithm for partial recovery of tree-structured graphs with noisy data.
problem Learning Ising tree models with noisy observations.
method Symmetrized Geometric Averaging (SGA) algorithm with improved sample complexity.
result Significantly better sample complexity for partial tree recovery.
The problem of maximum-likelihood (ML) estimation of discrete tree-structured distributions is considered. Chow and Liu established that ML-estimation reduces to the construction of a maximum-weight spanning tree using the empirical mutual information quantities as the edge weights. Using the theory of large-deviations…
The problem of categorical data analysis in high dimensions is considered. A discussion of the fundamental difficulties of probability modeling is provided, and a solution to the derivation of high dimensional probability distributions based on Bayesian learning of clique tree decomposition is presented. The main contr…
Study recovers tree structure in noisy MRFs with support size 3 or more.
problem Learning tree-structured MRFs with symmetric noise.
method Characterized recoverability based on joint PMF, provided algorithm for recovery.
result Structure of leaf clusters can be partially or fully identifiable.
New clustering method recovers hidden tree structure from data.
problem Recovering hidden hierarchical structure in data.
method Maximum average dot product for merging clusters in hierarchical clustering.
result The algorithm produces a tree that accurately represents the underlying generative hierarchical structure.
PolyILR: A Tree-Structured Orthonormal Decomposition of Compositional Data
problem Representing compositional data with hierarchical structure
method PolyILR: A canonical orthonormal decomposition of the Aitchison tangent space aligned with any tree topology
result PolyILR yields stable, interpretable features and enables inference at multiscale tree resolution
USNRT uses tree-structured learning to improve uncertainty quantification of variance networks.
problem Improving uncertainty quantification of variance networks.
method Tree-structured local neural network model that partitions feature space into regions for training region-specific neural networks to predict mean and variance.
result USNRT shows superior performance in estimating uncertainty with variances on UCI datasets compared to recent methods.
We construct a partial order relation which acts on the set of 3-cliques of a maximal planar graph G and defines a unique hierarchy. We demonstrate that G is the union of a set of special subgraphs, named `bubbles', that are themselves maximal planar graphs. The graph G is retrieved by connecting these bubbles in a tre…
Sum-Product Networks (SPNs) can be regarded as a form of deep graphical models that compactly represent deeply factored and mixed distributions. An SPN is a rooted directed acyclic graph (DAG) consisting of a set of leaves (corresponding to base distributions), a set of sum nodes (which represent mixtures of their chil…
Tree-AMP simplifies inference in complex tree-structured models.
problem Inference in high-dimensional tree-structured models.
method Approximate Message Passing algorithms for various machine learning tasks.
result Theoretical performance predictions and automated entropy estimation.
TreeDSB solves mOT problems on tree-structured costs for Wasserstein barycenters.
problem Optimal transport with multiple marginals and tree-structured quadratic costs.
method Tree-based Diffusion Schrödinger Bridge (TreeDSB) for continuous and dynamic solutions.
result TreeDSB efficiently computes Wasserstein barycenters in high dimensions.
Optimal transport for measures on noisy tree metrics is solved with robust approach.
problem Optimal transport problem for measures on noisy tree metrics.
method Max-min robust optimal transport approach considering uncertainty sets of tree metrics.
result Robust optimal transport admits a closed-form expression for fast computation.
Many common sequential data sources, such as source code and natural language, have a natural tree-structured representation. These trees can be generated by fitting a sequence to a grammar, yielding a hierarchical ordering of the tokens in the sequence. This structure encodes a high degree of syntactic information, ma…
Pitman-Yor Diffusion Treesstat.ML
We introduce the Pitman Yor Diffusion Tree (PYDT) for hierarchical clustering, a generalization of the Dirichlet Diffusion Tree (Neal, 2001) which removes the restriction to binary branching structure. The generative process is described and shown to result in an exchangeable distribution over data points. We prove som…
Tree structured graphical models are powerful at expressing long range or hierarchical dependency among many variables, and have been widely applied in different areas of computer science and statistics. However, existing methods for parameter estimation, inference, and structure learning mainly rely on the Gaussian or…
We propose a new algorithm to do posterior sampling of Kingman's coalescent, based upon the Particle Markov Chain Monte Carlo methodology. Specifically, the algorithm is an instantiation of the Particle Gibbs Sampling method, which alternately samples coalescent times conditioned on coalescent tree structures, and tree…
Bottom-Up Hidden Tree Markov Model is a highly expressive model for tree-structured data. Unfortunately, it cannot be used in practice due to the intractable size of its state-transition matrix. We propose a new approximation which lies on the Tucker factorisation of tensors. The probabilistic interpretation of such ap…
Efficiently learns tree-structured Ising models with minimal samples.
problem Learning tree-structured Ising models efficiently and accurately.
method Plug-in estimator for mutual information using the Chow-Liu algorithm.
result Proper learning of tree-structured Ising models with samples.
This paper introduces a new method to cluster qualitative attribute data using tree structures.
problem Clustering qualitative attribute data, especially when values are not in Euclidean space.
method Developed a joint learning mechanism to iteratively learn trees representing qualitative values' order relationships.
result The joint learning mechanism successfully clusters qualitative attribute data, yielding accurate results.
Paper proposes a VB method for TS-SBP mixture models with reduced computational cost.
problem Efficiently learning tree-structured stick-breaking process mixture models.
method Utilizes Bayes coding algorithm for context tree models to calculate sums over all possible trees.
result Proposes a learning algorithm with less computational cost for TS-SBP mixture of Gaussians.
We provide high-probability sample complexity guarantees for exact structure recovery and accurate predictive learning using noise-corrupted samples from an acyclic (tree-shaped) graphical model. The hidden variables follow a tree-structured Ising model distribution, whereas the observable variables are generated by a …
The paper proposes a method for interpretable mixture density estimation using a tree structure.
problem Complex probability distributions in machine learning models.
method Interpretable tree structure for mixture density estimation with fast inference.
result The method achieves both high speed and interpretability for mixture density estimation.
New algorithm recovers graph structure from noisy data.
problem Noise corrupts structure in Gaussian graphical models, making identification impossible.
method Developed an algorithm to recover graph structure up to an unavoidable ambiguity.
result Algorithm recovers graph structure up to an identified ambiguity, revealing local clustering and connectivity.
SBT model uses randomized sharding and sub-models to improve Bayesian Additive Regression Trees.
problem Improving efficiency and accuracy of Bayesian Additive Regression Trees.
method Randomized sharding, sub-models, intersection tree structure, optimal design.
result Theoretical optimal weights and worst-case complexity of SBT model.
Researchers improve tree model recovery from noisy data.
problem Learning tree structured models from corrupted data.
method Linear latent tree models and continuous corruption model.
result Chow-Liu algorithm consistently learns tree from noisy data.
Gromov-Wasserstein (GW) is a powerful tool to compare probability measures whose supports are in different metric spaces. GW suffers however from a computational drawback since it requires to solve a complex non-convex quadratic program. We consider in this work a specific family of cost metrics, namely \textit{tree me…
Label tree-based algorithms are widely used to tackle multi-class and multi-label problems with a large number of labels. We focus on a particular subclass of these algorithms that use probabilistic classifiers in the tree nodes. Examples of such algorithms are hierarchical softmax (HSM), designed for multi-class class…
In this paper, we study the weak compactness of the set of conformal metrics in any Riemann surface without boundary whose Calabi energy and area are uniformly bounded. We prove that for any sequence of such metrics, there alwasy exists a subsequence which converges in H\sp{2,2}_\sb{loc} everywhere except a finite numb…