Boosting meta-trees improve decision tree performance.
problem Overfitting in decision trees.
method Boosting approach to construct multiple meta-trees.
result Ensembles of meta-trees prevent overfitting.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,742 papers · 148 categories
Trend · papers per month
48 results for “Tree construction”
dtControl uses decision trees to represent controllers efficiently and explainably.
problem Representing controllers concisely and explainably.
method dtControl uses decision tree learning algorithms to represent controllers. Novel techniques for determinizing controllers are introduced.
result Novel techniques for determinizing controllers during decision tree construction are extremely efficient, yielding small decision trees.
Bayesian Decision Trees are known for their probabilistic interpretability. However, their construction can sometimes be costly. In this article we present a general Bayesian Decision Tree algorithm applicable to both regression and classification problems. The algorithm does not apply Markov Chain Monte Carlo and does…
New method for Lagrangian Floer homology groups using flow trees.
problem Computing equivariant Lagrangian Floer homology.
method Constructing and exploiting an A-infinity module structure on the Floer complex.
result Established constructions of equivariant Lagrangian Floer homology groups.
In this technical note, we adapt an idea of Gabai to construct non-uniquely ergodic, non-geometric, arational trees.
Alexander polynomial equals spanning tree count at t=1.
problem Alexander polynomial for spatial graphs.
method Combinatorial constructions generalized to weighted graphs.
result Value of Alexander polynomial at t=1 equals weighted spanning tree count.
On Uncertainty Estimation by Tree-based Surrogate Models in Sequential Model-based Optimizationstat.ML
A new tree-based model improves uncertainty estimation in sequential optimization.
problem Improving uncertainty estimation in sequential model-based optimization.
method Proposed a new ensemble of randomized trees (BwO forest) with bagging and oversampling.
result BwO forest outperforms existing tree-based models in various optimization scenarios.
We present a construction, called the limit of a tree system of spaces (or, less formally, a tree of spaces). The construction is designed to produce compact metric spaces that resemble fractals, out of more regular spaces, such as closed manifolds, compact polyhedra, compact Menger manifolds, etc. Such spaces are pote…
A Novel Hyperparameter-free Approach to Decision Tree Construction that Avoids Overfitting by Designcs.LG
Decision trees are an extremely popular machine learning technique. Unfortunately, overfitting in decision trees still remains an open issue that sometimes prevents achieving good performance. In this work, we present a novel approach for the construction of decision trees that avoids the overfitting by design, without…
A new random forest algorithm improves tree construction for optimal performance.
problem Improving the performance of random forests, especially in complex and smooth scenarios.
method Adaptive split-balancing method using permutation-based splitting criterion.
result Achieves minimax optimality under various Lipschitz and Hölder classes.
A cluster tree provides a highly-interpretable summary of a density function by representing the hierarchy of its high-density clusters. It is estimated using the empirical tree, which is the cluster tree constructed from a density estimator. This paper addresses the basic question of quantifying our uncertainty by ass…
JSRT improves regression tree performance by incorporating global node information.
problem Regression tree performance relies on local node means, ignoring global node information.
method Proposes JSRT by integrating global mean information from different nodes.
result Demonstrates superior performance and efficiency compared to other regression tree methods.
This work presents an approach to automatically induction for non-greedy decision trees constructed from neural network architecture. This construction can be used to transfer weights when growing or pruning a decision tree, allowing non-greedy decision tree algorithms to automatically learn and adapt to the ideal arch…
In this paper, we study the dynamics of degenerating sequences of rational maps on Riemann sphere using -trees. Given a sequence of degenerating rational maps, we give two constructions for limiting dynamics on -trees: one geometric and one algebraic. The geometric constructio…
A quasi-tree is a geodesic metric space quasi-isometric to a tree. We give a general construction of many actions of groups on quasi-trees. The groups we can handle include non-elementary (relatively) hyperbolic groups, rank 1 CAT(0) groups, mapping class groups and Out(Fn). As an application, we show that mapping clas…
We present some explicit constructions of universal R-trees with applications to the asymptotic geometry of hyperbolic spaces. In particular, we show that any asymptotic cone of a complete simply connected manifold of negative curvature is a complete homogeneous R-tree with the valency at every point. It…
New connection found between complex polynomials and surface homeomorphisms.
problem Investigating the existence of generalized pseudo-Anosov maps from quadratic polynomials.
method Developed a new connection between dynamics of quadratic polynomials and surface homeomorphisms, focusing on Hubbard trees.
result Identified conditions for constructing generalized pseudo-Anosov maps from quadratic polynomials.
New method builds robust trees from noisy data.
problem Building accurate classification trees from noisy labeled data.
method Combines SVM-like splitting rules and label noise detection.
result Effective in detecting and mitigating label noise.
In this paper, we present a novel massively parallel algorithm for accelerating the decision tree building procedure on GPUs (Graphics Processing Units), which is a crucial step in Gradient Boosted Decision Tree (GBDT) and random forests training. Previous GPU based tree building algorithms are based on parallel multi-…
Boost-R uses gradient boosted trees for analyzing recurrence data.
problem Analyzing recurrence data with static and dynamic features.
method Gradient boosted additive trees with time-dependent functions.
result Estimates the cumulative intensity function of recurrent event processes.
Smooth fractal trees via analytic generators, preserving combinatorial and geometric properties.
problem Constructing smooth fractal trees from discrete models.
method Using analytic generator fields to integrate smooth vector fields in an internal state space, generating geometric curves as projections of generator trajectories.
result Analytic generators can represent any discrete tree specification and preserve the asymptotic limit geometry.
In this paper, we investigate adaptive nonlinear regression and introduce tree based piecewise linear regression algorithms that are highly efficient and provide significantly improved performance with guaranteed upper bounds in an individual sequence manner. We use a tree notion in order to partition the space of regr…
A new algorithm converts staged trees into Chain Event Graphs.
problem Creating explicit representations of structural zeros and conditional independences.
method Iterative backward algorithm transforming a staged tree into a CEG.
result No information is lost in the transformation from staged tree to CEG.
New techniques optimize decision trees for interpretable machine learning.
problem Optimizing decision trees for interpretable machine learning.
method General framework for decision tree optimization addressing imbalanced data and continuous variables.
result Proves optimal decision trees for various objectives.
The paper studies geometric properties of quasi-trees and tree approximations.
problem Geometric properties and tree approximations of quasi-trees.
method Construction of a tree approximating quasi-trees, proving quasi-isometric properties.
result Every quasi-tree is -quasi-isometric to a simplicial tree.
We construct examples of finitely generated groups L that have non-trivial actions on -trees but which cannot act, without fixing a vertex, on any simplicial tree. Moreover, any finitely presented group mapping onto L does have a fixed point-free action on some simplicial tree.
Infinite fractal tree solves shortest connection problem.
problem Finding the shortest connection for a fractal set.
method Constructing an infinite planar self-similar binary tree.
result The tree is the unique solution to the Steiner problem.
Max-Cut decision tree improves classification accuracy and reduces computation time.
problem Improving decision tree accuracy and efficiency for complex classification tasks.
method Alternative splitting metric (max cut) and PCA-based feature selection at each node.
result 49% improvement in accuracy with 94% reduction in CPU time on CIFAR-100 data.
Multi-Purpose Binomial Model: Fitting all Moments to the Underlying Geometric Brownian Motionq-fin.PR
We construct a binomial tree model fitting all moments to the approximated geometric Brownian motion. Our construction generalizes the classical Cox-Ross-Rubinstein, the Jarrow-Rudd, and the Tian binomial tree models. The new binomial model is used to resolve a discontinuity problem in option pricing.
Reduces conjecture to tree-based Artin groups.
problem Proving -conjecture for all Artin groups.
method Actions on Bestvina complexes of Garside groupoids.
result New classes of Artin groups satisfying the conjecture.
P-Trees improve investment performance by optimizing the efficient frontier.
problem Optimizing investment performance in complex financial markets.
method Introducing P-Trees, a new tree-based model for analyzing panel data.
result P-Trees significantly advance the efficient frontier and outperform existing models.
The construction of efficient and effective decision trees remains a key topic in machine learning because of their simplicity and flexibility. A lot of heuristic algorithms have been proposed to construct near-optimal decision trees. ID3, C4.5 and CART are classical decision tree algorithms and the split criteria they…
Semi-analytic models are best suited to compare galaxy formation and evolution theories with observations. These models rely heavily on halo merger trees, and their realistic features (i.e., no drastic changes on halo mass or jumps on physical locations). Our aim is to provide a new framework for halo merger tree gener…
Stochastic Gradient Treesstat.ML
We present an algorithm for learning decision trees using stochastic gradient information as the source of supervision. In contrast to previous approaches to gradient-based tree learning, our method operates in the incremental learning setting rather than the batch learning setting, and does not make use of soft splits…
Let G be a finitely presented group. Scott and Swarup have constructed a canonical splitting of G which encloses all almost invariant sets over virtually polycyclic subgroups of a given length. We give an alternative construction of this regular neighbourhood, by showing that it is the tree of cylinders of a JSJ splitt…
Kauri is a novel unsupervised binary tree for clustering that outperforms existing methods.
problem Learning a tree end-to-end for clustering without labels is an open challenge.
method Greedy maximization of the kernel KMeans objective without centroids.
result Kauri often outperforms existing unsupervised clustering methods, especially with non-linear kernels.
Improved Random Forests detect pure interactions better.
problem Random Forests struggle with certain pure interactions.
method Alternative partitioning schemes during tree construction.
result Improved Random Forests enhance fitting ability in scenarios with pure interactions.
We introduce block-tree graphs as a framework for deriving efficient algorithms on graphical models. We define block-tree graphs as a tree-structured graph where each node is a cluster of nodes such that the clusters in the graph are disjoint. This differs from junction-trees, where two clusters connected by an edge al…
Bowditch's JSJ tree for splittings over 2-ended subgroups is a quasi-isometry invariant for 1-ended hyperbolic groups which are not cocompact Fuchsian. Our main result gives an explicit, computable "visual" construction of this tree for certain hyperbolic right-angled Coxeter groups. As an application of our constructi…
Paper develops a new method for game options in local volatility models.
problem Optimal stopping in one-dimensional diffusion with general coefficients.
method Skorokhod embedding to construct recombining tree approximations.
result Construct nearly optimal stopping times with convergence rates.
HRF enhances tree diversity in random forests to improve performance.
problem Selection bias and lack of diversity in random forests.
method Introducing heterogeneity during tree construction by assigning lower weights to features used in previous trees.
result HRF outperforms other ensemble methods in accuracy across 52 datasets.
Adaptive Bayesian Reticulumstat.ML
Neural Networks and Decision Trees: two popular techniques for supervised learning that are seemingly disconnected in their formulation and optimization method, have recently been combined in a single construct. The connection pivots on assembling an artificial Neural Network with nodes that allow for a gate-like funct…
Sparse learning with CARTstat.ML
The paper studies statistical properties of CART regression trees.
problem Understanding the statistical properties of CART regression trees.
method The paper constructs a prior distribution on split points and solves a nonlinear optimization problem to bound the Pearson correlation between the optimal decision stump and response data.
result CART with cost-complexity pruning achieves an optimal complexity/goodness-of-fit tradeoff when the depth scales with the logarithm of the sample size.
Evolutionary algorithms improve decision tree ensembles.
problem Improving predictive performance of decision trees.
method Real-valued vector representation of decision trees, evolutionary algorithms (Differential evolution, Evolution strategies).
result Proposed methods outperform classical decision tree induction algorithms.
In the paper, we focus on complexity of C5.0 algorithm for constructing decision tree classifier that is the models for the classification problem from machine learning. In classical case the decision tree is constructed in running time, where is a number of classes, is the size of a traini…
New classifiers account for context-specific independences.
problem Restrictions in generative models for classification.
method Staged tree classifiers that account for context-specific independences.
result Staged tree classifiers achieve competitive classification accuracy.
New groups constructed from tree automorphisms, proving finiteness.
problem Finiteness properties of self-similar and Röver groups.
method Braiding of self-similar groups, use of -ary cloning systems, analysis of embedded disks.
result Construction of a new group (braided Röver group) of type .
TES-AE uses tree grammars to speed up autoencoding for tree data.
problem Challenges in autoencoding tree data due to its non-vectorial and discrete nature.
method TES-AE combines reservoir computing with tree grammars for faster training.
result TES-AE outperforms D-VAE in speed and accuracy for tree data.