A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Covariance-Driven Regression Trees reduce overfitting in CART.
Additive models, such as produced by gradient boosting, and full interaction models, such as classification and regression trees (CART), are widely used algorithms that have been investigated largely in isolation. We show that these models exist along a spectrum, revealing never-before-known connections between these t…
A new randomized tree classifier outperforms traditional CARTs.
The paper studies statistical properties of CART regression trees.
Study uses AI techniques to predict bank customer solvency.
Proposed by Donoho (1997), Dyadic CART is a nonparametric regression method which computes a globally optimal dyadic decision tree and fits piecewise constant functions in two dimensions. In this article we define and study Dyadic CART and a closely related estimator, namely Optimal Regression Tree (ORT), in the contex…
Kauri is a novel unsupervised binary tree for clustering that outperforms existing methods.
Max-Cut decision tree improves classification accuracy and reduces computation time.
Decision trees with binary splits are popularly constructed using Classification and Regression Trees (CART) methodology. For binary classification and regression models, this approach recursively divides the data into two near-homogenous daughter nodes according to a split point that maximizes the reduction in sum of …
The paper analyzes the convergence of CART under a SID condition, improving previous results.
Decision trees are consistent for regression and classification tasks even with many predictors.
This paper explores the use of Column Generation (CG) techniques in constructing univariate binary decision trees for classification tasks. We propose a novel Integer Linear Programming (ILP) formulation, based on root-to-leaf paths in decision trees. The model is solved via a Column Generation based heuristic. To spee…
Paper detects bias in AI medical models using CART.
A new method for decision tree selection in recommendation systems.
Decision trees improve performance in various fields.
Undirected graphical models encode in a graph the dependency structure of a random vector . In many applications, it is of interest to model given another random vector as input. We refer to the problem of estimating the graph of conditioned on as ``graph-valued regression.'' In this pap…
FIGS improves prediction performance while maintaining interpretability, especially in medical domains.
This work improves mixing rates for Bayesian CART, a key component of BART.
The construction of efficient and effective decision trees remains a key topic in machine learning because of their simplicity and flexibility. A lot of heuristic algorithms have been proposed to construct near-optimal decision trees. ID3, C4.5 and CART are classical decision tree algorithms and the split criteria they…
Bayesian CART models improve insurance claims frequency prediction and interpretation.
New split rules improve subpopulation targeting in policy-making.
While deep reinforcement learning has successfully solved many challenging control tasks, its real-world applicability has been limited by the inability to ensure the safety of learned policies. We propose an approach to verifiable reinforcement learning by training decision tree policies, which can represent complex p…
A single slow-growing tree matches Random Forest's performance.
Decision tree learning is a popular approach for classification and regression in machine learning and statistics, and Bayesian formulations---which introduce a prior distribution over decision trees, and formulate learning as posterior inference given data---have been shown to produce competitive performance. Unlike c…
Selective inference framework for CART trees to control error rates and coverage.
We propose a novel "tree-averaging" model that utilizes the ensemble of classification and regression trees (CART). Each constituent tree is estimated with a subset of similar data. We treat this grouping of subsets as Bayesian ensemble trees (BET) and model them as an infinite mixture Dirichlet process. We show that B…
This paper explains CART random forests using stochastic control theory.
A novel gradient-based method optimizes decision trees for complex tasks.
We consider the use of decision trees for decision-making problems under the predict-then-optimize framework. That is, we would like to first use a decision tree to predict unknown input parameters of an optimization problem, and then make decisions by solving the optimization problem using the predicted parameters. A …
Bregman perspective on CART provides a unified framework for impurity measures.
Risk bounds for Classification and Regression Trees (CART, Breiman et. al. 1984) classifiers are obtained under a margin condition in the binary supervised classification framework. These risk bounds are obtained conditionally on the construction of the maximal deep binary tree and permit to prove that the linear penal…
Decision trees are a popular technique in statistical data classification. They recursively partition the feature space into disjoint sub-regions until each sub-region becomes homogeneous with respect to a particular class. The basic Classification and Regression Tree (CART) algorithm partitions the feature space using…
Data mining and machine learning techniques such as classification and regression trees (CART) represent a promising alternative to conventional logistic regression for propensity score estimation. Whereas incomplete data preclude the fitting of a logistic regression on all subjects, CART is appealing in part because s…
Decision stumps accurately screen variables in nonparametric models.
Improved decision tree learning guarantees for complex functions.
Causal trees struggle with accuracy in estimating treatment effects.
TRUST improves tree models' accuracy while maintaining interpretability.
PILOT is a fast algorithm for linear model trees that outperforms existing methods.
The study reveals decision trees' limitations in fitting data from additive models, proving a generalization lower bound.
AF improves classification models by adaptively weighting trees.
Previous algorithms for constructing regression tree models for longitudinal and multiresponse data have mostly followed the CART approach. Consequently, they inherit the same selection biases and computational difficulties as CART. We propose an alternative, based on the GUIDE approach, that treats each longitudinal d…
Regularizes decision trees to reduce inference time by up to 4x with minimal accuracy loss.
Machine learning algorithms often contain many hyperparameters (HPs) whose values affect the predictive performance of the induced models in intricate ways. Due to the high number of possibilities for these HP configurations and their complex interactions, it is common to use optimization techniques to find settings th…
Recursive partitioning approaches producing tree-like models are a long standing staple of predictive modeling, in the last decade mostly as ``sub-learners'' within state of the art ensemble methods like Boosting and Random Forest. However, a fundamental flaw in the partitioning (or splitting) rule of commonly used tre…
The infinitesimal jackknife (IJ) has recently been applied to the random forest to estimate its prediction variance. These theorems were verified under a traditional random forest framework which uses classification and regression trees (CART) and bootstrap resampling. However, random forests using conditional inferenc…
G-FIGS uses instance weights to create interpretable models from diverse data.
The detection of Denial of Service (DoS) attacks remains a challenge for the cloud environment, affecting a massive number of services and applications hosted by such virtualized infrastructures. Typically, in the literature, the detection of DoS attacks is performed solely by analyzing the traffic of packets in the ne…
Designing effective and efficient classifier for pattern analysis is a key problem in machine learning and computer vision. Many the solutions to the problem require to perform logic operations such as `and', `or', and `not'. Classification and regression tree (CART) include these operations explicitly. Other methods s…