BooST combines boosting and smooth trees for nonlinear regression.
problem Estimating partial effects in nonlinear models.
method Boosting smooth trees for partial effect estimation.
result BooST provides more interpretable partial effects than tree-based models.
Paper studies ensemble probabilistic regression trees for smooth approximations.
problem Smooth approximations of regression functions.
method Ensemble versions of probabilistic regression trees.
result Ensemble probabilistic regression trees are consistent and perform well.
Decision tree learning heuristics fail even in smoothed analysis for complex targets.
problem Greedy decision tree learning heuristics fail for complex target functions in the smoothed analysis model.
method Construct counterexamples and analyze the behavior of heuristics in the smoothed setting and agnostic setting.
result Greedy decision tree learning heuristics can build trees of exponential depth before achieving high accuracy for certain complex target functions.
Paper explains how tree ensembles improve predictions by smoothing and regulating smoothness.
problem Understanding why tree ensembles perform well despite their complexity.
method Interpreting tree ensembles as adaptive and self-regularizing smoothers.
result Ensemble trees make more smooth predictions than individual trees and adjust smoothness based on input dissimilarity.
Smooth fractal trees via analytic generators, preserving combinatorial and geometric properties.
problem Constructing smooth fractal trees from discrete models.
method Using analytic generator fields to integrate smooth vector fields in an internal state space, generating geometric curves as projections of generator trajectories.
result Analytic generators can represent any discrete tree specification and preserve the asymptotic limit geometry.
Paper introduces methods to handle missing data in probabilistic regression trees.
problem Handling missing data in probabilistic regression trees.
method Three approaches: uniform probability, partial observation, and dimension-reduced smoothing.
result Preserves interpretability while extending applicability to incomplete datasets.
KTBoost combines tree and kernel boosting for better function learning.
problem Learning functions with varying degrees of regularity.
method Combines regression trees and RKHS regression in each boosting iteration.
result KTBoost significantly outperforms tree and kernel boosting in predictive accuracy.
Tree tensor networks balance model complexity and empirical risk for high-dimensional function approximation.
problem Selecting optimal tree structure and ranks for high-dimensional function approximation.
method Proposes a complexity-based model selection method for tree tensor networks in empirical risk minimization.
result Demonstrates near-minimax adaptive performance across various smoothness classes.
Survival trees exhibit end-cut preference, leading to biased splits.
problem End-cut preference in survival trees causes biased splits and poor interpretability.
method Proposed a smooth sigmoid surrogate (SSS) approach to replace hard-threshold indicator function.
result Smooth sigmoid surrogate (SSS) effectively mitigates end-cut preference in survival trees.
The paper explores metrics on tree moduli spaces and a new topological group.
problem Continuous metrics on tree moduli spaces.
method Proposes and analyzes continuous piecewise-smooth metrics.
result Observes a new abelian topological group structure.
We analyze the consistency of decision trees and random forests in regression.
problem Consistency of decision trees and random forests in regression.
method Elementary proofs following classical arguments for smoothing methods.
result Establish weak and almost sure convergence of honest trees and forest averages to the true regression function.
We construct smooth 4-manifolds homeomorphic but not diffeomorphic to $CP^2#k\bar{CP^2},k \in {6,7,8,9}$, using the technique of rational blow-down along Wahl type plumbing trees of spheres.
Trees represent critical points, linking function topology.
problem Understanding the topology of functions with isolated critical points.
method Corresponding trees to critical points, proving equivalence if trees are isomorphic.
result Constructed a complete topological invariant for functions on 3-manifolds.
We adopt data structure in the form of cover trees and iteratively apply approximate nearest neighbour (ANN) searches for fast compressed sensing reconstruction of signals living on discrete smooth manifolds. Levering on the recent stability results for the inexact Iterative Projected Gradient (IPG) algorithm and by us…
ID3 learns juntas under smoothed product distributions.
problem Understanding the ID3 algorithm's performance on juntas.
method Smoothed analysis of ID3 for learning k-Juntas.
result ID3 learns k-Juntas in polynomial time when k = log n.
Multivariate boosted trees improve forecasting and control by capturing correlated predictions.
problem Capturing multivariate target cross-correlations and applying structured penalties to predictions.
method A computationally efficient algorithm for fitting multivariate boosted trees.
result Multivariate trees outperform univariate counterparts in correlated prediction scenarios.
Decision trees and shallow neural networks have different geometric complexities, impacting their interpretability and accuracy.
problem The geometric simplicity of decision boundaries in decision trees conflicts with the approximation capabilities of shallow neural networks.
method Analysis of the Radon total variation (RTV) seminorm to compare geometric complexity of decision regions and neural network approximations.
result Smooth barrier scores can approximate decision regions with finite RTV, but their performance depends on the tube-mass condition near the decision boundary.
We consider certain groups of tree automorphisms as so-called diffeological groups. The notion of diffeology, due to Souriau, allows to endow non-manifold topological spaces, such as regular trees that we look at, with a kind of a differentiable structure that in many ways is close to that of a smooth manifold; a suita…
Enhances random forests by smoothing predictions for better performance.
problem Suboptimal performance due to piecewise constant predictions in random forests.
method Kernel-based smoothing mechanism to introduce local regularity.
result Smoothed random forest model consistently improves predictive performance.
The paper introduces a new model to correct bias in treatment effect estimates due to sample selection.
problem Bias in treatment effect estimates due to sample selection.
method Type 2 Tobit Bayesian Additive Regression Trees (TOBART-2) with Dirichlet Process Mixture distribution and soft trees.
result Corrects bias in treatment effect estimates by accounting for nonlinearities and model uncertainty.
Analytic patch trees reveal new geometric structures and dimension fields.
problem Understanding the geometric and analytical properties of surface patch trees.
method Developed analytic surface patch trees and introduced interface curves to transmit state.
result Surface patch trees have natural foliations with one-dimensional curve trees and dimension fields.
GP-BART improves BART's predictive performance by incorporating Gaussian process priors.
problem Lack of smoothness and explicit covariance structure in BART.
method GP-BART extends BART with Gaussian process priors for tree predictions.
result GP-BART outperforms traditional models in various applications.
Bayesian Probabilistic Integration uses BART for high-dimensional, non-smooth functions.
problem Bayesian quadrature's limitations in high-dimensional or non-smooth functions.
method Bayesian Additive Regression Trees (BART) priors for numerical integration.
result Explicit convergence rates can be obtained in various settings.
In this paper we give a necessary combinatorial condition for a negative--definite plumbing tree to be suitable for rational blow--down, or to be the graph of a complex surface singularity which admits a rational homology disk smoothing. New examples of surface singularities with rational homology disk smoothings are a…
Infinitesimal gradient boosting is a new algorithm derived from gradient boosting.
problem Improving the efficiency and smoothness of gradient boosting.
method Introduced a new class of randomized regression trees and used a limit process in vanishing-learning-rate asymptotic.
result Convergence of the stochastic algorithm and characterization of the limiting procedure as a unique solution of a nonlinear ODE.
Differentiable optimization bridges arbitrary metrics to tree metrics.
problem Designing algorithms to convert arbitrary metrics to tree metrics with guarantees.
method DeltaZero framework, leveraging differentiable Gromov hyperbolicity.
result DeltaZero consistently achieves state-of-the-art distortion on synthetic and real-world datasets.
Gradient boosting improved with lassoed trees achieves faster convergence.
problem Improving gradient boosting convergence in large nonparametric spaces.
method Lassoed gradient boosted trees with early stopping.
result Achieves faster than n−1/4 L2 convergence rate. We classify the resolution graphs of weighted homogeneous surface singularities which admit rational homology disk smoothings. The nonexistence of rational homology disk smoothings is shown by symplectic geometric methods, while the existence is verified via smoothings of negative weights. In particular, it is shown th…
Theory of smooth relative connections on quiver bundles developed.
problem Existence of smooth relative connections over quiver bundles.
method Developed a theory over RQ on smooth twisted quiver bundles, provided obstructions and necessary/sufficient conditions. result Established a necessary and sufficient condition for the existence of smooth relative connections on tree-type quiver bundles.
New method tests tree models without causing computational pressure.
problem Incompatibility of adversarial robustness testing with tree ensembles.
method Smooths tree ensembles with sigmoid functions and uses gradient descent.
result Successfully reveals adversarial vulnerability of tree ensemble models.
Assessing heterogeneous treatment effects has become a growing interest in advancing precision medicine. Individualized treatment effects (ITE) play a critical role in such an endeavor. Concerning experimental data collected from randomized trials, we put forward a method, termed random forests of interaction trees (RF…
Optimal transport for measures on noisy tree metrics is solved with robust approach.
problem Optimal transport problem for measures on noisy tree metrics.
method Max-min robust optimal transport approach considering uncertainty sets of tree metrics.
result Robust optimal transport admits a closed-form expression for fast computation.
Adaptive Bayesian model for covariate-dependent power spectra analysis.
problem Estimating complex relationships and interactions between covariates and power spectra.
method Bayesian sum of trees model with local power spectrum estimation and reversible-jump MCMC for tree modifications.
result The method can accurately recover both smooth and abrupt changes in power spectra across multiple covariates.
The study provides theoretical guarantees for the statistical performance of optimal decision trees.
problem Theoretical limits on the statistical performance of globally optimal decision trees.
method Sharp oracle inequalities and uniform concentration framework based on Rademacher complexity.
result Derivation of minimax optimal rates for piecewise sparse heterogeneous anisotropic Besov space.
SBAMDT uses adaptive soft splits to model complex decision boundaries.
problem Limited ability of standard decision trees to capture complex decision boundaries.
method Probabilistic additive decision tree model with adaptive soft multivariate splits.
result Demonstrated improved predictive performance on synthetic and real datasets.
Study finds small surfaces in space times with new functionals.
problem Investigating small surfaces in space times without symmetry assumptions.
method Introducing Hawking type functionals and analyzing their properties.
result Characterization of concentration points and expansion of critical surfaces.
A new random forest algorithm improves tree construction for optimal performance.
problem Improving the performance of random forests, especially in complex and smooth scenarios.
method Adaptive split-balancing method using permutation-based splitting criterion.
result Achieves minimax optimality under various Lipschitz and Hölder classes.
Two new methods reduce random forest latency and improve accuracy.
problem High latency and memory demands in deep random forest models.
method DiNo and RanBu convert shallow random forests into efficient predictors.
result RanBu matches or exceeds full-depth random forest accuracy with up to 95% reduction in time.
A new type of distributional regression tree uses soft split rules for better predictive performance.
problem Estimating complete conditional distributions in regression.
method Distributional adaptive soft regression trees using multivariate soft split rules.
result The method outperforms various benchmark methods, especially in complex non-linear interactions.
Improved decision tree learning guarantees for complex functions.
problem Achieving provable guarantees for decision tree induction with complex target functions.
method Introduces a new splitting criterion that considers correlations between target function and subsets of attributes.
result Proves provable guarantees for all target functions with respect to the uniform distribution, circumventing previous impossibility results.
Proposes an algorithm for semi-supervised learning with budget constraints.
problem Learning classifiers within test-time budget constraints with limited labeled data.
method Leverages unlabeled data through Laplace smoothing and gradient boosted regression trees.
result First algorithm for semi-supervised budgeted learning.
Let f:T2→R be Morse function on 2-torus T2, and O(f) be the orbit of f with respect to the right action of the group of diffeomorphisms D(T2) on C∞(T2). Let also Of(f,X) be a connected component of O(f,X) which contains f. In the case …
Functional BART adds shape priors to Bayesian tree regression for better curve fitting.
problem Regression with function-on-scalar data and shape constraints.
method Bayesian tree structure with spline representations, customized Bayesian backfitting algorithm, shape priors.
result Improved estimation and prediction accuracy with shape priors.
We consider the problem of estimating a sparse multi-response regression function, with an application to expression quantitative trait locus (eQTL) mapping, where the goal is to discover genetic variations that influence gene-expression levels. In particular, we investigate a shrinkage technique capable of capturing a…
A new algorithm estimates sparse gradients on graphs with improved risk bounds.
problem Estimating sparse gradients on graph-structured data.
method Tree-Projected Gradient Descent algorithm for gradient-sparse parameters.
result Achieves risk bound of ns∗log(1+s∗p). Adversarial online nonparametric regression achieves optimal rates with locally adaptive learning.
problem Adversarial online nonparametric regression with general convex losses.
method Parameter-free learning algorithm leveraging chaining trees to compete against H{ö}lder functions, dynamically tracking and adapting to local smoothness variations.
result First computationally efficient algorithm with locally adaptive optimal rates for online regression in an adversarial setting.
In this paper we construct Riemannian metrics and weight functions over Casson handles. We show that the corresponding Atiyah-Hitchin-Singer complexes are Fredholm for some class of Casson handles of bounded type. Using these, the Yang-Mills moduli spaces are constructed as finite dimensional smooth manifolds over Cass…
Develops a new multivariate regression model for complex outcomes.
problem Flexible, heterogeneous, and residual-dependent multivariate regression problems.
method MultiVCBART framework with Graphical Horseshoe priors.
result Empirically outperforms existing models on sparse, high-dimensional datasets.