ASBART accelerates Soft BART for faster Bayesian regression.
problem Slow computation in Soft BART.
method Proposed ASBART, a variant of Soft BART.
result ASBART is about 10 times faster than Soft BART with similar accuracy.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,657 papers · 148 categories
Trend · papers per month
48 results for “BART”
BART and MOTR-BART improve tree-based predictions with local linear models.
problem Non-linearity and high-order interactions in data.
method Bayesian Additive Regression Trees (BART) and Model Trees BART (MOTR-BART) using piecewise linear functions.
result MOTR-BART achieves equal or better performance with fewer trees than BART.
Probit Monotone BARTstat.ML
Probit Monotone BART estimates binary outcomes using monotonic functions.
problem Estimating conditional mean functions for binary outcomes with monotonicity constraints.
method Proposes a new BART variant that incorporates monotonicity constraints for binary outcomes.
result Allows for more precise estimation of monotonic functions in binary outcome models.
Lower bound on BART's mixing time increases with data points.
problem Slow mixing time in BART's MCMC chains.
method Simplified BART with a single tree and reduced MCMC moves.
result Mixing time grows exponentially with data points.
This study converts BART to Gaussian process regression, revealing its limitations and potential improvements.
problem Understanding the Gaussian process limit of BART and its implications.
method Deriving and computing BART's prior covariance function, implementing the infinite trees limit as GP regression, and tuning hyperparameters.
result The Gaussian process limit of BART is inferior to standard BART but can be made competitive with proper hyperparameter tuning.
GP-BART improves BART's predictive performance by incorporating Gaussian process priors.
problem Lack of smoothness and explicit covariance structure in BART.
method GP-BART extends BART with Gaussian process priors for tree predictions.
result GP-BART outperforms traditional models in various applications.
Proposes extensions to semi-parametric models using BART for shared covariates.
problem Avoiding poor coverage properties and reducing bias in linear predictor estimates.
method Modifies tree-generation moves in BART to handle shared covariates between linear and non-parametric components.
result Competitive performance in modelling complex interactions and predicting student achievements.
SoftBart improves BART for high-noise modeling in science.
problem High noise in scientific data.
method Soft BART algorithm for Bayesian additive regression trees.
result Improves predictive performance and facilitates larger model integration.
Paper proposes a new method to improve BART model predictions outside training data range.
problem Improving prediction and prediction intervals for BART models at extrapolation points.
method Gaussian processes are added to BART leaf nodes for extrapolation.
result The new method outperforms standard BART and frequentist resampling methods in simulations.
On Theory for BARTstat.ML
Ensemble learning is a statistical paradigm built on the premise that many weak learners can perform exceptionally well when deployed collectively. The BART method of Chipman et al. (2010) is a prominent example of Bayesian ensemble learning, where each learner is a tree. Due to its impressive performance, BART has rec…
Bayesian Additive Regression Trees (BART) is a fully Bayesian approach to modeling with ensembles of trees. BART can uncover complex regression functions with high dimensional regressors in a fairly automatic way and provide Bayesian quantification of the uncertainty through the posterior. However, BART assumes IID nor…
Oblique BART improves tree-based predictions.
problem Axis-aligned decision rules in BART can be suboptimal.
method Developed an oblique version of BART using data-adaptive hyperplane partitions.
result Oblique BART outperformed axis-aligned BART and other tree methods on benchmarks.
We develop a Bayesian "sum-of-trees" model where each tree is constrained by a regularization prior to be a weak learner, and fitting and inference are accomplished via an iterative Bayesian backfitting MCMC algorithm that generates samples from a posterior. Effectively, BART is a nonparametric Bayesian regression appr…
Bayesian additive regression trees (BART) (Chipman et. al., 2010) is a powerful predictive model that often outperforms alternative models at out-of-sample prediction. BART is especially well-suited to settings with unstructured predictor variables and substantial sources of unmeasured variation as is typical in the so…
An Infinite BART modelstat.CO
Infinite BART model selects number of trees and allows different functions for clusters.
problem Regression and classification analysis with automatic tree selection and cluster-specific functions.
method Incorporates an Indian Buffet process prior to select a subset of decision trees for each observation.
result Infinite BART model outperforms classic BART on simulated and real datasets.
Paper introduces ps-BART for estimating nonlinear ATE and CATE in continuous treatments.
problem Estimating ATE and CATE in continuous treatments with nonlinear relationships.
method Generalized ps-BART model for nonparametric estimation.
result ps-BART outperforms BCF model in highly nonlinear settings.
BART is extended to handle various response variables.
problem Modeling nonlinear regression functions for diverse response types.
method Generalized Bayesian Additive Regression Trees (GBART) for exponential family distributions.
result The posterior concentrates at a minimax rate for certain response distributions.
IQ-BART models conditional quantiles using a non-parametric Bayesian approach.
problem Capturing multimodal predictive distributions in time series forecasting.
method Implicit Quantile BART (IQ-BART) augments data with quantile values for non-parametric quantile function estimation.
result IQ-BART provides flexible distribution-free regression with theoretical guarantees.
On the Computational Efficiency of Bayesian Additive Regression Trees: An Asymptotic Analysisstat.ML
BART improves predictive performance but slows down with more data.
problem Understanding and improving the computational efficiency of BART with large datasets.
method Asymptotic analysis of a modified BART sampler, focusing on hitting time of high posterior density sets.
result The convergence time of the BART sampler increases with the number of training samples due to multi-modality, but can be mitigated by increasing the number of trees or raising the sampler temperature.
We present BART, a denoising autoencoder for pretraining sequence-to-sequence models. BART is trained by (1) corrupting text with an arbitrary noising function, and (2) learning a model to reconstruct the original text. It uses a standard Tranformer-based neural machine translation architecture which, despite its simpl…
GPU-accelerated BART speeds up Bayesian regression.
problem Long running time of BART makes it impractical for large datasets.
method GPU-enabled implementation of BART.
result BART is now 200x faster on GPUs.
Bayesian Probabilistic Integration uses BART for high-dimensional, non-smooth functions.
problem Bayesian quadrature's limitations in high-dimensional or non-smooth functions.
method Bayesian Additive Regression Trees (BART) priors for numerical integration.
result Explicit convergence rates can be obtained in various settings.
New algorithm broadens BART models applicability.
problem Limited applicability of Bayesian additive regression trees (BART) models due to conditional conjugacy.
method Introduces a reversible jump Markov chain Monte Carlo algorithm for generalized BART models.
result Extends BART models to arbitrary generalized BART models without conditional conjugacy.
flexBART improves BART for categorical predictors by creating flexible tree partitions.
problem Limitation of BART in handling categorical predictors with one-hot encoding.
method flexBART re-implements BART with regression trees that can assign multiple levels to both branches of a decision tree node, and proposes a new decision rule prior for spatial data.
result flexBART often yields improved predictive performance and scales better to larger datasets than existing BART implementations.
Proposes using external data to improve predictions in medical applications with limited samples.
problem Small sample sizes and complex covariate-response relationships in medical data.
method Integrates external co-data into Bayesian Additive Regression Trees (BART) using an empirical Bayes framework.
result Improves prediction accuracy compared to standard BART, especially for nonlinear relationships.
Functional BART with Shape Priors: A Bayesian Tree Approach to Constrained Functional Regressionstat.ME
Functional BART adds shape priors to Bayesian tree regression for better curve fitting.
problem Regression with function-on-scalar data and shape constraints.
method Bayesian tree structure with spline representations, customized Bayesian backfitting algorithm, shape priors.
result Improved estimation and prediction accuracy with shape priors.
We present a new package in R implementing Bayesian additive regression trees (BART). The package introduces many new features for data analysis using BART such as variable selection, interaction detection, model diagnostic plots, incorporation of missing data and the ability to save trees for future prediction. It is …
Proposes K-Fold Causal BART for improved CATE estimation.
problem Improving estimation of Conditional Average Treatment Effects (CATE).
method K-Fold Causal Bayesian Additive Regression Trees (K-Fold Causal BART).
result K-Fold Causal BART is not state-of-the-art for ATE and CATE estimation in the IHDP dataset, but provides insights into model robustness and evaluation methods.
BAVART model combines VAR and BART for non-linear forecasting.
problem Overly restrictive linearity assumption in VAR models.
method Combining VAR with Bayesian additive regression trees (BART).
result BAVART model yields highly competitive forecasts.
Two methods use BART to model missing data in leaf photosynthetic trait data.
problem Handling missing data in multivariate outcomes with non-ignorable mechanisms.
method Bayesian Additive Regression Trees (BART) for joint modeling of data and missingness indicators.
result Both methods effectively recover various missingness mechanisms and outperform existing approaches.
BARK optimizes black-box functions using Bayesian Additive Regression Trees.
problem Bayesian optimization of complex, black-box functions with uncertainty quantification.
method BART Kernel using tree agreement for posterior over piecewise-constant functions, explored using MCMC.
result BARK obtains samples of Gaussian processes for function distributions, enabling acquisition functions for optimization.
Additive regression trees are flexible non-parametric models and popular off-the-shelf tools for real-world non-linear regression. In application domains, such as bioinformatics, where there is also demand for probabilistic predictions with measures of uncertainty, the Bayesian additive regression trees (BART) model, i…
Bayesian Additive Distribution Regression (DistBART) predicts distributions from grouped data.
problem Predicting distributions from grouped data with varying characteristics.
method Bayesian nonparametric approach using BART for modeling the regression function.
result Empirical and theoretical evidence supports DistBART's effectiveness in learning from low-dimensional marginals.
Proposes a new model to handle noisy data in scientific research.
problem Measurement error in noisy data settings.
method Measurement error BART (meBART) integrates measurement error in Bayesian additive regression trees.
result meBART provides more accurate parameter estimation, robust uncertainty quantification, and superior predictive performance.
We present a method for incorporating missing data in non-parametric statistical learning without the need for imputation. We focus on a tree-based method, Bayesian Additive Regression Trees (BART), enhanced with "Missingness Incorporated in Attributes," an approach recently proposed incorporating missingness into deci…
Estimating heterogeneous survival treatment effect in observational data using machine learningstat.AP
Study improves machine learning for estimating survival treatment effects.
problem Estimating heterogeneous survival treatment effects in observational data.
method Flexible machine learning methods in the counterfactual framework, including AFT-BART-NP.
result AFT-BART-NP consistently yields best performance in terms of bias, precision, and frequentist coverage.
Develops a new multivariate regression model for complex outcomes.
problem Flexible, heterogeneous, and residual-dependent multivariate regression problems.
method MultiVCBART framework with Graphical Horseshoe priors.
result Empirically outperforms existing models on sparse, high-dimensional datasets.
Bayesian approach for estimating heterogeneous treatment effects in RDD designs.
problem Heterogeneity in treatment effects in RDD designs can lead to misleading conclusions.
method Direct Bayesian Additive Regression Trees (BART) for modeling heterogeneous treatment effects.
result Flexibly captures complicated structures of heterogeneous treatment effects as a function of covariates.
Combines BART and Gaussian process for spatial covariate prediction with uncertainty.
problem Improving spatial prediction models with nonlinear and interaction covariates.
method Bayesian Additive Regression Trees (BART) combined with Gaussian process for spatial dependence.
result Effective in reducing computational burden through INLA and MCMC.
Bayesian Additive Regression Networks use neural networks for regression tasks.
problem Regression tasks with small neural networks and ensemble learning.
method Bayesian Additive Regression Tree principles applied to small neural networks, Gibbs sampling for ensemble learning.
result BARN provides more consistent and often more accurate results than shallow neural networks, BART, and ordinary least squares.
New algorithms improve MPBART for HIV patient data.
problem Improving inference for multinomial outcomes in HIV patient data.
method Introduced two new algorithms for fitting MPBART.
result Better performance in MCMC convergence and predictive accuracy.
Developed a flexible Bayesian g-formula for causal survival analysis with time-dependent confounding.
problem Estimating causal survival curves in longitudinal observational studies with time-varying treatments and confounding.
method Incorporated Bayesian Additive Regression Trees (BART) into the g-formula to model time-evolving generative components and mitigate bias due to model misspecification.
result Demonstrated improved empirical performance and practical utility of the proposed method through simulations and real-world data analysis.
The paper studies causal effects of multiple treatments in healthcare databases with rare outcomes.
problem Estimating causal effects of multiple treatments in healthcare databases with rare outcomes.
method The paper designs three sets of simulations and compares the operating characteristics of three types of methods: Bayesian Additive Regression Trees (BART), regression adjustment on multivariate spline of generalized propensity scores (RAMS), and inverse probability of treatment weighting (IPTW) with multinomial logistic regression or generalized boosted models.
result BART and RAMS provide lower bias and mean squared error compared to IPTW methods.
This work improves mixing rates for Bayesian CART, a key component of BART.
problem Understanding and improving mixing rates for Bayesian inference with MCMC.
method Derived upper bounds on mixing times, provided sufficient conditions for polynomial mixing, and proposed Twiggy Bayesian CART.
result Twiggy Bayesian CART achieves polynomial mixing without assuming signal connectivity.
Paper proves Jeffrey's update rule minimizes relative entropy.
problem Improving Bayesian learning algorithms.
method More concise proof of Jeffrey's update rule.
result Jeffrey's update rule reduces relative entropy.
This article proposes Multinomial Probit Bayesian Additive Regression Trees (MPBART) as a multinomial probit extension of BART - Bayesian Additive Regression Trees (Chipman et al (2010)). MPBART is flexible to allow inclusion of predictors that describe the observed units as well as the available choice alternatives. T…
BFTS uses Bayesian Additive Regression Trees for improved personalized mobile health interventions.
problem Adapting to complex, non-linear user behaviors in personalized mobile health interventions.
method Bayesian Forest Thompson Sampling (BFTS) integrates Bayesian Additive Regression Trees (BART) into the exploration loop of contextual bandits.
result BFTS achieves state-of-the-art regret on tabular benchmarks and improves engagement rates by over 30% in a behavioral intervention study.
A Bayesian approach to multilabel classification using tree-based models.
problem Challenges in multilabel classification due to complex label relationships and correlations.
method Bayesian Additive Regression Trees (BART) framework for modeling multilabel classification.
result Improved predictive performance compared to other models, including an oracle model.