Generalized Baumslag-Solitar groups are defined as fundamental groups of graphs of groups with infinite cyclic vertex and edge groups. Forester proved (in "On uniqueness of JSJ decompositions of finitely generated groups", Comment. Math. Helv. 78 (2003) pp 740-751) that in most cases the defining graphs are cyclic JSJ …
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,181 papers · 148 categories
Trend · papers per month
48 results for “forest decomposition”
New unbiased variance estimator for random forests using Hoeffding decomposition.
problem Uncertainty quantification in random forests with large kernel sizes and small sample sizes.
method Proposes a new Hoeffding decomposition view for variance estimation, establishing unbiased estimators and ratio consistency.
result Establishes the ratio consistency of the proposed variance estimator, justifying confidence interval coverage rates.
New graph-based preconditioners speed up optimization on graph data.
problem Optimizing functions on graph data structures.
method Construct combinatorial preconditioners from graph partitions.
result Provable optimal condition numbers for certain decompositions.
Develops HCQRF for estimating heterogeneous treatment effects with censored data.
problem Estimating heterogeneous treatment effects on censored responses with high-dimensional variables.
method Hybrid Censored Quantile Regression Forest (HCQRF) combining random forests and censored quantile regression.
result Demonstrates the effectiveness and stability of HCQRF through simulation studies and real-world application.
Random Planted Forest interprets tree-based models by keeping some splits, leading to more interpretable predictions.
problem Estimating the unknown regression function from lower-order interaction terms.
method Modifying the random forest algorithm by keeping certain leaves instead of deleting them, resulting in non-binary trees called planted trees.
result The random planted forest achieves asymptotically optimal convergence rates up to a logarithmic factor when the interaction bound is low.
Develops exact and invariant study-based decompositions for network meta-analysis.
problem Lack of exact contribution decompositions in network meta-analysis.
method Contrast-space projection formulation of NMA, study-based definition of direct and indirect evidence.
result Exact covariance-aware decompositions of NMA estimator into direct and indirect contributions.
Paper proposes a new method combining random forests and Lasso selection.
problem Improving random forest performance by applying Lasso regression.
method Adaptive Lasso weighting applied to random forest predictions.
result Unified framework strictly outperforms other methods in simulations and real-world datasets.
SHAKE-GNN scales GNNs for large graphs with multi-scale representations.
problem Scaling Graph Neural Networks (GNNs) to large graphs.
method SHAKE-GNN uses a hierarchy of Kirchhoff Forests for stochastic multi-resolution graph decompositions.
result SHAKE-GNN achieves competitive performance on large-scale graph classification benchmarks.
This paper analyzes Mean Decrease Impurity (MDI) variable importance in random forests.
problem Lack of interpretability in random forest variable importances.
method Analysis of Mean Decrease Impurity (MDI) in random forests.
result MDI provides a variance decomposition of the output when variables are independent and there are no interactions.
Spatial graphs are decomposed into planar forests and braids.
problem Understanding the structure of spatial graphs in 3-space.
method Decomposition of spatial graphs into planar forests and braids.
result Every finite spatial graph is a connected sum of a planar graph and a braid.
Identifying Entangled Physics Relationships through Sparse Matrix Decomposition to Inform Plasma Fusion Designphysics.plasm-ph
Sparse matrix decomposition identifies key design variables for ICF experiments.
problem Improving predictive capability of ICF simulation codes through better understanding of design inputs and outcomes.
method Sparse Principal Component Analysis (SPCA) and Random Forest (RF) surrogate model.
result Identified clusters of design variables related to physical processes, revealing important variables not previously considered.
Bayesian fusion forest combines clinical and real-world data to estimate treatment effects.
problem Estimating treatment effects on survival from mixed data sources with confounding.
method Nonparametric Bayesian fusion forest combining randomised and real-world data, relaxing unconfoundedness assumption.
result Fusion identifies treatment benefits not seen in clinical trials alone.
Bayesian calibration speeds up ABM for pandemic modeling.
problem Calibrating stochastic ABMs for accurate pandemic predictions is computationally intensive.
method Random forest surrogate modeling for accelerated ABM evaluation.
result Improved predictive performance with random forest calibration compared to previous methods.
Algorithm improves wildlife protection patrols.
problem Balancing exploration and exploitation in patrolling vast protected areas.
method Formulated as a stochastic multi-armed bandit problem, leveraging smoothness and decomposability.
result Algorithm LIZARD improves performance on real-world poaching data.
Machine learning the first stage in 2SLS: Practical guidance from bias decomposition and simulationecon.EM
Machine learning can improve 2SLS first stage predictions, but nonlinear methods often introduce bias.
problem Improving the first stage of 2SLS using machine learning.
method Decomposed bias into three components, investigated through simulation.
result Nonlinear machine learning methods can introduce substantial bias in second-stage estimates.
iMondrian forest combines isolation forest and Mondrian forest for better anomaly detection.
problem Anomaly detection in batch and online settings.
method Hybrid of isolation forest and Mondrian forest, using depth in Mondrian forest structure.
result iMondrian forest outperforms existing methods in batch and online settings.
Unified local and global explanations through functional decomposition of low dimensional structures.
problem Tackles the challenge of extracting meaningful local and global explanations from machine learning models.
method Proposes a new identification constraint to decompose the global representation into main and interaction components of arbitrary order.
result Unified local and global explanations by connecting partial dependence plots and interventional SHAP values.
Random Hinge Forests are a new decision forest method that can be integrated into neural networks.
problem Training and optimizing neural networks efficiently and effectively.
method Random Hinge Forests are a novel variant of decision forests that can be integrated into neural networks and optimized end-to-end.
result Random Hinge Forests can be efficiently optimized end-to-end with stochastic gradient descent.
Ensembles of randomized decision trees, usually referred to as random forests, are widely used for classification and regression tasks in machine learning and statistics. Random forests achieve competitive predictive performance and are computationally efficient to train and test, making them excellent candidates for r…
HDI-Forest improves regression prediction intervals using Random Forest.
problem Improving the quality of prediction intervals in regression tasks.
method HDI-Forest is a novel quality-based PI estimation method based on Random Forest, optimizing PI quality metrics directly from standard tree-based models.
result HDI-Forest significantly reduces PI width by over 20% compared to previous methods, while maintaining or improving coverage probability.
New random forest method provides optimal rates and confidence bands.
problem Improving random forest regression rates and constructing confidence bands.
method Proposed Ehrenfest centered purely random forests achieve optimal rates; used Gaussian approximation for supremum of empirical processes.
result Explicit asymptotic uniform confidence bands constructed for both random forest types.
Study shows training duration impacts model merging quality, suggesting joint selection of duration and method.
problem Impact of expert training duration on model merging quality for large language models (LLMs).
method Systematically fine-tuned experts on five domains across three model sizes, evaluating five merging methods at each duration.
result Training duration affects merging quality, with simple averaging degrading sharply and sparsification-based methods performing well past the validation optimum.
RFpredInterval: An R Package for Prediction Intervals with Random Forests and Boosted Forestsstat.ML
RFpredInterval package builds prediction intervals for random forests and boosted forests.
problem Quantifying uncertainty in random forest and boosted forest point predictions.
method 16 methods to build prediction intervals with random forests and boosted forests.
result The proposed method outperforms existing methods in building prediction intervals.
Boosting random forests reduces bias and improves predictive performance.
problem Reducing bias in random forest predictions.
method Extract residuals from random forest, fit another random forest to residuals, sum predictions.
result One-step boosted forest has reduced bias and improved predictive performance.
Improved random forest proximities capture data geometry.
problem Inaccurate random forest proximities do not reflect learned data geometry.
method Introduce RF-GAP: Geometry- and Accuracy-Preserving proximities.
result RF-GAP improves geometric representation in tasks like data imputation.
Deep forests enhance expressiveness exponentially with depth, not width or tree size.
problem Understanding the role of depth, width, and tree size in deep forest performance.
method Provided upper and lower bounds on deep forest approximation complexity.
result Depth exponentially enhances deep forest expressiveness.
This paper improves forest pruning to balance accuracy and interpretability.
problem Limited interpretability of regression forests.
method Lasso-pruning and theoretical analysis of regression forests.
result Pruned regression forests can achieve equal or better accuracy than unpruned ones, with significant size reduction.
This paper is a comment on the survey paper by Biau and Scornet (2016) about random forests. We focus on the problem of quantifying the impact of each ingredient of random forests on their performance. We show that such a quantification is possible for a simple pure forest , leading to conclusions that could apply more…
Forest Guided Smoothingstat.ML
Forest-guided smoothing uses random forest outputs for interpretable local smoothers.
problem Creating interpretable local smoothers from complex random forest outputs.
method Uses random forest outputs to define spatially adaptive bandwidth matrices for a linear smoother.
result Improves interpretability and applicability of random forest outputs for various analyses.
This paper studies Mondrian Forests, proving they achieve optimal rates in arbitrary dimensions.
problem Understanding optimal rates for Mondrian Forests in arbitrary dimensions.
method Theoretical study based on new results about Mondrian partitions.
result Mondrian Forests achieve minimax optimal rates for -Hölder functions in arbitrary dimensions.
Improves time series classification with forest proximities.
problem Time series classification accuracy and efficiency.
method PF-GAP, an extension of RF-GAP proximities to proximity forests, combined with Multi-Dimensional Scaling and Local Outlier Factors.
result Forest proximities show stronger connection between misclassified points and outliers.
Random forests reduce bias and variance, especially in low SNR settings.
problem Reducing bias and variance in machine learning models, particularly in low SNR scenarios.
method Empirical study of random forests and bagging ensembles, focusing on the importance of tuning.
result Random forests reduce both bias and variance, outperforming bagging ensembles in high SNR settings.
New random forest variants achieve optimal performance in high dimensions.
problem Handling dependencies between features in high-dimensional data.
method Using oblique splits in random forests with general split directions.
result Achieved minimax optimal convergence rates in arbitrary dimension.
Study examines survival models for ALS, focusing on proportional hazards assumption.
problem Impact of proportional hazards assumption on survival models for ALS.
method Theoretical and empirical investigation of survival forests and their variants.
result Alternative split procedures can improve model performance in non-proportional hazards situations.
Enhances random forest consistency and introduces DMRF for improved performance.
problem Improving the consistency and efficiency of random forest algorithms.
method Strengthened proof methods and propose DMRF algorithm.
result DMRF achieves better theoretical and experimental performance than previous variants.
Random forests improve probability estimates through kernel regression.
problem Improving the principled approach to random forest probability estimation.
method Forge a connection between random forests and kernel regression, develop a proximity kernel model.
result Improves statistical footing of random forest probability estimation.
Transfer learning improves chatter detection accuracy with EEMD over WPT.
problem Improving chatter detection accuracy in metal cutting using transfer learning.
method Wavelet Packet Transform (WPT) and Ensemble Empirical Mode Decomposition (EEMD) for feature extraction; Support Vector Machine (SVM), Logistic Regression, Random Forest Classification, and Gradient Boosting with RFE for classification; Transfer learning applied to different turning configurations.
result EEMD outperforms WPT in transfer learning applications, achieving up to 95% accuracy.
Online random forests improve Q-learning performance in specific gym environments.
problem Improving Q-learning performance in reinforcement learning tasks.
method Proposed online random forests as Q-function approximators and growing them as learning progresses.
result Improved performance over state-of-the-art Deep Q-Networks in specific gym environments.
New method learns representations for decision forests using input perturbation.
problem Decision forests struggle with raw structured data and lack effective representations.
method Approximate decision forest gradients through input perturbation.
result Effective representation learning for decision forests without structural changes.
Improved random forest models enhance machine learning predictions.
problem Equal weights for random forest base decision trees are not optimal.
method Proposes algorithms to modify weighting strategy of regular random forest.
result Numerical results show significant improvements over regular random forest.
Proposes a more accurate random forest algorithm by selecting the best-performing trees.
problem Improving accuracy in binary classification problems.
method Best-scored random forest: selects the best-performing tree from random candidates.
result The best-scored random forest can be more accurate than the original random forest.
Local Linear Forestsstat.ML
Local Linear Forests improve random forests for smooth signals and causal inference.
problem Random forests struggle with smooth signals and poor predictive performance in smooth effects.
method Pairing forest kernel with local linear regression adjustment.
result Improves asymptotic rates of convergence and accuracy on real and simulated data.
DDBF improves random forest for imbalanced data.
problem Learning from imbalanced data.
method Incorporates hard example mining into random forest, dynamically removing easy examples.
result DDBF outperforms random forest on multiple datasets.
RPSF improves shapelet-based random forest accuracy and speed.
problem Limitations of random shapelet forest, including high training cost and limited information per node.
method Combines pairs of shapelets, omits threshold searching, and uses DMDI for interpretability.
result Improves accuracy and training speed of shapelet-based random forest.
Many scientific and engineering challenges -- ranging from personalized medicine to customized marketing recommendations -- require an understanding of treatment effect heterogeneity. In this paper, we develop a non-parametric causal forest for estimating heterogeneous treatment effects that extends Breiman's widely us…
Decision forests, including Random Forests and Gradient Boosting Trees, have recently demonstrated state-of-the-art performance in a variety of machine learning settings. Decision forests are typically ensembles of axis-aligned decision trees; that is, trees that split only along feature dimensions. In contrast, many r…
A fast method for finding counterfactual explanations for decision forests.
problem Finding counterfactual explanations for decision forests efficiently.
method Constrain optimization to data-populated regions, reducing to nearest-neighbor search.
result Very fast and realistic counterfactual explanations for decision forests.
Improves random survival forest model by weighted averaging.
problem Improving the performance of random survival forest.
method Modifies random forest by weighted averaging of trees, optimizing weights via quadratic optimization to maximize Harrell's C-index.
result The weighted random survival forest outperforms the original model in numerical examples.