Proposes regional tree regularization for interpretable deep models.
problem Lack of interpretability in deep neural networks.
method Encourages deep models to be well-approximated by separate decision trees for predefined regions of the input space.
result Regional tree regularization delivers more accurate predictions than training separate decision trees for each region, while producing simpler explanations.
A new probabilistic model for image segmentation using region trees.
problem Image segmentation, especially multiscale and distributional.
method Probabilistic generative model based on region trees, exact inference via dynamic programming.
result Ability to sample segmentations at various scales and produce a distribution over all possible segmentations.
Proposes a method to handle input uncertainties in regression trees.
problem Uncertainties in input variables in regression problems.
method Adapting standard regression trees to account for input uncertainties.
result The proposed method improves performance on data sets with input uncertainties.
USNRT uses tree-structured learning to improve uncertainty quantification of variance networks.
problem Improving uncertainty quantification of variance networks.
method Tree-structured local neural network model that partitions feature space into regions for training region-specific neural networks to predict mean and variance.
result USNRT shows superior performance in estimating uncertainty with variances on UCI datasets compared to recent methods.
The paper uses model-based trees to create interpretable surrogate models for complex machine learning models.
problem Interpreting complex machine learning models.
method Using model-based trees to partition feature space and create interpretable models.
result Model-based trees generate optimal surrogate models that balance interpretability and performance.
This paper proposes an improved active learning method using classification trees.
problem Reducing the size of training sets while maintaining high accuracy in supervised learning.
method A wrapper active learning method using a classification tree to sub-sample from low-entropy regions.
result The proposed method constructs accurate classification models even with severely restricted labeled data.
New insights into pseudo-Anosov flows with special periodic orbits.
problem Understanding pseudo-Anosov flows with periodic orbits in 3-manifolds.
method Analyzing the topological features corresponding to trees of scalloped regions and classifying flows with the same free homotopy data.
result Explicit examples of flows with the same free homotopy data but not orbit equivalent.
New approach synthesizes Gaussian trees with unrecoverable correlation signs using information theory.
problem Quantifying and utilizing unrecoverable correlation signs in latent Gaussian trees.
method Information-theoretic approach, modeling as a communication channel, layered encoding framework.
result Achievable rate region for synthesizing observed data with unrecoverable signs.
Inference Trees adaptively sample to balance exploration and exploitation.
problem Balancing exploration and exploitation in adaptive inference methods.
method Inference Trees use hierarchical partitions and online learning to adaptively sample.
result ITs identify high posterior mass regions and maintain uncertainty estimates.
flexBART improves BART for categorical predictors by creating flexible tree partitions.
problem Limitation of BART in handling categorical predictors with one-hot encoding.
method flexBART re-implements BART with regression trees that can assign multiple levels to both branches of a decision tree node, and proposes a new decision rule prior for spatial data.
result flexBART often yields improved predictive performance and scales better to larger datasets than existing BART implementations.
HHCART improves decision tree accuracy with oblique splits.
problem Complex decision boundaries not aligned with feature axes.
method HHCART uses Householder matrices to reflect and split data.
result HHCART achieves comparable accuracy to other methods with fewer splits.
Paper studies ensemble probabilistic regression trees for smooth approximations.
problem Smooth approximations of regression functions.
method Ensemble versions of probabilistic regression trees.
result Ensemble probabilistic regression trees are consistent and perform well.
Decision Machines embeds decision trees into vector spaces for improved optimization.
problem Overfitting and difficulty in finding optimal decision tree structure.
method Embedding Boolean tests into a binary vector space and representing tree structure as matrices.
result Optimized decision trees with enhanced predictive power.
Proposes neural decision trees combining neural networks and decision trees.
problem Combining neural networks and decision trees for improved modeling power.
method Integrates multilayer perceptrons into decision tree structure with weight sharing.
result Demonstrates improved modeling power and flexibility over standard decision trees and MLPs.
Gradient boosting with randomized trees reduces discontinuities and complexity.
problem Discontinuities in regression functions due to sparse training data.
method Gradient boosting machine with partially randomized decision trees.
result Improves robustness and computational efficiency of gradient boosting.
Probability calibration trees improve accuracy of probability estimates.
problem Improving accuracy and calibration of probability estimates from classifiers.
method Probability calibration trees modify logistic model trees to learn different models in regions of the input space.
result Probability calibration trees outperform isotonic regression and Platt scaling in terms of root mean squared error.
A new model predicts spatio-temporal data using adaptive decision trees and point processes.
problem Predicting spatio-temporal data with real-life applications.
method Hawkes process, adaptive decision tree, joint optimization algorithm.
result Significant improvement in predictions compared to standard methods.
This work introduces a novel nonparametric density index defined on graphs, the Sum-over-Forests (SoF) density index. It is based on a clear and intuitive idea: high-density regions in a graph are characterized by the fact that they contain a large amount of low-cost trees with high outdegrees while low-density regions…
Topological methods improve neuron analysis and tracer injection summary.
problem Traditional methods fail to capture the tree-like structure of neurons.
method Discrete Morse (DM) Theory for neuron skeletonization and consensus tree summarization.
result Significant performance improvements over non-topological methods.
A new approach uses partial likelihood to improve tree-based density estimation and inference.
problem Inference on tree-based models suffers from overfitting and reduced efficiency due to data-independent partitioning.
method Proposes a partial likelihood approach to data-dependent partitioning of tree-based models.
result Significant gains in estimation accuracy and computational efficiency from adopting partial likelihood.
Proves convergence of gradient Ricci shrinkers with uniform bounds.
problem Compactness and energy concentration in gradient Ricci shrinkers.
method Bubble-tree convergence and local energy analysis.
result No energy concentrates in neck regions, leading to a local diffeomorphism finiteness theorem.
Hollow-tree Super resolves feature importance in large datasets.
problem Lack of effective scaling for large feature numbers in boosted tree models.
method Hollow-tree Super (HOTS) methodology for feature importance visualization.
result HOTS effectively resolves feature importance and directionality in high-dimensional neuroscientific data.
A new algorithm, Regular Tree Search, tackles non-convex simulation optimization problems.
problem Non-convex objective functions in simulation optimization.
method Integrates adaptive sampling with recursive partitioning of the search space.
result Proves global convergence and reliably identifies the global optimum.
Study evaluates how limited training data affects streamflow predictions.
problem Limited historical meteorological and streamflow data affects streamflow prediction accuracy.
method Evaluated tree- and LSTM-based models on CAMELS dataset with varying training data sizes and time spans.
result Tree- and LSTM-based models provide similarly accurate predictions on small datasets, but LSTMs are superior with more training data.
CDER uses Cover Trees and entropy to find labeled pointcloud differences.
problem Finding differences between labeled pointclouds.
method Combines Cover Trees and entropy to identify differences in labeled pointclouds.
result CDER identifies differences in labeled pointclouds in linear time.
Alpha-trimming prunes trees in random forests to improve predictive performance.
problem Improving predictive performance of random forests by locally adaptive tree pruning.
method Alpha-trimming is a fast pruning algorithm that prunes trees in a random forest based on signal-to-noise ratio, controlled by a tuning parameter.
result Alpha-trimming often lowers mean squared prediction error compared to fully grown random forests.
Study on prescribing positive curvature with conical singularities on a sphere.
problem Prescribing positive curvature with conical singularities on a sphere.
method Fine analysis of bubble trees and an area identity in the convergence process.
result Criterion for nonexistence in an open region of the prescribing data.
OLBoost improves online decision tree performance without increasing memory or time costs.
problem Improving predictive performance in online decision trees without high memory or time costs.
method OLBoost applies boosting to small regions of the instances space within online decision tree algorithms.
result OLBoost can significantly improve online learning decision tree performance without increasing tree size.
Paper introduces methods to handle missing data in probabilistic regression trees.
problem Handling missing data in probabilistic regression trees.
method Three approaches: uniform probability, partial observation, and dimension-reduced smoothing.
result Preserves interpretability while extending applicability to incomplete datasets.
New method creates adaptive prediction intervals for regression models.
problem Need to quantify uncertainty in regression model predictions.
method Regression trees and Random Forests trained on conformity scores.
result Superior scalability and performance compared to baselines.
Tree regularization makes deep models interpretable by approximating them with simple decision trees.
problem Lack of interpretability in deep neural networks.
method Tree regularization to train deep models to resemble compact, axis-aligned decision trees.
result Tree regularized models are easier for humans to interpret without sacrificing accuracy.
The paper develops a theory for speculative decoding acceptance criteria.
problem Speculative decoding's acceptance criteria and their rejection regions.
method Characterization of rejection regions as lower level sets of the target distribution, derivation of exact and margin-based certificates.
result Relaxed and tree-based acceptance criteria substantially enlarge the region of certified acceptance.
Rectangular Bounding Process (RBP) improves partitioning efficiency in multi-dimensional spaces.
problem Creating many unnecessary divisions in sparse regions when describing dense regions.
method Introduces Rectangular Bounding Process (RBP) to efficiently partition multi-dimensional spaces using a bounding strategy.
result The RBP is self-consistent and can be extended to infinite space, offering rich yet parsimonious expressiveness.
DTE uses tree leaf means to embed data, balancing accuracy and speed.
problem High variance in decision tree splits and computational inefficiency of ensembles.
method DTE constructs an interpretable feature representation using leaf means of a trained tree.
result DTE strikes a balance between accuracy and computational efficiency, outperforming ensembles.
Bayesian optimization algorithm reduces regret with efficient region pruning.
problem Sequential optimization of unknown functions in high-dimensional spaces.
method Gaussian process-based, domain shrinking through tree-based region pruning.
result Order-optimal regret performance with reduced computational complexity.
The paper introduces a method to control false splits in tree-based data aggregation.
problem Identifying the correct subgroups to treat as a single entity in tree-based data.
method Introduces the 'false split rate' and proposes a multiple hypothesis testing algorithm for tree-based aggregation.
result The proposed algorithm controls the false split rate, demonstrating its effectiveness on stock volatility and taxi fare data.
We studied the topology of correlation networks among 34 major currencies using the concept of a minimal spanning tree and hierarchical tree for the full years of 2007-2008 when major economic turbulence occurred. We used the USD (US Dollar) and the TL (Turkish Lira) as numeraires in which the USD was the major currenc…
Study integrates reliability constraints into generation planning models.
problem Challenges in integrating reliability constraints with generation planning models.
method Leverages a weighted oblique decision tree (WODT) technique to embed reliability verification constraints.
result Demonstrates effectiveness in achieving reliable and optimal planning solutions.
New method combines heuristics and search techniques to speed up cooperative planning for autonomous vehicles.
problem Efficient cooperative planning for autonomous vehicles in complex traffic scenarios.
method Combining learned heuristics with Monte Carlo Tree Search (MCTS) to guide search towards promising actions.
result Better solutions at lower computational costs achieved through accelerated planning.
Using transfer entropy, we observed the strength and direction of information flow between stock indices. We uncovered that the biggest source of information flow is America. In contrast, the Asia/Pacific region the biggest is receives the most information. According to the minimum spanning tree, the GSPC is located at…
Paper interprets deep learning using decision trees and Haar wavelets.
problem Understanding the function approximation capabilities of ReLU deep learning.
method Constructing a deep learning structure equivalent to a forest and approximating Haar wavelet functions with ReLU deep learning.
result ReLU deep learning can be considered as decision trees and approximates Haar wavelet functions with arbitrary precision.
This paper uses two hierarchical techniques, a minimal spanning tree and an ultrametric hierarchical tree, to extract a topological influence map for major currencies from the ultrametric distance matrix for 1996-2001. We find that these two techniques generate a defined and robust scale free network with meaningful ta…
The paper proposes a method to improve random forest classification accuracy by weighting trees based on their decision path reliability.
problem Random forests' uniform voting fails to correct errors in regions where incorrect tree representations outnumber correct ones.
method The paper introduces using the structural pattern of each tree's decision path as an instance-adaptive reliability signal to identify and weight more reliable trees.
result Using the proposed method yields a statistically significant accuracy improvement over RF on 36 binary classification benchmarks.
This paper applies conformal prediction techniques to compute simultaneous prediction bands and clustering trees for functional data. These tools can be used to detect outliers and clusters. Both our prediction bands and clustering trees provide prediction sets for the underlying stochastic process with a guaranteed fi…
The study models credit risk using Merton's framework and binomial trees.
problem Credit risk pricing and implied volatility estimation.
method Calibrated using Merton's structural model, with asset volatility derived from Black-Scholes-Merton. Implied mean return and probability surfaces constructed using a recombining binomial tree.
result Established a practical method for constructing implied credit surfaces.
By analyzing the foreign exchange market data of various currencies, we derive a hierarchical taxonomy of currencies constructing minimal-spanning trees. Clustered structure of the currencies and the key currency in each cluster are found. The clusters match nicely with the geographical regions of corresponding countri…
Bayesian model estimates treatment effects near cutoffs in regression discontinuity designs.
problem Estimating conditional average treatment effects in regression discontinuity designs.
method Develops a Bayesian additive regression tree (BART) model with linear leaf-level regressions.
result Adapts to different slopes on the running variable near the cutoff, providing interpretable inference.
EPICSCORE improves conformal scores by explicitly accounting for epistemic uncertainty.
problem Overconfident predictions in data-sparse regions due to lack of epistemic uncertainty.
method Model-agnostic approach using Bayesian techniques like Gaussian Processes, Dropout, and Regression Trees.
result Enhanced predictive intervals that adaptively expand in sparse data regions and maintain compact intervals in abundant data.