Improves tree model performance by considering future node splits.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
IMPaCT improves node classification in chronological split temporal graphs.
In this work, we propose a novel node splitting method for regression trees and incorporate it into the regression forest framework. Unlike traditional binary splitting, where the splitting rule is selected from a predefined set of binary splitting rules via trial-and-error, the proposed node splitting method first fin…
ES-MLP combines Graph-MLP with edge splitting for node classification on both homophilic and heterophilic graphs.
Novel approach for creating interpretable classifiers using bilevel optimization of split-rules in NLDTs.
Paper proposes a novel SVM method for creating survival trees.
DiPriMe forests use private medians to create balanced tree splits for privacy-protected data.
SBAMDT uses adaptive soft splits to model complex decision boundaries.
Real-world data often presents itself in the form of a network. Examples include social networks, citation networks, biological networks, and knowledge graphs. In their simplest form, networks represent real-life entities (e.g. people, papers, proteins, concepts) as nodes, and describe them in terms of their relations …
We investigate how asymmetrizing an impurity function affects the choice of optimal node splits when growing a decision tree for binary classification. In particular, we relax the usual axioms of an impurity function and show how skewing an impurity function biases the optimal splits to isolate points of a particular c…
A new method identifies class-specific covariates in multi-class prediction tasks.
Paper predicts future graph structures using time series methods.
Futures trading is the core of futures business, and it is considered as one of the typical complex systems. To investigate the complexity of futures trading, we employ the analytical method of complex networks. First, we use real trading records from the Shanghai Futures Exchange to construct futures trading networks,…
Random survival forests (RSF) are a powerful method for risk prediction of right-censored outcomes in biomedical research. RSF use the log-rank split criterion to form an ensemble of survival trees. The most common approach to evaluate the prediction accuracy of a RSF model is Harrell's concordance index for survival d…
While many statistical models and methods are now available for network analysis, resampling network data remains a challenging problem. Cross-validation is a useful general tool for model selection and parameter tuning, but is not directly applicable to networks since splitting network nodes into groups requires delet…
CDF uses centroids to split features for high-dimensional classification.
DaRE forests enable efficient data deletion from random forests.
This work introduces a transformation-based learner model for classification forests. The weak learner at each split node plays a crucial role in a classification tree. We propose to optimize the splitting objective by learning a linear transformation on subspaces using nuclear norm as the optimization criteria. The le…
In this paper, we tackle the real-world problem of predicting Yelp star-review rating based on business features (such as images, descriptions), user features (average previous ratings), and, of particular interest, network properties (which businesses has a user rated before). We compare multiple models on different s…
Convex polytope trees expand decision trees with interpretable boundaries.
Exact distribution of split conformal prediction coverage found.
This paper presents an improvement to model learning when using multi-class LogitBoost for classification. Motivated by the statistical view, LogitBoost can be seen as additive tree regression. Two important factors in this setting are: 1) coupled classifier output due to a sum-to-zero constraint, and 2) the dense Hess…
Decision trees with binary splits are popularly constructed using Classification and Regression Trees (CART) methodology. For binary classification and regression models, this approach recursively divides the data into two near-homogenous daughter nodes according to a split point that maximizes the reduction in sum of …
USNRT uses tree-structured learning to improve uncertainty quantification of variance networks.
GraphBench creates a unified benchmark for graph learning tasks.
New order defined for conformal classes, impacts Bartnik's conjecture.
Minimal TIP and TIF found in compact spacetimes, impacting spacetime splitting.
Tree-based algorithm for functional data analysis reduces generalization error.
The paper studies statistical properties of CART regression trees.
This paper looks at the splitting problem for globally hyperbolic spacetimes with timelike Ricci curvature bounded below containing a (spacelike, acausal, future causally complete) hypersurface with mean curvature bounded from above. For such spacetimes we show a splitting theorem under the assumption of either the exi…
We consider multi-label classification where the goal is to annotate each data point with the most relevant of labels from an extremely large label set. Efficient annotation can be achieved with balanced tree predictors, i.e. trees with logarithmic-depth in the label complexity, whose leaves correspon…
Simultaneous Latent Budget Trees for stratified classification
We study the small perturbations of the -dimensional Milne model for the Einstein-Klein-Gordon (EKG) system. We prove the nonlinear future stability, and show that the perturbed spacetimes are future causally geodesically complete. For the proof, we work within the constant mean curvature (CMC) gauge and focus on …
Unified representation for tree ensembles indexed by nodes
Improved sampling for network community detection.
Neural Networks and Decision Trees: two popular techniques for supervised learning that are seemingly disconnected in their formulation and optimization method, have recently been combined in a single construct. The connection pivots on assembling an artificial Neural Network with nodes that allow for a gate-like funct…
New algorithm reduces discrimination in predictions.
VFGNN tackles privacy-preserving node classification with federated GNN.
New algorithm estimates past and future diffusion processes on networks.
CIT and CIF improve feature selection for downstream prediction.
We propose and analyze a generic method for community recovery in stochastic block models and degree corrected block models. This approach can exactly recover the hidden communities with high probability when the expected node degrees are of order or higher. Starting from a roughly correct community partition …
Causal trees struggle with accuracy in estimating treatment effects.
Conventional decision trees have a number of favorable properties, including interpretability, a small computational footprint and the ability to learn from little training data. However, they lack a key quality that has helped fuel the deep learning revolution: that of being end-to-end trainable, and to learn from scr…
Graph convolutional neural networks, which learn aggregations over neighbor nodes, have achieved great performance in node classification tasks. However, recent studies reported that such graph convolutional node classifier can be deceived by adversarial perturbations on graphs. Abusing graph convolutions, a node's cla…
We propose a dynamic network model where two mechanisms control the probability of a link between two nodes: (i) the existence or absence of this link in the past, and (ii) node-specific latent variables (dynamic fitnesses) describing the propensity of each node to create links. Assuming a Markov dynamics for both mech…
Neural sequence generation is typically performed token-by-token and left-to-right. Whenever a token is generated only previously produced tokens are taken into consideration. In contrast, for problems such as sequence classification, bidirectional attention, which takes both past and future tokens into consideration, …
Link prediction (LP) algorithms propose to each node a ranked list of nodes that are currently non-neighbors, as the most likely candidates for future linkage. Owing to increasing concerns about privacy, users (nodes) may prefer to keep some of their connections protected or private. Motivated by this observation, our …
Proposes a network framework for forecasting futures with different expirations.