New method reduces complexity of fuzzy decision trees in Big Data.
problem Reducing complexity in multi-way fuzzy decision trees for Big Data classification.
method Two-step process: 1) Probability integral transform, 2) Ruspini strong fuzzy partition.
result Up to 6 million fewer leaves with similar classification accuracy.
This paper compares methods for handling mixed-attribute data in GFMM neural networks.
problem Handling datasets with mixed features in GFMM neural networks.
method Three main methods: encoding, combining with other classifiers, and specific learning algorithms.
result Encoding methods and combining with decision trees improve GFMM models' performance.
Fuzzy prediction sets generalize binary predictions to include elements at varying confidence levels.
problem Binary prediction sets are limited; fuzzy prediction sets offer richer guarantees.
method Generalize prediction sets to fuzzy sets, showing they are e-values with merging properties.
result Optimal e-values lead to optimal fuzzy prediction sets, including optimal conformal prediction.
This paper explores fuzzy systems' equivalence to neural networks and other machine learning methods.
problem Designing optimal fuzzy systems and overcoming challenges.
method Comparative analysis of Takagi-Sugeno-Kang fuzzy systems with neural networks, mixture of experts, CART, and stacking ensemble regression.
result Functional equivalence between fuzzy systems and machine learning methods.
Improved online learning for fuzzy min-max neural networks.
problem Classification performance issues due to expansion and contraction steps.
method Proposes an improved online learning algorithm without contraction for overlapping hyperboxes.
result Significant improvement in classification accuracy and stability.
Introduces fuzzy layers to enhance deep learning performance.
problem Improving deep learning accuracy for complex tasks.
method Incorporates fuzzy methodologies into deep learning architecture.
result Preliminary results show promising performance in semantic segmentation.
Study enhances financial forecasting with machine learning and fuzzy MCDM.
problem Increasing financial uncertainty and market complexity.
method Integrates machine learning (XGBoost, LSTM, GNN) and intuitionistic fuzzy MCDM.
result High forecasting accuracy with low MAPE and narrow confidence intervals.
New deep learning models inspired by fuzzy logic are more robust to adversarial attacks.
problem Flawed generalization in deep neural networks leading to adversarial examples.
method Inspired by fuzzy logic, new architectures combining alternative design elements.
result New models are more robust to adversarial examples and noise.
FCM clustering adapts to persistence diagrams for topological data analysis.
problem Integrating topological data into machine learning workflows.
method Adapting Fuzzy c-Means to persistence diagrams.
result FCM clustering captures topological structure without additional processing.
CFM-BD builds interpretable fuzzy models for Big Data.
problem Maintaining accuracy and interpretability in fuzzy models for Big Data.
method Distributed learning algorithm with three stages: pre-processing, rule induction, and rule selection.
result CFM-BD constructs simpler models with fewer rules and linguistic labels, achieving competitive accuracy.
Decision Machines embeds decision trees into vector spaces for improved optimization.
problem Overfitting and difficulty in finding optimal decision tree structure.
method Embedding Boolean tests into a binary vector space and representing tree structure as matrices.
result Optimized decision trees with enhanced predictive power.
Boosting meta-trees improve decision tree performance.
problem Overfitting in decision trees.
method Boosting approach to construct multiple meta-trees.
result Ensembles of meta-trees prevent overfitting.
dtControl uses decision trees to represent controllers efficiently and explainably.
problem Representing controllers concisely and explainably.
method dtControl uses decision tree learning algorithms to represent controllers. Novel techniques for determinizing controllers are introduced.
result Novel techniques for determinizing controllers during decision tree construction are extremely efficient, yielding small decision trees.
A new decision tree method avoids overfitting without hyperparameters.
problem Overfitting in decision trees.
method Hyperparameter-free approach that constructs smaller, shallower trees.
result Avoids overfitting without compromising accuracy or training time.
Paper simulates LR fuzzy intervals with interval-valued cores.
problem Generating random fuzzy intervals with interval-valued cores.
method Developed algorithms for simulating LR fuzzy numbers with interval-valued cores.
result Numerically efficient algorithm for simulating fuzzy values.
Neural models can realize decision trees with parameter sharing and improved performance.
problem Training and optimizing oblique decision trees.
method Locally constant networks based on ReLU gradients, parameter sharing, and neural tools.
result Locally constant networks can implicitly model oblique decision trees with fewer neurons.
The study analyzes when Bayesian averaging over decision trees is reliable.
problem When do Bayesian model averaging weights over decision trees provide reliable information?
method Closed-form solution for Bayesian decision trees with Catalan-exponential priors.
result Established a complete non-asymptotic theory of rational commitment thresholds.
Trinary decision tree improves handling of missing data in machine learning.
problem Improving accuracy in decision tree algorithms when dealing with missing data.
method Introduces Trinary decision tree, which does not assume missing values contain information about the response.
result Trinary decision tree outperforms other algorithms in Missing Completely at Random settings, especially when data is only missing out-of-sample.
Optimized decision trees for reinforcement learning, improving sample complexity and interpretability.
problem Updating decision trees online in reinforcement learning.
method Gradient update over differentiable decision trees, including theoretical justification and empirical validation.
result Our approach outperforms neural networks in sample complexity and achieves higher rewards online.
In this paper, we have tried to apply the concepts of fuzzy sets to Lie groups and its relative concepts. First, we define a C1 fuzzy submanifold after reviewing C1−fuzzy manifold definition. In main section, we defined the Lie group and some its relative concepts such as fuzzy transformation group,…
Meta-learning interpretable decision trees with synthetic data.
problem Lack of efficient, scalable methods for generating synthetic data for decision tree meta-learning.
method Synthetic generation of near-optimal decision trees using the MetaTree transformer architecture.
result Meta-learning of decision trees achieves performance comparable to real-world data or optimal decision trees, with significant computational cost reduction.
Extracts decision trees from CNNs to explain concept importance.
problem Understanding how CNNs make decisions about human-understandable concepts.
method Inferring labeled concept data from CNN hidden layer activations and creating a shallow decision tree.
result Extracted decision trees accurately represent CNN classifications.
The paper improves decision tree stability for health care applications.
problem Stability of decision trees in health care applications.
method Introducing a new distance metric to determine tree stability and proposing a novel training methodology.
result On average, a 4.6% decrease in predictive power yields a 38% increase in model stability.
Convex polytope trees expand decision trees with interpretable boundaries.
problem High accuracy often requires many nodes in decision trees, reducing interpretability.
method CPT uses logical disjunction of weighted linear decision-makers, geometrically a convex polytope.
result CPT achieves high accuracy with fewer nodes compared to existing methods.
Proposes a simple neural network model similar to gradient boosted decision trees.
problem Building a neural network equivalent to gradient boosted decision trees.
method Converts an ensemble of decision trees to a neural network, relaxes properties, and trains a simple neural network model.
result The proposed Hammock model achieves similar performance to gradient boosted decision trees.
New algorithm finds optimal decision trees for binary variables.
problem Greedy decision tree algorithms often produce suboptimal models.
method Analytical bounds and modern systems techniques co-designed for efficient search space reduction.
result First practical algorithm for optimal decision trees for binary variables.
FoLDTree improves oblique decision trees with ULDA, enhancing accuracy and feature selection.
problem Axis-orthogonal splits limit traditional decision trees' performance on oblique decision boundaries.
method Integrates ULDA into decision tree structure for efficient oblique splits, feature selection, and handling missing values.
result FoLDTree outperforms other methods in accuracy and feature selection, comparable to random forest.
Evolutionary algorithms improve decision tree ensembles.
problem Improving predictive performance of decision trees.
method Real-valued vector representation of decision trees, evolutionary algorithms (Differential evolution, Evolution strategies).
result Proposed methods outperform classical decision tree induction algorithms.
Paper introduces algorithms for private decision tree learning.
problem Private decision tree learning in distributed settings.
method Proposes DP-TopDown, NoisyCounts, and LocalRNM.
result First utility guarantees for private decision tree learning.
Enhanced ODT with Feature Concatenation boosts learning efficiency.
problem Insufficient learning efficiency of ODT due to linear projections not being transmitted to child nodes.
method Feature Concatenation ( exttt{FC-ODT}) to transmit linear projections along decision paths.
result Experiments show exttt{FC-ODT} outperforms state-of-the-art decision trees with a limited tree depth.
Transform ANNs into interpretable decision trees.
problem Lack of interpretability in ANNs.
method Developed two MDT algorithms: EC-DT and Extended C-Net.
result Extended C-Net generates the most compact and effective trees.
Max-Cut decision tree improves classification accuracy and reduces computation time.
problem Improving decision tree accuracy and efficiency for complex classification tasks.
method Alternative splitting metric (max cut) and PCA-based feature selection at each node.
result 49% improvement in accuracy with 94% reduction in CPU time on CIFAR-100 data.
Fuzzy eIX method evolves classifiers for online data streams.
problem Handling time-varying classifiers in online data streams.
method Develops evolving Internal-eXternal Fuzzy granules for numerical data.
result Fuzzy eIX maintains high accuracy in dynamic scenarios.
New techniques optimize decision trees for interpretable machine learning.
problem Optimizing decision trees for interpretable machine learning.
method General framework for decision tree optimization addressing imbalanced data and continuous variables.
result Proves optimal decision trees for various objectives.
TAO outperforms other decision tree algorithms in accuracy.
problem Optimizing decision tree algorithms for better performance.
method Comparison of TAO with established algorithms on various datasets.
result TAO achieves higher accuracy in nearly all datasets.
This work presents an approach to automatically induction for non-greedy decision trees constructed from neural network architecture. This construction can be used to transfer weights when growing or pruning a decision tree, allowing non-greedy decision tree algorithms to automatically learn and adapt to the ideal arch…
This paper improves Bayesian decision tree learning using HMC.
problem Bayesian decision tree learning is challenging due to a large parameter space.
method Develops and compares HMC-based algorithms for exploring Bayesian decision tree posteriors.
result HMC-based methods outperform existing methods in predictive accuracy and tree complexity.
Decision trees improve performance in various fields.
problem Improving performance in machine learning and data mining.
method Introduce tree-based models and training techniques.
result Highlight probabilistic characteristics and practical benefits.
Decision trees improve decision-making by optimizing predictions of unknown parameters.
problem Optimizing decisions based on predicted unknown parameters.
method SPO Trees (SPOTs) for training decision trees under the SPO loss function.
result SPOTs provide higher quality decisions and significantly lower model complexity compared to other machine learning approaches.
Decision trees can be biased towards minority class, contrary to belief.
problem Bias in decision trees towards minority class in imbalanced datasets.
method Critical evaluation of past literature, specific conditions analysis, tree-fitting adjustments, and post-hoc calibration methods.
result Decision trees can be biased towards minority class under specific conditions, not always towards majority.
We introduce a novel incremental decision tree learning algorithm, Hoeffding Anytime Tree, that is statistically more efficient than the current state-of-the-art, Hoeffding Tree. We demonstrate that an implementation of Hoeffding Anytime Tree---"Extremely Fast Decision Tree", a minor modification to the MOA implementat…
Rectified decision trees improve machine learning interpretability and effectiveness.
problem Combining interpretability and effectiveness in machine learning models.
method Knowledge distillation and modified decision tree splitting criteria.
result Soft labels improve model performance and reduce model size.
Algorithm learns decision trees from noisy data.
problem Learning stochastic decision trees from corrupted samples.
method Quasipolynomial-time algorithm for adversarial noise.
result Returns a hypothesis with error within 2η+ε of optimal. Study explores loss design for decision trees to improve robustness against noisy labels.
problem Improving decision tree robustness to noisy labels.
method Investigated loss correction and symmetric losses, found ineffective.
result Other loss design directions need exploration for robust decision trees.
Develops a new method for decision trees using categorical variable structure.
problem Lack of structure in treating categorical variables as predictors.
method Introduces a mathematical framework to represent categorical structure and generalizes decision trees to utilize this structure.
result Improves prediction accuracy on weather data using the new method.
A novel gradient-based method optimizes decision trees for complex tasks.
problem Training decision trees with arbitrary differentiable loss functions.
method Gradient-based optimization using first and second derivatives of loss functions.
result Improves accuracy and flexibility in decision tree optimization.
Decision trees improve intraday trading strategies for NIFTY50 stocks.
problem Creating optimal trading rules for individual stocks.
method Using decision trees to generate unique trading rules for each stock based on technical indicators.
result Decision tree strategies outperform simple buy-and-hold for many stocks.
This paper solves the open problem of computing Bayes optimal prediction for decision trees using a Markov chain Monte Carlo method.
problem Computing the Bayes optimal prediction for decision trees is infeasible due to an infeasible summation over all division patterns of a feature space.
method Solved the open problem using a Markov chain Monte Carlo method with adaptively tuned step size.
result Computed the Bayes optimal prediction for decision trees using a Markov chain Monte Carlo method.