Rectified decision trees improve machine learning interpretability and effectiveness.
problem Combining interpretability and effectiveness in machine learning models.
method Knowledge distillation and modified decision tree splitting criteria.
result Soft labels improve model performance and reduce model size.
OTSS learns personalized decision weights from logged decisions and outputs.
problem Learning context-specific decision weights from logged decisions and outputs.
method Output-targeted soft-segmentation model that deploys personalized decision-ready weight vectors.
result OTSS achieves the lowest mean regret in benchmark settings.
Bayesian GBMs improve predictive uncertainty calibration for tabular data.
problem Lack of well-calibrated predictive uncertainties in gradient boosting machines.
method Variational inference with soft decision trees.
result Variational soft GBMs provide useful uncertainty estimates and maintain good predictive performance.
SBAMDT uses adaptive soft splits to model complex decision boundaries.
problem Limited ability of standard decision trees to capture complex decision boundaries.
method Probabilistic additive decision tree model with adaptive soft multivariate splits.
result Demonstrated improved predictive performance on synthetic and real datasets.
Paper presents a self-adaptive learning model for robust classification and regression.
problem Dealing with various datasets of different complexity.
method Combines DNDN and DSP, an end-to-end training approach with multiple randomly initialized softmax layers and adaptive soft pruning.
result The model demonstrates no performance loss compared with unpruned models and higher robustness over different data and feature distributions.
Proposes ReDT for interpretable, compressed, and robust decision trees.
problem Improving interpretability and performance of decision trees.
method Knowledge distillation with soft labels and multiple cross-validation.
result ReDT achieves fewer nodes than classical decision trees while maintaining good performance and interpretability.
Less-than-one-shot learning tackles few-shot learning with minimal data.
problem Training models on very small datasets while maintaining accuracy.
method Soft-label k-Nearest Neighbors classifier and theoretical lower bounds analysis.
result Achieving learning of multiple classes with fewer than the required samples.
Simplifies neural networks into easier-to-explain decision trees.
problem Difficulty in explaining neural network decisions.
method Converts neural network into a soft decision tree.
result The resulting soft decision tree generalizes better.
Binary classification is a common statistical learning problem in which a model is estimated on a set of covariates for some outcome indicating the membership of one of two classes. In the literature, there exists a distinction between hard and soft classification. In soft classification, the conditional class probabil…
Paper analyzes soft tree ensembles using NTK, finding only leaf count matters.
problem Understanding impact of various tree architectures in ensemble learning.
method Formulated and analyzed Neural Tangent Kernel (NTK) for soft tree ensembles.
result Only the number of leaves at each depth is relevant for tree architecture in ensemble learning.
Deep neural networks improve MIMO detection accuracy and efficiency.
problem Improving MIMO detection accuracy and efficiency.
method Introduced two deep architectures: a standard fully connected network and a DetNet designed for MIMO detection.
result Achieved state-of-the-art performance with low computational requirements.
Stochastic Gradient Trees learn decision trees incrementally.
problem Learning decision trees using stochastic gradient information.
method Incremental learning setting, soft splits not used, new tree not constructed per update.
result Performs similarly to standard incremental classification trees, outperforms state of the art incremental regression trees, comparable to batch multi-instance learning methods.
This paper introduces TNTK to study infinite soft tree ensembles.
problem Understanding the behavior of infinite soft tree ensembles.
method Introduced Tree Neural Tangent Kernel (TNTK) to analyze infinite soft tree ensembles.
result Identified several non-trivial properties of infinite soft tree ensembles.
This paper improves deep forest models with soft routing and topology learning.
problem Expensive computational costs and lack of interpretability in deep neural networks.
method Soft routing in probabilistic trees and topology learning for joint optimization.
result Empowered deep forests achieve better performance with reduced model complexity.
sGBM speeds up gradient boosting by parallelizing and adapting base learners.
problem Infeasibility of parallelizing GBM training and sub-optimal performance in online settings.
method Integrates multiple differentiable base learners, jointly optimizing them with linear speed-up.
result sGBM achieves higher time efficiency and better accuracy than traditional GBM.
New algorithms optimize a soft-robust criterion in reinforcement learning, reducing conservatism.
problem Computing robust policies for high-stakes decisions with limited data.
method Soft-robust criterion using risk measures, two algorithms for optimization.
result Our algorithms produce less conservative solutions than existing methods.
Study improves fair opinion aggregation by balancing voter attributes.
problem Aggregation of opinions can be biased by voter attributes.
method Combines majority voting and D&S model with fairness options.
result Effective combination of Soft D&S and fairness options for different data types.
A framework learns dynamic soft labels to improve model generalization and accuracy.
problem Models trained on one-hot labels overfit and are sensitive to noisy annotations.
method Proposes a framework where labels are treated as learnable parameters, adapting dynamically during optimization.
result Consistent gains across different datasets and architectures, improving ResNet18 by 2.1% on CIFAR100.
Study decision boundaries using heat diffusion and probabilistic techniques.
problem Understanding the geometry of decision boundaries in machine learning.
method Using Brownian motion and probabilistic techniques to analyze decision boundaries.
result Decision boundaries exhibit persistent 'wiggly and fuzzy' regions, even under adversarial attacks.
We discuss an autoencoder model in which the encoding and decoding functions are implemented by decision trees. We use the soft decision tree where internal nodes realize soft multivariate splits given by a gating function and the overall output is the average of all leaves weighted by the gating values on their path. …
A new type of distributional regression tree uses soft split rules for better predictive performance.
problem Estimating complete conditional distributions in regression.
method Distributional adaptive soft regression trees using multivariate soft split rules.
result The method outperforms various benchmark methods, especially in complex non-linear interactions.
New framework optimizes decisions under uncertainty considering causal and continuous data.
problem Optimizing decisions under uncertain distributions with causal and continuous data structures.
method Developed a framework using Causal Sinkhorn DRO with Soft Regression Forest decision rules.
result Framework provides interpretable and tractable decision rules for optimizing under uncertainty.
Sparse MDP with entropy regularization improves reinforcement learning performance.
problem Improving reinforcement learning policies with sparse and multi-modal distributions.
method Proposes a sparse Markov decision process with causal sparse Tsallis entropy regularization.
result The proposed method achieves a constant performance error bound, outperforming soft MDPs.
Paper compares hard and soft EM for BN learning from incomplete data.
problem Learning BNs from incomplete data using EM algorithms.
method Investigates the impact of imputation vs. belief propagation in hard and soft EM.
result A decision tree can guide practitioners in choosing the best EM algorithm.
New dropout method prevents overfitting in hierarchical models.
problem Overfitting in hierarchical mixture of experts.
method Variant of dropout applied hierarchically, not unitwise.
result Prevents overfitting and improves generalization in hierarchical models.
Improves RL generalization by minimizing adversarial risk.
problem Overfitting to training environments and poor generalization to unseen scenarios.
method Introduces minimax formulation and distributional framework to RL.
result Trained policy shows improved generalization to different environments.
DNF-Net tackles tabular data challenges with neural architecture.
problem Handling tabular data efficiently using neural networks.
method DNF-Net uses a neural architecture with inductive bias corresponding to logical Boolean formulas in disjunctive normal form over affine soft-threshold decision terms.
result DNF-Net significantly outperforms fully connected networks on tabular data.
CGNS predicts probabilistic trajectories for safer autonomous systems.
problem Accurate probabilistic trajectory prediction for dynamic obstacles in complex scenarios.
method CGNS combines latent space learning and variational divergence minimization, incorporating static and interaction information with soft attention mechanisms and regularization for soft constraints.
result CGNS outperforms baseline approaches in pedestrian trajectory prediction and naturalistic driving datasets.
New RL framework improves real-time control performance.
problem Real-time RL systems assume static states, leading to suboptimal outcomes.
method Introduces a new real-time RL framework where states and actions evolve simultaneously.
result RTAC algorithm outperforms existing state-of-the-art algorithms in real-time and non-real-time settings.
Paper proposes a method to accurately match soft skills in job ads.
problem Matching soft skills in job ads leads to false positives.
method Phrase-matching approach with context-based binary classification.
result LSTM tagging-based input representation achieved highest recall of 83.92%.
Soft Actor-Critic improves deep RL with entropy maximization.
problem High sample complexity and brittle convergence in deep RL.
method Maximum entropy reinforcement learning framework, off-policy updates, stochastic actor-critic.
result State-of-the-art performance on continuous control tasks.
Mutual-information regularization improves RL algorithms, especially in high-dimensional domains.
problem Value overestimation and exploration in reinforcement learning.
method Developed a novel mutual-information regularized actor-critic learning (MIRACLE) algorithm.
result MIRACLE outperforms state-of-the-art algorithms in continuous action spaces.
Developed a new thresholding method that connects soft and hard thresholding.
problem Connecting soft and hard thresholding methods in data analysis.
method Scaled soft thresholding method with empirical scaling values.
result Found two sources of over-fitting in the scaled soft thresholding method.
Soft labeling impacts OOD detection in neural networks.
problem Impact of soft labeling on OOD detection in deep neural networks.
method Empirical analysis of how soft labeling affects OOD detection performance.
result Soft labeling can either improve or deteriorate OOD detection performance.
A new method stabilizes deep reinforcement learning by using QGraphs to retain replay memory information.
problem Stabilizing model-free off-policy deep reinforcement learning with soft divergence.
method Representing past experiences as a QGraph, selecting a subgraph with favorable structure, and using lower bounds for temporal difference learning.
result QG-DDPG method is less prone to soft divergence and more robust to hyperparameters.
Recently proposed budding tree is a decision tree algorithm in which every node is part internal node and part leaf. This allows representing every decision tree in a continuous parameter space, and therefore a budding tree can be jointly trained with backpropagation, like a neural network. Even though this continuity …
Optimizes exploration in networks by interpolating between random and deterministic paths.
problem Balancing exploitation and exploration in network routing with constraints.
method Developed a constrained randomized shortest-paths framework using Lagrangian duality and iterative procedures.
result Optimal routing policy that interpolates between random and deterministic paths while satisfying constraints.
Soft cells fill space without gaps, derived from minimal surfaces and deformed using edge bending.
problem Creating space-filling shapes without sharp corners.
method Edge bending algorithm to deform polyhedral tilings into soft tilings.
result Soft tilings derived from minimal surfaces can be continuously transformed into one another.
Study earnings calls to predict stock price movements, finding them more predictive than traditional data.
problem Improving investment decisions by analyzing earnings calls for stock price predictions.
method Graph Neural Network based approach to process and analyze earnings call transcripts.
result Earnings call transcripts are more predictive of stock price movements than traditional hard data.
Hybrid model for online nonlinear prediction using LSTM and soft GBDT.
problem Online nonlinear prediction with manual feature selection and model selection issues.
method End-to-end architecture with LSTM for feature extraction and soft GBDT for regression, jointly optimized.
result Significant performance improvements over conventional methods on real datasets.
A new method for RL with continuous actions improves stability and scalability.
problem Stability and scalability issues in existing RL methods.
method Soft policy gradient with entropy regularization, combined with double sampling for soft Bellman equation.
result Outperforms off-policy prior methods in continuous action RL tasks.
ASBART accelerates Soft BART for faster Bayesian regression.
problem Slow computation in Soft BART.
method Proposed ASBART, a variant of Soft BART.
result ASBART is about 10 times faster than Soft BART with similar accuracy.
New method improves stability of soft FQI for offline RL.
problem Stability issues in soft FQI under function approximation.
method Stationary reweighting to align operator norms.
result Local linear convergence proved under certain conditions.
New method combines gradient optimization with constraint-based techniques for causal discovery.
problem Causal discovery from observational data, especially with small sample sizes.
method Differentiable d-separation scores using percolation theory and soft logic for gradient-based optimization of conditional independence constraints. result Empirical evaluations show robust performance in low-sample regimes, surpassing traditional methods.
Introduces deterministic information bottleneck (DIB) replacing mutual information with entropy.
problem Compression and feature selection in lossy compression and clustering.
method Formulates deterministic information bottleneck (DIB) using entropy instead of mutual information, resulting in deterministic encoder (hard clustering).
result DIB outperforms IB in terms of DIB cost function and offers computational efficiency gains.
Theory unifies various reinforcement learning methods with a generalized regularized approach.
problem Improving reinforcement learning algorithms with regularization.
method Develops a theory of regularized Markov Decision Processes, extending previous approaches.
result Unified analysis of various reinforcement learning algorithms.
A new method prunes neural network channels based on operation characteristics.
problem Compressing deep neural networks efficiently and maintaining accuracy.
method Differentiable masks for channel pruning considering BN and ReLU.
result Outstanding performance in accuracy with less resources compared to state-of-the-art methods.
Generalizes soft noncommutative schemes to flag varieties.
problem Applying soft noncommutative schemes to flag varieties.
method Generalization via toric geometry and distinguished affine charts.
result Soft noncommutative schemes can be applied to flag varieties.