A new classifier improves one-class predictions on unevenly sampled data.
problem Non-uniformly sampled data affects one-class classifier performance.
method Dynamic decision boundary based on minimum spanning tree.
result Proves effectiveness and robustness compared to state-of-the-art classifiers.
Unified framework models neural decision-making, improving accuracy.
problem Limitations in modeling neural activity during decision-making.
method Unifying framework based on state-space models with scalable inference.
result Two-dimensional accumulator better captures neural responses.
Stochastic Gradient Descent introduces noise in training, affecting model decision boundaries.
problem Understanding the impact of noise in SGD on model decision boundaries.
method Characterized SGD and persistent SGD dynamics in a neural network model, measuring noise magnitude in both under- and over-parametrized regimes.
result Noisier algorithms lead to wider decision boundaries in constraint satisfaction problems.
SBAMDT uses adaptive soft splits to model complex decision boundaries.
problem Limited ability of standard decision trees to capture complex decision boundaries.
method Probabilistic additive decision tree model with adaptive soft multivariate splits.
result Demonstrated improved predictive performance on synthetic and real datasets.
Adaptive populations such as those in financial markets and distributed control can be modeled by the Minority Game. We consider how their dynamics depends on the agents' initial preferences of strategies, when the agents use linear or quadratic payoff functions to evaluate their strategies. We find that the fluctuatio…
The paper explores the geometry and topology of DNN decision boundaries.
problem Understanding the geometric and topological properties of DNN decision boundaries.
method Differential geometry and the Gauss-Bonnet-Chern theorem.
result Computed the Euler characteristics of compact decision boundaries.
This work connects the Hessian to the decision boundary complexity in neural networks.
problem Understanding the decision boundary complexity in high-dimensional input space.
method Characterizing the decision boundary using the Hessian top eigenvectors and analyzing the number of outliers.
result The number of outliers in the Hessian spectrum is proportional to the complexity of the decision boundary.
DeepDIG generates samples near decision boundaries of deep neural networks for better understanding.
problem Limited knowledge of how deep neural networks make decisions.
method Adversarial example generation to create samples near decision boundaries.
result Characterized decision boundaries of various deep neural network models.
Many recent works on knowledge distillation have provided ways to transfer the knowledge of a trained network for improving the learning process of a new one, but finding a good technique for knowledge distillation is still an open problem. In this paper, we provide a new perspective based on a decision boundary, which…
Q-learning adapted to find near-equivalent treatment strategies.
problem Finding optimal treatment sequences in dynamic treatment regimes.
method Introducing a worst-value tolerance criterion to find sets of near-equivalent policies.
result Constructs families of near-equivalent treatment strategies.
Deep learning models have been the subject of study from various perspectives, for example, their training process, interpretation, generalization error, robustness to adversarial attacks, etc. A trained model is defined by its decision boundaries, and therefore, many of the studies about deep learning models speculate…
Study decision boundaries using heat diffusion and probabilistic techniques.
problem Understanding the geometry of decision boundaries in machine learning.
method Using Brownian motion and probabilistic techniques to analyze decision boundaries.
result Decision boundaries exhibit persistent 'wiggly and fuzzy' regions, even under adversarial attacks.
This work uses tropical geometry to understand neural network decision boundaries.
problem Characterizing neural network decision boundaries with piecewise linear activations.
method Tropical geometry applied to a simple neural network model.
result Decision boundaries are a subset of a tropical hypersurface related to a polytope formed by zonotopes.
New method measures generalizability of deep neural networks based on decision boundary complexity.
problem Lack of generalization methods for deep neural networks.
method Created Decision Boundary Complexity (DBC) score to measure DNN complexity.
result Simpler decision boundaries lead to better generalizability, supporting Occam's Razor.
The paper shows how neural networks with less decision boundary variability generalize better.
problem Improving neural network generalizability by reducing decision boundary variability.
method Introduces new measures (algorithm DB variability and (ε,η)-data DB variability) to quantify decision boundary variability and proves theoretical bounds on generalizability. result Neural networks with lower decision boundary variability have better generalizability, as shown by extensive experiments and theoretical bounds.
Measures neural network decision boundary volume to predict model performance.
problem Understanding the geometry of deep learning models for better performance.
method Local surface volumes to measure decision boundary, applying Weyl's tube formula.
result Smaller surface volume correlates with higher classification accuracy.
Deep learning models generalize by extending decision boundaries outside the convex hull of training data.
problem Understanding how deep learning models generalize beyond their training data.
method Investigation of decision boundaries inside and outside the convex hull of training sets, using various neural network architectures and training regimes.
result Over-parameterization is necessary for deep learning models to extend decision boundaries outside the convex hull of their training data.
Study reveals how features influence deep network decision boundaries.
problem Understanding the role of features in neural network decision boundaries.
method Adopted adversarial robustness tools to measure changes in CNN decision boundaries.
result Neural networks exhibit high invariance to non-discriminative features and are sensitive to small perturbations of training samples.
Deep neural networks' decision boundaries move closer to natural images during training.
problem Limited understanding of deep neural networks' decision boundaries and regions.
method Examined the minimum distance of data points to the decision boundary over training.
result The decision boundary moves closer to natural images during training, even in late epochs.
AI models assess psychological risks in currency trading.
problem Identifying psychological risks in currency traders.
method Developed a decision tree model to identify patterns in historical data.
result Enhanced decision-making through real-time alerts.
In this paper, we investigate dynamic optimization problems featuring both stochastic control and optimal stopping in a finite time horizon. The paper aims to develop new methodologies, which are significantly different from those of mixed dynamic optimal control and stopping problems in the existing literature, to stu…
Study on neuron dynamics for XOR classification with zero-margin.
problem Understanding neural network training dynamics in zero-margin classification problems.
method Analysis of Gaussian XOR problem, focusing on neuron block dynamics and generalization without margin assumptions.
result Neurons cluster into four directions and block-level signals evolve coherently, essential for reliable prediction in the Gaussian setting.
New method visualizes decision boundaries of classification models.
problem Difficulty in understanding how classification models interpret data.
method Hybrid supervised-unsupervised technique for visualizing decision boundaries.
result Provides interpretable maps for qualitative and quantitative analysis.
Random forest is widely exploited as an ensemble learning method. In many practical applications, however, there is still a significant challenge to learn from imbalanced data. To alleviate this limitation, we propose a deep dynamic boosted forest (DDBF), a novel ensemble algorithm that incorporates the notion of hard …
We propose the labeled Čech complex, the plain labeled Vietoris-Rips complex, and the locally scaled labeled Vietoris-Rips complex to perform persistent homology inference of decision boundaries in classification tasks. We provide theoretical conditions and analysis for recovering the homology of a decision boundary fr…
The goal of this paper is to analyze the geometric properties of deep neural network classifiers in the input space. We specifically study the topology of classification regions created by deep networks, as well as their associated decision boundary. Through a systematic empirical investigation, we show that state-of-t…
Proposes a method to speed up model selection for classification.
problem Time-consuming model selection process and lack of dataset-specific insights.
method Relaxes decision boundaries of neural decision trees to find equivalent or better models.
result Reduces the scope of exploration needed for model selection.
Deep neural networks have been widely deployed in various machine learning tasks. However, recent works have demonstrated that they are vulnerable to adversarial examples: carefully crafted small perturbations to cause misclassification by the network. In this work, we propose a novel defense mechanism called Boundary …
This paper tackles online reinforcement learning for unseen tasks with unknown boundaries.
problem Real-world tasks violate assumptions of task distributions, independence, and clear task delineations.
method A mixture of Gaussian Processes models different dynamics, and a transition prior handles temporal dependencies.
result The approach reliably handles task distribution shifts and outperforms alternatives in non-stationary tasks.
Paper proposes a new classifier for hyperbolic spaces using horospherical boundaries.
problem Optimization of large margin classifiers in hyperbolic spaces.
method Horospherical decision boundaries for geodesically convex optimization.
result Geodesically convex optimization leads to globally optimal solutions.
Convex polytope trees expand decision trees with interpretable boundaries.
problem High accuracy often requires many nodes in decision trees, reducing interpretability.
method CPT uses logical disjunction of weighted linear decision-makers, geometrically a convex polytope.
result CPT achieves high accuracy with fewer nodes compared to existing methods.
Decision trees are a popular technique in statistical data classification. They recursively partition the feature space into disjoint sub-regions until each sub-region becomes homogeneous with respect to a particular class. The basic Classification and Regression Tree (CART) algorithm partitions the feature space using…
Mixup reduces the sample complexity of finding optimal decision boundaries for more separable data.
problem Finding optimal decision boundaries in separable data distributions.
method Mixup technique applied to binary linear classification problems.
result Mixup significantly reduces the sample complexity for more separable data.
Capacity control, the bias/variance dilemma, and learning unknown functions from data, are all concerned with identifying effective and consistent fits of unknown geometric loci to random data points. A geometric locus is a curve or surface formed by points, all of which possess some uniform property. A geometric locus…
Continuous-time optimal stopping solved with deep reinforcement learning
problem Optimal stopping problems in continuous time
method CARLOS (Continuous-time Adaptive Reinforcement Learning for Optimal Stopping)
result Higher prices than existing Bermudan solvers, approaching American upper bound
Dynamic probabilistic forecasts guide optimal decisions in uncertain processes.
problem Optimal decision making in processes influenced by uncertain random factors.
method Stochastic models for probabilistic forecast evolution, calibrated from ensemble forecasts.
result Optimal decision strategies determined using dynamic probabilistic forecasts.
We use flip points to explain and audit deep learning models, revealing decision boundaries and improving model performance.
problem Lack of interpretability in deep learning models hinders their use in important applications.
method Flip points are used to analyze decision boundaries of deep learning models with continuous output scores.
result Flip points reveal the least changes in input that would alter a model's classification, enabling better understanding and improvement of model behavior.
Optimal healthcare investment timing in a dynamic model with mortality risk.
problem Optimal timing of healthcare investment to reduce mortality risk.
method Dynamic framework, stochastic control, optimal stopping problem, dual transformation.
result Characterization of the optimal investment boundary and numerical solutions.
Study optimal investment and consumption strategies with various transaction costs.
problem Investment and consumption decisions under varying transaction costs.
method Dynamic programming and singular perturbation expansion for small cost-to-wealth ratio.
result Derive leading-order asymptotic formulas for no-trade regions and trading boundaries.
Paper extends transfer learning for decision rules, improving treatment rule estimation.
problem Estimating optimal individualized treatment rules under changing conditions.
method Bayes decision rules and low-dimensional empirical risk minimization.
result Consistent estimators and risk bounds established under mild conditions.
New attacks reveal membership in label-only ML models.
problem Vulnerability of ML models to membership inference attacks.
method Developed decision-based membership inference attacks.
result Label-only exposures are vulnerable to membership leakage.
The goal of a decision-based adversarial attack on a trained model is to generate adversarial examples based solely on observing output labels returned by the targeted model. We develop HopSkipJumpAttack, a family of algorithms based on a novel estimate of the gradient direction using binary information at the decision…
Proposes a novel method for generating hard negatives near time series data boundaries.
problem Challenges in generating effective negative samples for time series anomaly detection.
method Reconstruction-driven boundary negative generation framework using reinforcement learning.
result Improves anomaly representation learning and achieves competitive detection performance.
Local surrogate models, to approximate the local decision boundary of a black-box classifier, constitute one approach to generate explanations for the rationale behind an individual prediction made by the back-box. This paper highlights the importance of defining the right locality, the neighborhood on which a local su…
Stable actions of hyperbolic groups on their boundaries.
problem Stability of group actions on boundaries.
method Dynamical coding and semi-conjugacy analysis.
result Topological stability of actions on hyperbolic group boundaries.
A set of introductory notes on the subject of data classification using a linear classifier and least-squares cost function, and the negative effect of the presence of outliers on the decision boundary of the linear discriminant. We also show how a simple scaling could make the outlier less significant, thereby obtaini…
We consider the sharp interface limit of the Allen-Cahn equation with Dirichlet or dynamic boundary conditions and give a varifold characterization of its limit which is formally a mean curvature flow with Dirichlet or dynamic boundary conditions. In order to show the existence of the limit, we apply the phase field me…
Deep neural networks achieve optimal learning rates for high-dimensional classification.
problem Learning classification functions from noisy data with smooth boundaries.
method Empirical risk minimization over deep neural networks for locally Barron-regular decision boundaries.
result Optimal estimation rates are independent of dimension and can be achieved by deep neural networks.