Framework adds human knowledge to AI decisions to improve outcomes.
problem Conflict between AI recommendations and human insights.
method Develops a framework for integrating human knowledge as a guardrail for AI decisions.
result Human knowledge can improve AI decisions, especially in specific pitfalls.
New algorithm finds optimal decision trees for binary variables.
problem Greedy decision tree algorithms often produce suboptimal models.
method Analytical bounds and modern systems techniques co-designed for efficient search space reduction.
result First practical algorithm for optimal decision trees for binary variables.
New algorithm tracks COVID-19 outbreak phases.
problem Decision-making in pandemic data.
method Developed a new algorithm (BLLR) based on decision theory.
result Demonstrated ability to track different phases of the COVID-19 outbreak.
Combines offline causal inference and online bandit learning for better decision-making.
problem Making adaptive decisions using both logged and streaming data to avoid user harm.
method Unified offline causal inference and online learning algorithms, deriving bounds on decision accuracy.
result First upper regret bound for forest-based online bandit algorithms.
Algorithm learns decision trees from noisy data.
problem Learning stochastic decision trees from corrupted samples.
method Quasipolynomial-time algorithm for adversarial noise.
result Returns a hypothesis with error within 2η+ε of optimal. New algorithms for privately learning decision lists and halfspaces.
problem Private learning of decision lists and halfspaces.
method Differentially private algorithms for PAC and online models.
result Private algorithms match or surpass non-private guarantees.
New research shows machine-assisted decisions can still be unfair even when the algorithm is fair.
problem Ensuring fairness in decisions made with machine-assisted human input.
method Formal model and lab experiment to analyze how machine predictions affect human decisions.
result Excluding information about protected groups from machine predictions can increase disparities.
Paper introduces algorithms for private decision tree learning.
problem Private decision tree learning in distributed settings.
method Proposes DP-TopDown, NoisyCounts, and LocalRNM.
result First utility guarantees for private decision tree learning.
Evolutionary algorithms improve decision tree ensembles.
problem Improving predictive performance of decision trees.
method Real-valued vector representation of decision trees, evolutionary algorithms (Differential evolution, Evolution strategies).
result Proposed methods outperform classical decision tree induction algorithms.
Paper proposes an intersection decision algorithm for autonomous vehicles.
problem Navigating intersections with non-automated vehicles.
method Combines reinforcement learning for high-level decisions and model predictive control for low-level planning.
result The proposed algorithm outperforms another controller in success rate and training episodes.
dtControl uses decision trees to represent controllers efficiently and explainably.
problem Representing controllers concisely and explainably.
method dtControl uses decision tree learning algorithms to represent controllers. Novel techniques for determinizing controllers are introduced.
result Novel techniques for determinizing controllers during decision tree construction are extremely efficient, yielding small decision trees.
Designs algorithms to assist humans without affecting their decisions.
problem Algorithms often fail to improve human decisions.
method Formalizes algorithm design using potential outcomes framework and monotonicity assumption.
result Derives minimax optimal recommendation algorithms for limited data.
New algorithm solves uncertain Markov decision processes using Wasserstein uncertainty.
problem Solving Markov decision processes with uncertain transition probabilities.
method Distributionally robust Q-learning algorithm for Wasserstein uncertainty. result Convergence of the algorithm proved and demonstrated with real data.
A new decision tree method avoids overfitting without hyperparameters.
problem Overfitting in decision trees.
method Hyperparameter-free approach that constructs smaller, shallower trees.
result Avoids overfitting without compromising accuracy or training time.
Study examines whether biased training data lead to biased algorithms.
problem Tackles the issue of bias in algorithmic decision-making.
method Examines a setting where biased human decision-makers affect training data and labels.
result Clarifies conditions for bias reversal in algorithmic decision rules.
New algorithm learns decision trees faster than before.
problem Properly learning decision trees in polynomial time.
method Membership query algorithm with nO(loglogn) time complexity. result Achieved faster learning time for decision trees.
New framework for contesting algorithmic decisions, not just explaining them.
problem Helping individuals review and correct erroneous algorithmic decisions.
method Operationalized contestability as a natural complement to explainable AI (XAI), identifying three types of evidence for reversal.
result Existing EU legislation already grants individuals legal rights to contest algorithmic decisions.
Improved model-free reinforcement learning with decision-estimation coefficient.
problem Interactive decision making, including structured bandits and reinforcement learning.
method Combining Estimation-to-Decisions with optimistic estimation to achieve better regret bounds.
result Regret bounds for model-free reinforcement learning with value function approximation.
An online decision-making algorithm using stochastic gradient descent for big data.
problem Efficiently updating decision rules in online decision making with big data.
method Stochastic gradient descent for online updates, asymptotic normality of estimators.
result Asymptotic normality of parameter and value estimators, enabling statistical inference.
Framework uses human judgment to distinguish algorithmically indistinguishable cases.
problem Clarifying human-AI collaboration in prediction and decision tasks.
method Integrates human judgment to distinguish algorithmically indistinguishable cases.
result Improves performance of any feasible algorithmic predictor.
New algorithms optimize decision rules in strategic scenarios, minimizing prediction risk and incentivizing better outcomes.
problem Strategic agents manipulate features to improve outcomes, complicating decision-making models.
method Efficient algorithms for learning decision rules that minimize prediction risk, incentivize better outcomes, and estimate true model coefficients.
result Optimal decision rules can be learned through testing and observing agent responses, circumventing hardness results.
Safe exploration framework for IML algorithms.
problem Safe decision-making in IML without unsafe outcomes.
method Exploits Gaussian process prior to efficiently learn safe decisions.
result Outperforms other algorithms empirically.
A new fairness metric for decision-making algorithms, conditioning on known fair variables.
problem Fairness issues in decision-making systems.
method Conditional fairness metric, Derivable Conditional Fairness Regularizer (DCFR), adversarial representation.
result Traditional fairness notations are special cases of the new conditional fairness notation.
TAO outperforms other decision tree algorithms in accuracy.
problem Optimizing decision tree algorithms for better performance.
method Comparison of TAO with established algorithms on various datasets.
result TAO achieves higher accuracy in nearly all datasets.
New algorithms achieve decision calibration without sample complexity dependent on feature dimension.
problem Achieving decision calibration for nonlinear loss functions with polynomial sample complexity.
method Developed smooth relaxation of decision calibration, enabling dimension-free algorithms.
result Efficient algorithms post-process predictors to satisfy decision calibration without worsening accuracy.
Proposes a recourse algorithm for machine learning decisions.
problem Individuals can suffer unfair outcomes in black-box systems.
method Models data distribution, generates smallest changes for improvement.
result Algorithm applicable to supervised and causal systems.
The construction of efficient and effective decision trees remains a key topic in machine learning because of their simplicity and flexibility. A lot of heuristic algorithms have been proposed to construct near-optimal decision trees. ID3, C4.5 and CART are classical decision tree algorithms and the split criteria they…
Survey on DRL for clinical decision support.
problem Improving clinical decision-making through AI.
method Deep reinforcement learning with DNN.
result Survey and comparison of DRL algorithms in clinical applications.
ID3 generates near-optimal decision trees for DNFs under product distributions.
problem Understanding the optimality of decision trees generated by ID3.
method Introducing a new metric (MIC) to measure the optimality of ID3-generated trees and comparing it with other algorithms.
result The TopDown variant of ID3 is near-optimal in learning read-once DNFs under product distributions, while another variant is not.
New learning process for neural classifiers simplifies decision weights.
problem Training decision layer weights in neural classifiers.
method Choosing appropriate loss functions and solving constrained optimization problems.
result A new learning process for pre-decision weights that is simple and effective.
Decision forests learn to model text by evaluating categorical-set conditions.
problem Decision forests cannot directly model text features.
method Defined and learned conditions for categorical-set features, enabling efficient text modeling.
result Decision forests can now directly model text features.
This work presents an approach to automatically induction for non-greedy decision trees constructed from neural network architecture. This construction can be used to transfer weights when growing or pruning a decision tree, allowing non-greedy decision tree algorithms to automatically learn and adapt to the ideal arch…
Societies often rely on human experts to take a wide variety of decisions affecting their members, from jail-or-release decisions taken by judges and stop-and-frisk decisions taken by police officers to accept-or-reject decisions taken by academics. In this context, each decision is taken by an expert who is typically …
Quantum version of C5.0 algorithm improves decision tree construction time.
problem Improving the efficiency of decision tree construction in machine learning.
method Improved classical algorithm and applied quantum subroutines for faster decision tree construction.
result Quantum algorithm reduces decision tree construction time significantly.
Machine learning algorithms are now frequently used in sensitive contexts that substantially affect the course of human lives, such as credit lending or criminal justice. This is driven by the idea that `objective' machines base their decisions solely on facts and remain unaffected by human cognitive biases, discrimina…
New decision-theoretic calibration error metric improves prediction reliability.
problem Improving the reliability of predictions for decision-making.
method Proposed Calibration Decision Loss (CDL) and an efficient algorithm to achieve near-optimal CDL.
result Near-optimal CDL guarantees vanishing payoff loss from miscalibration.
HL algorithms improve resource allocation in cloud environments.
problem Sequential decision-making under uncertainty with exogenous variables.
method HL algorithms leverage exogenous variable samples to infer counterfactual consequences.
result HL algorithms outperform classic methods and reinforcement learning in resource allocation.
In many healthcare settings, intuitive decision rules for risk stratification can help effective hospital resource allocation. This paper introduces a novel variant of decision tree algorithms that produces a chain of decisions, not a general tree. Our algorithm, α-Carving Decision Chain (ACDC), sequentially carves o…
OLBoost improves online decision tree performance without increasing memory or time costs.
problem Improving predictive performance in online decision trees without high memory or time costs.
method OLBoost applies boosting to small regions of the instances space within online decision tree algorithms.
result OLBoost can significantly improve online learning decision tree performance without increasing tree size.
In most real-world settings such as recommender systems, finance, and healthcare, collecting useful information is costly and requires an active choice on the part of the decision maker. The decision-maker needs to learn simultaneously what observations to make and what actions to take. This paper incorporates the info…
Transform ANNs into interpretable decision trees.
problem Lack of interpretability in ANNs.
method Developed two MDT algorithms: EC-DT and Extended C-Net.
result Extended C-Net generates the most compact and effective trees.
Develops an actor-critic algorithm for risk-sensitive Markov decision processes.
problem Risk-sensitive cost criterion in Markov decision processes.
method Actor-critic algorithm with function approximation.
result Asymptotic convergence of the actor-critic algorithm.
Boosted decision trees enjoy popularity in a variety of applications; however, for large-scale datasets, the cost of training a decision tree in each round can be prohibitively expensive. Inspired by ideas from the multi-arm bandit literature, we develop a highly efficient algorithm for computing exact greedy-optimal d…
New algorithms learn in complex decision-making problems with smooth transitions.
problem Learning in complex decision-making problems with smooth transitions.
method UCB and PSRL philosophies applied to episodic Markov decision processes with kernel approximation.
result Low regret learning achieved in continuous state and action spaces.
We summarize the potential impact that the European Union's new General Data Protection Regulation will have on the routine use of machine learning algorithms. Slated to take effect as law across the EU in 2018, it will restrict automated individual decision-making (that is, algorithms that make decisions based on user…
New algorithms for fast online decision making using neural networks and martingale posteriors.
problem Online sequential decision making under uncertainty.
method Martingale posterior neural networks for fast online learning and decision making.
result Achieves competitive performance-speed trade-offs in non-stationary contextual bandits and Bayesian optimization.
The study assesses the relative value of prediction in algorithmic decision making.
problem Improving welfare through better predictions versus other policy levers.
method Theoretical analysis of statistical models.
result Simple conditions determining the relative value of prediction.
New complexity measure for interactive learning reduces regret to near-optimal levels.
problem Challenges in sample-efficient, adaptive learning algorithms for interactive decision making.
method Introduces the Decision-Estimation Coefficient and the Estimation-to-Decisions (E2D) principle.
result Unified algorithm design principle E2D achieves optimal sample-efficient learning.