Paper proves LCVB method's consistency in Bayesian posteriors and decision rules.
problem Approximating Bayesian posteriors and decision rules.
method Loss-calibrated variational Bayes (LCVB) method.
result LCVB method's consistency in both approximate posterior and decision rules.
Local reservoir model explains decision consistency in learning.
problem Understanding decision consistency in learning processes.
method Proposes a local reservoir model to explain decision consistency.
result Size of local reservoir affects decision consistency.
Gini index needs auto-calibration for consistent decision-making.
problem Gini index's inconsistency in decision-making.
method Restrict Gini index to auto-calibrated regression models.
result Gini index becomes strictly consistent with auto-calibration.
Paper proposes consistent estimators for learning to defer decisions to experts.
problem Learning algorithms often ignore expert decision-making in practical scenarios.
method Reduction to cost sensitive learning, novel surrogate loss for consistent estimation.
result Effective approach demonstrated on various tasks, showing consistency.
We consider portfolio selection when decisions based on a dynamic risk measure are affected by the use of a moving horizon, and the possible inconsistencies that this creates. By giving a formal treatment of time consistency which is independent of Bellman's equations, we show that there is a new sense in which these d…
New algorithms improve on consistency and robustness in convex function chasing with black-box advice.
problem Minimizing cost in normed vector space with black-box advice for convex function chasing.
method Two novel algorithms: INTERP and BDINTERP, exploiting convexity to achieve improved consistency and robustness.
result BDINTERP achieves near-optimal consistency-robustness trade-off for α-polyhedral cost functions.
Improved decision tree for big data classification.
problem Classification of large datasets.
method Divide and conquer strategy with decision tree segmentation and leaf level classifier.
result Models are interpretable and as accurate as ensemble methods.
We analyze the consistency of decision trees and random forests in regression.
problem Consistency of decision trees and random forests in regression.
method Elementary proofs following classical arguments for smoothing methods.
result Establish weak and almost sure convergence of honest trees and forest averages to the true regression function.
Decision trees are consistent for regression and classification tasks even with many predictors.
problem Consistency of decision trees with many predictors.
method CART and C4.5 methodology, oracle inequality, sparsity constraints.
result Decision trees and random forests are consistent for various types of data.
In stochastic decision problems, one often wants to estimate the underlying probability measure statistically, and then to use this estimate as a basis for decisions. We shall consider how the uncertainty in this estimation can be explicitly and consistently incorporated in the valuation of decisions, using the theory …
Optimizes portfolio construction using Bayesian methods and variational techniques.
problem Balancing reward and risk in portfolio construction.
method Bayesian decision-theoretic formulation, saddle-point problem, variational Bayes relaxation, efficient algorithm, provable convergence.
result Proves statistical consistency of proposed decision with optimal Bayesian decision.
The paper proposes a method to evaluate superhuman models by checking for logical inconsistencies.
problem Evaluating superhuman models when ground truth is hard to obtain.
method A framework using consistency checks to identify logical inconsistencies in model decisions.
result Logical inconsistencies can be discovered in superhuman model decisions across various tasks.
Paper tackles non-monotonic resource utilization in sequential decision-making.
problem Sequential decision-making under uncertainty with resource constraints.
method Introduces a new MDP policy with constant regret against LP relaxation.
result Develops a learning algorithm with logarithmic regret for unknown outcome distributions.
Empirical model tackles decision problems without specifying states of the world.
problem Decision problems under uncertainty with inaccessible states of the world.
method Empirical approach using observed act--consequence pairs as model primitives.
result Optimality in empirical decision problems addressed using protocol-based empirical choice functions.
Paper develops IV method for consistent OPE in confounded MDPs.
problem Confounding variables in observational data affect OPE effectiveness.
method Instrumental variable approach for consistent off-policy evaluation.
result IV method enables correct identification of target policy's value.
Paper proposes a new method for SP with covariates using PADR and ERM.
problem Stochastic programming with covariate information.
method Empirical risk minimization (ERM) with nonconvex piecewise affine decision rules (PADR).
result The method provides theoretical consistency and computational tractability for nonconvex SP problems.
ID3 generates near-optimal decision trees for DNFs under product distributions.
problem Understanding the optimality of decision trees generated by ID3.
method Introducing a new metric (MIC) to measure the optimality of ID3-generated trees and comparing it with other algorithms.
result The TopDown variant of ID3 is near-optimal in learning read-once DNFs under product distributions, while another variant is not.
New approach optimizes decisions based on uncertainty in predictions.
problem Mismatch between prediction accuracy and decision loss in sequential design.
method Directional uncertainty-guided approach to sequential experimental design.
result Directional uncertainty-based design stops earlier and performs better.
A new approach for inferring optimal decision trees from large datasets.
problem Inferring an optimal decision tree from large datasets is NP-complete.
method Incremental generation of Boolean formula to infer a decision tree of minimum depth.
result The approach scales well and runs efficiently on large datasets.
Paper analyzes venture capital exit decisions under inconsistent preferences.
problem Time-inconsistent preferences in venture capital exit timing.
method Modeling four types of venture capitalists with varying levels of inconsistency.
result Time-inconsistent venture capitalists exit earlier than consistent ones.
The paper tackles selective labels in decision making, proposing a data augmentation approach to mitigate bias and discrimination.
problem Selective labels cause bias in decision making, making standard bias correction methods ineffective.
method Proposes a data augmentation approach to leverage expert consistency or empirically validate models under selective labels.
result Data augmentation can mitigate the bias caused by selective labels and prevent unreliable models.
Optimizes decision-making with variational Bayesian methods for continuous utilities.
problem Inference approximations for continuous utilities without full posterior knowledge.
method Automatic pipeline that co-opts continuous utilities into variational inference algorithms.
result Consistent improvement in decision-making when calibrating approximations for specific utilities.
In this paper we introduce a novel family of decision lists consisting of highly interpretable models which can be learned efficiently in a greedy manner. The defining property is that all rules are oriented in the same direction. Particular examples of this family are decision lists with monotonically decreasing (or i…
Decision-alignment evaluates uncertainty quantification for decision-relevant UQ
problem Evaluation of uncertainty quantification metrics
method Introduce decision-alignment
result Proper scoring rules align with decision utility
Wasserstein DR optimizes decisions under uncertain distributions.
problem Learning decisions from uncertain data with limited samples.
method Wasserstein distributionally robust optimization (DR) approach.
result Optimal decisions can be computed efficiently and have strong guarantees.
CREDO assesses decision optimality under uncertainty without assuming a model.
problem Uncertainty in decision-making without reliable quantification of optimality.
method CREDO uses the inverse feasible region and conformal prediction balls to estimate decision optimality probability.
result CREDO provides accurate, efficient, and reliable evaluations of decision optimality.
More and more processes governing our lives use in some part an automatic decision step, where -- based on a feature vector derived from an applicant -- an algorithm has the decision power over the final outcome. Here we present a simple idea which gives some of the power back to the applicant by providing her with alt…
Paper addresses regret minimization and inference in high-dimensional online decision-making.
problem Regret minimization and statistical inference in high-dimensional online decision-making.
method Integrates ε-greedy bandit algorithm with hard thresholding for sparse bandit parameters and debiasing method for inference.
result Achieves either O ( T 1 / 2 ) O(T^{1/2}) O ( T 1/2 ) regret or O ( T 1 / 2 ) O(T^{1/2}) O ( T 1/2 ) -consistent inference, with trade-off between exploration and exploitation. A new decision tree variant improves linear model performance.
problem Improving decision tree performance on non-linear data.
method Extremely random tree with non-linear data transformation and linear observer.
result Outperforms linear models on benchmark dataset.
Optimizes decisions from observational data with a novel algorithm.
problem Optimizing uncertain objectives over continuous, multi-dimensional spaces with limited data.
method Proposes a novel algorithm that combines predictive machine learning with uncertainty information.
result Demonstrates superior performance compared to existing methods on various data sets.
We demonstrate a limitation of discounted expected utility, a standard approach for representing the preference to risk when future cost is discounted. Specifically, we provide an example of the preference of a decision maker that appears to be rational but cannot be represented with any discounted expected utility. A …
Paper extends transfer learning for decision rules, improving treatment rule estimation.
problem Estimating optimal individualized treatment rules under changing conditions.
method Bayes decision rules and low-dimensional empirical risk minimization.
result Consistent estimators and risk bounds established under mild conditions.
The paper defines and characterizes conditional nonlinear expectations.
problem Defining and characterizing conditional nonlinear expectations.
method Embedding in decision theory, using state-dependent preferences, and continuous utility representation.
result Consistent backward conditional projections are characterized by the Sure-Thing Principle.
New method detects inconsistencies in AHP matrices using triadic preference reversals.
problem Challenges in assessing consistency in AHP pairwise comparison matrices.
method Triadic preference reversals to detect inconsistencies between pairs of elements.
result 97% accuracy in detecting inconsistencies, significantly surpassing traditional methods.
Study finds AUC is most consistent across different prevalence in binary classification.
problem Consistency of model evaluation metrics across varying prevalence in binary classification.
method Analysis of 156 data scenarios with 18 metrics, 5 models, and a random guess model.
result AUC has the smallest variance in evaluating individual models and ranking of models.
FoLDTree improves oblique decision trees with ULDA, enhancing accuracy and feature selection.
problem Axis-orthogonal splits limit traditional decision trees' performance on oblique decision boundaries.
method Integrates ULDA into decision tree structure for efficient oblique splits, feature selection, and handling missing values.
result FoLDTree outperforms other methods in accuracy and feature selection, comparable to random forest.
Online learning framework for inverse optimization improves decision-making in noisy data.
problem Real-time decision-making with noisy data and limited historical information.
method Developed an online learning algorithm with implicit update rule for noisy data.
result Algorithm converges at O ( 1 / T ) \mathcal{O}(1/\sqrt{T}) O ( 1/ T ) rate and is statistically consistent. Paper integrates LLMs into portfolio optimization to improve decision quality.
problem Suboptimal portfolio decisions due to mismatch between prediction and decision quality.
method Integrates LLMs with decision-focused learning, using attention mechanism to process asset relationships and macro variables.
result Model consistently outperforms state-of-the-art deep learning models in portfolio optimization.
The theory of rational choice assumes that when people make decisions they do so in order to maximize their utility. In order to achieve this goal they ought to use all the information available and consider all the choices available to choose an optimal choice. This paper investigates what happens when decisions are m…
This paper simplifies OPE in large state spaces using state abstractions.
problem Accurately evaluating policies offline in large state spaces.
method Developed a backward-model-irrelevance condition and an iterative state abstraction procedure.
result Deeply-abstracted states substantially simplify OPE sample complexity.
A new autoregressive SPO method improves decision-making for dependent data.
problem Improving decision-making for dependent data in stochastic optimization.
method An autoregressive Smart Predict-then-Optimize (SPO) method for time series data.
result Generalization bounds and uniform calibration results for the SPO loss in autoregressive models.
Enhanced ODT with Feature Concatenation boosts learning efficiency.
problem Insufficient learning efficiency of ODT due to linear projections not being transmitted to child nodes.
method Feature Concatenation ( exttt{FC-ODT}) to transmit linear projections along decision paths.
result Experiments show exttt{FC-ODT} outperforms state-of-the-art decision trees with a limited tree depth.
Decision stumps accurately screen variables in nonparametric models.
problem Challenges in theoretical properties of tree-based variable importance measures.
method Derive performance guarantees for variable selection using a single-level CART decision tree (decision stump).
result Decision stumps can perform consistent model selection despite being inaccurate for estimation.
Consistent supervised learning with missing values is possible using imputation or specialized models.
problem Predicting with missing values in both training and testing data.
method Two approaches: imputing with a constant and using a predictor for complete observations through multiple imputation. Decision trees can handle missing values naturally.
result Imputing with a constant can be consistent when missing values are not informative.
In this paper the theory of semi-bounded rationality is proposed as an extension of the theory of bounded rationality. In particular, it is proposed that a decision making process involves two components and these are the correlation machine, which estimates missing values, and the causal machine, which relates the cau…
An online decision-making algorithm using stochastic gradient descent for big data.
problem Efficiently updating decision rules in online decision making with big data.
method Stochastic gradient descent for online updates, asymptotic normality of estimators.
result Asymptotic normality of parameter and value estimators, enabling statistical inference.
Hybridizes genetic algorithms with PROMOTHEE for better economic activity localization decisions.
problem Making optimal location decisions for economic activities considering multiple criteria.
method Hybridization of genetic algorithms with PROMOTHEE method for multicriteria analysis.
result Improves decision-making for economic activity localization.
DRO optimizes decisions under uncertain distributions, considering worst-case scenarios.
problem Optimizing decisions when the distribution of uncertainties is itself uncertain.
method Defines ambiguity sets and seeks decisions optimal under the worst-case distribution.
result DRO models can be connected to regularization techniques and machine learning.