Paper improves KNN-Shapley for privacy-friendly data valuation.
problem Privacy challenges in data valuation methods.
method Introduces TKNN-Shapley, a privacy-friendly variant of KNN-Shapley.
result TKNN-Shapley offers superior privacy-utility tradeoff compared to naively privatized KNN-Shapley.
Unified and noise-reduced data valuation framework for machine learning.
problem Quantifying the contribution of individual data points in machine learning.
method Beta Shapley, a generalization of Data Shapley, relaxes the efficiency axiom.
result Beta Shapley outperforms state-of-the-art data valuation methods on various ML tasks.
Study reveals Data Shapley's inconsistent performance in data selection tasks.
problem Inconsistency of Data Shapley's performance in data selection across different settings.
method Hypothesis testing framework and identification of utility functions.
result Data Shapley's performance is no better than random selection without specific constraints.
Efficient WKNN-Shapley computation improves data valuation accuracy.
problem Efficient computation of Data Shapley for WKNN algorithm.
method Reframed WKNN-Shapley as a counting problem, introduced quadratic-time algorithm.
result Quadratic-time WKNN-Shapley computation, improving from O(NK). New insights on Shapley value precision for tabular data predictions.
problem Precision of Shapley value explanations for individual observations.
method Conditional Shapley value estimation methods for tabular data.
result Shapley value explanations are less precise for outer observations.
Develops Shapley explainability solutions respecting data manifold.
problem Tenable assumption of uncorrelated features in Shapley explainability.
method Two solutions: generative modelling and direct learning of Shapley value-function.
result On-manifold Shapley explainability overcomes drawbacks of 'off-manifold' values.
The paper introduces Absolute Shapley Value to handle negative contributions in machine learning model training.
problem Negative marginal contributions in machine learning model training.
method Investigates three philosophies: Original Shapley Value, Zero Shapley Value, and Absolute Shapley Value.
result Absolute Shapley Value significantly outperforms other definitions in evaluating data importance.
This paper quantifies uncertainty in Data Shapley using statistical inference.
problem Uncertainty in data valuation due to dynamic data distribution.
method Established relationship with U-statistics and quantified uncertainty using statistical inference.
result Confidence intervals for Data Shapley estimations are provided.
New Shapley values reveal non-linear feature dependencies.
problem Understanding non-linear dependencies in machine learning models.
method Model-independent Shapley values using non-parametric measures of dependence.
result Model-independent Shapley values can uncover non-linear dependencies.
Paper uses VAEAC to estimate Shapley values for complex models with mixed features.
problem Estimating Shapley values for models with dependent mixed features.
method Uses variational autoencoder with arbitrary conditioning (VAEAC) to model feature dependencies.
result VAEAC approach outperforms state-of-the-art methods for various settings.
FGSV defends against shell company attacks in group data valuation.
problem Shell company attacks on group-level data valuation.
method Developed a provably fast and accurate approximation algorithm for FGSV.
result Empirical results show significant improvement in computational efficiency and accuracy.
"How much is my data worth?" is an increasingly common question posed by organizations and individuals alike. An answer to this question could allow, for instance, fairly distributing profits among multiple data contributors and determining prospective compensation when data breaches happen. In this paper, we study the…
A new framework assigns values to data points considering their distribution.
problem Limited applicability of data Shapley to points outside the fixed data set.
method Proposes distributional Shapley, defining point value in context of data distribution.
result Distributional Shapley values are stable under data point and distribution perturbations.
We introduce a new method to explain Gaussian processes using Shapley values.
problem Explaining the uncertainty in Gaussian process models.
method Extending Shapley values to stochastic cooperative games for Gaussian processes.
result Our method generates explanations that are random variables and satisfy favorable axioms.
As data becomes the fuel driving technological and economic growth, a fundamental challenge is how to quantify the value of data in algorithmic predictions and decisions. For example, in healthcare and consumer markets, it has been suggested that individuals should be compensated for the data that they generate, but it…
Paper proves Shapley value convergence in Bayesian learning games.
problem Measuring contributions in cooperative games using Bayesian inference.
method Established convergence of Shapley value in parametric Bayesian learning games.
result Shapley value differences converge in probability to a limiting game.
A method uses Shapley values and Mahalanobis distances to explain multivariate outliers.
problem Explaining multivariate outlyingness in data.
method Decomposing squared Mahalanobis distance using Shapley values.
result Shapley values provide variable contributions to outlying observations.
New methods for estimating conditional Shapley values compared and evaluated.
problem Estimating precise conditional Shapley values for tabular data models.
method Developed new and extended methods using Monte Carlo integration and regression.
result Recommendations for choosing between Monte Carlo and regression methods based on data distribution.
We introduce a variable importance measure to quantify the impact of individual input variables to a black box function. Our measure is based on the Shapley value from cooperative game theory. Many measures of variable importance operate by changing some predictor values with others held fixed, potentially creating unl…
The study compares different game-theoretic attribution methods and finds that interventional Shapley values yield less consistent results than Aumann-Shapley due to path symmetry.
problem Investigating the influence of path choice on game-theoretic attribution algorithms.
method Comparative analysis of interventional Shapley values and Generalized Integrated Gradients (GIG) methods.
result Interventional Shapley values yield less consistent attributions than Aumann-Shapley due to path symmetry and extended away from the training data manifold.
Group Shapley evaluates feature groups in business data, improving explainability in AI.
problem Evaluating the importance of feature groups in business and economic data.
method Developed Group Shapley and a significance testing procedure based on chi-square approximation.
result Market-related variables are identified as the most influential feature group.
SHAFF estimates Shapley effects efficiently even with dependent variables.
problem Challenges in estimating Shapley effects, especially with dependent variables.
method SHAFF uses random forests to estimate Shapley effects efficiently.
result SHAFF provides a fast and accurate estimate of Shapley effects.
This research adapts superpixels for Shapley value computation in DNA profile classification.
problem Efficiently computing Shapley values for large, multidimensional time-series data.
method Adapting the concept of superpixels to streamline Shapley value computation for time-series-like data.
result Realistic, accurate, and fast computation of Shapley values for DNA profile classification.
Tab-Shapley identifies top-k anomalies in tabular data quality insights.
problem Challenges in identifying anomalies in unlabeled tabular datasets.
method Cooperative game theory using Shapley values to quantify attribute contributions.
result Efficiently identifies top-k tabular data quality insights using closed-form Shapley values.
New sampling method estimates Shapley values more accurately.
problem Exponential time complexity of computing Shapley values.
method Multilinear sampling algorithm based on game theory.
result Our method reduces variance and provides more accurate Shapley value estimations.
In-Run Data Shapley offers efficient data attribution for large-scale models.
problem Existing data attribution methods are computationally intensive and cannot target specific models.
method In-Run Data Shapley, which efficiently attributes data contributions to a specific model without re-training.
result In-Run Data Shapley achieves significant efficiency, enabling data attribution for pretraining models.
Developing an explainable outlier detection method for interval-valued data using Shapley value-based approach.
problem Outlier detection in interval-valued data.
method Proposed a novel approach based on Shapley value for interval-valued data.
result Fine-grained interpretation of outliers with variable contributions.
Proposes a new method to avoid model extrapolation in Shapley values.
problem Model extrapolation in marginal Shapley values leads to unreliable explanations.
method Proposes a new approach that avoids model extrapolation using marginal averaging and causal information.
result Demonstrates the impacts of model extrapolation on Shapley values and proposes a new method to avoid it.
Shapley values explain financial language models, aligning with domain knowledge.
problem Lack of explainability in financial applications of large language models.
method Shapley value analysis for financial textual data.
result Shapley values provide consistent explanations with financial reasoning.
A new method reduces data valuation variance for more trustworthy data trading.
problem Data valuation and trustworthy data trading in algorithmic prediction.
method Variance reduced Shapley value estimation using stratified sampling.
result VRDS method reduces estimation variance and improves data marketplace development.
ManifoldShap improves model explanations by restricting evaluations to the data manifold.
problem Inaccurate and misleading model explanations due to reliance on out-of-distribution data.
method Restricts model evaluations to the data manifold to avoid off-manifold perturbations.
result ManifoldShap provides more accurate and intuitive explanations than existing methods.
This work simplifies data valuation for LLMs using Shapley value computation.
problem How to fairly distribute benefits from training superior LLMs with multiple data owners' resources.
method We leverage the specific mathematical structure of DPO to enable scalable Shapley value computation for LLMs.
result We demonstrate that Shapley value computation for LLMs trained with DPO is significantly simplified.
New method improves model explainability.
problem Improper model explanations fail to reflect true data-generating process.
method Shapley Marginal Surplus for Strong Models
result Significant outperformance in inferential capabilities.
We present a novel framework for estimation and inference with the broad class of universal approximators. Estimation is based on the decomposition of model predictions into Shapley values. Inference relies on analyzing the bias and variance properties of individual Shapley components. We show that Shapley value estima…
Paper uses Shapley values to identify key confounders in product funnel data.
problem Identifying important confounders in product funnel data.
method Applies Shapley values for scalable coarsened exact matching.
result Shapley values provide robust importance-ranking for confounders.
PSI models and infers feature attributions efficiently and accurately.
problem Modeling and inferring feature attributions in flexible predictive models.
method Probabilistic Shapley inference (PSI) framework using latent random variables and a masking-based neural network architecture.
result PSI learns feature attribution distributions centered at Shapley values, revealing meaningful uncertainty.
Paper uses Shapley values to explain how clusters of training data affect predictions.
problem Explaining how training data clusters impact predictions from black-box models.
method Extends Shapley values to cluster importance, using coalitional game theory.
result Shows how different clusters of training data contribute to model predictions.
We study instancewise feature importance scoring as a method for model interpretation. Any such method yields, for each predicted instance, a vector of importance scores associated with the feature vector. Methods based on the Shapley score have been proposed as a fair way of computing feature attributions of this kind…
A framework for uncertainty-aware multimodal learning using conformal Shapley intervals.
problem Uncertainty and modality level importance in multimodal learning.
method Introduces conformal Shapley intervals to quantify modality level importance and uncertainty.
result Demonstrates meaningful uncertainty quantification and strong predictive performance.
Enhances data valuation by integrating global and local statistical properties.
problem Insufficient consideration of global and local statistical properties in data valuation methods.
method Proposes a method that fuses global and local statistical properties into regularization terms for Shapley value estimation and dynamic data valuation.
result Demonstrates improved performance and efficiency of data valuation methods through integration of global and local statistical properties.
Shapley values criticized for feature selection, leading to new insights.
problem Using Shapley values for feature selection is problematic.
method Introduced and critiqued Shapley values as feature selection tools, using counterexamples and simulations.
result Shapley values may not always align with feature selection goals.
Introduces joint Shapley values to measure feature importance in models.
problem Measuring the importance of feature sets in machine learning models.
method Extends Shapley's axioms to measure a set of features' average contribution to a model's prediction.
result Joint Shapley values provide unique insights and are more consistent with local intuitions.
Improved KNN data valuation method with reduced computation time.
problem Efficiently valuing individual data points in KNN models.
method Proposed a new utility function and derived its calculation for KNN classifiers/regressors, achieving similar time complexity as the original method.
result Soft-label KNN-SV outperforms the original method in mislabeled data detection.
Shapley value improves model interpretation but not causal inference.
problem Improving model interpretability without losing predictive power.
method Analyzed Shapley value in Bayesian networks, linking it to conditional independence.
result Eliminating high Shapley value variables does not harm predictive performance, but low Shapley value variables can.
A new method for interpreting AI models using Shapley value for functional data.
problem Interpreting AI models, especially those based on functional data.
method Proposes an interpretability method based on the Shapley value for continuous games.
result Demonstrates the effectiveness of the method through experiments with simulated and real data.
A framework detects nonlinear and interaction effects in epidemiological data with uncertainty quantification.
problem Lack of reliable inference for ML-discovered nonlinearities and interactions in epidemiological data.
method Combines Bayesian sparse regression, tree ensembles, and Shapley values.
result Valid uncertainty quantification for feature effects at the individual level.
New method calculates Shapley values for uncertain functions.
problem Uncertain value functions in explainable machine learning.
method Definition of Shapley values using probability theory.
result Shapley values can be applied to uncertain functions.
Unified framework for calculating Shapley values with correlated features.
problem Inaccurate Shapley values due to multicollinearity.
method Unified framework with matrix formulation and mathematical proof.
result Shapley values become independent of feature correlations.