Dynamic Influence Tracker measures changing sample importance during model training.
problem Static influence measurements during training overlook how sample importance varies over time.
method Dynamic Influence Tracker (DIT) captures time-varying sample influence across arbitrary time windows.
result DIT reveals distinct learning phases with shifting priorities and detects corrupted samples more efficiently.
Shapley Homology measures sample influence on neural networks' manifold topology.
problem Assumption of iid samples simplifies manifold analysis in machine learning.
method Shapley Homology framework quantifies sample influence on neural networks' manifold topology.
result Higher influence scores correlate with greater impact on neural network accuracy.
There is an especially strong need in modern large-scale data analysis to prioritize samples for manual inspection. For example, the inspection could target important mislabeled samples or key vulnerabilities exploitable by an adversarial attack. In order to solve the "needle in the haystack" problem of which samples t…
Study examines influence diagnostics in high-dimensional M-estimation.
problem Understanding influence diagnostics in high-dimensional settings.
method Characterized the distribution of leave-one-out influences in high-dimensional Gaussian M-estimation.
result The distribution of influences converges to a limiting measure in high-dimensional settings.
New algorithm estimates influence in social networks without sampling.
problem Estimating the number of influenced nodes in social networks.
method Dynamic message-passing approach for scalable influence estimation.
result Upper bound on expected spread for general graphs, exact for treelike networks.
Proposes second-order influence functions for identifying influential groups in test-time predictions.
problem Identifying influential groups in test-time predictions for black-box models.
method Second-order approximations of the effect of removing a group of training samples on model predictions.
result Improves the correlation between computed influence values and ground truth values for linear models.
New method estimates data influence efficiently by leveraging test samples.
problem Efficiently estimating influence of training data on model predictions.
method Mirrored Influence Hypothesis, forward pass for test samples.
result Significant improvement in efficiency over existing methods.
A new framework for structured bandits using influence diagrams and variational Thompson sampling.
problem Complex statistical dependencies in structured bandit problems.
method Influence diagram framework, variational Thompson sampling, tracking structured posterior distribution.
result Empirically evaluated algorithms perform as well as or better than existing baselines.
Establishes statistical and computational bounds for influence diagnostics.
problem Identifying influential datapoints or subsets in machine learning models.
method Finite-sample statistical bounds and computational complexity for influence functions and approximate maximum influence perturbations.
result Established statistical and computational guarantees for influence diagnostics.
MISS identifies influential subsets in ML models.
problem Capturing collective influence of training samples.
method Analyzed and compared influence-based greedy heuristics and adaptive versions.
result Adaptive heuristics can better capture sample interactions.
Sub-sampling is a common and often effective method to deal with the computational challenges of large datasets. However, for most statistical models, there is no well-motivated approach for drawing a non-uniform subsample. We show that the concept of an asymptotically linear estimator and the associated influence func…
Enhances influence functions for deep models without costly Hessian inversion.
problem Challenges in computing Hessian matrix inverse for deep models.
method Substitutes Hessian inverse with identity matrix and extends applications.
result TracIn method performs well in measuring model utility and fairness.
New bandit algorithms adapt to evolving user interests influenced by social circles.
problem Adapting to evolving user interests in recommendation systems.
method Online recommendation algorithms tailored for social influence, based on LinREL and Thompson Sampling.
result Our adaptations maintain asymptotic regret bounds similar to non-social cases.
Improved data attribution for high-dimensional models.
problem Inaccurate influence functions in high-dimensional settings.
method Rescaled influence functions (RIF) for more precise data attribution.
result RIFs offer significantly better predictions in practice.
New estimator stabilizes higher-order influence functions for bilinear forms.
problem Stability issues in estimating bilinear forms using higher-order influence functions.
method Proposes a new stabilized higher-order estimator for a class of bilinear forms without sample splitting.
result New estimator exhibits more stable finite-sample performance compared to the empirical higher-order estimator.
Proposes a new sampling method for online learning with cumulative oversampling.
problem Budgeted Influence Maximization in online learning.
method Cumulative Oversampling (CO) method for online learning.
result CO-based algorithm achieves comparable regret to UCB-based algorithms and performs similarly to Thompson Sampling.
A new method subsamples data without weights to improve model performance.
problem Training complex models on large datasets is computationally expensive.
method Unweighted Influence Data Subsampling (UIDS) method.
result The subset-model outperforms the full-set-model in diverse tasks.
New estimator stabilizes higher-order influence functions for stable statistical inference.
problem Numerical instability in estimating inverse population Gram matrix.
method Proposes a new stabilized higher-order estimator without sample splitting.
result Stabilized estimator exhibits more stable performance and similar statistical guarantees.
Develops a faster model selection method using influence functions.
problem Time-consuming and computationally inefficient model selection.
method Model-specific data subsampling guided by influence functions.
result Empirically shows improved selection of high-quality models.
New IF method improves accuracy in deep neural networks with noisy data.
problem Inaccurate influence estimates in deep neural networks, especially with noisy data.
method Established a connection between influence estimation error, validation set risk, and sharpness, introducing a novel estimation form for flat validation minima.
result Our novel Influence Function approach provides more accurate influence estimates, validated across various tasks.
In this paper, we study the problem of robust influence maximization in the independent cascade model under a hyperparametric assumption. In social networks users influence and are influenced by individuals with similar characteristics and as such, they are associated with some features. A recent surging research direc…
Paper assesses how features influence classification of COVID-19 patients.
problem Evaluating the influence of features on classification problems.
method Introduced a measure of feature influence using Shapley value of cooperative games, with axiomatic characterisation.
result Validated the performance of the measure through experiments on COVID-19 patients.
Influence maximization (IM) is the problem of finding for a given s≥1 a set S of ∣S∣=s nodes in a network with maximum influence. With stochastic diffusion models, the influence of a set S of seed nodes is defined as the expectation of its reachability over simulations, where each simulation specifies a det…
A non-parametric method for ranking stock indices according to their mutual causal influences is presented. Under the assumption that indices reflect the underlying economy of a country, such a ranking indicates which countries exert the most economic influence in an examined subset of the global economy. The proposed …
Deep neural networks (DNNs) are notorious for their vulnerability to adversarial attacks, which are small perturbations added to their input images to mislead their prediction. Detection of adversarial examples is, therefore, a fundamental requirement for robust classification frameworks. In this work, we present a met…
Develops a framework to test excessive influence of small data subsets.
problem Identifying when small data subsets significantly impact model conclusions.
method Formalizes the concept of most influential sets, deriving influence formulas and extreme value distributions.
result Allows rigorous hypothesis testing for excessive influence, resolving contested findings.
Influence functions are inaccurate in deep learning models, especially for deeper networks.
problem Inaccuracies in influence functions in deep learning models.
method Empirical study of influence functions in neural network models trained on various datasets.
result Influence estimates are often erroneous for deeper networks and require regularization.
Active learning (AL) concerns itself with learning a model from as few labelled data as possible through actively and iteratively querying an oracle with selected unlabelled samples. In this paper, we focus on analyzing a popular type of AL in which the utility of a sample is measured by a specified goal achieved by th…
New measure of feature influence in classification problems considering feature dependencies.
problem Measuring the influence of features in classification problems with dependencies.
method Developed a new measure based on cooperative game theory, providing axiomatic characterization and demonstrating its equivalence to the Banzhaf-Owen value.
result The proposed influence measure effectively characterizes feature importance in classification problems with feature dependencies.
New method reveals how training data influence diffusion model outputs.
problem Difficulty in assessing training data impact on diffusion model outputs.
method Use of ensembles trained on carefully engineered splits of training data to identify influential training examples.
result Demonstrated the viability of ensembles as generative models and validity of assessing influence.
Aims to optimize influence spread in social networks using bandit algorithms.
problem Maximizing influence spread in unknown social networks.
method Combines Thompson Sampling and Epsilon Greedy algorithms with automatic ensemble learning.
result Demonstrates effectiveness of automatic ensemble learning for combinatorial bandit problems.
In2Core selects a coreset for efficient LLM fine-tuning with reduced data.
problem Costly fine-tuning of large language models due to extensive parameters and data requirements.
method Analyzes model gradients to estimate training sample influence, optimizing for efficiency.
result Achieves similar performance with 50% of training data using In2Core.
The pairwise influence matrix of Dobrushin has long been used as an analytical tool to bound the rate of convergence of Gibbs sampling. In this work, we use Dobrushin influence as the basis of a practical tool to certify and efficiently improve the quality of a discrete Gibbs sampler. Our Dobrushin-optimized Gibbs samp…
Study reveals how features influence deep network decision boundaries.
problem Understanding the role of features in neural network decision boundaries.
method Adopted adversarial robustness tools to measure changes in CNN decision boundaries.
result Neural networks exhibit high invariance to non-discriminative features and are sensitive to small perturbations of training samples.
MRI image quality affects statistical and predictive analysis of brain morphology.
problem Impact of MRI image quality on statistical and predictive analysis of brain morphology.
method Systematic testing of image quality on univariate statistics and machine learning classification using three large datasets.
result Low-quality MRI data significantly affects detecting significant sex/gender differences in smaller samples, but not in larger ones.
The paper analyzes methods to identify influential data points in deep models.
problem Interpreting deep learning models and debugging datasets.
method Curated experiments to analyze influence of data points on classifiers.
result Training loss-based sample selection outperformed other methods in detecting mislabels.
Develops new methods to evaluate data influence in SAM for improved model training.
problem Challenges in mislabeled noisy data and privacy concerns in SAM.
method Two innovative data valuation methods based on influence functions (IF) for SAM.
result Demonstrates effectiveness in identifying mislabeled data and enhancing interpretability.
Optimal intervention in economic networks modeled as influence maximization, with hard computational problems.
problem Optimal intervention in economic networks modeled as influence maximization.
method Transformed into influence maximization-like form, with theoretical and practical implications.
result Optimal intervention is NP-hard and cannot be approximated to a constant factor in polynomial time.
Gradient rollback explains neural models by identifying influential training examples.
problem Explain predictions of neural black-box models, especially in applications requiring user trust.
method Gradient rollback, a general approach for influence estimation applicable to neural models with limited parameter updates.
result Gradient rollback provides faithful explanations for neural models, including knowledge graph embedding methods.
Fuzzy cognitive maps (FCMs) model feedback causal relations in interwoven webs of causality and policy variables. FCMs are fuzzy signed directed graphs that allow degrees of causal influence and event occurrence. Such causal models can simulate a wide range of policy scenarios and decision processes. Their directed loo…
We present a method for learning the parameters of a Bayesian network with prior knowledge about the signs of influences between variables. Our method accommodates not just the standard signs, but provides for context-specific signs as well. We show how the various signs translate into order constraints on the network …
Understanding the influence of features in machine learning is crucial to interpreting models and selecting the best features for classification. In this work we propose the use of principles from coalitional game theory to reason about importance of features. In particular, we propose the use of the Banzhaf power inde…
GOIMDA selects inputs to maximize expected influence on a goal functional, reducing data acquisition needs.
problem Challenges in active data acquisition for learning and optimization tasks in deep neural networks.
method GOIMDA uses inverse curvature and goal gradient to select inputs maximizing expected influence on a specified goal functional.
result GOIMDA achieves target performance with fewer labeled samples or function evaluations compared to baselines.
Alignment of neural network representations is influenced by SNR and sample size.
problem Understanding how neural network representations align across different conditions.
method Controlled training of neural networks on perturbed datasets, analyzing alignment and generalization.
result Alignment varies monotonically with SNR but non-monotonically with sample size, with minimal alignment near the interpolation threshold.
A new method for graph neural networks speeds up inference and training.
problem Challenges in constructing mini-batches for large graphs in graph neural networks.
method Theoretical model of batch construction via maximizing influence score of nodes on outputs.
result Accelerates inference by up to 130x compared to previous methods.
The paper investigates instance-based interpretation methods for VAEs.
problem Understanding how VAEs make predictions without supervision.
method Formally framed influence functions for VAEs and developed VAE-TracIn.
result Varying training samples significantly impacts VAE predictions.
Study explores factors influencing saving behavior among Dhaka employees.
problem Factors influencing saving behavior among Dhaka employees.
method Quantitative approach with cross-sectional survey design, structured questionnaire, descriptive statistics, reliability analysis, regression analysis.
result Only financial management practices had a significant positive relationship with saving behavior.
Customer Satisfaction is the most important factors in the industry irrespective of domain. Key Driver Analysis is a common practice in data science to help the business to evaluate the same. Understanding key features, which influence the outcome or dependent feature, is highly important in statistical model building.…