Develops new methods to evaluate data influence in SAM for improved model training.
problem Challenges in mislabeled noisy data and privacy concerns in SAM.
method Two innovative data valuation methods based on influence functions (IF) for SAM.
result Demonstrates effectiveness in identifying mislabeled data and enhancing interpretability.
New algorithm reveals feature influence of machine learning models.
problem Causal influence measures can be misleading when applied to atypical data.
method Proposes an active learning algorithm to constrain influence measures.
result Trained models retain accuracy on in-distribution points while generalizing better to out-of-distribution points.
Develops a novel framework for activity shaping in social networks.
problem Controlling user activity spread in social networks.
method Optimizes the spectral radius of the Hazard matrix for local control actions.
result Minimizes the influence of information cascades through targeted resource allocation.
A new framework maximizes influence spread in social networks by accounting for inter-community diffusion.
problem Real-world social networks have inter-community influence that is often overlooked in community-based IM approaches.
method Community-IM++ uses a heuristic based on community-based diffusion degree and progressive budgeting to model and prioritize cross-community diffusion.
result Community-IM++ achieves near-greedy influence spread at up to 100 times lower runtime than existing methods.
Retraining stabilizes model influence on data.
problem Performativity in predictive models leads to feedback loops.
method Developed the stable signal principle to address retraining dynamics.
result Repeated risk minimization converges geometrically to stable signal direction.
New framework for predicting decisions that influence their own outcomes.
problem Predictions that affect the outcomes they predict, leading to undesirable distribution shift.
method Risk minimization framework combining statistics, game theory, and causality.
result Necessary and sufficient conditions for retraining to converge to a performatively stable point of minimal loss.
TAROT improves data selection for complex multimodal distributions.
problem Suboptimal data selection in multimodal distributions.
method TAROT uses optimal transport theory to select data, addressing greedy heuristics' limitations.
result TAROT outperforms state-of-the-art methods across various deep learning tasks.
In the present paper, the minimal investment risk for a portfolio optimization problem with imposed budget and investment concentration constraints is considered using replica analysis. Since the minimal investment risk is influenced by the investment concentration constraint (as well as the budget constraint), it is i…
Overparameterization enhances SAM's effectiveness in minimizing sharpness.
problem Improving generalization in deep neural networks.
method Analysis of Sharpness-Aware Minimization (SAM) under varying degrees of overparameterization.
result Overparameterization significantly improves SAM's performance, particularly in noisy and sparse settings.
Personalized Influence Estimation helps understand key factors influencing individual observations.
problem Understanding key factors influencing individual observations in various business problems.
method Joint behavior of feature dimensions and relative feature importance.
result Encouraging results justify key reasons for churn in majority of the sample.
Identifies minimal training subset to flip a prediction.
problem Flipping predictions in machine learning models.
method Extended influence function for relabeling minimal subset.
result Relabeling fewer than 2% of training points can flip a prediction.
GOIMDA selects inputs to maximize expected influence on a goal functional, reducing data acquisition needs.
problem Challenges in active data acquisition for learning and optimization tasks in deep neural networks.
method GOIMDA uses inverse curvature and goal gradient to select inputs maximizing expected influence on a specified goal functional.
result GOIMDA achieves target performance with fewer labeled samples or function evaluations compared to baselines.
This paper analyzes social influence using causal data science.
problem Separating genuine causal processes from spurious correlations in social influence data.
method The approach involves partitioning data into groups with minimal contradiction, followed by constrained MLE for causal topology learning.
result The method can retrieve genuine causal arcs and improve influence spread prediction.
This work introduces RISE to explain LLMs more reliably by distinguishing essential context.
problem Identifying which context elements influence LLM outputs reliably.
method RISE (Redundancy-Insensitive Scoring of Explanation) method.
result RISE provides more robust explanations than traditional methods.
HyperINF improves influence function estimation for large models with better accuracy and efficiency.
problem Inaccurate and computationally expensive influence function estimation for large-scale models.
method HyperINF leverages Schulz's iterative algorithm and GFIM for low-rank approximation of Hessian matrix.
result HyperINF achieves superior accuracy and performance compared to existing methods on LoRA-tuned models.
Proposes a new sampling method for online learning with cumulative oversampling.
problem Budgeted Influence Maximization in online learning.
method Cumulative Oversampling (CO) method for online learning.
result CO-based algorithm achieves comparable regret to UCB-based algorithms and performs similarly to Thompson Sampling.
FRED explains text model predictions by identifying key words and providing counterfactual examples.
problem Lack of interpretable methods for text models that are complex, lack foundations, and have unguaranteed performance.
method FRED identifies minimal influential word sets, assigns token importance, and generates counterfactual examples.
result FRED provides reliable and effective explanations for text model predictions.
A study on the relation between the smooth structure of a symplectic homotopy K3 surface and its symplectic symmetries is initiated. A measurement of exoticness of a symplectic homotopy K3 surface is introduced, and the influence of an effective action of a K3 group via symplectic symmetries is investigated. It is show…
The private car license plates issued in Shanghai are bestowed the title of "the most expensive sheet iron all over the world", more expensive than gold. A citizen has to bid in an monthly auction to obtain a license plate for his new private car. We perform statistical analysis to investigate the influence of the mini…
We study the problem of learning the support of transition matrix between random processes in a Vector Autoregressive (VAR) model from samples when a subset of the processes are latent. It is well known that ignoring the effect of the latent processes may lead to very different estimates of the influences among observe…
The standard approach to supervised classification involves the minimization of a log-loss as an upper bound to the classification error. While this is a tight bound early on in the optimization, it overemphasizes the influence of incorrectly classified examples far from the decision boundary. Updating the upper bound …
We analyze double descent in finite-width neural networks using influence functions.
problem Understanding double descent in finite-width neural networks.
method Using influence functions to derive population loss bounds and investigate loss function effects.
result Derived bounds exhibit double descent behavior at the interpolation threshold.
GRANITE unifies feature-based explanation methods to reduce disagreement.
problem Disagreement among feature-based explanation methods.
method GRANITE partitions feature space into regions minimizing interaction and distribution influences.
result Unified and consistent feature explanations.
Unified framework for automatic debiased machine learning for various statistical parameters.
problem Inference on smooth functionals of nonparametric M-estimands.
method Unified framework using gradient, Hessian, and linear approximation; solves two risk minimization problems.
result Efficient autoDML estimators with double robustness and robustness to misspecification.
Establishes statistical and computational bounds for influence diagnostics.
problem Identifying influential datapoints or subsets in machine learning models.
method Finite-sample statistical bounds and computational complexity for influence functions and approximate maximum influence perturbations.
result Established statistical and computational guarantees for influence diagnostics.
Investigates optimal portfolios with risk-free assets, minimizing investment risk.
problem Investment risk minimization with budget and return constraints.
method Replica analysis and exploration of implications of a risk-free asset.
result Implications of a risk-free asset on optimal portfolio and investment risk.
A generalization of expectiles for d-dimensional multivariate distribution functions is introduced. The resulting geometric expectiles are unique solutions to a convex risk minimization problem and are given by d-dimensional vectors. They are well behaved under common data transformations and the corresponding sample v…
Domain adaptation framework identifies latent variables for target distribution identifiability.
problem Unsupervised domain adaptation without identifiable joint distribution of features and labels.
method Formulated latent variable model with invariant and changing components, constrained domain shift to influence only changing components.
result Joint distribution of data and labels in target domain is identifiable under mild conditions.
Develops a method to audit indirect feature influence in complex models.
problem Auditing indirect feature influence in complex, black-box models.
method Disentangled influence audits using disentangled representations.
result Can detect proxy features and show which ones affect model outcomes most.
Unified approach for influence maximization using diffusion cascade representations.
problem Influence maximization on networks with diffusion cascades.
method Multi-task neural network learning influencer and susceptible vectors; greedy algorithm for influence maximization.
result IMINFECTOR outperforms other methods in efficiency and seed set quality.
Proposes a new model to capture joint influence of correlated events on user search behavior.
problem Real-world events influence each other and pose joint influence on user search behavior, not independent.
method Joint Influence Model based on Multivariate Hawkes Process.
result The model captures the temporal dynamics of joint influence and outperforms baseline methods.
Dynamic Influence Tracker measures changing sample importance during model training.
problem Static influence measurements during training overlook how sample importance varies over time.
method Dynamic Influence Tracker (DIT) captures time-varying sample influence across arbitrary time windows.
result DIT reveals distinct learning phases with shifting priorities and detects corrupted samples more efficiently.
The paper tackles fairness in machine learning by incorporating it into empirical risk minimization.
problem Ensuring fairness in classifier outcomes by preventing sensitive variables from unfairly influencing results.
method Empirical risk minimization with a fairness constraint that maintains approximately constant conditional risk with respect to the sensitive variable.
result The approach is statistically consistent and can be applied to kernel methods and linear models with simple preprocessing steps.
RelatIF selects more intuitive training examples for explaining model predictions.
problem Influence functions identify outliers as explanatory examples, leading to poor explanations.
method RelatIF separates global and local influence, optimizing for local relative to global effects.
result Examples selected by RelatIF are more intuitive than those from influence functions.
Paper proposes an unbiased risk estimator for PLLAC, handling unseen classes.
problem Handling unseen classes in PLLAC where some classes are not present in the training set.
method Proposes an unbiased risk estimator that estimates the distribution of augmented classes by differentiating known classes from unlabeled data.
result The estimator provides theoretical guarantees and converges to true risk minimizer as data increases.
Complete criterion for VoI in multi-decision influence diagrams established.
problem Analyzing safety and fairness properties of AI systems using influence diagrams.
method Introduced ID homomorphisms and Tree of Systems to prove properties of multi-decision influence diagrams.
result First complete graphical criterion for VoI in influence diagrams with multiple decisions.
The paper explores effective data selection methods for weakly supervised learning.
problem Efficiently selecting a subset of unlabeled data for weakly supervised learning.
method Using a surrogate model to predict labels and selecting a subset of samples for training.
result Data selection can significantly improve model performance over training on the full dataset.
Influence functions are inaccurate in deep learning models, especially for deeper networks.
problem Inaccuracies in influence functions in deep learning models.
method Empirical study of influence functions in neural network models trained on various datasets.
result Influence estimates are often erroneous for deeper networks and require regularization.
Aims to optimize influence spread in social networks using bandit algorithms.
problem Maximizing influence spread in unknown social networks.
method Combines Thompson Sampling and Epsilon Greedy algorithms with automatic ensemble learning.
result Demonstrates effectiveness of automatic ensemble learning for combinatorial bandit problems.
Paper tackles heavy-tailed data without finite variance, proposing robust risk minimization.
problem Empirical risk minimization under heavy-tailed data with finite p-th moment. method Minimizes risk values robustly estimated via Catoni's method, using generalized generic chaining.
result Shows better performance of optimizer based on empirical risks via Catoni-style estimation.
INFUSER improves reasoning by co-evolving a generator and solver with adaptive curriculum.
problem Improving reasoning in language models with minimal external supervision.
method INFUSER uses a Generator and Solver to co-evolve iteratively, rewarding the Generator with an influence score and the Solver with correctness rewards.
result INFUSER outperforms self-evolution baselines by over 20% on Olympiad and SuperGPQA benchmarks.
New method for online influence maximization in social networks.
problem Identifying influential nodes in social networks.
method Factorization of activation probabilities into latent factors on nodes, using upper confidence bound online learning.
result Significant reduction in regret with proposed algorithm.
The paper simplifies influence computations for large-scale machine learning models.
problem Improving training efficiency and accuracy in large-scale models.
method Study influence functions, define memorization, simplify computations.
result Influence functions can be practical for large-scale models, indicating memorization.
New algorithm for competing influence spread in unknown networks.
problem Maximizing influence spread in a social network with unknown probabilities.
method Combinatorial multi-armed bandit (CMAB) framework, Triggering Probability Modulated (TPM) condition, OCIM-TS, OCIM-OFU, OCIM-ETC.
result Sublinear Bayesian and frequentist regret for OCIM-TS and OCIM-OFU, respectively.
We tackle robust influence maximization in social networks with hyperparametric edge probabilities.
problem Maximizing worst-case influence in social networks with hyperparametric edge probabilities.
method Proposed a model with NP-hard proper robust optimization, using sampling and multiplicative weight updates.
result Empirically validated method outperforms state-of-the-art robust influence maximization techniques.
Better Hessian approximations improve influence function attributions in deep learning.
problem Influence functions are difficult to compute due to ill-conditioned Hessians, leading to poor data attribution performance.
method Investigated the impact of Hessian approximation quality on influence-function attributions in a controlled setting.
result Better Hessian approximations consistently yield better influence score quality.
The paper extends influence functions to sequence tagging tasks for better model interpretability.
problem Lack of interpretability methods for sequence tagging models.
method Define and compute influence of training instance segments on test segment predictions.
result The segment influence method tracks with true influence and identifies annotation errors.
This study analyzes mutual influence on investment strategies of financial market agents.
problem Mutual influence among agents in financial markets and its impact on investment strategies.
method Formulated optimal investment differential game problem, derived analytical solutions, proposed fast algorithm, and theoretically analyzed mutual influence.
result Agents' optimal strategies converge to the asymptotic strategy when mutual influence is strong and approaches infinity.