This work introduces RISE to explain LLMs more reliably by distinguishing essential context.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
We present a method for learning the parameters of a Bayesian network with prior knowledge about the signs of influences between variables. Our method accommodates not just the standard signs, but provides for context-specific signs as well. We show how the various signs translate into order constraints on the network …
New measure of feature influence in classification problems considering feature dependencies.
Influence functions are inaccurate in deep learning models, especially for deeper networks.
The rise of Online Social Networks (OSNs) has caused an insurmountable amount of interest from advertisers and researchers seeking to monopolize on its features. Researchers aim to develop strategies for determining how information is propagated among users within an OSN that is captured by diffusion or influence model…
Enhances LLMs for predicting stock movements by considering news dissemination and context.
This study identifies financial risk paths in digital-transformed enterprises.
New method discovers context effects in choice data.
HawkesLLM models text generation with temporal influence, improving semantic alignment under limited memory.
The paper investigates instance-based interpretation methods for VAEs.
This note treats the notion of Lagrange derivative for the third order mechanics in the context of covariant Riemannian geometry. The variational differential equation for geodesic circles in two dimensions is obtained. The influence of the curvature tensor on the Lagrange derivative leads to the emergence of the notio…
Random Transformers behave like polynomial models in ICL with asymptotic growth.
Language systems have been of great interest to the research community and have recently reached the mass market through various assistant platforms on the web. Reinforcement Learning methods that optimize dialogue policies have seen successes in past years and have recently been extended into methods that personalize …
Low dimensional embeddings that capture the main variations of interest in collections of data are important for many applications. One way to construct these embeddings is to acquire estimates of similarity from the crowd. However, similarity is a multi-dimensional concept that varies from individual to individual. Ex…
Study explores factors influencing saving behavior among Dhaka employees.
This paper models how features influence event triggers in high-dimensional networks.
Federated Machine Learning (FML) creates an ecosystem for multiple parties to collaborate on building models while protecting data privacy for the participants. A measure of the contribution for each party in FML enables fair credits allocation. In this paper we develop simple but powerful techniques to fairly calculat…
Home entertainment systems feature in a variety of usage scenarios with one or more simultaneous users, for whom the complexity of choosing media to consume has increased rapidly over the last decade. Users' decision processes are complex and highly influenced by contextual settings, but data supporting the development…
Most real life systems have a random component: the multitude of endogenous and exogenous factors influencing them result in stochastic fluctuations of the parameters determining their dynamics. These empirical systems are in many cases subject to noise of multiplicative nature. The special properties of multiplicative…
Framework identifies causal factors of climate change using correlations and machine learning.
Paper tackles overfitting in RL for trade execution.
Reproductive success and survival are influenced by wealth in human populations. Wealth is transmitted to offsprings and strategies of transmission vary over time and among populations, the main variation being how equally wealth is transmitted to children. Here we propose a model where we simulate both the dynamics of…
New method reveals true causal functions in nonlinear time series, not just scores.
Transformers can approximate posterior predictive distributions through in-context learning.
Combines BO with context to optimize binary feedback.
EDRBO optimizes Bayesian optimization with continuous contexts using ensemble models and robust methods.
Context-aware recommender systems (CARS) have gained increasing attention due to their ability to utilize contextual information. Compared to traditional recommender systems, CARS are, in general, able to generate more accurate recommendations. Latent factors approach accounts for a large proportion of CARS. Recently, …
Improves understanding of neural network predictions using influence functions.
This paper deals with optimally-robust parameter estimation in generalized Pareto distributions (GPDs). These arise naturally in many situations where one is interested in the behavior of extreme events as motivated by the Pickands-Balkema-de Haan extreme value theorem (PBHT). The application we have in mind is calcula…
New method accounts for hidden context in preference learning for RLHF models.
Unified theory for semiparametric data fusion with individual-level data.
We study the explore-exploit tradeoff in distributed cooperative decision-making using the context of the multiarmed bandit (MAB) problem. For the distributed cooperative MAB problem, we design the cooperative UCB algorithm that comprises two interleaved distributed processes: (i) running consensus algorithms for estim…
The well-known Influence Maximization (IM) problem has been actively studied by researchers over the past decade, with emphasis on marketing and social networks. Existing research have obtained solutions to the IM problem by obtaining the influence spread and utilizing the property of submodularity. This paper is based…
Novel method uses information theory to measure causal influences during transient neural events.
Empowerment quantifies the influence an agent has on its environment. This is formally achieved by the maximum of the expected KL-divergence between the distribution of the successor state conditioned on a specific action and a distribution where the actions are marginalised out. This is a natural candidate for an intr…
Adapts randomization for single unit time-series data for optimal treatment.
The paper examines how updates to probabilistic models influence behavior based on evidence.
Particles representing tokens cluster in Transformers, influenced by initial tokens and matrix spectrum.
Predicting panic is of critical importance in many areas of human and animal behavior, notably in the context of economics. The recent financial crisis is a case in point. Panic may be due to a specific external threat, or self-generated nervousness. Here we show that the recent economic crisis and earlier large single…
We propose an approach to self-supervised representation learning based on maximizing mutual information between features extracted from multiple views of a shared context. For example, one could produce multiple views of a local spatio-temporal context by observing it from different locations (e.g., camera positions w…
The paper introduces a tensor-based approach to improve neural models' aggregation of structural context.
We present a method for explaining the image classification predictions of deep convolution neural networks, by highlighting the pixels in the image which influence the final class prediction. Our method requires the identification of a heuristic method to select parameters hypothesized to be most relevant in this pred…
Two new methods assess feature importance for fairness in machine learning models.
Establishes statistical and computational bounds for influence diagnostics.
The standard approach to supervised classification involves the minimization of a log-loss as an upper bound to the classification error. While this is a tight bound early on in the optimization, it overemphasizes the influence of incorrectly classified examples far from the decision boundary. Updating the upper bound …
ELSA efficiently adapts to label shift without post-prediction calibrations.
The consideration of spatial effects at a regional level is becoming increasingly frequent and the work of Anselin (1988), among others, has contributed to this. This study analyses, through cross-section estimation methods, the influence of spatial effects in productivity (product per worker) in the NUTs III economic …
This paper introduces a new task to better understand Transformers in quantitative contexts.