A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
New insights into cascade feedback linearization of control systems.
Optimizes ranking from click feedback in a bandit setting.
Motivated by the pressing need for efficient optimization in online recommender systems, we revisit the cascading bandit model proposed by Kveton et al. (2015). While Thompson sampling (TS) algorithms have been shown to be empirically superior to Upper Confidence Bound (UCB) algorithms for cascading bandits, theoretica…
New method for online learning IC models with node-level feedback.
We study the online influence maximization problem in social networks under the independent cascade model. Specifically, we aim to learn the set of "best influencers" in a social network online while repeatedly interacting with it. We address the challenges of (i) combinatorial action space, since the number of feasibl…
We consider a problem of stochastic online learning with general probabilistic graph feedback, where each directed edge in the feedback graph has probability . Two cases are covered. (a) The one-step case, where after playing arm the learner observes a sample reward feedback of arm with independent prob…
New model for personalized online advertising with multi-user interaction.
We study cascades on a two-layer multiplex network, with asymmetric feedback that depends on the coupling strength between the layers. Based on an analytical branching process approximation, we calculate the systemic risk measured by the final fraction of failed nodes on a reference layer. The results are compared with…
An automatic machine learning (AutoML) task is to select the best algorithm and its hyper-parameters simultaneously. Previously, the hyper-parameters of all algorithms are joint as a single search space, which is not only huge but also redundant, because many dimensions of hyper-parameters are irrelevant with the selec…
New framework for online influencer selection considering cost constraints.
Proposes an online model for LLM cascading with adaptive API selection.
Relevance ranking and result diversification are two core areas in modern recommender systems. Relevance ranking aims at building a ranked list sorted in decreasing order of item relevance, while result diversification focuses on generating a ranked list of items that covers a broad range of topics. In this paper, we s…
In this paper, we propose a cost-aware cascading bandits model, a new variant of multi-armed ban- dits with cascading feedback, by considering the random cost of pulling arms. In each step, the learning agent chooses an ordered list of items and examines them sequentially, until certain stopping condition is satisfied.…
Model shows how confidence feedback can lead to different crisis outcomes.
We study combinatorial multi-armed bandit with probabilistically triggered arms (CMAB-T) and semi-bandit feedback. We resolve a serious issue in the prior CMAB-T studies where the regret bounds contain a possibly exponentially large factor of , where is the minimum positive probability that an arm is trigg…
This work proposes an efficient autoregressive model for text generation.
In this paper, we present a new approach to learning cascaded classifiers for use in computing environments that involve networks of heterogeneous and resource-constrained, low-power embedded compute and sensing nodes. We present a generalization of the classical linear detection cascade to the case of tree-structured …
In this paper, we present a general, multistage framework for graphical model approximation using a cascade of models such as trees. In particular, we look at the problem of covariance matrix approximation for Gaussian distributions as linear transformations of tree models. This is a new way to decompose the covariance…
We design and analyze CascadeBAI, an algorithm for finding the best set of items, also called an arm, within the framework of cascading bandits. An upper bound on the time complexity of CascadeBAI is derived by overcoming a crucial analytical challenge, namely, that of probabilistically estimating the amount of ava…
Most recommender systems recommend a list of items. The user examines the list, from the first item to the last, and often chooses the first attractive item and does not examine the rest. This type of user behavior can be modeled by the cascade model. In this work, we study cascading bandits, an online learning variant…
Algorithm estimates clock in network cascades to improve performance.
On many social networking web sites such as Facebook and Twitter, resharing or reposting functionality allows users to share others' content with their own friends or followers. As content is reshared from user to user, large cascades of reshares can form. While a growing body of research has focused on analyzing and c…
Cascade classifiers are widely used in real-time object detection. Different from conventional classifiers that are designed for a low overall classification error rate, a classifier in each node of the cascade is required to achieve an extremely high detection rate and moderate false positive rate. Although there are …
Learning to rank is an important problem in machine learning and recommender systems. In a recommender system, a user is typically recommended a list of items. Since the user is unlikely to examine the entire recommended list, partial feedback arises naturally. At the same time, diverse recommendations are important be…
Test for linearizing 2-input systems with 2D feedback.
Deep convolutional networks provide state of the art classifications and regressions results over many high-dimensional problems. We review their architecture, which scatters data with a cascade of linear filter weights and non-linearities. A mathematical framework is introduced to analyze their properties. Computation…
New algorithm reduces regret in delayed feedback generalised linear bandits.
Paper tackles counterfactual sentence detection and evaluation.
This paper explores a new form of the linear bandit problem in which the algorithm receives the usual stochastic rewards as well as stochastic feedback about which features are relevant to the rewards, the latter feedback being the novel aspect. The focus of this paper is the development of new theory and algorithms fo…
Study shows how to control jump-diffusion processes with stable feedback controls in reinforcement learning.
This paper optimizes power grid protection settings to maximize network degradation due to cascading attacks.
Model infers diffusion networks from heterogeneous cascade data.
Diffusion reach probability between two nodes on a network is defined as the probability of a cascade originating from one node reaching to another node. An infinite number of cascades would enable calculation of true diffusion reach probabilities between any two nodes. However, there exists only a finite number of cas…
Paper proposes methods to reduce financial contagion by targeted cash injections.
New algorithm controls linear systems with bandit feedback, achieving optimal regret.
Neural algorithms optimize arm selection with human preference feedback for complex reward functions.
Advocates a local feedback approach for RL in unknown systems.
Algorithm learns optimal arm selection in unsupervised sequential selection with contextual information.
A new dual test for forward-flatness simplifies computations.
Paper studies CLO with partial feedback, improving decision-making in uncertain contexts.
Modeling cascading behavior in complex systems using CTBNs.
Thompson Sampling tackles USS, a sequential selection problem without feedback.
Easy conditions found for simplifying complex systems.
Online learning to rank is a sequential decision-making problem where in each round the learning agent chooses a list of items and receives feedback in the form of clicks from the user. Many sample-efficient algorithms have been proposed for this problem that assume a specific click model connecting rankings and user b…
The paper studies symmetry reduction of control systems and its implications for feedback linearization.
A new algorithm for conversational recommendation systems using dueling bandits in GLMs.
Unified LP framework for offline reward learning from human demonstrations and feedback.
How big is the risk that a few initial failures of nodes in a network amplify to large cascades that span a substantial share of all nodes? Predicting the final cascade size is critical to ensure the functioning of a system as a whole. Yet, this task is hampered by uncertain or changing parameters and missing informati…