Predicts student performance in interactive online question pools using GNNs.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Fine-tuning RL with offline data reduces online interactions.
Proposes online learning for Hawkes processes with network structure and event interaction.
Interactive user interfaces need to continuously evolve based on the interactions that a user has (or does not have) with the system. This may require constant exploration of various options that the system may have for the user and obtaining signals of user preferences on those. However, such an exploration, especiall…
The rise in online social networking has brought about a revolution in social relations. However, its effects on offline interactions and its implications for collective well-being are still not clear and are under-investigated. We study the ecology of online and offline interaction in an evolutionary game framework wh…
Paper tackles policy selection with logged data and limited online interactions.
Autonomous robots need to interact with unknown, unstructured and changing environments, constantly facing novel challenges. Therefore, continuous online adaptation for lifelong-learning and the need of sample-efficient mechanisms to adapt to changes in the environment, the constraints, the tasks, or the robot itself a…
Study online RL with mismatched dynamics, achieving sublinear regret.
New framework converts offline to online estimation using black-box offline estimators.
Loss Data Analytics is an interactive, online, freely available text. The idea behind the name Loss Data Analytics is to integrate classical loss data models from applied probability with modern analytic tools. In particular, we seek to recognize that big data (including social media and usage based insurance) are here…
Method detects interactions for better CTR prediction.
New method for online learning in interacting particle systems.
Interactive tools help teach economics online.
In academic literature, recommender systems are often evaluated on the task of next-item prediction. The procedure aims to give an answer to the question: "Given the natural sequence of user-item interactions up to time t, can we predict which item the user will interact with at time t+1?". Evaluation results obtained …
LSTM improves cross-network recommendations by capturing user preference changes and irregular time intervals.
In many online applications interactions between a user and a web-service are organized in a sequential way, e.g., user browsing an e-commerce website. In this setting, recommendation system acts throughout user navigation by showing items. Previous works have addressed this recommendation setup through the task of pre…
Recent work has demonstrated that problems-- particularly imitation learning and structured prediction-- where a learner's predictions influence the input-distribution it is tested on can be naturally addressed by an interactive approach and analyzed using no-regret online learning. These approaches to imitation learni…
Study estimates long-term effects of online advertising mechanisms on user behavior and revenue.
Study minimax rates for online learning with time-varying dynamics.
The paper models user-advertiser interactions using point processes.
Interactive applications incorporating high-data rate sensing and computer vision are becoming possible due to novel runtime systems and the use of parallel computation resources. To allow interactive use, such applications require careful tuning of multiple application parameters to meet required fidelity and latency …
Study shows effectiveness of offline RL in online RL tasks.
RKT model improves knowledge tracing by considering exercise relations and student forget behavior.
Recommender systems play a crucial role in mitigating the problem of information overload by suggesting users' personalized items or services. The vast majority of traditional recommender systems consider the recommendation procedure as a static process and make recommendations following a fixed strategy. In this paper…
Algorithm balances online and offline data for linear bandits.
Strategic feature manipulation helps learners identify meaningful variables in online regression settings.
New model for personalized online advertising with multi-user interaction.
In this paper, we propose a deep, globally normalized topic model that incorporates structural relationships connecting documents in socially generated corpora, such as online forums. Our model (1) captures discursive interactions along observed reply links in addition to traditional topic information, and (2) incorpor…
Algorithm learns from offline data to improve performance in target environment.
KGRL uses reinforcement learning with knowledge graphs for better interactive recommendation.
The increasing popularity of internet, wireless technologies and mobile devices has led to the birth of mass connectivity and online interaction through Online Social Networks (OSNs) and similar environments. OSN reflects a social structure consist of a set of individuals and different types of ties like connections, r…
We study the online influence maximization problem in social networks under the independent cascade model. Specifically, we aim to learn the set of "best influencers" in a social network online while repeatedly interacting with it. We address the challenges of (i) combinatorial action space, since the number of feasibl…
User response prediction makes a crucial contribution to the rapid development of online advertising system and recommendation system. The importance of learning feature interactions has been emphasized by many works. Many deep models are proposed to automatically learn high-order feature interactions. Since most featu…
Sample efficiency is critical in solving real-world reinforcement learning problems, where agent-environment interactions can be costly. Imitation learning from expert advice has proved to be an effective strategy for reducing the number of interactions required to train a policy. Online imitation learning, which inter…
Online Apprenticeship Learning aims to match expert performance without access to cost functions.
A new dataset tracks user interactions and click responses in online marketplaces.
This work explains why online imitation learning improves faster than theory predicts.
Algorithm learns robust equilibrium in online Markov games with interactive data.
A new reinforcement learning framework separates users into risk-tolerant and risk-averse groups for better performance.
Interactive IL algorithm queries noisy expert for feedback, reducing sample size.
New RL approach learns dynamic VCG mechanisms in unknown MDP environments.
A3RL combines online and offline RL with active sampling to improve policy learning.
We propose a new efficient online algorithm to learn the parameters governing the purchasing behavior of a utility maximizing buyer, who responds to prices, in a repeated interaction setting. The key feature of our algorithm is that it can learn even non-linear buyer utility while working with arbitrary price constrain…
We study the problem of online influence maximization in social networks. In this problem, a learner aims to identify the set of "best influencers" in a network by interacting with it, i.e., repeatedly selecting seed nodes and observing activation feedback in the network. We capitalize on an important property of the i…
Paper proposes a hybrid RL algorithm that combines offline and online data without needing reward info.
LF-IBIS learns optimal policies online without explicit likelihood.
Collaborative filtering (CF) allows the preferences of multiple users to be pooled to make recommendations regarding unseen products. We consider in this paper the problem of online and interactive CF: given the current ratings associated with a user, what queries (new ratings) would most improve the quality of the rec…
AriaNN enables private deep learning with minimal interaction and reduced key sizes.