Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

63126189252 · Jun 202019922001200920172026
48 results for Collaborative Exploration

New algorithm balances exploration cost between groups in multi-armed bandits.

problem Balancing exploration cost between groups in multi-armed bandits.
method Introducing Col-UCB algorithm that dynamically coordinates exploration across groups.
result Achieves optimal minimax and instance-dependent collaborative regret up to logarithmic factors.

DiCE uses diverse agents to explore and learn, avoiding local minima.

problem Local minima in RL due to limited exploration and correlated behavior.
method DiCE employs a group of heterogeneous agents to explore simultaneously and share experiences, with a diversity regularization mechanism.
result DiCE achieves substantial improvement over baselines in MuJoCo locomotion tasks.

In this paper we show how the study of asymmetric R&D alliances, that are those between young and small firms and large and MNEs firms for knowledge exploration and/or exploitation, requires the adoption of a coopetitive framework which consider both collaboration and competition. We draw upon the literature on asymmet…

2012-05-13abs ↗pdf ↗

XploVAE improves recommendation by balancing known and novel items.

problem Balancing known and novel items for better recommendations.
method Constructs user-specific subgraphs for exploitation and exploration, learns personalized item embeddings.
result Demonstrates effectiveness on various real-world datasets.

Despite the prevalence of collaborative filtering in recommendation systems, there has been little theoretical development on why and how well it works, especially in the "online" setting, where items are recommended to users over time. We address this theoretical gap by introducing a model for online recommendation sy…

2014-10-31abs ↗pdf ↗

New algorithms balance collaboration and adversarial behavior in linear bandits.

problem Minimizing regret in a collaborative linear bandit problem with adversarial agents.
method Robust collaborative phased elimination algorithm with tight analyses.
result Achieves near-optimal regret bounds of $O\left(α+ 1/\sqrt{M} ight) \sqrt{dT}$ for good agents.

We investigate a novel cluster-of-bandit algorithm CAB for collaborative recommendation tasks that implements the underlying feedback sharing mechanism by estimating the neighborhood of users in a context-dependent manner. CAB makes sharp departures from the state of the art by incorporating collaborative effects into …

2016-08-06abs ↗pdf ↗

We focus on the problem of streaming recommender system and explore novel collaborative filtering algorithms to handle the data dynamicity and complexity in a streaming manner. Although deep neural networks have demonstrated the effectiveness of recommendation tasks, it is lack of explorations on integrating probabilis…

2019-06-11abs ↗pdf ↗

Deep reinforcement learning algorithms have been successfully applied to a range of challenging control tasks. However, these methods typically struggle with achieving effective exploration and are extremely sensitive to the choice of hyperparameters. One reason is that most approaches use a noisy version of their oper…

2019-05-02abs ↗pdf ↗

Classical collaborative filtering, and content-based filtering methods try to learn a static recommendation model given training data. These approaches are far from ideal in highly dynamic recommendation domains such as news recommendation and computational advertisement, where the set of items and users is very fluid.…

2015-02-11abs ↗pdf ↗

Proposes MANE for multi-view network embedding, improving node representations.

problem Learning low-dimensional representations from multiple views of networks.
method MANE combines diversity and collaboration, including second-order collaboration, and attention-based extension MANE+.
result MANE+ outperforms state-of-the-art approaches on real-world multi-view networks.

Nowadays, collaborative filtering recommender systems have been widely deployed in many commercial companies to make profit. Neighbourhood-based collaborative filtering is common and effective. To date, despite its effectiveness, there has been little effort to explore their robustness and the impact of data poisoning …

2019-12-01abs ↗pdf ↗

This paper analyzes P2P collaborative insurance products and network structure impact.

problem Analyzing P2P collaborative insurance products and their network structure impact.
method Examined a P2P insurance product with reciprocal risk sharing contracts, studied network structure impact on risk reduction, and discussed optimal reciprocal commitments.
result The network structure, particularly the distribution of degrees, significantly impacts risk reduction in P2P insurance products.

In distributed machine learning, where agents collaboratively learn from diverse private data sets, there is a fundamental tension between consensus and optimality. In this paper, we build on recent algorithmic progresses in distributed deep learning to explore various consensus-optimality trade-offs over a fixed commu…

2018-05-30abs ↗pdf ↗

Collaborative filtering is an important technique for recommendation. Whereas it has been repeatedly shown to be effective in previous work, its performance remains unsatisfactory in many real-world applications, especially those where the items or users are highly diverse. In this paper, we explore an ensemble-based f…

2018-06-26abs ↗pdf ↗

We consider the decentralized exploration problem: a set of players collaborate to identify the best arm by asynchronously interacting with the same stochastic environment. The objective is to insure privacy in the best arm identification problem between asynchronous, collaborative, and thrifty players. In the context …

2018-11-19abs ↗pdf ↗

ShapleyBO explains BO's decisions, enhancing human-AI collaboration in robotics.

problem Lack of explainability in BO's black box nature, especially in human-in-the-loop applications.
method Uses game-theoretic Shapley values to quantify and interpret BO's parameter contributions.
result ShapleyBO identifies exploration and exploitation contributions, disentangling aleatoric and epistemic uncertainty.

Two DRL policies collaborate to solve NP-hard routing problems.

problem Solving complex routing problems like TSP without expert knowledge.
method Learning Collaborative Policies (LCP) using seeder and reviser policies.
result Improves solution quality over single-policy DRL on various NP-hard routing problems.

FedLCB-Q learns optimal policies from federated offline data with linear speedup.

problem Learning optimal policies from offline data with federated learning.
method Federated offline RL algorithm tailored for Q-learning, using local Q-function updates and central aggregation.
result Achieves linear speedup in sample complexity with collaboration among agents.

Supply Chain Management often requires independent organizations to work together to achieve shared objectives. This collaboration is necessary when coordinated actions benefit the group more than the uncoordinated efforts of individual firms. Despite the commonly reported benefits that can be gained in close relations…

2016-10-10abs ↗pdf ↗

The interactions of users and items in recommender system could be naturally modeled as a user-item bipartite graph. In recent years, we have witnessed an emerging research effort in exploring user-item graph for collaborative filtering methods. Nevertheless, the formation of user-item interactions typically arises fro…

2019-11-25abs ↗pdf ↗

Ranking over sets arise when users choose between groups of items. For example, a group may be of those movies deemed 55 stars to them, or a customized tour package. It turns out, to model this data type properly, we need to investigate the general combinatorics problem of partitioning a set and ordering the subsets. …

2014-07-31abs ↗pdf ↗

The excellent performance of representation learning of autoencoders have attracted considerable interest in various applications. However, the structure and multi-local collaborative relationships of unlabeled data are ignored in their encoding procedure that limits the capability of feature extraction. This paper pre…

2019-06-12abs ↗pdf ↗

We consider the online one-class collaborative filtering (CF) problem that consists of recommending items to users over time in an online fashion based on positive ratings only. This problem arises when users respond only occasionally to a recommendation with a positive rating, and never with a negative one. We study t…

2017-05-31abs ↗pdf ↗