Agents learn social skills from each other, improving performance.
problem Independent RL agents fail to use social learning.
method Imposed constraints, model-based auxiliary loss, mixed training.
result Agents trained with social learning outperform solo-trained agents.
Algorithm improves learning by integrating diverse agents' behaviors.
problem Lack of social learning in reinforcement learning algorithms.
method Free energy approach for social bandit learning.
result Algorithm converges to optimal policy and enhances learning.
Efficiently models agent dependencies in large social networks.
problem Challenges in incorporating inter-agent dependencies in social reinforcement learning models.
method Clusters users based on payoff and contribution, combines cluster-level policies with personalized agent-level policies, and uses dynamic clustering.
result Our approach learns more accurate policy estimates and converges more quickly than existing methods.
Social learning can make financial markets inefficient, but individual learning can fix this.
problem Inefficiencies in financial markets due to social learning.
method Study of the Minority Game model with social and individual learning mechanisms.
result Individual learning can rescue a population from the inefficiencies caused by social learning.
We study a networked version of the minority game in which agents can choose to follow the choices made by a neighbouring agent in a social network. We show that for a wide variety of networks a leadership structure always emerges, with most agents following the choice made by a few agents. We find a suitable parameter…
PHASE dataset simulates complex social interactions in physical environments.
problem Lack of datasets for evaluating physically grounded perception of complex social interactions.
method Created PHASE dataset of 2D animations with procedural generation and physics engine.
result SIMPLE model outperforms neural networks in recognizing complex social interactions.
Bayesian truth discovery uses social network info to improve reliability estimates.
problem Truth discovery from unreliable or biased agents with correlated biases in the same community.
method Laplace variational inference and stochastic variational inference for large networks.
result Our methods outperform other inference methods in sparse observation scenarios.
This paper develops an active sensing method to estimate the relative weight (or trust) agents place on their neighbors' information in a social network. The model used for the regression is based on the steady state equation in the linear DeGroot model under the influence of stubborn agents, i.e., agents whose opinion…
SBO uses dual voting to build consensus in noisy feedback settings.
problem Collective decision-making under social influence.
method Dual voting system with noisy public votes and private interviews.
result Efficient consensus-building through noisy public votes, debiased by estimated social graph.
Model financial markets with social media influences using hierarchical networks.
problem Understanding social media's impact on financial markets.
method Agent-based model with hierarchical influence network.
result Model accurately simulates real-world financial market behaviors.
New models study agent learning in financial markets and social networks under time-varying noise.
problem Understanding agent learning in financial markets and social networks under time-varying noise.
method Developed new models using the DeGroot framework for social learning and studied discrete time random linear dynamical systems.
result Agents' beliefs converge in distribution, not necessarily normal, under certain conditions.
Collaborative learning in social networks improves multi-armed bandit performance.
problem Improving multi-armed bandit performance in a social network setting.
method Analyzed various policies and developed a simple learning algorithm based on dominating sets.
result Natural extensions of single-agent policies perform poorly in a network setting.
A new framework for causal inference in networked settings.
problem Causal inference under network interference.
method Characterize agent network configuration and use it to estimate treatment effects.
result Finite-sample bounds and asymptotically valid tests for policy irrelevance.
An unsupervised neural network learns event truths from social network data.
problem Estimating event truths from conflicting opinions in social networks.
method Autoencoder learns relationships, Bayesian network models agent reliability and social relationships, variational inference estimates hidden variables and parameters.
result The approach outperforms state-of-the-art methods on real datasets.
AI agents on social networks rarely engage in extended conversations.
problem Understanding the persistence of interactions in AI-agent social networks.
method Analysis of Moltbook, a social network of AI agents, using interaction half-life and spectral tests.
result Most comments on Moltbook receive a direct reply within seconds, indicating a ``fast response or silence'' regime.
Heterogeneous SVO leads to diverse policies in sequential social dilemmas.
problem Understanding how diverse social value orientations affect behavior in sequential social dilemmas.
method Extending prior reinforcement learning studies, we instantiated heterogeneous SVO in a sequential social dilemma setting and measured task-specific diversity metrics.
result Heterogeneous SVO leads to meaningfully diverse policies across various incentive structures.
This paper considers a statistical signal processing problem involving agent based models of financial markets which at a micro-level are driven by socially aware and risk- averse trading agents. These agents trade (buy or sell) stocks by exploiting information about the decisions of previous agents (social learning) v…
This paper studies two important signal processing aspects of equilibrium behavior in non-cooperative games arising in social networks, namely, reinforcement learning and detection of equilibrium play. The first part of the paper presents a reinforcement learning (adaptive filtering) algorithm that facilitates learning…
Agents are rewarded for influencing others' actions in MARL, improving coordination and communication.
problem Achieving effective coordination and communication in Multi-Agent Reinforcement Learning.
method Rewarding agents for having causal influence over other agents' actions, assessed through counterfactual reasoning.
result Influence rewards lead to enhanced coordination and communication in challenging social dilemma environments.
This paper tackles no-regret learning for fair multi-agent social welfare optimization.
problem Maximizing social welfare in a fair manner for multiple agents.
method Developed algorithms for stochastic and adversarial multi-agent settings, proving regret bounds and tightness.
result Achieved no-regret learning for fair multi-agent social welfare optimization in various settings.
Model shows how social norms and individual ethics affect tax evasion.
problem Effects of social norms and individual ethics on tax evasion.
method Agent-based model with simulations of different tax compliance behaviors.
result Threshold levels in society composition explain tax evasion extent.
Study on decision-making cascades with agents having varying beliefs and noise levels.
problem Optimizing decision-making in a cascade of agents with heterogeneous beliefs and noise.
method Recursive belief update and analysis of optimal decision rules, predecessor selection problem characterization.
result Optimal decisions can deviate from true prior beliefs in certain conditions, highlighting the importance of social learning.
Spatial ABM predicts housing market trends in Sydney.
problem Inadequate spatial modeling in housing market forecasts.
method Graph-based spatial agent-based model incorporating social and economic factors.
result Model accurately predicts market trends and local area-specific forecasts.
Algorithm learns fair division from noisy feedback in uncertain markets.
problem Learning fair division in uncertain markets with noisy feedback.
method Wrapper algorithms using dual averaging to learn item and agent values from bandit feedback.
result Asymptotically achieves optimal Nash social welfare in linear Fisher markets.
MGpi model predicts social actions in group interactions.
problem Social interaction among multiple agents and groups.
method Deep neural network with Kinesic-Proxemic-Message gate for social signal gating.
result Achieves state-of-the-art performance in group identification.
Mobile sensing is an emerging technology that utilizes agent-participatory data for decision making or state estimation, including multimedia applications. This article investigates the structure of mobile sensing schemes and introduces crowdsourcing methods for mobile sensing. Inspired by social network, one can estab…
RFM models predict multi-agent behavior, offering insights and faster learning.
problem Understanding and improving multi-agent systems learning.
method Relational Forward Models (RFM) that learn to predict future agent behavior.
result RFM modules inside agents lead to faster learning compared to baseline methods.
Agent learns goals and rewards through language and curiosity.
problem Autonomous agents lack intrinsic motivations and reward functions.
method LE2 algorithm using NL interactions and intrinsic motivations.
result Agent autonomously discovers and grounds goals in real behavior.
Reduced models derived from agent-based systems using Koopman theory.
problem Time-consuming simulations of large agent-based systems.
method Koopman operator theory applied to simulation data.
result Derived reduced models match known analytical results.
The paper develops an economic foundation for multi-agent learning in markets.
problem Learning dynamics in markets with strategic externalities.
method A two-phase incentive mechanism that estimates and uses implementable transfers to steer long-run dynamics.
result The mechanism achieves sublinear social-welfare regret and asymptotically optimal welfare under mild rationality and exploration conditions.
The ABC algorithm's social interactions are characterized through a novel interaction network.
problem Understanding complex behavior in swarm intelligence systems.
method Definition and analysis of the interaction network for the ABC algorithm.
result ABC exhibits dynamic information flow but lacks continuous coordination.
We study two kinds of economic exchange, additive and multiplicative, in a system of N agents. The work is divided in two parts, in the first one, the agents are free to interact with each other. The system evolves to a Boltzmann-Gibbs distribution with additive exchange and condenses with a multiplicative one. If bank…
The paper examines how social inequality affects algorithmic classification outcomes.
problem Social inequality impacts algorithmic classification outcomes.
method Adapting models of strategic manipulation to account for social inequality and subsidy effects.
result Subsidizing disadvantaged groups can paradoxically harm both groups and the learner.
Modeling social conventions from real-time interactions and sensorimotor control.
problem The role of real-time control and learning in social convention formation.
method Control-based Reinforcement Learning (CRL) model grounded in Distributed Adaptive Control (DAC) theory.
result CRL model achieves human-level performance in multi-agent game-theoretic tasks.
We analyze income tax evasion dynamics in a standard model of statistical mechanics, the Ising model of ferromagnetism. However, in contrast to previous research, we use an inhomogeneous multi-dimensional Ising model where the local degrees of freedom (agents) are subject to a specific social temperature and coupled to…
Agents learn their states from interactions using Bayesian classifiers and ML estimators.
problem Learning unknown states from score graphs in social networks.
method Bayesian framework, local classifiers, centralized ML estimator, relaxed probabilistic model.
result Agents can learn their states through distributed computation.
Agent-based model uses SAM to create realistic economic system.
problem Lack of tools to understand and predict economic crises.
method Agent-based modeling (ABM) with Social Accounting Matrix (SAM) calibration.
result ABM can produce economic systems close to real-world data.
New method learns distribution shifts caused by predictive models in social computing.
problem Learning distribution shifts due to predictive models in social computing.
method Reverse causal model with microfoundation for agents' actions.
result Effective in minimizing performative prediction risk.
This work uses variational inference to estimate parameters of opinion dynamics models.
problem Challenges in parameter estimation for ABMs of social phenomena.
method Transformed ABM parameter estimation into an optimization problem using variational inference.
result Estimates parameters more accurately than simulation-based and MCMC methods.
We review some statistical many-agent models of economic and social systems inspired by microscopic molecular models and discuss their stochastic interpretation. We apply these models to wealth exchange in economics and study how the relaxation process depends on the parameters of the system, in particular on the savin…
The study proposes that people prioritize status maximization over simple profit maximization in social interactions.
problem The gap between competitive and altruistic human tendencies in social interactions.
method Agent-based model of repeated dictator games in a social network, considering living costs and infractions.
result Individual strategies in the game vary from selfish to selfless, influenced by model parameters.
Paper investigates if RL can learn from observing others without explicit modeling.
problem Can RL learn from observing others without explicit modeling?
method Simple scenarios with RL agents observing and learning from another agent's actions.
result RL agents can learn from observing others, leveraging environmental effects.
We revisit a recently introduced agent model[ACS {\bf 11}, 99 (2008)], where economic growth is a consequence of education (human capital formation) and innovation, and investigate the influence of the agents' social network, both on an agent's decision to pursue education and on the output of new ideas. Regular and ra…
Indirect competition emerged from the complex organization of human societies, and knowledge of the existing network topology may aid in developing effective strategies for success. Here, we propose an agent-based model of competition with systems co-existing in a `small-world' social network. We show that within the r…
The well-known Ising model used in statistical physics was adapted to a social dynamics context to simulate the adoption of a technological innovation. The model explicitly combines (a) an individual's perception of the advantages of an innovation and (b) social influence from members of the decision-maker's social net…
We obtain the conditions for the emergence of the swarm intelligence effect in an interactive game of restless multi-armed bandit (rMAB). A player competes with multiple agents. Each bandit has a payoff that changes with a probability pc per round. The agents and player choose one of three options: (1) Exploit (a …
We consider a group of Bayesian agents who try to estimate a state of the world θ through interaction on a social network. Each agent v initially receives a private measurement of θ: a number Sv picked from a Gaussian distribution with mean θ and standard deviation one. Then, in each discrete time iteration,…
Modeling trading interactions with money and trust variables.
problem Understanding wealth distribution in social networks.
method Simple dynamical model with conserved money and goods, influenced by trust and price.
result Model accurately predicts wealth distribution in trading networks.