Deep learning agents negotiate contracts with prosocial or selfish behaviors.
problem Training agents to negotiate contracts with varying behaviors.
method Multi-Agent Reinforcement Learning, modeling prosocial and selfish behaviors, training a meta agent.
result Trained agents hold their own against human players and emulate human behavior.
We calculate the dynamics of tax evasion within a multi-agent econophysics model which is adopted from the theory of magnetism and previously has been shown to capture the main characteristics from agent-based based models which build on the standard Allingham and Sandmo approach. In particular, we implement a feedback…
New algorithm outperforms existing ones in multi-player bandit problems without sensing.
problem Decentralized multi-player multi-armed bandit problem without collision or sensing info.
method Randomized Selfish KL-UCB, inspired by Selfish KL-UCB, with low complexity.
result Randomized Selfish KL-UCB outperforms state-of-the-art algorithms in almost all environments.
New algorithm for multi-player bandits with selfish players, achieving logarithmic regret.
problem Challenges of robustness to selfish players in multi-player bandits.
method First algorithm robust to selfish players achieving logarithmic regret, with or without collision observation.
result Achieved logarithmic regret for robust algorithms to selfish players in multi-player bandits.
This paper analyzes the profitability of selfish mining on blockchain, considering the risk of ruin.
problem The profitability of selfish mining on blockchain, considering the risk of ruin.
method Formulated a stochastic model and used tools from applied probability and analysis to determine expected profit.
result Explicit expressions for expected profit under different scenarios were derived, identifying conditions for selfish mining as a strategic advantage.
Look-ahead reasoning helps predict strategic user behavior on learning platforms.
problem Optimization criteria on learning platforms do not reflect users' priorities.
method Formalized level-k thinking and contrasted collective and selfish behavior.
result Coordination benefits users but does not offer higher-level reasoning advantages in the long run.
Multi-player Multi-Armed Bandits (MAB) have been extensively studied in the literature, motivated by applications to Cognitive Radio systems. Driven by such applications as well, we motivate the introduction of several levels of feedback for multi-player MAB algorithms. Most existing work assume that sensing informatio…
Human behavioural patterns exhibit selfish or competitive, as well as selfless or altruistic tendencies, both of which have demonstrable effects on human social and economic activity. In behavioural economics, such effects have traditionally been illustrated experimentally via simple games like the dictator and ultimat…
New algorithms for batch decision-making with high-dimensional user data.
problem Maximizing treatment efficacy in groups of users.
method Teamwork LASSO Bandit algorithm, switching between teamwork and selfish stages.
result Upper bound on expected cumulative regret for the proposed algorithm.
Standard economic theory, starting with Adam Smith's invisible hand, holds that those who trade for their own selfish motives of maximizing their private preferences may contribute more to the public wealth than those who claim altruistic motives. Under restrictive conditions, this has been shown to result from a self-…
Paper introduces metrics for evaluating multi-agent policies using best response dynamics.
problem Evaluation and ranking of multi-agent policies in reinforcement learning.
method Adopting strict best response dynamics (SBRD) to model selfish behaviors, proposing perturbed SBRD for dynamic and non-stationary settings.
result Proposed perturbed SBRD can observe policies with maximum metrics and differ from optimal by any given tolerance.
New algorithm reduces regret in strategic prediction problem.
problem Designing an IC algorithm with sublinear regret for strategic experts.
method Developed a new algorithm WSU-UX and proved a worst-case regret bound.
result WSU-UX suffers a Ω(T2/3) lower bound on regret. Study on decision-making cascades with agents having varying beliefs and noise levels.
problem Optimizing decision-making in a cascade of agents with heterogeneous beliefs and noise.
method Recursive belief update and analysis of optimal decision rules, predecessor selection problem characterization.
result Optimal decisions can deviate from true prior beliefs in certain conditions, highlighting the importance of social learning.
A new algorithm reduces communication costs for collaborative decision-making across clients.
problem Collaborative decision-making with sparse rewards and heterogeneous contexts.
method Federated Lasso algorithm for sparse linear contextual bandits.
result Achieves near-optimal regret with logarithmic communication costs.
This paper optimizes driver repositioning using MARL and reward design for better service and traffic management.
problem Unserved passenger requests due to drivers' cruising behavior during passenger seeking.
method Mean field multi-agent reinforcement learning (MARL) with a reward design scheme and Bayesian optimization (BO) to solve bilevel optimization problems.
result Optimal toll charges and service charges can improve platform and city planner objectives by significant margins, leading to better traffic conditions.
Sequential learning, also called lifelong learning, studies the problem of learning tasks in a sequence with access restricted to only the data of the current task. In this paper we look at a scenario with fixed model capacity, and postulate that the learning process should not be selfish, i.e. it should account for fu…
Decentralized learning ensures stability in online queuing systems with packet rates above 1.
problem Ensuring stability in online queuing systems with decentralized learning.
method Proposed cooperative queues and a learning algorithm for packet rates above 1.
result Decentralized learning strategies guarantee stability in queuing systems with packet rates above 1.
Model captures neural activity related to behavior while separating internal computations.
problem Capturing neural activity related to behavior from complex brain recordings.
method Behavior-decomposed linear dynamical systems (b-dLDS) model.
result Improves over state-of-the-art models in disentangling behavior-related dynamics.
Behavior modification improves prediction accuracy by nudging user behavior.
problem Improving prediction accuracy using behavior modification techniques.
method Combining prediction and behavior modification with reinforcement learning algorithms.
result Behavior modification can make predictions more certain but may not generalize.
Paper presents a new time-series segmentation technique for mobile phone user behavior.
problem Current segmentation techniques do not accurately capture individual user behavior over time.
method Behavior-Oriented Time Segmentation (BOTS) technique that considers temporal coverage and number of incidences.
result BOTS technique better captures user behavior at various times of day and week.
LISBET automates social behavior analysis using machine learning.
problem Manual annotation of social behaviors is time-consuming, biased, and misses subtle interactions.
method Self-supervised learning on body tracking data.
result Automated detection and segmentation of social interactions.
The paper introduces new metrics for evaluating generative models of behavior.
problem Lack of quantitative evaluation criteria for unsupervised behavior discovery.
method Proposed and investigated several metrics for generative models of behavior.
result The proposed metrics correspond with biologists' intuitions and allow for model evaluation and bias understanding.
Proposes a graph-based system for personalized news recommendation considering multiple user behaviors.
problem Lack of considering multiple user behaviors in news recommendation systems.
method Builds an interaction behavior graph, applies DeepWalk and G-CNN for news and behavior sequence representations, introduces core and coritivity features.
result Achieves personalized news recommendation considering user's concentration degree of interests.
Study reveals LLM personality patterns but lacks behavioral consistency.
problem Understanding and validating personality traits in LLMs.
method Characterized LLM personality across three dimensions: training dynamics, self-report validity, and intervention effects.
result Self-reported traits do not reliably predict behavior, and instructional alignment affects trait expression but not behavior.
Herd behavior is an important economic phenomenon, especially in the context of the recent financial crises. In this paper, herd behavior in global stock markets is investigated with a focus on intercontinental comparison. Since most existing herd behavior indices do not provide a comparative method, we propose a new h…
New approach uses Wasserstein distances to score and optimize policy behaviors.
problem Comparing reinforcement learning policies and guiding policy optimization.
method Dual formulation of Wasserstein distances in latent behavioral space, learning score functions, smoothed WDs, stochastic gradient descent, on-policy algorithms.
result Demonstrated improved performance over existing methods in various environments.
Method learns behavioral states from wearable sensor data.
problem Understanding behavioral patterns from sensor data.
method Non-parametric Bayesian approach to model sensor data.
result Learned behavioral states cluster participants into meaningful groups and predict psychological states.
Detects illegal stock market trading behaviors using graph ranking methods.
problem Detecting irregular trade behaviors in the stock market.
method Three graph Laplacian based semi-supervised ranking methods.
result Un-normalized and symmetric normalized graph Laplacian based methods outperform the random walk Laplacian method.
Study examines if LLMs' trading styles match real market behavior.
problem Lack of behavioral consistency in LLMs' trading strategies.
method Year-long simulations with LLMs, operationalizing behavioral finance drivers, and comparing with financial theory.
result LLMs' strategy switching is only partially consistent with behavioral finance theories.
A test measures artificial agents' human-like behavior in video games.
problem Measuring the believability of artificial agents' human-like behavior.
method Developed a non-parametric two-sample hypothesis test.
result The p-value correlates with human judgment of human-like behavior. Method uses DNNs to approximate functions with specific asymptotic behavior.
problem Approximating functions with given asymptotic behavior.
method Specifically constructed terms combined with unconstrained DNN.
result Enforcing asymptotic behavior leads to better approximation and faster convergence.
Extracts behavioral features from smartphone and wearable data.
problem Processing raw data streams from smartphones and wearables for human behavior analysis.
method Generic framework for processing raw data streams and extracting behavioral features.
result Extracts useful features related to non-verbal human behavior from raw data streams.
Study models Ricci flow on complex surfaces, showing mixed behavior.
problem Understanding long-time behavior of Ricci flow on complex surfaces.
method BiLipschitz models for 4-manifolds (minimal surfaces of general type).
result Exhibits a combination of expanding and static behavior.
Model predicts human food choices based on demographics.
problem Predicting human food choices from demographic data.
method Non-deterministic model based on NHANES dataset and behavioral studies.
result Generates synthetic data similar to original dataset.
New method interprets object representations from human behavior.
problem Understanding how mental object representations relate to human behavior.
method Sparse, non-negative representations of objects estimated from behavioral judgments.
result Representations predict latent object similarity and are interpretable.
We consider the problem of off-policy evaluation in Markov decision processes. Off-policy evaluation is the task of evaluating the expected return of one policy with data generated by a different, behavior policy. Importance sampling is a technique for off-policy evaluation that re-weights off-policy returns to account…
Paper develops a framework for learning interpretable representations of sequential decision behavior.
problem Obtaining a transparent description of existing behavior.
method Inverse decision modeling framework, formalizing both forward and inverse problems.
result Learning interpretable representations of behavior, including suboptimal actions, biased beliefs, and imperfect knowledge.
Survey visual analytics methods for detecting anomalous user behaviors.
problem Understanding and detecting anomalous user behaviors in various domains.
method Survey and classification of visual analytics methods in four categories.
result Discussion of findings and potential research directions.
Study uses contrastive learning to analyze market order behavior.
problem Understanding diverse market order behaviors.
method Self-supervised learning with triplet loss for order representation.
result Identified distinct behavior types using K-means clustering.
Dual-view mixture models cluster users with features and latent behaviors inferred from actions.
problem Clustering users based on features and latent behavioral functions inferred from indirect observations.
method Dual-view mixture models with non-parametric Dirichlet Process for automatic cluster number inference.
result Dual-view models outperform single-view models when one view lacks information.
Collective behavior of the complex socio-economic systems is heavily influenced by the herding, group, behavior of individuals. The importance of the herding behavior may enable the control of the collective behavior of the individuals. In this contribution we consider a simple agent-based herding model modified to inc…
Study asymptotic behaviors of solutions near singular boundaries for the Yamabe problem.
problem Boundary behavior of the singular Yamabe problem near singular boundaries.
method Analysis of asymptotic behaviors and derivation of optimal estimates for background metrics.
result Solutions are well approximated by solutions in tangent cones at singular points.
We propose Turing Learning, a novel system identification method for inferring the behavior of natural or artificial systems. Turing Learning simultaneously optimizes two populations of computer programs, one representing models of the behavior of the system under investigation, and the other representing classifiers. …
Study uses ML to analyze financial behavior in big data.
problem Challenges in analyzing financial big data.
method Applied machine learning to financial behavioral data.
result ML models can effectively estimate performance in financial markets.
Revisits behavioral finance option pricing model to align with rational asset pricing theory.
problem Inconsistency between behavioral finance and rational asset pricing models in option pricing.
method Introduces arbitrage transaction costs to modify the behavioral finance option pricing formula.
result Modifies behavioral finance option pricing formula to be consistent with rational asset pricing theory.
KFAtt improves CTR prediction by modeling user behavior with Kalman filtering attention.
problem Improving CTR prediction in personalized e-commerce search engines.
method KFAtt combines Kalman filtering with attention mechanisms to model user behavior.
result KFAtt outperforms existing methods in CTR prediction, achieving better performance in both offline and online settings.
Study of urban lifestyles from mobility data of 1.2M people in 11 U.S. cities.
problem Lack of interpretability in digital mobility data for understanding urban lifestyles.
method Privacy-enhanced dataset of mobility visitation patterns, latent activity behavior decomposition.
result Detected 12 latent activity behaviors that describe urban lifestyles, not single lifestyles.
Study on manifolds with kinks and Gaussian kernel behavior.
problem Understanding the asymptotic behavior of graph Laplacian on manifolds with singularities.
method Introduced manifolds with kinks, derived asymptotic behavior of Graph Laplacian with Gaussian kernel, and validated results numerically.
result Asymptotic behavior of the Graph Laplacian is determined by the inward sector of the tangent space.