This paper investigates generalisation in multi-agent games, where the generality of the agent can be evaluated by playing against opponents it hasn't seen during training. We propose two new games with concealed information and complex, non-transitive reward structure (think rock/paper/scissors). It turns out that mos…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,742 papers · 148 categories
Trend · papers per month
48 results for “agent hierarchy”
Develops a framework for decision-making abstractions under computational limitations.
problem Decision-making by agents with limited computational resources.
method Information-theoretic signal compression and optimization problem formulation.
result Generates a hierarchy of abstractions for a non-trivial environment.
In this study, we investigate the use of global information to speed up the learning process and increase the cumulative rewards of reinforcement learning (RL) in competition tasks. Within the actor-critic RL, we introduce multiple cooperative critics from two levels of the hierarchy and propose a reinforcement learnin…
HiDe learns hierarchical control for complex tasks by separating planning and control.
problem Solving long horizon control tasks with generalization to unseen scenarios.
method Functional decomposition of state-action spaces, RL-based planner, modular transfer of policy layers.
result Generalizes across unseen test environments and scales to longer horizons.
We study an economic model where agents trade a variety of products by using one of three competing rules: "need", "greed" and "noise". We find that the optimal strategy for any agent depends on both product composition in the overall market and composition of strategies in the market. In particular, a strategy that do…
FEN model learns fairness and efficiency in multi-agent systems.
problem Fairness in multi-agent systems for stability and productivity.
method Hierarchical reinforcement learning model with fair-efficient reward and sub-policies.
result FEN model easily learns both fairness and efficiency in multi-agent scenarios.
Improved cooperation between levels boosts reinforcement learning performance.
problem Training multi-level policies in hierarchical reinforcement learning.
method Modeling policy optimization as a multi-agent process and inducing cooperation between sub-policies.
result Inducing cooperation between sub-policies leads to stronger and more sample-efficient policies.
We introduce a framework to study the effective objectives at different time scales of financial market microstructure. The financial market can be regarded as a complex adaptive system, where purposeful agents collectively and simultaneously create and perceive their environment as they interact with it. It has been s…
The paper proposes a method to transfer knowledge across different settings using causal theory.
problem Learning transfer across similar but different settings.
method Bayesian perspective of causal theory induction, integrating instance-level associative learning and abstract-level structural causal knowledge.
result The proposed model achieved transfer behavior across trials and learning situations, unlike RL algorithms.
RODE learns roles to simplify multi-agent tasks.
problem Efficiently discovering roles for complex multi-agent tasks.
method Clustering actions based on effects, bi-level learning hierarchy, integrating action effects into role policies.
result RODE outperforms state-of-the-art MARL algorithms on StarCraft II benchmarks.
The security of Deep Reinforcement Learning (Deep RL) algorithms deployed in real life applications are of a primary concern. In particular, the robustness of RL agents in cyber-physical systems against adversarial attacks are especially vital since the cost of a malevolent intrusions can be extremely high. Studies hav…
Proposes a value-oriented forecast reconciliation method for renewables in electricity markets.
problem Forecast reconciliation overlooks the value of forecasts in decision-making, leading to unfair outcomes.
method Value-oriented forecast reconciliation using a Nash bargaining framework and a primal-dual algorithm for parameter estimation.
result Consistently increases profits for all agents involved in an aggregated wind energy trading problem.
Constructs integrable hierarchies for generalized Frobenius manifolds with non-flat unity.
problem Integrable hierarchies for generalized Frobenius manifolds with non-flat unity.
method Constructs a bihamiltonian integrable hierarchy of hydrodynamic type.
result Integrable hierarchy possesses Virasoro symmetries and a tau structure.
Interactive RL and DT feedback improve feature selection efficiency.
problem Balancing feature selection effectiveness and efficiency.
method Interactive Reinforcement Learning (IRL) and Decision Tree Feedback (DTF) architecture.
result Improved feature selection performance on real-world datasets.
Study identifies pitfalls in assessing hierarchies for multi-class classification.
problem Lack of understanding in selecting hierarchies for multi-class classification.
method Analyzed and compared popular approaches to extracting hierarchies.
result Hierarchy quality becomes irrelevant when using powerful classifiers.
Super tau-covers extend bihamiltonian hierarchies' symmetries.
problem Extending symmetries of bihamiltonian hierarchies.
method Constructing super tau-covers for bihamiltonian integrable hierarchies.
result Symmetries of bihamiltonian hierarchies extended to super tau-covers.
Hydrodynamic hierarchy deformed using conservation laws.
problem Deforming a hydrodynamic hierarchy with non-vanishing Nijenhuis torsion.
method Using a chain of conservation laws to deform the hierarchy.
result The resulting hierarchy has non-vanishing Nijenhuis torsion but vanishing Haantjes tensor.
Legendre transformations link related integrable hierarchies.
problem Understanding relationships between integrable hierarchies.
method Legendre-type transformations of generalized Frobenius manifolds.
result Linear reciprocal transformations link related hierarchies.
Twisted - and twisted -hierarchies are soliton hierarchies introduced by Terng to find higher flows of the generalized sine-Gordon equation. Twisted -hierarchies are among the most important classes of twisted hierarchies. In this paper, interesting first and higher flows of twi…
Derive bihamiltonian structure for rational reduction of 2D-Toda hierarchy
problem Derive bihamiltonian structure for rational reduction of 2D-Toda hierarchy
method Direct computations
result Derive local bihamiltonian structure
We propose a formally completely integrable extension of heat hierarchy based on the space of symmetries isomorphic to the Weyl algebra . The extended heat hierarchy will be the basic model for the analysis of the extension of KP hierarchy, and other integrable equations.
In this paper we study a new reinforcement learning setting where the environment is non-rewarding, contains several possibly related objects of various controllability, and where an apt agent Bob acts independently, with non-observable intentions. We argue that this setting defines a realistic scenario and we present …
Wise's Quasiconvex Hierarchy Theorem classifying hyperbolic virtually compact special groups in terms of quasiconvex hierarchies played an essential role in Agol's proof of the Virtual Haken Conjecture. Answering a question of Wise, we construct a new virtual quasiconvex hierarchy for relatively hyperbolic virtually co…
New hierarchies derived from KP hierarchy using non-formal operators and Yang-Mills action.
problem Formal solutions of KP hierarchy and their non-formal counterparts.
method Developed new hierarchies of non-linear equations on non-formal pseudo-differential operators.
result Expressed one hierarchy as Yang-Mills action minimization.
A symmetry reduction of the Painlevé IV hierarchy to the Flaschka-Newell Painlevé II hierarchymath-ph
Symmetry reduction of Painlevé IV to Flaschka-Newell Painlevé II
problem Isomonodromic deformation problem associated with rank-two meromorphic connections
method Symmetry
result Induced isomonodromic dynamics coincides with Flaschka-Newell Painlevé II hierarchy
Scroll structures on solutions of 4D integrable equations are involutive and governed by a dispersionless hierarchy.
problem Characterizing the geometry of solutions to 4D integrable equations.
method Defining rational normal scrolls and showing their involutivity.
result Involutive scroll structures are governed by a dispersionless integrable hierarchy.
Constructs tri-Hamiltonian structure and Frobenius manifold for asymmetric gAL hierarchy
problem Tri-Hamiltonian structure and Frobenius manifold for asymmetric gAL hierarchy
method Local tri-Hamiltonian structure construction and Frobenius manifold construction
result Dispersionless limits of flows belong to Principal Hierarchy
A relation between the Goldstein-Petrich hierarchy for plane curves and the Toda lattice hierarchy is investigated. A representation formula for plane curves is given in terms of a special class of -functions of the Toda lattice hierarchy. A representation formula for discretized plane curves is also discussed.
HAL learns hierarchical affordances to prune impossible subtasks, improving reinforcement learning efficiency.
problem Reinforcement learning struggles with complex hierarchical dependency structures.
method HAL learns a model of hierarchical affordances to prune impossible subtasks.
result HAL agents are better at learning complex tasks, navigating stochastic environments, and acquiring diverse skills.
HAKE embeds entities in polar coordinates to model semantic hierarchies in knowledge graphs.
problem Lack of modeling semantic hierarchies in knowledge graph embeddings.
method HAKE embeds entities in a polar coordinate system, where the radial coordinate represents hierarchy levels and the angular coordinate distinguishes entities at the same level.
result HAKE significantly outperforms existing methods on link prediction tasks in knowledge graphs.
New integrable deformations for topological hierarchies from Frobenius manifolds.
problem Integrable deformations of topological hierarchies from Frobenius manifolds.
method Construction of integrable deformations with polynomial tau-structures.
result Conjecture of universal object for Riemann--Hopf hierarchy.
We introduce two families of soliton hierarchies: the twisted hierarchies associated to symmetric spaces. The Lax pairs of these two hierarchies are Laurent polynomials in the spectral variable. Our constructions gives a hierarchy of commuting flows for the generalized sine-Gordon equation (GSGE), which is the Gauss-Co…
Paper investigates methods to improve classification by inducing a hierarchy from flat labels.
problem Improving classification performance on datasets lacking a natural hierarchy.
method The approach involves clustering conditional distributions and using a hierarchical classifier with the induced hierarchy.
result The methods can discover latent hierarchies and improve accuracy in various applications.
We compute the central invariants of the bihamiltonian structures of the constrained KP hierarchies, and show that these integrable hierarchies are topological deformations of their hydrodynamic limits.
We prove that the extended Toda hierarchy of \cite{CDZ} admits nonabelian Lie algebra of infinitesimal symmetries isomorphic to the half of the Virasoro algebra. The generators , of the Lie algebra act by linear differential operators onto the tau function of the hierarchy. We also prove that the tau fu…
Paper addresses limitations of traditional hierarchical clustering methods.
problem Traditional hierarchical clustering methods face limitations in binary trees and ultrametrics.
method Introduces the notion of a valid hierarchy and a two-step algorithm to construct a binary tree and prune it to enforce validity.
result Proposes a method to recover the finest valid hierarchy, which is not constrained to binary structures.
The Extended Toda Hierarchynlin.SI
We present the Lax pair formalism for certain extension of the continuous limit of the classical Toda lattice hierarchy, provide a well defined notion of tau function for its solutions, and give an explicit formulation of the relationship between the topological sigma model and the extended Toda hierarchy. We al…
New diffiety theory leads to a well-posed KP hierarchy.
problem Formalizing diffieties for better hierarchy analysis.
method Definition of diffiety based on Frolicher structures.
result Formation of a well-posed Kadomtsev-Petviashvili hierarchy.
CMC hierarchymath.DG
We propose an extension of the differential system for constant mean curvature (CMC) surfaces in a three dimensional space form to an associated hierarchy of evolution equations by the higher-order commuting symmetries. The infinite sequence of higher-order conservation laws of CMC surfaces admit the corresponding exte…
Agent learns diverse hierarchical structures in unknown environments.
problem Autonomous discovery and learning of diverse structures in unknown changing environments.
method Progressive construction of a Hierarchy of Observation Latent Models for Exploration Stratification (HOLMES).
result Agent can learn and reuse representations to progressively explore and discover diverse structures.
This is the third in a series of papers attempting to describe a uniform geometric framework in which many integrable systems can be placed. A soliton hierarchy can be constructed from a splitting of an infinite dimensional group as positive and negative subgroups L_+, L_- and a commuting sequence in the Lie algebr…
Study bihamiltonian structures and Frobenius manifolds for specific Toda hierarchies.
problem Local bihamiltonian structures and Frobenius manifolds for asymmetric rational reductions of 2D-Toda hierarchy.
method Construct three-dimensional generalized Frobenius manifold, relate to other hierarchies via transformations.
result Explicit relation between RR2T and bi-graded Toda and constrained KP hierarchies.
We observe that the modular class of a Poisson-Nijhenhuis manifold has a canonical representative and that, under a cohomological assumption, this vector field is bi-hamiltonian. In many examples the associated hierarchy of flows reproduces classical integrable hierarchies.
ProHOC detects OOD samples in class hierarchies, predicting them to correct internal nodes.
problem Binary OOD detection ignores semantic relationships between OOD and ID classes.
method Probabilistic hierarchical model using multi-depth networks trained for ID classification.
result ProHOC effectively classifies OOD samples to their correct internal nodes in class hierarchies.
We construct integrable hierarchies of flows for curves in centroaffine through a natural pre-symplectic structure on the space of closed unparametrized starlike curves. We show that the induced evolution equations for the differential invariants are closely connected with the Boussinesq hierarchy, and …
Hierarchical Partial-Order Models for Ranking
problem Rank aggregation combining ordered lists
method Hierarchical partial-order models
result Bayesian inference for latent poset hierarchy
The hierarchy structure associated with a (2+1)-dimensional Nonlinear Schroedinger equation is discussed as an extension of the theory of the KP hierarchy. Several methods to construct special solutions are given. The relation between the hierarchy and a representation of toroidal Lie algebras are established by using …
Starting from a so-called flat exact semisimple bihamiltonian structures of hydrodynamic type, we arrive at a Frobenius manifold structure and a tau structure for the associated principal hierarchy. We then classify the deformations of the principal hierarchy which possess tau structures.