A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
GARIM theory explains how conscious manipulation of internal representations enhances goal-directed behavior.
Agents need world models to generalize multi-step tasks.
Chance-constrained ActInf allows for small violations of constraints to drive goal-directed behavior.
New RL approach infers optimal policies via variational inference.
Improves RL planning by proposing sub-goals hierarchically.
Imitation Learning (IL) is an appealing approach to learn desirable autonomous behavior. However, directing IL to achieve arbitrary goals is difficult. In contrast, planning-based algorithms use dynamics models and reward functions to achieve goals. Yet, reward functions that evoke desirable behavior are often difficul…
Active inference minimizes expected free energy for optimal behavior.
New method learns optimal environment and goal difficulty for reinforcement learning.
Learning goal-directed behavior in environments with sparse feedback is a major challenge for reinforcement learning algorithms. The primary difficulty arises due to insufficient exploration, resulting in an agent being unable to learn robust value functions. Intrinsically motivated agents can explore new behavior for …
Paper tackles goal-directed generation of discrete structures using conditional generative models.
Causal reasoning has been an indispensable capability for humans and other intelligent animals to interact with the physical world. In this work, we propose to endow an artificial agent with the capability of causal reasoning for completing goal-directed tasks. We develop learning-based approaches to inducing causal kn…
We propose a hybrid approach aimed at improving the sample efficiency in goal-directed reinforcement learning. We do this via a two-step mechanism where firstly, we approximate a model from Model-Free reinforcement learning. Then, we leverage this approximate model along with a notion of reachability using Mean First P…
New method predicts vehicle trajectories using map lane centers.
A key challenge in complex visuomotor control is learning abstract representations that are effective for specifying goals, planning, and generalization. To this end, we introduce universal planning networks (UPN). UPNs embed differentiable planning within a goal-directed policy. This planning computation unrolls a for…
Generating novel graph structures that optimize given objectives while obeying some given underlying rules is fundamental for chemistry, biology and social science research. This is especially important in the task of molecular graph generation, whose goal is to discover novel molecules with desired properties such as …
Sparse reward problems are one of the biggest challenges in Reinforcement Learning. Goal-directed tasks are one such sparse reward problems where a reward signal is received only when the goal is reached. One promising way to train an agent to perform goal-directed tasks is to use Hindsight Learning approaches. In thes…
New approach decouples skill learning and language grounding for autonomous agents.
Graph clustering is a fundamental task which discovers communities or groups in networks. Recent studies have mostly focused on developing deep learning approaches to learn a compact graph embedding, upon which classic clustering methods like k-means or spectral clustering algorithms are applied. These two-step framewo…
Many AI problems, in robotics and other domains, are goal-directed, essentially seeking a trajectory leading to some goal state. In such problems, the way we choose to represent a trajectory underlies algorithms for trajectory prediction and optimization. Interestingly, most all prior work in imitation and reinforcemen…
Animals execute goal-directed behaviours despite the limited range and scope of their sensors. To cope, they explore environments and store memories maintaining estimates of important information that is not presently available. Recently, progress has been made with artificial intelligence (AI) agents that learn to per…
Universal AI seeks high-optionality states through empowerment and curiosity.
Extended Predictable Feature Analysis (PFAx) [Richthofer and Wiskott, 2017] is an extension of PFA [Richthofer and Wiskott, 2015] that allows generating a goal-directed control signal of an agent whose dynamics has previously been learned during a training phase in an unsupervised manner. PFAx hardly requires assumptio…
DISTANA improves weather prediction by inferring hidden factors from temperature data.
An internal model of the own body can be assumed a fundamental and evolutionary-early representation as it is present throughout the animal kingdom. Such functional models are, on the one hand, required in motor control, for example solving the inverse kinematic or dynamic task in goal-directed movements or a forward t…
GraphAF generates chemically valid molecules efficiently and accurately.
A reinforcement learning algorithm improves graph construction for robustness.
Paper proposes a method to make learned models focus on task-relevant information.
Consider mutli-goal tasks that involve static environments and dynamic goals. Examples of such tasks, such as goal-directed navigation and pick-and-place in robotics, abound. Two types of Reinforcement Learning (RL) algorithms are used for such tasks: model-free or model-based. Each of these approaches has limitations.…
In recent years, deep generative models have been shown to 'imagine' convincing high-dimensional observations such as images, audio, and even video, learning directly from raw data. In this work, we ask how to imagine goal-directed visual plans -- a plausible sequence of observations that transition a dynamical system …
Unified framework for hybrid learning and optimization via active inference.
Fine-tunes diffusion models to generate diverse samples with high genuine rewards.
NIPA aims to translate brain learning mechanisms into scalable Bayesian inference.
Guided Learning improves end-to-end modeling for multi-stage decision-making.
We present an active learning architecture that allows a robot to actively learn which data collection strategy is most efficient for acquiring motor skills to achieve multiple outcomes, and generalise over its experience to achieve new outcomes. The robot explores its environment both via interactive learning and goal…
Model captures neural activity related to behavior while separating internal computations.
Behavior modification improves prediction accuracy by nudging user behavior.
LISBET automates social behavior analysis using machine learning.
The paper introduces new metrics for evaluating generative models of behavior.
Mobile phones can record individual's daily behavioral data as a time-series. In this paper, we present an effective time-series segmentation technique that extracts optimal time segments of individual's similar behavioral characteristics utilizing their mobile phone data. One of the determinants of an individual's beh…
Study reveals LLM personality patterns but lacks behavioral consistency.
Herd behavior is an important economic phenomenon, especially in the context of the recent financial crises. In this paper, herd behavior in global stock markets is investigated with a focus on intercontinental comparison. Since most existing herd behavior indices do not provide a comparative method, we propose a new h…
Interactive news recommendation has been launched and attracted much attention recently. In this scenario, user's behavior evolves from single click behavior to multiple behaviors including like, comment, share etc. However, most of the existing methods still use single click behavior as the unique criterion of judging…
Study examines if LLMs' trading styles match real market behavior.
A test measures artificial agents' human-like behavior in video games.
Method uses DNNs to approximate functions with specific asymptotic behavior.
Study models Ricci flow on complex surfaces, showing mixed behavior.
Model predicts human food choices based on demographics.
We consider the problem of off-policy evaluation in Markov decision processes. Off-policy evaluation is the task of evaluating the expected return of one policy with data generated by a different, behavior policy. Importance sampling is a technique for off-policy evaluation that re-weights off-policy returns to account…