Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,878 papers · 148 categories

Trend · papers per month

224448671895 · Jun 202019922001200920172026
48 results for neural pedagogical agent

Neural pedagogical agent updates user models in real-time for mobile education apps.

problem Real-time user modeling for dynamic mobile education platforms.
method Bidirectional recurrent neural networks with attention mechanism over embedded question-response pairs.
result Model outperforms existing approaches in predicting user response correctness.

This note presents in a technical though hopefully pedagogical way the three most common forms of neural network architectures: Feedforward, Convolutional and Recurrent. For each network, their fundamental building blocks are detailed. The forward pass and the update rules for the backpropagation algorithm are then der…

2017-09-05abs ↗pdf ↗

Deep neural networks are widely used for nonlinear function approximation with applications ranging from computer vision to control. Although these networks involve the composition of simple arithmetic operations, it can be very challenging to verify whether a particular network satisfies certain input-output propertie…

2019-03-15abs ↗pdf ↗

Novel neural likelihood ratio estimation for negative data in particle physics.

problem Estimating likelihood ratios with negative probability densities and weights.
method Introducing a novel loss function and a new model architecture based on signed mixture models.
result Demonstrated improved estimation on a real-world example from particle physics.

A self-contained introduction is presented of the notion of the (abstract) differentiable manifold and its tangent vector fields. The way in which elementary topological ideas stimulated the passage from Euclidean (vector) spaces and linear maps to abstract spaces (manifolds) and diffeomorphisms is emphasized. Necessar…

2012-04-10abs ↗pdf ↗

Explains differences between WL and folklore-WL formulations in graph neural networks.

problem Understanding the differences between WL and folklore-WL formulations in graph neural networks.
method Visual explanation of differences between WL and folklore-WL formulations.
result Clarifies the differences between WL and folklore-WL formulations.

MagNet uses neural networks to predict multi-agent dynamics from observations.

problem Predicting the evolution of complex multi-agent systems.
method Formulated a coupled non-linear network with ODE-based state evolution, trained a neural network to discover dynamics from observations.
result Orders of magnitude improvement in prediction accuracy over traditional models.

Neural Architecture Search has shown potential to automate the design of neural networks. Deep Reinforcement Learning based agents can learn complex architectural patterns, as well as explore a vast and compositional search space. On the other hand, evolutionary algorithms offer higher sample efficiency, which is criti…

2018-11-24abs ↗pdf ↗

NeuroMAS treats multi-agent systems as neural networks for scalable, trainable coordination.

problem Designing multi-agent systems as hand-designed workflows is inefficient and inflexible.
method NeuroMAS treats multi-agent systems as a neural network architecture with reinforcement learning for scalable coordination.
result NeuroMAS improves significantly over multi-agent baselines and can be scaled progressively.

The Neural Testbed evaluates joint predictions of neural agents, revealing their limitations.

problem Evaluating the quality of joint predictions generated by neural agents.
method Developed an open-source benchmark (The Neural Testbed) to assess agents' marginal and joint predictions.
result Popular Bayesian deep learning agents perform poorly on joint predictions, even with accurate marginal predictions.

MPLP learns neural network weights by treating operations as message-passing agents.

problem Training neural networks using gradient-based methods.
method MPLP abstracts neural network operations as message-passing agents, updating internal states and passing messages.
result MPLP outperforms traditional gradient-based methods on simple feed-forward neural networks.

A simple model explains deep learning phenomena like grokking and gradient boosting.

problem Understanding the unexpected behaviors of deep learning models.
method A telescoping sequence of first-order approximations to explain neural network performance.
result Empirical insights into neural network performance and training process.

Bayesian optimization with Gaussian processes speeds up searches for stationary points.

problem Accelerating searches for stationary points on potential energy surfaces.
method Unified Bayesian optimization view using Gaussian process regression with derivative observations, inverse-distance kernels, and active learning.
result Surrogates can reduce the number of expensive electronic structure evaluations by an order of magnitude.

Why do large neural network generalize so well on complex tasks such as image classification or speech recognition? What exactly is the role regularization for them? These are arguably among the most important open questions in machine learning today. In a recent and thought provoking paper [C. Zhang et al.] several au…

2017-04-05abs ↗pdf ↗

One-shot path planning for multiple agents using neural networks.

problem Efficiently generating optimal or near-optimal paths for multiple agents in robotics.
method Utilizes fully convolutional neural networks for one-shot multi-agent path planning.
result Demonstrates successful generation of optimal or near-optimal paths in over 85% of cases for multi-path planning.

I2C enables agents to learn efficient communication without redundancy.

problem Redundant broadcast communication in multi-agent cooperation.
method I2C learns a prior for agent-agent communication via causal inference and reinforcement learning.
result I2C reduces communication overhead and improves multi-agent cooperative performance.

In this short paper, we re-derive the Bochner formula for the Laplacian by considering local variations of volume. The derivation is rooted in the fact that the Laplacian of a function measures the volume variation along the flow of the gradient vector of the function. Possible extensions of this approach/technique are…

2013-06-17abs ↗pdf ↗

AgentNet is a graph neural network that learns to walk graphs intelligently, outperforming traditional methods.

problem Graph-level tasks, especially distinguishing and classifying graphs.
method AgentNet uses a computational model inspired by sublinear algorithms, where neural agents walk the graph and collectively decide the output.
result AgentNet can distinguish and separate graphs that are hard to distinguish, outperforming traditional graph neural networks.

Hybrid model simulates market dynamics using neural stochastic background traders.

problem Lack of realistic LOB simulations that combine historical data and dynamic interactions.
method Neural stochastic background trader trained on historical LOB data, embedded in multi-agent simulation.
result Hybrid model recreates stylised market facts and financial herding behaviors.

Improves neural relational inference for dynamic multi-agent trajectories.

problem Limited accuracy of NRI in short output sequences for relational inference in multi-agent trajectories.
method Proposes DYnamic multi-AgentRelational Inference (DYARI) model to handle changing interactions over time.
result DYARI model outperforms NRI in dynamic relational inference tasks.

Deep reinforcement learning methods attain super-human performance in a wide range of environments. Such methods are grossly inefficient, often taking orders of magnitudes more data than humans to achieve reasonable performance. We propose Neural Episodic Control: a deep reinforcement learning agent that is able to rap…

2017-03-06abs ↗pdf ↗

A novel framework for adaptive multi-agent communication in reinforcement learning.

problem Manual specification of communication structures in multi-agent reinforcement learning.
method Learning Structured Communication (LSC) framework using hierarchical graph neural networks.
result Adaptive hierarchical formations and efficient message propagation among agents.

Many questions of fundamental interest in todays science can be formulated as inference problems: Some partial, or noisy, observations are performed over a set of variables and the goal is to recover, or infer, the values of the variables based on the indirect information contained in the measurements. For such problem…

2015-11-08abs ↗pdf ↗

ReF-ER algorithm improved performance in multi-agent reinforcement learning.

problem Improving performance in multi-agent reinforcement learning environments.
method Extended ReF-ER algorithm to include dependencies between agents and modeled environment dynamics.
result ReF-ER MARL outperforms state-of-the-art algorithms in collaborative environments.

VectorNet predicts car behavior using vectorized HD maps and agent dynamics.

problem Predicting behavior in multi-agent systems with self-driving cars.
method VectorNet uses hierarchical graph neural networks on vectorized representations of HD maps and agent trajectories.
result VectorNet achieves comparable or better performance than state-of-the-art methods while using fewer parameters and less computational power.

Recently, deep reinforcement learning (RL) methods have been applied successfully to multi-agent scenarios. Typically, these methods rely on a concatenation of agent states to represent the information content required for decentralized decision making. However, concatenation scales poorly to swarm systems with a large…

2018-07-17abs ↗pdf ↗

Model predicts multi-agent trajectories using a differentiable simulator.

problem Predicting future positions of multiple interacting agents.
method Conditional recurrent variational neural networks (CVRNNs) with a kinematic bicycle model.
result Achieves state-of-the-art results on INTERACTION dataset.

This a free translation with additional explanations of {\em Processus à Accroissement Independants Chapitre I: La Décomposition de Paul Lévy}, by J.L. Bretagnolle, in {\em Ecole d'Eté de Probabilités}, Lecture Notes in Mathematics 307, Springer 1973. The Lévy-Khintchine representation of infinitely divisible distribut…

2015-06-09abs ↗pdf ↗

New approach for open ad hoc teamwork using graph-based policy learning.

problem Designing autonomous agents to collaborate with changing teams without prior coordination.
method Graph-based policy learning to adapt to dynamic team compositions.
result Successfully models the effects of other agents, leading to robust adaptation and superior performance.

This is the first monograph on the geometry of anisotropic spinor spaces and its applications in modern physics. The main subjects are the theory of gravity and matter fields in spaces provided with off--diagonal metrics and associated anholonomic frames and nonlinear connection structures, the algebra and geometry of …

2001-12-12abs ↗pdf ↗

Randomized neural networks improve deep RL agents' generalization.

problem Deep RL agents struggle to generalize to new, semantically similar environments.
method Introduce a randomized (convolutional) neural network to perturb input observations.
result Significantly outperforms various regularization and data augmentation methods.

We give a pragmatic/pedagogical discussion of using Euclidean path integral in asset pricing. We then illustrate the path integral approach on short-rate models. By understanding the change of path integral measure in the Vasicek/Hull-White model, we can apply the same techniques to "less-tractable" models such as the …

2014-10-07abs ↗pdf ↗

Reinforcement learning (RL) algorithms allow agents to learn skills and strategies to perform complex tasks without detailed instructions or expensive labelled training examples. That is, RL agents can learn, as we learn. Given the importance of learning in our intelligence, RL has been thought to be one of key compone…

2019-01-01abs ↗pdf ↗