We aim to reduce the burden of programming and deploying autonomous systems to work in concert with people in time-critical domains, such as military field operations and disaster response. Deployment plans for these operations are frequently negotiated on-the-fly by teams of human planners. A human operator then trans…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,181 papers · 148 categories
Trend · papers per month
48 results for “human planning”
A pedestrian path-planning model in accordance with obstacle's danger with reinforcement learningcs.LG
A novel pedestrian path-planning model using reinforcement learning.
problem Challenges in replicating natural pedestrian navigation behavior.
method Reinforcement learning for collision avoidance and path planning.
result Path planning by the agent closely resembles human pedestrian behavior.
Study on human planning and re-planning in unknown stochastic environments.
problem Understanding how humans adjust plans in unfamiliar environments.
method Grid world task, 12 different models, model-based reinforcement learning approach.
result Model-based reinforcement learning approach best explains human re-planning behavior.
Perceive, Predict, and Plan: Safe Motion Planning Through Interpretable Semantic Representationscs.RO
End-to-end learnable network for safer self-driving with interpretable intermediate representations.
problem Safe motion planning for self-driving vehicles.
method Differentiable semantic occupancy representation for cost calculation in motion planning.
result Significantly outperforms state-of-the-art planners in imitating human behaviors and producing safer trajectories.
Survey of mobility studies using mobile phone data.
problem Understanding human mobility patterns.
method Data Science techniques applied to mobile phone datasets.
result Applications in urban planning, data traffic prediction, etc.
Proposes a generic prediction architecture for autonomous vehicles considering both rational and irrational driving behaviors.
problem Accurately predicting future behaviors of surrounding vehicles for safe autonomous vehicle planning.
method Combines learning-based and planning-based models to address rationalities in human behavior.
result Stable prediction performance under various unseen driving scenarios.
PHASE dataset simulates complex social interactions in physical environments.
problem Lack of datasets for evaluating physically grounded perception of complex social interactions.
method Created PHASE dataset of 2D animations with procedural generation and physics engine.
result SIMPLE model outperforms neural networks in recognizing complex social interactions.
New method combines heuristics and search techniques to speed up cooperative planning for autonomous vehicles.
problem Efficient cooperative planning for autonomous vehicles in complex traffic scenarios.
method Combining learned heuristics with Monte Carlo Tree Search (MCTS) to guide search towards promising actions.
result Better solutions at lower computational costs achieved through accelerated planning.
New approach learns human planning algorithms for reward inference.
problem Learning reward functions from human demonstrations with biases.
method Data-driven approach to learn planning algorithms directly from demonstrations.
result Mixed results: better reward inference but at cost of differentiability.
VaST maps complex environments to simpler models for faster learning.
problem Sample inefficiency in deep reinforcement learning.
method Variational State Tabulation (VaST) and prioritized sweeping planning.
result VaST enables rapid learning and adaptation in complex tasks.
Robot learns from human actions to perform complex tasks.
problem Learning complex skills from interaction data with embodiment differences.
method Formulated graphical model, treated action as observed variable, used domain-dependent prior.
result Robotic planning agent can learn tool use from human observations.
Neural A* uses machine learning to improve path planning efficiency.
problem Challenges in applying machine learning to search-based path planning.
method Reformulated A* search as a differentiable network coupled with a convolutional encoder.
result Neural A* outperforms state-of-the-art planners in optimality and efficiency.
The paper predicts human-like driving behavior of other vehicles for safer AVs.
problem Safe and efficient interaction of AVs with other vehicles.
method Hierarchical inverse reinforcement learning considering both discrete and continuous decisions.
result The proposed approach accurately predicts both discrete and continuous driving behaviors.
Study experiment planning with function approximation in contextual bandit problems.
problem Designing effective data collection strategies in settings with limited rewards.
method Proposes two experiment planning strategies compatible with function approximation.
result Eluder planning and sampling procedure achieves optimality guarantees.
Deep RL finds efficient pathways for sugar to chemicals.
problem Finding efficient pathways from sugar to value-added chemicals.
method Markov decision process with deep reinforcement learning.
result Promising preliminary results in efficient biomass conversion.
Mathematical framework for cooperative communication explains belief transmission.
problem Lack of understanding why cooperation enables effective belief transmission.
method Connection to optimal transport theory, deriving prior models, statistical interpretations, proofs of robustness and instability.
result Cooperative communication provably enables effective, robust belief transmission.
Algorithm learns from human demonstrations to schedule tasks efficiently.
problem Efficient resource scheduling in dynamic environments.
method Personalized apprenticeship learning framework infers decision-making criteria from heterogeneous human demonstrations.
result Achieves high accuracy in synthetic and real-world domains, outperforming baselines.
Strategic Workforce Planning is a company process providing best in class, economically sound, workforce management policies and goals. Despite the abundance of literature on the subject, this is a notorious challenge in terms of implementation. Reasons span from the youth of the field itself to broader data integratio…
New method finds competitive neural networks in a day.
problem Designing neural network architectures is laborious and requires human expertise.
method Combining UCT with two UCT derivations for efficient network architecture search.
result Competitive networks found for MNIST, SVHN, and CIFAR-10 in a single GPU day.
LEAPS uses semantic models to improve reinforcement learning in diverse environments.
problem Generalizing and adapting to unseen environments in reinforcement learning.
method Hybrid model-based and model-free approach with a multi-target sub-policy and a Bayesian semantic model.
result LEAPS outperforms baselines in visual navigation tasks using diverse indoor scenes.
Method learns reusable actions from human demonstrations.
problem Learning reusable actions from human demonstrations.
method Skill segmentation, inverse reinforcement learning, one-class support vector machine.
result Inferred options improve learning and planning.
Study on limits of LLM-based multi-agent planning reliability.
problem Reliability limits of LLM-based multi-agent planning.
method Modeling LLM-based multi-agent architecture as a decision network, showing dominance by centralized Bayes decision maker.
result Optimizing multi-agent directed acyclic graphs under communication budget is equivalent to choosing a constrained experiment.
Agents trained to play with themselves fail when paired with humans, suggesting the need for human-aware learning.
problem Current AI agents trained to play with themselves fail to coordinate effectively with humans.
method Introduced a simple Overcooked game environment and trained agents via self-play and population-based training. Evaluated performance against a human model.
result Agents trained to play with themselves perform poorly when paired with a human model, highlighting the need for human-aware learning.
Develops models for temporally abstract reasoning and attention.
problem Temporal abstraction and attention in reinforcement learning.
method Defines affordances for options and develops partial option models.
result Identifies trade-offs between estimation and approximation error.
A novel model arbitrates between planning and habitual control for efficient decision-making.
problem Balancing flexibility and efficiency in decision-making systems.
method Introduces an arbitrator that switches between planning and habitual control systems.
result The model learns kinematics quickly and adapts to changing environments.
Safe autonomous decisions made with machine learning predictions using Conformal Decision Theory.
problem Safe decisions from imperfect machine learning predictions.
method Conformal Decision Theory framework for producing safe decisions.
result Safe decisions with provable statistical guarantees of low risk.
Project analyzes traffic videos to improve Jakarta's safety.
problem Improving traffic safety in Jakarta.
method Developed a pipeline to analyze traffic videos, turning them into usable databases.
result Better understanding of traffic challenges and safety risks.
MultiPath predicts multi-modal future trajectories for better motion planning.
problem Predicting human behavior in uncertain real-world domains like autonomous driving.
method Leverages fixed future state-sequence anchors and regresses offsets with uncertainties.
result Achieves more accurate predictions with an order of magnitude fewer trajectories.
LLMs improve parent-order execution in trading.
problem Improving execution costs in algorithmic trading.
method PACE (Plan-Ahead Controlled Execution) framework.
result LLMs outperform existing methods by 0.65 bps.
Reciprocating interactions represent a central feature of all human exchanges. They have been the target of various recent experiments, with healthy participants and psychiatric populations engaging as dyads in multi-round exchanges such as a repeated trust task. Behaviour in such exchanges involves complexities relate…
Deep RL algorithm learns human-level policies on nearly all Atari games.
problem Consistent performance on diverse Atari games.
method Addressing three key challenges: diverse reward distributions, long-term reasoning, and efficient exploration.
result Exceeds human performance on 40 out of 42 Atari games.
Predicting movie box office success using historical data and modern computing.
problem Manual prediction of movie revenue is difficult due to many exogenous variables.
method Use modern computing power and historical data to model movie revenue.
result Predicted movie revenues can be used for planning production and distribution stages.
ERP improves drug discovery by balancing molecule generation quality and efficiency.
problem Generating valid and optimal molecules from large language models.
method Entropy-Reinforced Planning (ERP) for Transformer Decoding.
result ERP outperforms current state-of-the-art algorithms by 1-5 percent on SARS-CoV-2 and human cancer cell targets.
A conceptor-based approach helps robots recognize human internal states.
problem Recognizing human internal states for diagnostic purposes in autism therapy.
method A conceptor-based classifier to classify internal states.
result Initial results show potential for detailed diagnostic information.
Human mobility is well described by closed-form gravity-like models learned automatically from dataphysics.soc-ph
New models predict mobility flows as well as complex machine learning but are simpler and interpretable.
problem Incomplete understanding and modeling of human mobility flows.
method Developed simple machine-learned, closed-form models of mobility.
result These models predict mobility flows more accurately than gravity or complex machine/deep learning models.
Efficient Q-learning for metric spaces without planning oracles.
problem Efficient reinforcement learning in continuous state-action spaces.
method Model-free Q-learning adapted for metric spaces without a planning oracle.
result Sample efficiency in continuous state-action spaces.
Director learns hierarchical behaviors from pixels, outperforming exploration methods.
problem Challenges in learning long-term hierarchical behaviors from pixels.
method Directly learns hierarchical behaviors from pixels using a latent space world model.
result Director outperforms exploration methods on various tasks.
Transformers learn to predict chess moves with surprising accuracy and strength.
problem Training transformers on chess to predict moves accurately.
method Large-scale chess dataset (10M games), supervised learning with up to 270M parameters.
result Transformers can predict action-values for novel boards with high accuracy.
Reaction prediction remains one of the major challenges for organic chemistry, and is a pre-requisite for efficient synthetic planning. It is desirable to develop algorithms that, like humans, "learn" from being exposed to examples of the application of the rules of organic chemistry. We explore the use of neural netwo…
Paper analyzes GPS data to identify POIs and user similarities.
problem Analyzing GPS data for meaningful places and user profiles.
method Data mining algorithms applied to raw GPS data.
result Steps to identify POIs and user similarities are satisfactory.
Novel approach to learning models based on subjective timescales for better exploration and decision-making.
problem Learning models over multi-step timescales in environments with intermediate states.
method Developed a subjective-timescale model (STM) based on episodic memories, enabling systematic variation of temporal extent of predictions.
result STM produces more informative action-conditioned roll-outs, leading to better decision-making and exploration.
New method infers intent from suboptimal behavior by modeling incorrect internal beliefs about dynamics.
problem Inferring intent from suboptimal human behavior using traditional methods assumes near-optimality, which is not always valid.
method Model suboptimal behavior as internal model misspecification, estimating incorrect beliefs about dynamics.
result Accurately models human intent by accounting for internal model inaccuracies.
Unified framework explains retirement and annuitization decisions under age-dependent mortality.
problem Complexity of annuitization decisions due to longevity risk and labor force participation.
method Stochastic control and optimal stopping framework with habit formation and endogenous labor supply.
result Rich sequence of retirement dynamics, including defensive and aggressive labor supply phases.
ForecastQA creates a new QA task for event forecasting from text data.
problem Forecasting future events from unstructured text data.
method Formulated a restricted-domain, multiple-choice QA task for event forecasting.
result Best model achieves 60.1% accuracy, lagging behind human performance by about 19%
Competition aims to develop sample-efficient RL methods using human demonstrations.
problem Exponential increase in samples needed for reinforcement learning.
method Develop sample-efficient algorithms using human demonstrations.
result Introduction of MineRL ObtainDiamond task and MineRL-v0 dataset.
Predicts user next location using CDR data.
problem Predicting user's next location using CDR data.
method Data processing framework with deep neural network model.
result Error of prediction decreased from 74% to 55%.
AI-Interpret transforms opaque policies into simple, interpretable decision rules.
problem Designing effective decision aids for professionals to mitigate decision-making biases.
method Combining imitation learning, program induction, and clustering to transform learned policies into interpretable descriptions.
result Providing interpretable decision rules as flowcharts significantly improves people's planning strategies and decisions.
DPN combines model-based and model-free reinforcement learning for efficient planning.
problem Efficiently plan actions in reinforcement learning environments.
method Combines model-based and model-free reinforcement learning, dynamically constructing plans using a learned state-transition model.
result Reduces the number of state transitions during planning by up to 96%, improving data efficiency and performance.