A model learns object representations for physical scene understanding without direct supervision.
problem Learning object-centric representations without direct supervision of object properties.
method Object-Oriented Prediction and Planning (O2P2) model that learns perception, physics interaction, and rendering functions.
result The model can predict physical interactions and build block towers more complex than those seen during training.
MAOP learns object dynamics from raw visual data.
problem Efficient learning of dynamics from raw visual data for multiple objects.
method Three-level learning architecture with spatial-temporal relational reasoning.
result Significantly outperforms previous methods in sample efficiency and generalization.
Unified method for managing dynamic power flows using convex optimization.
problem Optimizing power flows in networks over time.
method Unified method based on convex optimization, including model predictive control and handling uncertainty.
result Developed a real-time control strategy for dynamic power flows.
Agents use object-oriented reasoning to solve problems more quickly.
problem Finding solutions to problems more efficiently.
method Hierarchical controller directs low-level agent to simulate alternate states of the world.
result Achieves similar reward levels as non-hierarchical agents but with better data efficiency.
OGRePy simplifies tensor calculations in general relativity.
problem Complex tensor calculations in general relativity.
method Object-oriented Python package for symbolic tensor calculations.
result Reproduces functionality of Mathematica package OGRe with improvements.
OGRe simplifies tensor calculations in general relativity.
problem Complex tensor calculations in general relativity.
method Object-oriented design for tensor calculus, automatic transformations, and optimized algorithms.
result Eliminates user errors and simplifies tensor calculations.
This work tackles long-term visual planning by goal-conditioned hierarchical predictors.
problem Current learning approaches fail on long-horizon tasks due to lack of goal information and coarse-to-fine planning.
method Formulate goal-conditioned predictors (GCPs) and hierarchical models to predict trajectories between observations.
result GCPs enable effective long-term planning with much longer horizons than before.
Knowledge-based planning (KBP) is an automated approach to radiation therapy treatment planning that involves predicting desirable treatment plans before they are then corrected to deliverable ones. We propose a generative adversarial network (GAN) approach for predicting desirable 3D dose distributions that eschews th…
Enhanced route planning with probabilistic prediction and uncertainty sets.
problem Improving route planning reliability under uncertainty.
method CQR-GAE model integrating conformal prediction and uncertainty sets.
result Significantly outperforms baseline methods in real-world traffic scenarios.
SPACE models complex scenes by decomposing objects and backgrounds.
problem Scalability and unsupervised object-oriented scene representation learning.
method Generative latent variable model combining spatial-attention and scene-mixture approaches.
result SPACE achieves factorized object representations and decomposes complex scenes.
Over the past decade, contextual bandit algorithms have been gaining in popularity due to their effectiveness and flexibility in solving sequential decision problems---from online advertising and finance to clinical trial design and personalized medicine. At the same time, there are, as of yet, surprisingly few options…
New method combines heuristics and search techniques to speed up cooperative planning for autonomous vehicles.
problem Efficient cooperative planning for autonomous vehicles in complex traffic scenarios.
method Combining learned heuristics with Monte Carlo Tree Search (MCTS) to guide search towards promising actions.
result Better solutions at lower computational costs achieved through accelerated planning.
Selective planning with imperfect models reduces harmful effects of model inadequacy.
problem Harmful effects of using an imperfect model in reinforcement learning.
method Selective planning with heteroscedastic regression to estimate predictive uncertainty from model inadequacy.
result Effective selective planning requires considering both parameter uncertainty and model inadequacy.
Deep learning improves trip prediction accuracy in transportation planning.
problem Traditional models fail to accurately predict person and vehicle trips due to complexity and dynamics.
method Developed and trained a deep learning model using NHTS data.
result Deep learning model achieved 98% accuracy for person trip prediction and 96% for vehicle trip estimation.
Proposes a framework for automated radiation therapy treatment planning with uncertainty quantification.
problem Quantifying uncertainties in dose-related quantities for automated treatment planning.
method Three-step pipeline: feature extraction, dose statistic prediction, and dose mimicking.
result Probabilistic treatment plans agree better with clinical counterparts than non-probabilistic ones.
End-to-end learnable network for safer self-driving with interpretable intermediate representations.
problem Safe motion planning for self-driving vehicles.
method Differentiable semantic occupancy representation for cost calculation in motion planning.
result Significantly outperforms state-of-the-art planners in imitating human behaviors and producing safer trajectories.
The paper proposes a fast method to predict tactical solutions to operational problems under imperfect information.
problem Predicting tactical solutions to operational planning problems under imperfect information.
method Formulated as a two-stage optimal prediction stochastic program, solved with a supervised machine learning algorithm using training data from deterministic problems.
result Deep learning algorithms produce highly accurate predictions in very short computing time (milliseconds or less).
New ML approach predicts glare in open-plan offices with high accuracy.
problem Challenging to predict discomfort glare in open-plan offices.
method Used Machine Learning algorithms to predict glare.
result ML model achieved 83.8% accuracy in predicting glare.
Proposes learning latent reward model for planning from rewards.
problem Planning in high-dimensional state spaces with limited reward information.
method Directly learns a latent dynamics model from rewards, planning in latent state-space.
result Successfully learns accurate latent reward prediction model, achieving strong performance and high sample efficiency.
DoubleML is a Python library for causal inference using machine learning.
problem Estimating causal parameters in complex models with machine learning.
method Double machine learning framework for valid statistical inference.
result High flexibility and easy extension for various model specifications.
Agents compose pre-trained policies for complex tasks, improving zero-shot performance.
problem Challenges in long-horizon predictions and estimating visitation distributions induced by policy sequences.
method Learn predictive jumpy world models of multi-step dynamics, enhancing predictions with a consistency objective.
result Compositional planning with jumpy world models yields, on average, a 200% relative improvement over primitive actions on long-horizon tasks.
In this paper, we focus on developing efficient sensitivity analysis methods for a computationally expensive objective function f(x) in the case that the minimization of it has just been performed. Here "computationally expensive" means that each of its evaluation takes significant amount of time, and therefore our m…
Designs a framework to transfer causal models between similar environments.
problem Transferability of causal models between different but similar environments.
method Object-oriented representations and continuous optimization for structure learning.
result Demonstrates advantages in gridworld settings using reinforcement learning.
This paper proposes a real-time signal plan recommendation system for traffic incidents.
problem Limited effectiveness of traffic incident management due to late response and workload.
method Decomposes recommendation task into real-time traffic prediction and plan association, learning from historical data and metric learning.
result Precision score of 96.75% and recall of 87.5% on testing plan, with 22.5 minutes lead time ahead of Waze alerts.
Deep network predicts action sequences for complex tasks from a scene image.
problem Scalable task and motion planning from initial scene images.
method Deep convolutional recurrent neural network that predicts action sequences.
result Predicts promising action sequences, reducing motion planning problems.
Hierarchical Foresight improves robot vision tasks by planning long-term goals.
problem Compounding uncertainty and scalability issues in long horizon video prediction.
method Subgoal generation and planning using hierarchical visual foresight (HVF).
result Achieves nearly 200% performance improvement in vision-based manipulation tasks.
The paper explores how planning with models improves credit assignment in reinforcement learning.
problem Improving credit assignment in reinforcement learning.
method Investigates the use of forward and backward models for planning in reinforcement learning.
result Establishes the relative merits and limitations of forward and backward planning mechanisms.
One-shot path planning for multiple agents using neural networks.
problem Efficiently generating optimal or near-optimal paths for multiple agents in robotics.
method Utilizes fully convolutional neural networks for one-shot multi-agent path planning.
result Demonstrates successful generation of optimal or near-optimal paths in over 85% of cases for multi-path planning.
Proposes a generic prediction architecture for autonomous vehicles considering both rational and irrational driving behaviors.
problem Accurately predicting future behaviors of surrounding vehicles for safe autonomous vehicle planning.
method Combines learning-based and planning-based models to address rationalities in human behavior.
result Stable prediction performance under various unseen driving scenarios.
We introduce the value iteration network (VIN): a fully differentiable neural network with a `planning module' embedded within. VINs can learn to plan, and are suitable for predicting outcomes that involve planning-based reasoning, such as policies for reinforcement learning. Key to our approach is a novel differentiab…
SCALOR learns scalable object representations for crowded scenes.
problem Scalability in scenes with many objects.
method Spatially-parallel attention and proposal-rejection mechanisms.
result SCALOR can handle up to a hundred objects in crowded scenes.
Study shows GDP and CPI predict CCC funding, highlighting need for economic forecasting.
problem Challenges in aligning CCC funding with DEI initiatives.
method Quantitative correlational design, analyzing 30 years of economic data.
result Strong positive correlation between GDP growth and CCC funding levels, and between CPI and funding levels.
This work improves AI's ability to solve physical tasks by optimizing world models in abstracted spaces.
problem Developing AI agents capable of solving diverse physical tasks and generalizing to new environments.
method Investigates and optimizes a family of joint-embedding predictive world models (JEPA-WMs) for efficient planning in abstracted spaces.
result Proposes a model that outperforms two established baselines in both navigation and manipulation tasks.
POPLIN improves model-based planning in complex environments.
problem Efficient planning in complex high-dimensional environments.
method Combines policy networks with online planning, optimizing parameters directly.
result POPLIN achieves state-of-the-art performance in MuJoCo benchmarks, 3x more sample efficient.
New stock valuation measure improves retirement planning predictions.
problem Improving accuracy of stock market predictions for retirement planning.
method Generalized CAPE model with detrending, treating earnings growth as exogenous.
result Long-run total returns equal earnings growth plus 4.6%.
Safe autonomous decisions made with machine learning predictions using Conformal Decision Theory.
problem Safe decisions from imperfect machine learning predictions.
method Conformal Decision Theory framework for producing safe decisions.
result Safe decisions with provable statistical guarantees of low risk.
Language models predict inorganic synthesis conditions and temperatures.
problem Limited data and heuristic approaches constrain inorganic synthesis planning.
method Language models without fine-tuning predict precursor conditions and temperatures.
result Language models achieve high accuracy in predicting synthesis conditions and temperatures.
This paper builds a model to predict the long-term future in reinforcement learning.
problem Catastrophic failures due to flawed long-term predictions in reinforcement learning models.
method The authors develop a latent-variable autoregressive model using variational inference to incorporate future information.
result The model achieves higher rewards faster than baselines on various tasks and environments.
DoubleML implements machine learning for causal inference in R.
problem Estimating causal effects in regression models with high-dimensional data.
method Double machine learning framework with Neyman orthogonality and sample splitting.
result Valid inference on causal parameters using machine learning methods.
ODTLearn learns optimal decision trees for predictive and prescriptive tasks.
problem Learning optimal decision trees for high-stakes predictive and prescriptive tasks.
method Mixed-integer optimization framework and object-oriented design.
result Implementation of optimal decision trees for various tasks.
MultiPath predicts multi-modal future trajectories for better motion planning.
problem Predicting human behavior in uncertain real-world domains like autonomous driving.
method Leverages fixed future state-sequence anchors and regresses offsets with uncertainties.
result Achieves more accurate predictions with an order of magnitude fewer trajectories.
CoTj improves diffusion model quality and stability via graph planning.
problem Rigidity in diffusion models due to high-dimensional state space.
method Chain-of-Trajectories (CoTj) framework using Diffusion DNA for graph planning.
result CoTj discovers context-aware trajectories improving output quality and stability.
Study improves traffic prediction intervals for minor roads.
problem Uncertainty in traffic data for underrepresented minor roads.
method Quantile Random Forest with PCA for interval prediction.
result Achieved 88.22% interval coverage and Winkler Score of 7,468.47.
Planning has been very successful for control tasks with known environment dynamics. To leverage planning in unknown environments, the agent needs to learn the dynamics from interactions with the world. However, learning dynamics models that are accurate enough for planning has been a long-standing challenge, especiall…
Neural A* uses machine learning to improve path planning efficiency.
problem Challenges in applying machine learning to search-based path planning.
method Reformulated A* search as a differentiable network coupled with a convolutional encoder.
result Neural A* outperforms state-of-the-art planners in optimality and efficiency.
New method for predicting paths of unpredictable objects with high confidence.
problem Need for dependable uncertainty estimates in motion planning with diverse unpredictable objects.
method Blend online conformal prediction, multiple time series techniques, and heteroscedasticity addressing.
result Simultaneous forecasting bands that cover entire paths with high probability.
DADS discovers skills with predictable outcomes from unlabeled data.
problem Learning accurate models for complex dynamical systems is difficult and often doesn't generalize well.
method Dynamics-Aware Discovery of Skills (DADS) combines model-based and model-free learning.
result DADS discovers infinitely many behaviors in high-dimensional state-spaces.
This paper calibrates deep reinforcement learning models to improve planning and performance.
problem Inaccurate predictive uncertainties from deep learning systems hinder model-based reinforcement learning.
method Describes a simple method to calibrate uncertainties in model-based reinforcement learning agents.
result Calibrated model-based reinforcement learning agents achieve state-of-the-art performance with fewer samples.