Deep RL policies can leak private information from trained policies.
problem Privacy leakage in deep reinforcement learning models.
method Environment dynamics search via genetic algorithm and candidate inference based on shadow policies.
result 95.83% average recovery rate of floor plans from trained Grid World navigation DRL agents.
The study uses machine learning to analyze office floor plans and predict function based on geometry.
problem Lack of formalisms to describe spatial affordance in automated floor-plan generation tools.
method Supervised and unsupervised data mining techniques, including J48 algorithm, were used to analyze office floor plans.
result J48 algorithm can predict class performance on unseen examples up to 79.5% for office dataset.
DualSMC combines filtering and planning for continuous POMDPs.
problem Handling multi-modal state distributions and uncertainty in continuous POMDPs.
method DualSMC network that combines SMC for filtering and planning, with adversarial particle filter and uncertainty-dependent policy.
result DualSMC effectively handles complex observations and remains interpretable.
The paper uses Bayesian Surprise to identify unexpected structures in indoor environments.
problem Identifying unexpected structures in indoor environments.
method Bayesian Surprise applied to Isovist Analysis of 2D floor plans.
result Surprise regions in indoor environments can be used to focus on important areas in LBS.
Study proposes explainable analytics for manufacturing process planning.
problem Improving data-driven decision-making in manufacturing.
method Combines process mining, machine learning, and XAI. Uses deep learning for prediction and Shapley values/ICE plots for explanations.
result Enhanced decision-making capabilities through local post-hoc explanations.
EdgeLite detects hazardous supermarket floors, improving safety.
problem Detecting hazardous conditions on supermarket floors to prevent injuries.
method Developed a lightweight deep learning model, EdgeLite, for edge devices.
result EdgeLite outperformed state-of-the-art models in detecting hazards on supermarket floors.
Optimizes pension fund strategies considering age-dependent risk preferences.
problem Maximizing utility of future consumption and wealth in DC pension plans.
method Solves optimal consumption and investment policies using Black-Scholes framework and HARA utility functions.
result Only extended model with time-varying preference parameters provides adequate fit for real-life data.
This work clarifies the role of inference types in planning.
problem Lack of consistency in using inference types for planning.
method Variational framework and loopy belief propagation.
result All inference types correspond to different weights in variational problems.
TASID learns policies in high-dimensional settings with abstract simulator knowledge.
problem RL in high-dimensional settings with limited observation knowledge.
method TASID algorithm for transfer RL from abstract simulator with bounded perturbations.
result Sample complexity polynomial in horizon, independent of number of states.
We aim to reduce the burden of programming and deploying autonomous systems to work in concert with people in time-critical domains, such as military field operations and disaster response. Deployment plans for these operations are frequently negotiated on-the-fly by teams of human planners. A human operator then trans…
In this paper, we propose hybrid building/floor classification and floor-level two-dimensional location coordinates regression using a single-input and multi-output (SIMO) deep neural network (DNN) for large-scale indoor localization based on Wi-Fi fingerprinting. The proposed scheme exploits the different nature of th…
One of the key technologies for future large-scale location-aware services covering a complex of multi-story buildings --- e.g., a big shopping mall and a university campus --- is a scalable indoor localization technique. In this paper, we report the current status of our investigation on the use of deep neural network…
Paper proposes a graph model for optimal AP deployment in indoor optical wireless networks.
problem Challenges in deploying optical wireless networks due to LoS requirement and limited range.
method Graph modeling approach to identify minimum number of APs and their optimal locations.
result Optimal deployment of APs ensures connectivity and minimizes interference in indoor environments.
Trading floors need to be twice as deep as electronic markets to compete.
problem Informed traders prefer fast electronic markets over slow trading floors.
method Examined the performance of trading floors and electronic markets in a hybrid system.
result Trading floors need to be twice as deep as electronic markets to compete.
Unified framework for planning under uncertainty using variational inference.
problem Planning under uncertainty with separate objectives for exploration and exploitation.
method Variational inference on a generative model augmented with priors.
result EFE-based planning emerges as variational inference, enabling scalable, resource-aware policies.
EBMs improve sample efficiency and generalization in RL.
problem Improving sample efficiency and generalization in reinforcement learning.
method Developed an online algorithm to train EBMs for model-based planning, leveraging their ability to infer intermediate states.
result EBMs lead to significantly better online learning and state space planning compared to feed-forward networks.
Unified approach to path planning using probabilistic inference on factor graphs.
problem Path planning problems using probabilistic inference.
method Unified framework using probabilistic factor graphs and message composition rules.
result Unified approach includes various algorithms like Sum-product, Max-product, Dynamic programming, and mixed criteria.
This paper studies when particle filtering is efficient for planning in partially observed systems.
problem The efficiency of particle filtering for planning in partially observed linear dynamical systems.
method Coupling of ideal and approximate sequences to bound particle complexity.
result Polynomially many particles suffice for stable systems to approximate optimal planning.
Learning and inference movement is a very challenging problem due to its high dimensionality and dependency to varied environments or tasks. In this paper, we propose an effective probabilistic method for learning and inference of basic movements. The motion planning problem is formulated as learning on a directed grap…
A framework for cost of belief revision in uncertain agents.
problem Cost of revising beliefs in uncertain agents.
method Axiomatic framework for transport-based belief costs, postulates P0 and P1.
result Cost metric is conformally reweighted by Fisher information, leading to a cost floor diverging at certainty.
Enhances PlaNet for better planning in uncertain environments.
problem Improving deep planning networks for partially observable environments.
method Incorporates Bayesian inference to handle uncertainty in latent models and action candidates.
result Consistently improves asymptotic performance on continuous control tasks.
CriticSMC improves planning efficiency in constrained environments.
problem Planning with hard constraints in dynamic environments.
method Sequential Monte Carlo with learned heuristic factors.
result CriticSMC reduces collision rates with low computational cost.
Improved analysis for fair federated learning reduces dependence on noise floor.
problem Asymptotic stationarity in group fair federated learning with reduced noise floor dependence.
method DS FedProxGrad framework with inexact local proximal solutions and fairness regularization.
result Algorithm converges asymptotically to stationarity without dependence on a noise floor.
We present a representation learning algorithm that learns a low-dimensional latent dynamical system from high-dimensional \textit{sequential} raw data, e.g., video. The framework builds upon recent advances in amortized inference methods that use both an inference network and a refinement procedure to output samples f…
In this paper we consider three types of embedded options in pension benefit design. The first is the Florida second election (FSE) option, offered to public employees in the state of Florida in 2002. Employees were given the option to convert from a defined contribution (DC) plan to a defined benefit (DB) plan at a ti…
We study the portfolio selection problem of a long-run investor who is maximising the asymptotic growth rate of her expected utility. We show that, somewhat surprisingly, it is essentially not affected by introduction of a floor constraint which requires the wealth process to dominate a given benchmark at all times. We…
Consider an agent who enters a financial market on day t = 0 with an initial capital amount x. He invests this amount on stocks and the money market, and by day t = T, has generated a wealth W . He is given a convex class of probability measures (called scenarios) and a real-valued function (or floors) corresponding to…
Bayesian approach to optimal transport with stochastic costs.
problem Inferring optimal transport plans with uncertain costs.
method Bayesian framework and Hamiltonian Monte Carlo (HMC) sampling.
result Inference of optimal transport plans under stochastic cost functions.
A new method for multi-agent planning on graphs outperforms existing approaches.
problem Planning coordination among multiple interacting agents on a graph.
method Variational perturbation theory applied to inference in large networks.
result Our method outperforms state-of-the-art methods in non-local cost function scenarios.
The paper uses deep learning to speed up spatial and visual connectivity analysis.
problem Slow calculation of spatial and visual connectivity metrics.
method Investigates machine learning models and a pipeline for training them on spatial and visual connectivity analysis.
result Deep learning models significantly speed up the analysis process.
The computational costs of inference and planning have confined Bayesian model-based reinforcement learning to one of two dismal fates: powerful Bayes-adaptive planning but only for simplistic models, or powerful, Bayesian non-parametric models but using simple, myopic planning strategies such as Thompson sampling. We …
The paper develops a theory for random forests, separating variance components and providing methods for estimating prediction intervals.
problem Understanding the variance and uncertainty in random forest predictions.
method Design-based theory, Monte Carlo averaging, PASR resampling.
result The floor of prediction uncertainty is positive and persists even without observation overlap, providing conservative prediction intervals.
We present novel empirical observations regarding how stochastic gradient descent (SGD) navigates the loss landscape of over-parametrized deep neural networks (DNNs). These observations expose the qualitatively different roles of learning rate and batch-size in DNN optimization and generalization. Specifically we study…
Automates infectious disease policy-making via inference in epidemiological models.
problem Improving policy-making for infectious diseases during pandemics.
method Performing inference in existing epidemiological models using a probabilistic programming language.
result Automated inference leads to better disease progression outcomes and policy prescriptions.
New method combines heuristics and search techniques to speed up cooperative planning for autonomous vehicles.
problem Efficient cooperative planning for autonomous vehicles in complex traffic scenarios.
method Combining learned heuristics with Monte Carlo Tree Search (MCTS) to guide search towards promising actions.
result Better solutions at lower computational costs achieved through accelerated planning.
A key challenge in complex visuomotor control is learning abstract representations that are effective for specifying goals, planning, and generalization. To this end, we introduce universal planning networks (UPN). UPNs embed differentiable planning within a goal-directed policy. This planning computation unrolls a for…
Unified reinforcement learning methods using hybrid inference.
problem Combining model-based and model-free reinforcement learning approaches.
method Control as Hybrid Inference (CHI) framework.
result CHI algorithm balances model-based and model-free learning.
Planning has been very successful for control tasks with known environment dynamics. To leverage planning in unknown environments, the agent needs to learn the dynamics from interactions with the world. However, learning dynamics models that are accurate enough for planning has been a long-standing challenge, especiall…
Algorithm speeds up search for stationary targets with guaranteed accuracy.
problem Minimize search time while ensuring high detection accuracy of stationary targets.
method Multi-fidelity Gaussian process model and EMTS algorithm.
result Guaranteed performance in target detection accuracy and search time.
We determine the price of digital double barrier options with an arbitrary number of barrier periods in the Black-Scholes model. This means that the barriers are active during some time intervals, but are switched off in between. As an application, we calculate the value of a structure floor for structured notes whose …
Enhances ocean floor mapping with adaptive uncertainty estimates.
problem Inaccurate bathymetric data for precise ocean modeling.
method Block-based conformal prediction with VQ-VAE architecture.
result Significant improvements in reconstruction quality and uncertainty estimation reliability.
Agents learn state ambiguity from non-linear sensor data using Gaussian approximations.
problem Learning state representation from non-linear sensor data.
method Second-order Taylor approximation of Gaussian distribution for non-linear measurement functions.
result Induces a preference for states based on inferability from observations.
PLANS synthesizes programs from noisy inputs using neural specs and filtering.
problem Synthesizing robust programs from noisy, raw inputs.
method Hybrid model combining neural extraction and rule-based synthesis with noise filtering.
result State-of-the-art performance in diverse environments with no ground-truth training.
This paper builds a model to predict the long-term future in reinforcement learning.
problem Catastrophic failures due to flawed long-term predictions in reinforcement learning models.
method The authors develop a latent-variable autoregressive model using variational inference to incorporate future information.
result The model achieves higher rewards faster than baselines on various tasks and environments.
Develops a new framework for perpetual futures on binary prediction markets.
problem Lack of effective risk management in perpetual futures on binary prediction markets.
method PIRAP framework with six components: index estimator, margin sizing, leverage, funding rule, halt protocol, and eligibility framework.
result Mixed results from empirical evaluation, with some pre-registered floors passing and others failing.
Deep learning enhances active inference for dynamic state spaces.
problem Limited applicability of active inference to continuous state spaces.
method Use of deep learning to approximate probability distributions for active inference.
result Active inference can be applied to continuous state spaces.
E2C separates planning and execution in LLMs, improving efficiency and performance.
problem Entangled planning and execution in LLMs waste tokens and limit flexibility.
method E2C splits exploration and execution phases, using SFT and RL for training.
result E2C achieves 53.3% accuracy on AIME'2024 with 12.4k tokens, outperforming alternatives.
A training-free conformal interval is a mandatory baseline for probabilistic time-series forecasting.
problem Comparing probabilistic forecasters against weak or omitted baselines.
method A simple conformal interval with no parameters and no training.
result The ConformalNaive interval decisively beats several baselines.