We enhance conformal prediction for risk-averse decisions with action-conditional guarantees.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
We tackle the blackbox issue of deep neural networks in the settings of reinforcement learning (RL) where neural agents learn towards maximizing reward gains in an uncontrollable way. Such learning approach is risky when the interacting environment includes an expanse of state space because it is then almost impossible…
Comma.ai's approach to Artificial Intelligence for self-driving cars is based on an agent that learns to clone driver behaviors and plans maneuvers by simulating future events in the road. This paper illustrates one of our research approaches for driving simulation. One where we learn to simulate. Here we investigate v…
In many vision-based reinforcement learning (RL) problems, the agent controls a movable object in its visual field, e.g., the player's avatar in video games and the robotic arm in visual grasping and manipulation. Leveraging action-conditioned video prediction, we propose an end-to-end learning framework to disentangle…
Learning to control robots directly based on images is a primary challenge in robotics. However, many existing reinforcement learning approaches require iteratively obtaining millions of robot samples to learn a policy, which can take significant time. In this paper, we focus on learning a realistic world model capturi…
The paper proposes an on-line monitoring framework for continuous real-time safety/security in learning-based control systems (specifically application to a unmanned ground vehicle). We monitor validity of mappings from sensor inputs to actuator commands, controller-focused anomaly detection (CFAM), and from actuator c…
Object-based approaches for learning action-conditioned dynamics has demonstrated promise for generalization and interpretability. However, existing approaches suffer from structural limitations and optimization difficulties for common environments with multiple dynamic objects. In this paper, we present a novel self-s…
We introduce Dynamic Planning Networks (DPN), a novel architecture for deep reinforcement learning, that combines model-based and model-free aspects for online planning. Our architecture learns to dynamically construct plans using a learned state-transition model by selecting and traversing between simulated states and…
Predicting movement of objects while the action of learning agent interacts with the dynamics of the scene still remains a key challenge in robotics. We propose a multi-layer Long Short Term Memory (LSTM) autoendocer network that predicts future frames for a robot navigating in a dynamic environment with moving obstacl…
In model-based reinforcement learning, generative and temporal models of environments can be leveraged to boost agent performance, either by tuning the agent's representations during training or via use as part of an explicit planning mechanism. However, their application in practice has been limited to simplistic envi…
KINet learns object interactions without supervision for robotic pushing.
In many online applications interactions between a user and a web-service are organized in a sequential way, e.g., user browsing an e-commerce website. In this setting, recommendation system acts throughout user navigation by showing items. Previous works have addressed this recommendation setup through the task of pre…
Deep neural network learns discrete state abstractions for efficient planning.
DRL agents perform poorly at high decision frequencies, but a new algorithm improves performance.
Endowing robots with human-like physical reasoning abilities remains challenging. We argue that existing methods often disregard spatio-temporal relations and by using Graph Neural Networks (GNNs) that incorporate a relational inductive bias, we can shift the learning process towards exploiting relations. In this work,…
Intelligent agents can learn to represent the action spaces of other agents simply by observing them act. Such representations help agents quickly learn to predict the effects of their own actions on the environment and to plan complex action sequences. In this work, we address the problem of learning an agent's action…
New method optimizes portfolios by dynamically integrating ESG constraints.
Unsupervised representation learning has succeeded with excellent results in many applications. It is an especially powerful tool to learn a good representation of environments with partial or noisy observations. In partially observable domains it is important for the representation to encode a belief state, a sufficie…
For humans, the process of grasping an object relies heavily on rich tactile feedback. Most recent robotic grasping work, however, has been based only on visual input, and thus cannot easily benefit from feedback after initiating contact. In this paper, we investigate how a robot can learn to use tactile information to…
A new method for learning policies from demonstrations without reinforcement.
Optimizes trading policies using future price forecasts.
Dreamer 4 learns Minecraft tasks from videos alone.
Identifies latent actions and dynamics from offline data with diverse demonstrators.
Novel approach to learning models based on subjective timescales for better exploration and decision-making.
Enhances RL in target domains with limited data using augmented return.
Deep learning provides a powerful tool for machine perception when the observations resemble the training data. However, real-world robotic systems must react intelligently to their observations even in unexpected circumstances. This requires a system to reason about its own uncertainty given unfamiliar, out-of-distrib…
UWM-JEPA predicts future scenarios in belief space, improving accuracy in partially observed environments.
Study finds implicit government guarantee improves municipal investment bond ratings.
This paper measures the intensity of implicit government guarantees using PMC index model.
ConfHit provides valid guarantees for generative models without oracle access.
Insurance companies often include very long-term guarantees in participating life insurance products, which can turn out to be very valuable. Under a guaranteed annuity options (G.A.O), the insurer guarantees to convert a policyholder's accumulated funds to a life annuity at a fixed rated when the policy matures. Both …
New model values equity-linked securities with guaranteed return.
Our knowledge about the evolution of guarantee network in downturn period is limited due to the lack of comprehensive data of the whole credit system. Here we analyze the dynamic Chinese guarantee network constructed from a comprehensive bank loan dataset that accounts for nearly 80% total loans in China, during 01/200…
New DP algorithms with margin guarantees for various hypothesis sets.
Two new algorithms recover ridge lines from point clouds with convergence guarantees.
The paper provides theoretical guarantees for optimized sampling in compressed sensing, showing error vanishes with more measurements.
Paper proves robust estimators' generalization guarantees without dimensionality issues.
New algorithms achieve uniform-PAC guarantees for RL with bounded eluder dimension.
New guarantees for adaptive combinatorial maximization with various objectives.
Exact generalization guarantees for robust models using Wasserstein distance are established.
Develops statistical guarantees for neural networks with regularization.
Efficient RNN algorithm guarantees convergence in online learning.
Improves bandits with knapsacks guarantees for partially stochastic workloads.
The paper proves statistical consistency and fairness guarantees for a plug-in algorithm.
Variable annuities, as a class of retirement income products, allow equity market exposure for a policyholder's retirement fund with electable additional guarantees to limit the downside risk of the market. Management fees and guarantee insurance fees are charged respectively for the market exposure and for the protect…
Optimal liquidation using VWAP strategies has been considered in the literature, though never in the presence of permanent market impact and only rarely with execution costs. Moreover, only VWAP strategies have been studied and the pricing of guaranteed VWAP contracts has never been addressed. In this article, we devel…
Reinsurance can help life insurers maintain higher capital guarantees without losing utility.
Paper provides statistical guarantees for GNNs in link prediction.