A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
We present new algorithms for computing and approximating bisimulation metrics in Markov Decision Processes (MDPs). Bisimulation metrics are an elegant formalism that capture behavioral equivalence between states and provide strong theoretical guarantees on differences in optimal behaviour. Unfortunately, their computa…
Enhances RL in partially observable, noisy environments by uncovering causal states.
problem Making decisions based on incomplete and noisy observations in partially observable Markov decision processes (P2OMDPs).
method Causal State Representation under Asynchronous Diffusion Model (CaDiff) framework, incorporating a novel asynchronous diffusion model (ADM) and a new bisimulation metric.
result Enhances returns by at least 14.18% compared to baselines on Roboschool tasks.
CEA augments reinforcement learning by generating counterfactual experiences.
problem Challenges in reinforcement learning, especially out-of-distribution and inefficient exploration.
method CEA uses variational autoencoders to model state transitions and introduces randomness for non-stationarity. It expands learning data through counterfactual inference.
result CEA outperforms SOTA algorithms in diverse environments.
Many reinforcement learning (RL) tasks provide the agent with high-dimensional observations that can be simplified into low-dimensional continuous states. To formalize this process, we introduce the concept of a DeepMDP, a parameterized latent space model that is trained via the minimization of two tractable losses: pr…
The paper proposes a principle for dynamically adjusting the granularity of reinforcement learning abstractions.
problem Lack of general principles for dynamically adjusting the granularity of reinforcement learning abstractions.
method The paper proposes a principle based on rate-distortion theory, formalized through a performance certificate decomposing value error into learning and abstraction error bounds.
result Soft state-action abstractions can achieve near-optimal performance under substantial lossy compression of state and action information.
Many dynamical systems exhibit similar structure, as often captured by hand-designed simplified models that can be used for analysis and control. We develop a method for learning to correspond pairs of dynamical systems via a learned latent dynamical system. Given trajectory data from two dynamical systems, we learn a …
Intelligent agents can cope with sensory-rich environments by learning task-agnostic state abstractions. In this paper, we propose an algorithm to approximate causal states, which are the coarsest partition of the joint history of actions and observations in partially-observable Markov decision processes (POMDP). Our m…
In this work we present a novel approach for transfer-guided exploration in reinforcement learning that is inspired by the human tendency to leverage experiences from similar encounters in the past while navigating a new task. Given an optimal policy in a related task-environment, we show that its bisimulation distance…
In this essay, we study the sufficient and necessary conditions for a Randers metrc to be of constant Ricci curvature without the restriction of strong convexity (regularity). The classification result for the case ∥β∥α>1 is provided, which is similar to the famous Bao-Robles-Shen's result for strongly convex Rand…
We prove the equivalences of several classical complete metrics on the Teichmüller and the moduli spaces of Riemann surfaces. We use as bridge two new Kähler metrics, the Ricci metric and the perturbed Ricci metric and prove that the perturbed Ricci metric is a complete Kähler metric with bounded negative holomorphic s…
We consider geometries on the space of Riemannian metrics conformally equivalent to the widely studied Ebin L^2 metric. Among these we characterize a distinguished metric that can be regarded as a generalization of Calabi's metric on the space of Kähler metrics to the space of Riemannian metrics, and we study its geome…
We study the geodesic equation for the Dirichlet (gradient) metric in the space of Kaehler potentials. We first solve the initial value problem for the geodesic equation of the combination metric, including the gradient metric. We then discuss a comparison theorem between it and the Calabi metric. As geometric motivati…
The study examines Lee metrics on groups and their properties.
problem Characterizing groups that admit Lee metrics.
method Analyzing conditions for groups to have or not have Lee metrics, studying specific families of groups, and providing tables for groups of order ≤ 31.
result Conditions for groups to have Lee metrics, including specific families and non-cyclic groups.
In this paper, we study an important class of Finsler metrics--square metrics. We give two expressions of such metrics in terms of a Riemannian metric and a 1-form. We show that Einstein square metrics can be classified up to the classification of Einstein Riemannian metrics.
The current paper deals with some new classes of Finsler metrics with reversible geodesics. We construct weighted quasi-metrics associated with these metrics. Further, we investigate some important geometric properties of weighted quasi-metric space. Finally, we discuss the embedding of quasi-metric spaces with general…
Douglas metrics are metrics with vanishing Douglas curvature which is an important projective invariant in Finsler geometry. To find more Douglas metrics, in this paper we consider a class of Finsler metrics called general (α,β)-metrics, which are defined by a Riemannian metric α=aij(x)yiyj and a 1-fo…
In this paper, we introduce the notion of Einstein-reversibility for Finsler met- rics. We study a class of p-power Finsler metrics determined by a Riemann metric and 1-form which are of Einstein-reversibility. It shows that such a class of Finsler metrics of Einstein-reversibility are always Einstein metrics. In parti…
In this paper, we give two classes of positive semi-definite metrics on 2-manifolds. The one is called a class of Kossowski metrics and the other is called a class of Whitney metrics: The pull-back metrics of wave fronts which admit only cuspidal edges and swallowtails in R3 are Kossowski metrics, and t…
In this paper, we study generalized Douglas-Weyl (α,β)-metrics. Suppose that an regular (α,β)-metric F is not of Randers type. We prove that F is a generalized Douglas-Weyl metric with vanishing S-curvature if and only if it is a Berwald metric. Moreover by ignoring the regularity, if F is not a Berwald met…
This is the author's Ph.D. thesis, submitted to the University of Leipzig. It deals with the L2 Riemannian metric on the manifold of all smooth Riemannian metrics on a fixed closed, finite-dimensional manifold. The main body of the thesis is a description of the completion manifold of metrics with respect to the $L^…