We aim to construct the optimal solutions to the undiscounted continuous-time infinite horizon optimization problems, the objective functionals of which may be unbounded. We identify the condition under which the limit of the solutions to the finite horizon problems is optimal for the infinite horizon problems under th…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,786 papers · 148 categories
Trend · papers per month
48 results for “horizon problem”
Is Long Horizon Reinforcement Learning More Difficult Than Short Horizon Reinforcement Learning?cs.LG
Long horizon reinforcement learning is as hard as short horizon learning.
problem Understanding the difficulty of long horizon reinforcement learning problems.
method Introduced new concepts: ε-net for optimal policies and Online Trajectory Synthesis algorithm.
result Proved that sample complexity scales logarithmically with the planning horizon, refuting the conjecture.
Proves uniqueness of certain spacetime solutions with extremal horizons.
problem Proving uniqueness of extremal Schwarzschild de Sitter spacetime solutions.
method Analytic proof in four and higher dimensions, spectral problem for hyperbolic surfaces.
result Proves extremal Schwarzschild de Sitter solutions are unique up to identifications.
This paper studies the utility maximization problem with changing time horizons in the incomplete Brownian setting. We first show that the primal value function and the optimal terminal wealth are continuous with respect to the time horizon . Secondly, we exemplify that the expected utility stemming from applying th…
We aim to generalize the results of Cai and Nitta (2007) by allowing both the utility and production function to depend on time. We also consider an additional intertemporal optimality criterion. We clarify the conditions under which the limit of the solutions for the finite horizon problems is optimal among all attain…
Proves conditions for Cauchy horizons in low-regularity spacetimes.
problem Conditions for the existence of Cauchy horizons in spacetimes with low regularity.
method Analyzes the relationship between complete Cauchy hypersurfaces, almost closed causal curves, and points at infinity.
result Wald's conjecture reformulated as a PDE problem about Cauchy horizons.
New insights into black hole horizons from asymptotic expansions.
problem Understanding the geometry of black hole horizons.
method Proving the asymptotic expansion of spacetime metrics at non-degenerate Killing horizons.
result The full asymptotic expansion of smooth vacuum metrics at non-degenerate Killing horizons is determined by the horizon geometry.
Study optimal portfolios in a non-Markovian regime-switching model with random time horizon.
problem Optimal portfolio selection in a market with non-Markovian regime-switching and random time horizon.
method Formulated as a constrained stochastic linear-quadratic optimal control problem, derived closed-form expressions for optimal portfolios and efficient frontier.
result Closed-form expressions for optimal portfolios and efficient frontier derived under non-Markovian regime-switching and random time horizon.
In this paper, we study optimal switching problems under ambiguity. To characterize the optimal switching under ambiguity in the finite horizon, we use multidimensional reflected backward stochastic differential equations (multidimensional RBSDEs) and show that a value function of the optimal switching under ambiguity …
We study the problem of stability and instability of extreme Reissner-Nordstrom spacetimes for linear scalar perturbations. Specifically, we consider solutions to the linear wave equation on a suitable globally hyperbolic subset of such a spacetime, arising from regular initial data prescribed on a Cauchy hypersurface …
This paper solves the consumption-investment problem under Epstein-Zin preferences on a random horizon. In an incomplete market, we take the random horizon to be a stopping time adapted to the market filtration, generated by all observable, but not necessarily tradable, state processes. Contrary to prior studies, we do…
Study optimal liquidation strategies with infinite horizon and regime switching.
problem Optimal liquidation with semimartingale strategies in a stochastic environment.
method Characterization of value function and optimal strategy via BSDEs with infinite horizon.
result Existence and uniqueness of optimal control problem solutions.
Careful tuning of the learning rate, or even schedules thereof, can be crucial to effective neural net training. There has been much recent interest in gradient-based meta-optimization, where one tunes hyperparameters, or even learns an optimizer, in order to minimize the expected loss when the training procedure is un…
Optimizes investment under uncertain time horizons with non-concave utility.
problem Optimizing investment decisions with non-concave utility and uncertain time horizons.
method Established necessary and sufficient conditions for optimality, suggested recursive procedure for non-concave utility.
result Optimal investment strategies under uncertain time horizons exhibit multimodal distribution, indicating flexibility in switching between local maximizers.
A new ML algorithm solves complex economic control problems.
problem Solving high-dimensional, finite-horizon stochastic control problems in economics.
method Deep neural network representation of optimal policy functions with three key features.
result Efficiently solves various economic control problems including recursive utility and growth models.
We present a new infinite class of near-horizon geometries of degenerate horizons, satisfying Einstein's equations for all odd dimensions greater than five. The symmetry and topology of these solutions is compatible with those of black holes. The simplest examples give horizons of spatial topology S^3xS^2 or the non-tr…
Solves infinite horizon portfolio problem with path-dependent labor income.
problem Infinite horizon portfolio choice with path-dependent labor income.
method Solves an infinite dimensional stochastic optimal control problem using explicit solutions to the HJB equation.
result Explicit solutions to the optimal controls in feedback form are found.
Flexible forward improvement iteration for infinite time horizon Markovian optimal stopping problemsmath.PR
Improved algorithm for optimal stopping problems reduces runtime.
problem Optimal stopping problems with infinite time horizon and random discounting.
method Flexible forward improvement iteration with a variable look-ahead distance.
result The new algorithm converges and can significantly reduce runtime.
We consider solutions to the linear wave equation on a suitable globally hyperbolic subset of an extreme Reissner-Nordstrom spacetime, arising from regular initial data prescribed on a Cauchy hypersurface crossing the future event horizon. We obtain boundedness, decay, non-decay and blow-up results. Our estimates hold …
Paper solves Bayesian bandit problem with continuous-time limit and approximate policy.
problem Finding optimal policy in Bayesian bandit problems with large horizons.
method Reformulates Bayesian bandit problem as continuous Hamilton-Jacobi-Bellman (HJB) equation and proposes approximate Bayes-optimal policy.
result Approximate Bayes-optimal policy for large horizons with constant computational cost.
We consider the off-policy estimation problem of estimating the expected reward of a target policy using samples collected by a different behavior policy. Importance sampling (IS) has been a key technique to derive (nearly) unbiased estimators, but is known to suffer from an excessively high variance in long-horizon pr…
In this paper, we investigate dynamic optimization problems featuring both stochastic control and optimal stopping in a finite time horizon. The paper aims to develop new methodologies, which are significantly different from those of mixed dynamic optimal control and stopping problems in the existing literature, to stu…
Minimal surfaces connect to horizons and electrostatic systems.
problem Connecting minimal surfaces to horizons and electrostatic systems.
method One-parameter min-max problem for area functional, inequality relating area and charge.
result Minimal surfaces of index one are related to unstable horizons in electrostatic systems.
State-of-the-art forecasting methods using Recurrent Neural Net- works (RNN) based on Long-Short Term Memory (LSTM) cells have shown exceptional performance targeting short-horizon forecasts, e.g given a set of predictor features, forecast a target value for the next few time steps in the future. However, in many appli…
Heterotic horizons preserving 4 supersymmetries have sections which are T^2 fibrations over 6-dimensional conformally balanced Hermitian manifolds. We give new examples of horizons with sections S^3 X S^3 X T^2 and SU(3). We then examine the heterotic horizons which are T^4 fibrations over a Kahler 4-dimensional manifo…
Paper proves existence of anisotropic dynamical horizons in gravitational collapse.
problem Existence of apparent horizons in gravitational collapse.
method Scale-critical hyperbolic method and non-perturbative elliptic techniques.
result Smooth and spacelike apparent horizons emerge from general initial data in gravitational collapse.
New approach confirms Kruskal-Szekeres extension for Schwarzschild spacetime.
problem Confirming the Kruskal-Szekeres extension for Schwarzschild spacetime.
method Reformulating the problem as an ODE and showing the ODE admits a solution if and only if the horizon is non-degenerate.
result Photon surfaces approaching the Killing horizon must necessarily cross it.
The study classifies compact Cauchy horizons in vacuum spacetimes.
problem Classifying compact Cauchy horizons in vacuum spacetimes.
method Complete classification theorem based on topology and null generators.
result Different cases of compact Cauchy horizons with specific manifolds and spacetime properties.
Solves expert prediction problem for 4 experts in finite time horizon.
problem Expert prediction problem in finite horizon with 4 experts.
method Solves nonlinear PDE, shows solution, proves Nash equilibrium and regret conjectures.
result Proves Finite vs Geometric regret conjecture for and shows comb strategies are optimal.
Two new algorithms improve model-free RL for infinite-horizon MDPs.
problem Learning in infinite-horizon average-reward MDPs.
method Two model-free algorithms for infinite-horizon average-reward MDPs.
result Improved regret bounds for model-free RL in MDPs.
The Infinite Horizon Investment-Consumption Problem for Epstein-Zin Stochastic Differential Utilityq-fin.MF
Investment and consumption strategy for risk-averse agents with Epstein-Zin utility.
problem Optimal investment and consumption strategy for Epstein-Zin utility.
method Detailed introduction to Epstein-Zin utility, existence and uniqueness proof, verification argument.
result Existence and uniqueness of optimal solution for Epstein-Zin utility under certain parameter restrictions.
UCRL-WVTR tackles long-term reinforcement learning with general approximations, achieving horizon-free and instance-dependent regret bounds.
problem Long-term reinforcement learning with general function approximations.
method UCRL-WVTR proposes a novel algorithm, UCRL-WVTR, with weighted value-targeted regression and a high-order moment estimator.
result Achieves horizon-free and instance-dependent regret bounds matching minimax lower bounds up to logarithmic factors.
Study of marginally trapped surfaces in a perturbed Schwarzschild spacetime.
problem Understanding marginally trapped surfaces in perturbed Schwarzschild spacetime.
method Developed a method to study spacelike surfaces in a double null coordinate system.
result For every incoming null hypersurface nearly spherically symmetric, there exists a unique embedded marginally trapped surface.
In this paper we present Horizon, Facebook's open source applied reinforcement learning (RL) platform. Horizon is an end-to-end platform designed to solve industry applied RL problems where datasets are large (millions to billions of observations), the feedback loop is slow (vs. a simulator), and experiments must be do…
This review tackles long horizon forecasting in time series analysis using deep learning.
problem Long horizon forecasting in time series analysis.
method Incorporates deep learning techniques such as trend, seasonality, Fourier and wavelet transforms, and various model architectures.
result LHF is an error propagation problem, with models like xLSTM and Triformer showing better performance.
Extends utility maximization theory for infinite horizons without strong no-arbitrage assumptions.
problem Maximizing lifetime utility from wealth over an infinite horizon.
method Develops a duality theory using deflators and supermartingale properties, extending previous work.
result Establishes a strong duality theorem for infinite horizon utility maximization under minimal no-arbitrage assumptions.
In this paper, we study optimal liquidation problems in a randomly-terminated horizon. We consider the liquidation of a large single-asset portfolio with the aim of minimizing a combination of volatility risk and transaction costs arising from permanent and temporary market impact. Three different scenarios are analyze…
This paper uses recent results on continuous-time finite-horizon optimal switching problems with negative switching costs to prove the existence of a saddle point in an optimal stopping (Dynkin) game. Sufficient conditions for the game's value to be continuous with respect to the time horizon are obtained using recent …
We prove that compact Cauchy horizons in a smooth spacetime satisfying the null energy condition are smooth. As an application, we consider the problem of determining when a cobordism admits Lorentzian metrics with certain properties. In particular, we prove a result originally due to Tipler without the smoothness hypo…
We characterise the value function of the optimal dividend problem with a finite time horizon as the unique classical solution of a suitable Hamilton-Jacobi-Bellman equation. The optimal dividend strategy is realised by a Skorokhod reflection of the fund's value at a time-dependent optimal boundary. Our results are obt…
Stopping spikes, continuation bays and other features of optimal stopping with finite-time horizonmath.PR
Study optimal stopping problems with finite-time horizon and proves continuity and strict monotonicity of the boundary.
problem Optimal stopping problems with finite-time horizon and state-dependent discounting.
method Linear diffusion process, time-homogeneous gain function, fine regularity properties, continuity and strict monotonicity proof.
result Proves continuity and strict monotonicity of the optimal stopping boundary under mild assumptions.
Study long-term asset liquidation behavior with external flows.
problem Investigate optimal liquidation in presence of external flows.
method Convergence analysis of BSDEs for value function and strategy.
result Long-term liquidation may not occur due to external flows.
Derives time-averaged active inference from control principles.
problem Finite-horizon or discounted-surprise problems in active inference.
method Derives infinite-horizon, average-surprise active inference from optimal control principles.
result Unified objective functional for sensorimotor control.
We study the following problem: Given initial data on a compact Cauchy horizon, does there exist a unique solution to wave equations on the globally hyperbolic region? Our main results apply to any spacetime satisfying the null energy condition and containing a compact Cauchy horizon with surface gravity that can be no…
BINOCULARS improves experimental design by balancing exploration and exploitation.
problem Efficiently balancing exploration and exploitation in sequential experiments.
method BINOCULARS computes a batch of experiments, then selects a single point to evaluate, avoiding myopic approaches.
result BINOCULARS significantly outperforms myopic alternatives in real-world scenarios.
Paper identifies reductive MDPs, solving them in polynomial time.
problem Computational hardness of general MDPs and tractability of finite-horizon MDPs.
method Defines reductivity, a new class of SSPs, and develops a polynomial-time solution.
result Optimal policies can be found in polynomial time for reductive SSPs and MDPs.
Proves rigidity of extremal Kerr-Newman horizons.
problem Classifying near-horizon geometries of extremal Kerr-Newman horizons.
method Proves intrinsic geometry constraints leading to rigidity.
result Proves extremal Kerr-Newman horizons are unique.
A new method for risk-averse decision-making in Markov processes with improved regret bounds.
problem Risk-averse decision-making in Markov processes.
method Introduces mini-batch measures and multipattern risk-averse problems in a feature-based -learning method.
result Proves a high-probability regret bound of for the -learning method.