Develops a reinforcement learning algorithm for learning deterministic equilibrium policies in time-inconsistent control problems.
problem Learning equilibrium policies in time-inconsistent control problems.
method Continuous-time model-free reinforcement learning algorithm using deterministic policy gradient approach.
result Learned equilibrium policies in general time-inconsistent control problems.
New theory extends LQ control to non-exponential discount scenarios.
problem Time-inconsistent deterministic LQ control problems.
method Extended equivalent relationship to non-exponential discount functions, studied Riccati equation solvability.
result Existence and uniqueness of linear equilibrium for time-inconsistent LQ problem.
Paper solves time-inconsistent control problems with BSDEs.
problem Time-inconsistent stochastic control in continuous time.
method Probabilistic representation via BSDEs.
result Equilibrium value function resolved for inconsistent cases.
This paper considers a time-inconsistent stopping problem in which the inconsistency arises from non-constant time preference rates. We show that the smooth pasting principle, the main approach that has been used to construct explicit solutions for conventional time-consistent optimal stopping problems, may fail under …
Study solves HJB equations for time-inconsistent control problems.
problem Time-inconsistent deterministic linear quadratic control problems.
method Characterized solutions using Riccati equations with integral terms, proving uniqueness.
result Uniqueness of solutions to equilibrium HJB equations proved.
In this paper, we study a time-inconsistent consumption-investment problem with random endowments in a possibly incomplete market under general discount functions. We provide a necessary condition and a verification theorem for an open-loop equilibrium consumption-investment pair in terms of a coupled forward-backward …
Study time-inconsistent portfolio optimization for competitive agents with relative performance criteria.
problem Time-inconsistent mean field and n-agent games under relative performance criteria.
method Construct open-loop equilibrium strategies for n-agent games and mean field games.
result Explicit solutions for n-agent games and mean field games, unique in a special class of equilibria.
Paper solves a complex portfolio selection problem with time-inconsistent preferences.
problem Time-inconsistent preferences in portfolio selection.
method Unified framework with minimal assumptions, proving existence and uniqueness of solution.
result Existence and uniqueness of square-integrable solution for the integral equation.
The paper solves TIC LQ control problems using stochastic differential games.
problem Time-inconsistent linear-quadratic stochastic control problems.
method Stochastic differential games, spike variation approach.
result Achieves Nash equilibrium for TIC problems, demonstrating impact of ambiguity aversion.
Time inconsistency leads to intra-personal conflict and reconciliation strategies.
problem Time inconsistency in dynamic choice problems.
method Rigorous treatment of intra-personal equilibrium in continuous-time settings.
result A new approach to understanding and reconciling intra-personal conflicts.
Investigates time-inconsistent portfolio selection under MMV preferences.
problem Time-inconsistent optimal strategies for MMV preferences.
method Nash equilibrium controls for MMV and MV preferences, solving FBSDE and HJB equations.
result MMV optimal strategies lead to higher investment amounts than MV strategies, narrowing over time.
The paper defines and solves time-inconsistent stopping control problems in multi-dimensional diffusion models.
problem Time-inconsistent problems in control and stopping strategies.
method Formal definition of weak equilibria, extended HJB system, and verification methodology.
result Explicit equilibrium solutions and existence of non-constant equilibria.
The paper analyzes optimal dividend and capital injection strategies under time-inconsistent preferences.
problem Optimal dividend and capital injection strategies under time-inconsistent preferences.
method Diffusion risk model with general discount functions, weak equilibrium definition, HJB equation system.
result Explicit solutions and threshold types of optimal strategies derived under different discount functions.
A new approach to MV portfolio optimization with jumps and RL.
problem Continuous-time Mean-Variance portfolio optimization with jumps.
method Jump-diffusion process, Reinforcement Learning, time-inconsistent control (TIC), Actor-Critic RL algorithm.
result The proposed RL model is profitable in real-world market data.
In this paper we study a class of time-inconsistent terminal Markovian control problems in discrete time subject to model uncertainty. We combine the concept of the sub-game perfect strategies with the adaptive robust stochastic to tackle the theoretical aspects of the considered stochastic control problem. Consequentl…
Unified approach to time-inconsistent problems with distribution-dependent rewards.
problem Time-inconsistent problems with distribution-dependent rewards in behavioral finance and economics.
method Equilibrium master equation on Wasserstein space, refined derivatives, Itô's formula.
result Unified approach to find equilibrium solutions for time-inconsistent problems.
Optimizes dividend payments to balance risk and reward.
problem Maximizing mean-variance of accumulated discounted dividends up to ruin.
method Develops a time-consistent equilibrium strategy using a verification lemma.
result Equilibrium strategy is a barrier strategy for low risk aversion.
Paper analyzes venture capital exit decisions under inconsistent preferences.
problem Time-inconsistent preferences in venture capital exit timing.
method Modeling four types of venture capitalists with varying levels of inconsistency.
result Time-inconsistent venture capitalists exit earlier than consistent ones.
In this paper, we formulate a general time-inconsistent stochastic linear--quadratic (LQ) control problem. The time-inconsistency arises from the presence of a quadratic term of the expected state as well as a state-dependent term in the objective functional. We define an equilibrium, instead of optimal, solution withi…
Paper tackles time inconsistency in portfolio management with stochastic volatility and power utility.
problem Time inconsistency in portfolio management with stochastic volatility and power utility.
method Extended Hamilton Jacobi Bellman (HJB) equation, fixed point iteration, and linear parabolic PDE.
result Subgame perfect strategies are characterized and solved through numerical experiments.
The study examines different types of equilibria for stopping problems in one-dimensional diffusion processes.
problem Characterizing and comparing different types of equilibria for time-inconsistent stopping problems.
method Analyzes log sub-additive discount functions and one-dimensional diffusion processes to derive necessary and sufficient conditions for weak equilibria and other types of equilibria.
result Conditions for weak equilibria and their implications for other types of equilibria are provided.
We study an infinite-horizon discrete-time optimal stopping problem under non-exponential discounting. A new method, which we call the iterative approach, is developed to find subgame perfect Nash equilibria. When the discount function induces decreasing impatience, we establish the existence of an equilibrium through …
Paper proves existence and uniqueness of solutions to nonlocal systems, generalizing stochastic game theory.
problem Time inconsistency in stochastic differential games.
method Proves existence and uniqueness of solutions to nonlocal fully-nonlinear parabolic systems.
result Generalizes stochastic game theory to include time-inconsistent preferences.
In this paper, we solve the time inconsistent portfolio selection problem by using different utility functions with a moving target as our constraint. We solve this problem by finding an equilibrium control under the given definition as our optimal control. We firstly derive a sufficient equilibrium condition for secon…
We consider a general time-inconsistent stochastic linear-quadratic differential game. The time-inconsistency arises from the presence of quadratic terms of the expected state as well as state-dependent term in the objective functionals. We define an equilibrium strategy, which is different from the classical one, and …
New MFG model for MV portfolio management with peer-based risk aversion.
problem Time-inconsistent mean-variance portfolio management with peer-based risk aversion.
method Mean-field game, smooth regularization, fixed-point arguments, convergence analysis.
result Existence of mean-field equilibrium in time-inconsistent MFG.
Develops a model for gambling decisions under time inconsistency.
problem Time inconsistency in gambling decisions due to probability weighting in CPT.
method Formulates the problem as a mathematical program, derives optimal precommitted rule.
result Gambler may enter the casino even with limited play, behavior varies based on gains/losses.
A \emph{new} notion of equilibrium, which we call \emph{strong equilibrium}, is introduced for time-inconsistent stopping problems in continuous time. Compared to the existing notions introduced in ArXiv: 1502.03998 and ArXiv: 1709.05181, which in this paper are called \emph{mild equilibrium} and \emph{weak equilibrium…
The paper solves a portfolio selection problem in incomplete markets by balancing utility and risk.
problem Time-inconsistent portfolio selection in incomplete markets.
method Characterizes equilibrium via a coupled quadratic BSDE system, introduces approximate equilibrium for general cases.
result Established existence theory for equilibrium strategies in special and general cases.
The paper solves stochastic control problems with implicit objectives, finding equilibrium strategies.
problem Stochastic control problems with implicitly defined objectives leading to time-inconsistency.
method Closed-loop equilibrium solutions in a controlled diffusion framework, providing sufficient and necessary conditions.
result Explicit characterization of equilibrium portfolio strategies in terms of ordinary differential equations.
This paper extends the classical consumption and portfolio rules model in continuous time (Merton 1969, 1971) to the framework of decision-makers with time-inconsistent preferences. The model is solved for different utility functions for both, naive and sophisticated agents, and the results are compared. In order to so…
The paper proves well-posedness of nonlocal PDEs related to stochastic control problems.
problem Characterizing equilibrium strategies and value functions for time-inconsistent stochastic control problems.
method Method of continuity and Banach's fixed point arguments, with Schauder prior estimates.
result Global well-posedness of nonlocal fully nonlinear PDEs with sharp a-priori estimates.
In this paper, we consider equilibrium strategies under Volterra processes and time-inconsistent preferences embracing mean-variance portfolio selection (MVP). Using a functional Itô calculus approach, we overcome the non-Markovian and non-semimartingale difficulty in Volterra processes. The equilibrium strategy is the…
Study on investment strategy for agents with periodic preferences and discounting.
problem Investment decisions by agents with periodic S-shaped preferences and present bias.
method Infinite-horizon, continuous-time portfolio selection problem with quasi-hyperbolic discounting.
result Time-consistent planning strategy can be formulated as an equilibrium to a static mean field game.
Proposes a robust equilibrium strategy for mean-variance portfolio selection.
problem Time-inconsistency in mean-variance portfolio selection.
method Introduces a novel definition of robust equilibrium strategy and solves the corresponding PDE system.
result A classical solution to the PDE system implies a robust equilibrium strategy.
In this paper, we continue our study on a general time-inconsistent stochastic linear--quadratic (LQ) control problem originally formulated in [6]. We derive a necessary and sufficient condition for equilibrium controls via a flow of forward--backward stochastic differential equations. When the state is one dimensional…
The study finds that maximizing median returns is the only viable strategy in portfolio selection.
problem Difficulties in studying optimal portfolio strategies due to discontinuity and time inconsistency in maximizing median and quantile returns.
method Used intra-personal equilibrium approach to analyze portfolio selection under median and quantile maximization.
result Median maximization is the only viable strategy, with no investment in risky assets for other quantiles.
The paper studies optimal investment using acceptability indices to maximize portfolio performance.
problem Optimal investment problem using coherent acceptability indices.
method Numerical algorithm approximating the original problem, dynamic coherent risk measures, set-valued Bellman's principle.
result Acceptability maximization problem reduces to a one-period problem under certain conditions.
Paper tackles stochastic control with mean and higher-order moments, finding Nash equilibria.
problem Time-inconsistent stochastic control problems with mean and higher-order moments.
method Developed closed-loop and open-loop Nash equilibrium controls using PDEs and maximum principles.
result Identical closed-loop and open-loop Nash equilibria controls, independent of state value and random path.
The paper analyzes a game where players must balance short-term and long-term interests, leading to cooperative or competitive outcomes.
problem Analyzing time inconsistency in inter-personal decision-making under non-exponential discounting.
method Iterative procedures and Zorn's lemma to find Nash equilibria between players' intra-personal equilibria.
result Inter-personal equilibria exist and depend on the impatience levels of the players.
Paper solves a complex stopping problem using regularization and HJB equations.
problem Time-inconsistent mean-variance optimal stopping problem
method Vanishing regularization method to derive HJB equations and prove existence of solutions
result Formally recovers variational inequalities for original problem
Proposes a deep learning approach for optimizing portfolios with stocks and options.
problem Optimizing portfolios with time-inconsistent objectives and trading constraints.
method Neural networks with adaptive activation functions for asset allocation and option strike prices.
result Adding options leads to more stable and consistent stock allocations.
Study optimal portfolio strategies with time-varying discount rates.
problem Optimizing portfolio decisions with a non-constant discount rate.
method Introduced subgame perfect strategies to handle time inconsistency, using fixed point iteration to find the utility-weighted discount rate.
result Subgame perfect strategies are equivalent to optimal strategies under certain utility function assumptions.
The paper solves portfolio selection for complex preferences in continuous time.
problem Dynamic portfolio selection for nonlinear preferences with time inconsistency.
method Stochastic maximum principle and verification theorems for equilibrium strategies.
result Equilibrium strategies derived in closed form for CRRA and CARA preferences.
A new RL framework for risk-sensitive decision-making using convex scoring functions.
problem Time-inconsistent risk measures in reinforcement learning.
method Convex scoring functions, augmented state space, auxiliary variable, customized Actor-Critic algorithm.
result Theoretical guarantees for approximation and convergence under certain conditions.
We consider the problem of stopping a diffusion process with a payoff functional that renders the problem time-inconsistent. We study stopping decisions of naive agents who reoptimize continuously in time, as well as equilibrium strategies of sophisticated agents who anticipate but lack control over their future selves…
Study optimal reinsurance strategies in a game between insurer and two reinsurers.
problem Optimal reinsurance strategies in a competitive market.
method Stochastic game theory, Stackelberg model, Nash game, time-inconsistent control problem, extended Hamilton-Jacobi-Bellman equation.
result Equilibrium reinsurance strategies and premiums found for exponential claim size.
We introduce a new notion of conditional nonlinear expectation under probability distortion. Such a distorted nonlinear expectation is not sub-additive in general, so it is beyond the scope of Peng's framework of nonlinear expectations. A more fundamental problem when extending the distorted expectation to a dynamic se…