Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

205410615820 · Jun 202019922001200920172026
48 results for long-term optimization

The paper targets optimal interventions for long-term outcomes using imputed data and policy learning.

problem Maximizing long-term outcomes observed only in the future.
method Imputing missing long-term outcomes and using a doubly-robust approach for policy evaluation and optimization.
result The approach outperforms simple short-term proxies and achieves significant revenue impact over three years.

Paper proposes a model-free algorithm for CMDPs with long-term constraints, achieving optimal regret bounds.

problem Optimizing systems with long-term constraints where transition probabilities are unknown.
method Combines concepts from constrained optimization and Q-learning to propose an algorithm.
result Achieves optimal regret bounds for reward and constraint violation.

Improved genetic algorithm optimizes SVR for robust long-term stock index forecasting.

problem Inaccurate long-term stock price predictions.
method Adaptive Weighted Genetic Algorithm-Optimized SVR (IGA-SVR).
result Reduction in MAPE by 19.87% compared to LSTM and 50.03% compared to OGA-SVR.

For a stochastic factor model we maximize the long-term growth rate of robust expected power utility with parameter λ(0,1)λ\in(0,1). Using duality methods the problem is reformulated as an infinite time horizon, risk-sensitive control problem. Our results characterize the optimal growth rate, an optimal long-term trading s…

2012-03-06abs ↗pdf ↗

Industrial-scale podcast recommender system optimizes long-term listening journeys.

problem Optimizing long-term listening experiences in podcast recommendation systems.
method Reinforcement learning approach to optimize user listening journeys over months.
result Significantly improved long-term performance in A/B tests compared to short-term metrics.

The optimal strategies for a long-term static investor are studied. Given a portfolio of a stock and a bond, we derive the optimal allocation of the capitols to maximize the expected long-term growth rate of a utility function of the wealth. When the bond has constant interest rate, three models for the underlying stoc…

2013-11-24abs ↗pdf ↗

Bayesian optimization for long-term outcomes using fast and slow experiments.

problem Optimizing long-term system effects with short-term misleading results.
method Combining fast and slow experiments for Bayesian optimization.
result Sequential optimization over large action spaces in a short time.

The article is devoted to investigating the application of aggregating algorithms to the problem of the long-term forecasting. We examine the classic aggregating algorithms based on the exponential reweighing. For the general Vovk's aggregating algorithm we provide its generalization for the long-term forecasting. For …

2018-03-18abs ↗pdf ↗

New algorithm optimizes long-term user satisfaction in recommendation systems.

problem Optimizing long-term user satisfaction in recommendation systems with delayed rewards.
method Developed a predictive model of delayed rewards and a bandit algorithm that balances exploration and exploitation.
result Our approach results in substantially better performance compared to short-term or delayed optimization.

New algorithm optimizes for long-term user satisfaction in delayed reward settings.

problem Optimizing for long-term user satisfaction in delayed reward settings.
method Developed a predictive model of delayed rewards and a bandit algorithm that combines rewards and surrogate outcomes.
result Our algorithm significantly outperforms methods that optimize for short-term proxies or rely solely on delayed rewards.

New algorithm optimizes online network resource allocation with long-term constraints.

problem Optimal resource reservation in communication networks with job transfers and budget limits.
method Randomized exponentially weighted method for long-term constraints.
result Upper bound for regret and cumulative constraint violations established.

This paper balances short-term and long-term rewards in policy learning.

problem Balancing short-term and long-term rewards in policy learning.
method Formalizes a new framework to balance rewards, identifies rewards under mild assumptions, deduces efficiency bounds, and develops a policy learning approach.
result The proposed method improves the estimator of long-term reward and reduces regret.

We consider a Bayesian financial market with one bond and one stock where the aim is to maximize the expected power utility from terminal wealth. The solution of this problem is known, however there are some conjectures in the literature about the long-term behavior of the optimal strategy. In this paper we prove now t…

2017-03-13abs ↗pdf ↗

FPG uses fractional calculus for efficient reinforcement learning with long-term memory.

problem High variance and inefficient sampling in standard policy gradient methods for long-term temporal modeling.
method Fractional Policy Gradients (FPG) incorporating Caputo fractional derivatives for power-law temporal correlations.
result Achieves asymptotic variance reduction of order O(t^(-alpha)) and sample efficiency gains.

Investigates fund separations and stability for long-term optimal investments.

problem Optimizing long-term investments in an incomplete market with risky and safe assets.
method Analyzes three market models with different state variable processes to find optimal portfolios and prove convergence stability.
result Dynamic optimal portfolios converge to static portfolios over time, with vanishing sensitivities in the long run.

Finding optimal policies which maximize long term rewards of Markov Decision Processes requires the use of dynamic programming and backward induction to solve the Bellman optimality equation. However, many real-world problems require optimization of an objective that is non-linear in cumulative rewards for which dynami…

2019-09-06abs ↗pdf ↗

This paper proposes a framework to predict long-term trends and short-term fluctuations in multivariate time series.

problem Existing prediction methods often ignore the distinction between long-term trends and short-term fluctuations.
method The paper introduces a MTS forecasting framework that uses both original time series and its first difference to capture long-term trends and short-term fluctuations.
result The proposed method improves forecasting performance by using more supervision information.

We propose a long term portfolio management method which takes into account a liability. Our approach is based on the LQG (Linear, Quadratic cost, Gaussian) control problem framework and then the optimal portfolio strategy hedges the liability by directly tracking a benchmark process which represents the liability. Two…

2013-03-16abs ↗pdf ↗

Long term optimal investment problems are studied in a factor model with matrix valued state variables. Explicit parameter restrictions are obtained under which, for an isoelastic investor, the finite horizon value function and optimal strategy converge to their long-run counterparts as the investment horizon approache…

2014-08-29abs ↗pdf ↗

Study examines how risk tolerance impacts long-term investment returns.

problem Understanding the impact of risk tolerance on investment returns over time.
method Used Malliavin calculus and Hansen--Scheinkman decomposition.
result Risk aversion affects long-term investment utility through eigenvalues and eigenfunctions.

This paper analyzes the robust growth rate of leveraged ETFs under uncertain parameters.

problem Analyzing the robust long-term growth rate of leveraged ETFs with uncertain parameters.
method Derive worst-case parameters using comparison principle and martingale extraction method.
result Explicitly obtain robust long-term growth rates under various models.

This study presents a long-term alternative formula for stock price variation described by a geometric Brownian motion on the basis of median instead of mean or expected values. The proposed method is motivated by the observation made in remote fields, where optimality of bet-hedging or diversification strategies is ex…

2019-04-09abs ↗pdf ↗

In this paper, we assume an insure is allowed to purchase proportional reinsurance and can invest his or her wealth into the financial market where a savings account, stocks and bonds are available. Different from classical optimal investment and reinsurance problem, this paper studies the insurer's long-term investmen…

2014-06-30abs ↗pdf ↗

Stochastic gradient descent's long-term fluctuations are described by a diffusion limit.

problem Long-term behavior of stochastic gradient descent in non-smooth settings.
method Functional central limit theorem applied to rescaled trajectory of SGD.
result Characterization of long-term fluctuations around the minimizer.

Deep RL drone trained to compete against classical path planning in drone racing.

problem Optimizing long-term drone racing strategies using reinforcement learning.
method Used PPO algorithm on a simulated quadrotor in a racing environment created with AirSim.
result Deep RL agent outperformed classical path planning in drone racing competitions.

In this paper, we derive a new model of synaptic plasticity, based on recent algorithms for reinforcement learning (in which an agent attempts to learn appropriate actions to maximize its long-term average reward). We show that these direct reinforcement learning algorithms also give locally optimal performance for the…

2019-11-17abs ↗pdf ↗

We study an exploration method for model-free RL that generalizes the counter-based exploration bonus methods and takes into account long term exploratory value of actions rather than a single step look-ahead. We propose a model-free RL method that modifies Delayed Q-learning and utilizes the long-term exploration bonu…

2018-08-31abs ↗pdf ↗

Open-domain dialog generation is a challenging problem; maximum likelihood training can lead to repetitive outputs, models have difficulty tracking long-term conversational goals, and training on standard movie or online datasets may lead to the generation of inappropriate, biased, or offensive text. Reinforcement Lear…

2019-09-17abs ↗pdf ↗

Deep RNNs excel at capturing long-term dependencies in sequential data.

problem Lack of a formal measure for RNNs' long-term memory capacity.
method Introduced a measure called Start-End separation rank to quantify RNNs' ability to model long-term dependencies.
result Deep RNNs support Start-End separation ranks that are combinatorially higher than shallow ones.

Optimizes long-term social welfare in recommender systems by matching users to providers.

problem Realistic recommender systems dynamics affect all agents, not just users.
method Formulated as an optimal constrained matching problem, solved using dynamical system equilibrium selection.
result Ensures maximal social welfare with diverse viable providers, improving over myopic matching.

Ranking models are typically designed to provide rankings that optimize some measure of immediate utility to the users. As a result, they have been unable to anticipate an increasing number of undesirable long-term consequences of their proposed rankings, from fueling the spread of misinformation and increasing polariz…

2019-05-13abs ↗pdf ↗

Model combines long-term and short-term memory using conceptors.

problem Transfer between long-term and short-term memory.
method Recurrent neural network with gated reservoir for short-term memory and conceptors for long-term memory.
result Standard operations on conceptors allow combining long-term memories and describing their effect on short-term memory.

Efficient algorithm predicts unknown linear systems with long-term memory.

problem Predicting unknown and partially observed linear dynamical systems with long-term memory.
method Bounding the generalized Kolmogorov width of the Kalman filter model using spectral methods and conducting tight convex relaxation.
result Competes with Kalman filter in hindsight with only logarithmic regret.

This paper considers online convex optimization over a complicated constraint set, which typically consists of multiple functional constraints and a set constraint. The conventional online projection algorithm (Zinkevich, 2003) can be difficult to implement due to the potentially high computation complexity of the proj…

2016-04-08abs ↗pdf ↗