Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

4283125166 · Jun 202019922001200920172026
48 results for long-term goals

WayDCM predicts trajectories considering long-term goals, improving accuracy.

problem Predicting future trajectories of dynamic agents in complex environments.
method WayDCM combines DCM and NN to predict intermediate goals and trajectories, considering long-term goals.
result WayDCM outperforms previous methods on the Waymo Open dataset.

This work tackles long-term visual planning by goal-conditioned hierarchical predictors.

problem Current learning approaches fail on long-horizon tasks due to lack of goal information and coarse-to-fine planning.
method Formulate goal-conditioned predictors (GCPs) and hierarchical models to predict trajectories between observations.
result GCPs enable effective long-term planning with much longer horizons than before.

New algorithm optimizes online network resource allocation with long-term constraints.

problem Optimal resource reservation in communication networks with job transfers and budget limits.
method Randomized exponentially weighted method for long-term constraints.
result Upper bound for regret and cumulative constraint violations established.

We describe a new class of learning models called memory networks. Memory networks reason with inference components combined with a long-term memory component; they learn how to use these jointly. The long-term memory can be read and written to, with the goal of using it for prediction. We investigate these models in t…

2014-10-15abs ↗pdf ↗

Goal-oriented reinforcement learning has recently been a practical framework for robotic manipulation tasks, in which an agent is required to reach a certain goal defined by a function on the state space. However, the sparsity of such reward definition makes traditional reinforcement learning algorithms very inefficien…

2019-06-10abs ↗pdf ↗

This paper proposes a framework to predict long-term trends and short-term fluctuations in multivariate time series.

problem Existing prediction methods often ignore the distinction between long-term trends and short-term fluctuations.
method The paper introduces a MTS forecasting framework that uses both original time series and its first difference to capture long-term trends and short-term fluctuations.
result The proposed method improves forecasting performance by using more supervision information.

Recurrent neural networks have gained widespread use in modeling sequential data. Learning long-term dependencies using these models remains difficult though, due to exploding or vanishing gradients. In this paper, we draw connections between recurrent networks and ordinary differential equations. A special form of rec…

2019-02-26abs ↗pdf ↗

This work improves imitation learning and goal-conditioned RL by estimating value densities.

problem Effective solutions for imitation and goal-conditioned reinforcement learning require reliably reaching specified states or demonstrations.
method The approach uses recent advances in density estimation to learn value functions efficiently and without hindsight bias.
result The method achieves state-of-the-art demonstration sample-efficiency in imitation learning and is both efficient and bias-free in goal-conditioned reinforcement learning.

New algorithm optimizes long-term user satisfaction in recommendation systems.

problem Optimizing long-term user satisfaction in recommendation systems with delayed rewards.
method Developed a predictive model of delayed rewards and a bandit algorithm that balances exploration and exploitation.
result Our approach results in substantially better performance compared to short-term or delayed optimization.

New algorithm optimizes for long-term user satisfaction in delayed reward settings.

problem Optimizing for long-term user satisfaction in delayed reward settings.
method Developed a predictive model of delayed rewards and a bandit algorithm that combines rewards and surrogate outcomes.
result Our algorithm significantly outperforms methods that optimize for short-term proxies or rely solely on delayed rewards.

Study compares LSTM models with sentiment analysis for stock price prediction.

problem Efficient stock price prediction models using LSTM with sentiment analysis.
method Various types of LSTM models combined with sentiment analysis.
result Identifies the most effective model for short and long-term stock price prediction.

Open-domain dialog generation is a challenging problem; maximum likelihood training can lead to repetitive outputs, models have difficulty tracking long-term conversational goals, and training on standard movie or online datasets may lead to the generation of inappropriate, biased, or offensive text. Reinforcement Lear…

2019-09-17abs ↗pdf ↗

Developing a dialogue agent that is capable of making autonomous decisions and communicating by natural language is one of the long-term goals of machine learning research. Traditional approaches either rely on hand-crafting a small state-action set for applying reinforcement learning that is not scalable or constructi…

2017-05-29abs ↗pdf ↗

Develops hierarchical reinforcement learning value function approximators.

problem Estimating long-term returns in reinforcement learning with multiple goals.
method Introduces hierarchical universal value function approximators (H-UVFAs) using the options framework.
result Demonstrates generalization and improved performance of H-UVFAs over UVFAs.

We study the problem of controllable generation of long-term sequential behaviors, where the goal is to calibrate to multiple behavior styles simultaneously. In contrast to the well-studied areas of controllable generation of images, text, and speech, there are two questions that pose significant challenges when genera…

2019-10-02abs ↗pdf ↗

We propose and study a new model for reinforcement learning with rich observations, generalizing contextual bandits to sequential decision making. These models require an agent to take actions based on observations (features) with the goal of achieving long-term performance competitive with a large set of policies. To …

2016-02-08abs ↗pdf ↗

Modern information technology services largely depend on cloud infrastructures to provide their services. These cloud infrastructures are built on top of datacenter networks (DCNs) constructed with high-speed links, fast switching gear, and redundancy to offer better flexibility and resiliency. In this environment, net…

2018-09-24abs ↗pdf ↗

Hierarchies of temporally decoupled policies present a promising approach for enabling structured exploration in complex long-term planning problems. To fully achieve this approach an end-to-end training paradigm is needed. However, training these multi-level policies has had limited success due to challenges arising f…

2019-12-05abs ↗pdf ↗

We present a detailed study of the performance of a trading rule that uses moving average of past returns to predict future returns on stock indexes. Our main goal is to link performance and the stochastic process of the traded asset. Our study reports short, medium and long term effects by looking at the Sharpe ratio …

2019-06-29abs ↗pdf ↗

Hierarchical hidden Markov models predict market trends in financial time series.

problem Misinterpretation of short-term price fluctuations as long-term trend changes.
method Hierarchical hidden Markov models to capture both short- and long-term trends.
result Hierarchical models provide a comprehensive picture of financial markets.

A new method distills datasets more efficiently and effectively.

problem Achieving competitive performance on test data with a small synthetic dataset.
method Tackles dataset distillation as a bilevel optimization problem, introduces RaT-BPTT to stabilize gradients and speed up optimization.
result Establishes new state-of-the-art performance across various benchmarks.

Model combines long-term and short-term memory using conceptors.

problem Transfer between long-term and short-term memory.
method Recurrent neural network with gated reservoir for short-term memory and conceptors for long-term memory.
result Standard operations on conceptors allow combining long-term memories and describing their effect on short-term memory.

TimeBridge addresses non-stationarity in long-term time series forecasting.

problem Non-stationarity in multivariate time series leads to spurious regressions and obscures long-term relationships.
method TimeBridge segments series into patches, applying Integrated Attention for short-term non-stationarity and Cointegrated Attention for long-term cointegration.
result TimeBridge achieves state-of-the-art performance in both short-term and long-term forecasting.

The construction of artificial general intelligence (AGI) was a long-term goal of AI research aiming to deal with the complex data in the real world and make reasonable judgments in various cases like a human. However, the current AI creations, referred to as "Narrow AI", are limited to a specific problem. The constrai…

2019-09-09abs ↗pdf ↗

We study the problem of repeated play in a zero-sum game in which the payoff matrix may change, in a possibly adversarial fashion, on each round; we call these Online Matrix Games. Finding the Nash Equilibrium (NE) of a two player zero-sum game is core to many problems in statistics, optimization, and economics, and fo…

2019-07-17abs ↗pdf ↗

Deep learning models outperform traditional methods in stock price prediction.

problem Improving stock price prediction accuracy using deep learning.
method Comparative analysis of deep learning models (LSTM, GRU) and traditional methods (ARIMA, ARMA) on historical data.
result Deep learning models, particularly LSTM, outperform traditional methods in predicting stock prices across different time horizons.

This paper balances short-term and long-term rewards in policy learning.

problem Balancing short-term and long-term rewards in policy learning.
method Formalizes a new framework to balance rewards, identifies rewards under mild assumptions, deduces efficiency bounds, and develops a policy learning approach.
result The proposed method improves the estimator of long-term reward and reduces regret.

This paper uses Bayesian models to analyze CTA returns across short and long-term trends.

problem The relative merits and interactions of short- and long-term trend systems in CTA replication remain controversial.
method Dynamic decomposition of CTA returns into short-term trend, long-term trend, and market beta factors using a Bayesian graphical model.
result The blend of horizons shapes the strategy's risk-adjusted performance.

Estimates long-term effects from short-term experiments and observational data with unobserved confounders.

problem Estimating long-term causal effects from short-term experiments and long-term observational data with unobserved confounding.
method Combining regression residuals with short-term experimental outcomes to create an instrumental variable for estimating long-term causal effects.
result The estimator is unbiased and its variance is analytically studied.

The paper tackles long-term treatment effects with persistent confounders using sequential short-term outcomes.

problem Estimating long-term treatment effects with persistent unmeasured confounders.
method Exploiting the sequential structure of short-term outcomes, the paper develops three novel identification strategies and corresponding estimators.
result The proposed methods outperform existing approaches in handling persistent confounders.

In this paper we provide compelling evidence of cyclical mean reversion and multiperiod stock return predictability over horizons of about 30 years with a half-life of about 15 years. This implies that the US stock market follows a long-term rhythm where a period of above average returns tends to be followed by a perio…

2012-03-10abs ↗pdf ↗