Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

275480107 · Jun 202019922001200920172026
48 results for Long-term reasoning

We describe a new class of learning models called memory networks. Memory networks reason with inference components combined with a long-term memory component; they learn how to use these jointly. The long-term memory can be read and written to, with the goal of using it for prediction. We investigate these models in t…

2014-10-15abs ↗pdf ↗

It is suggested to consider long term trends of financial markets as a growth phenomenon. The question that is asked is what conditions are needed for a long term sustainable growth or contraction in a financial market? The paper discuss the role of traditional market players of long only mutual funds versus hedge fund…

2003-08-26abs ↗pdf ↗

Benchmark for math reasoning models from human proofs.

problem Measuring and accelerating machine learning models in high-level mathematical reasoning.
method Built a non-synthetic dataset from theorem prover proofs, defined a task for model to fill in missing propositions, used hierarchical transformer to improve performance.
result Neural models can capture non-trivial mathematical reasoning, hierarchical transformer outperforms baseline.

This paper proposes a framework to predict long-term trends and short-term fluctuations in multivariate time series.

problem Existing prediction methods often ignore the distinction between long-term trends and short-term fluctuations.
method The paper introduces a MTS forecasting framework that uses both original time series and its first difference to capture long-term trends and short-term fluctuations.
result The proposed method improves forecasting performance by using more supervision information.

New RNN model handles long-term dependencies in irregularly-sampled time series.

problem Handling long-term dependencies in irregularly-sampled time series data.
method Designing ODE-LSTMs that separate memory from continuous-time state.
result ODE-LSTMs outperform other RNN-based models on non-uniformly sampled data with long-term dependencies.

Bayesian model predicts interest rates with short-term accuracy and long-term stability.

problem Improving short- and long-term prediction of time series with temporary non-stationary behavior.
method Time-varying autoregressive model with Bayesian regularization and MCMC inference.
result Model outperforms existing methods in both short and long-term predictions.

In this paper we examine a possible reason for the LSTM outperforming the GRU on language modeling and more specifically machine translation. We hypothesize that this has to do with counting. This is a consistent theme across the literature of long term dependence, counting, and language modeling for RNNs. Using the si…

2018-10-29abs ↗pdf ↗

It is a known fact that training recurrent neural networks for tasks that have long term dependencies is challenging. One of the main reasons is the vanishing or exploding gradient problem, which prevents gradient information from propagating to early layers. In this paper we propose a simple recurrent architecture, th…

2018-03-17abs ↗pdf ↗

PriceSeer benchmarks LLMs in real-time stock prediction.

problem Evaluating LLMs' stock prediction accuracy and robustness.
method Real-time benchmark with 110 U.S. stocks, internal and external information expansion.
result LLMs perform suboptimally in long-term predictions due to fake news and specific industries.

Improves neural relational inference for dynamic multi-agent trajectories.

problem Limited accuracy of NRI in short output sequences for relational inference in multi-agent trajectories.
method Proposes DYnamic multi-AgentRelational Inference (DYARI) model to handle changing interactions over time.
result DYARI model outperforms NRI in dynamic relational inference tasks.

The bias potential model explains how generative models can generalize or memorize samples.

problem Understanding and achieving generalization in generative models like GANs.
method Introducing the bias potential model to analyze the behavior of generative models.
result Dimension-independent generalization accuracy can be achieved with early stopping in the bias potential model.

Benchmark tests LLMs on discovering physics laws in unconventional worlds.

problem Difficulties in distinguishing genuine reasoning from recall in LLMs across physics evaluations.
method Interactive benchmark with 22 worlds governed by various unconventional physics laws, requiring agents to design experiments and revise hypotheses.
result Strongest agents fail on worlds requiring latent structure discovery, highlighting limitations in long-term reasoning.

Entrocraft addresses RL performance saturation in LLMs by customizing entropy curves.

problem Performance saturation in RL algorithms for LLMs.
method Entrocraft uses rejection sampling to bias advantage distributions for customized entropy schedules.
result Entrocraft significantly improves generalization, output diversity, and long-term training in 4B models.

Model combines long-term and short-term memory using conceptors.

problem Transfer between long-term and short-term memory.
method Recurrent neural network with gated reservoir for short-term memory and conceptors for long-term memory.
result Standard operations on conceptors allow combining long-term memories and describing their effect on short-term memory.

TimeBridge addresses non-stationarity in long-term time series forecasting.

problem Non-stationarity in multivariate time series leads to spurious regressions and obscures long-term relationships.
method TimeBridge segments series into patches, applying Integrated Attention for short-term non-stationarity and Cointegrated Attention for long-term cointegration.
result TimeBridge achieves state-of-the-art performance in both short-term and long-term forecasting.

The choice of how to retain information about past gradients dramatically affects the convergence properties of state-of-the-art stochastic optimization methods, such as Heavy-ball, Nesterov's momentum, RMSprop and Adam. Building on this observation, we use stochastic differential equations (SDEs) to explicitly study t…

2019-07-02abs ↗pdf ↗

Peer review is the foundation of scientific publication, and the task of reviewing has long been seen as a cornerstone of professional service. However, the massive growth in the field of machine learning has put this community benefit under stress, threatening both the sustainability of an effective review process and…

2018-12-18abs ↗pdf ↗

This paper balances short-term and long-term rewards in policy learning.

problem Balancing short-term and long-term rewards in policy learning.
method Formalizes a new framework to balance rewards, identifies rewards under mild assumptions, deduces efficiency bounds, and develops a policy learning approach.
result The proposed method improves the estimator of long-term reward and reduces regret.

This paper uses Bayesian models to analyze CTA returns across short and long-term trends.

problem The relative merits and interactions of short- and long-term trend systems in CTA replication remain controversial.
method Dynamic decomposition of CTA returns into short-term trend, long-term trend, and market beta factors using a Bayesian graphical model.
result The blend of horizons shapes the strategy's risk-adjusted performance.

Estimates long-term effects from short-term experiments and observational data with unobserved confounders.

problem Estimating long-term causal effects from short-term experiments and long-term observational data with unobserved confounding.
method Combining regression residuals with short-term experimental outcomes to create an instrumental variable for estimating long-term causal effects.
result The estimator is unbiased and its variance is analytically studied.

The paper tackles long-term treatment effects with persistent confounders using sequential short-term outcomes.

problem Estimating long-term treatment effects with persistent unmeasured confounders.
method Exploiting the sequential structure of short-term outcomes, the paper develops three novel identification strategies and corresponding estimators.
result The proposed methods outperform existing approaches in handling persistent confounders.

In this paper we provide compelling evidence of cyclical mean reversion and multiperiod stock return predictability over horizons of about 30 years with a half-life of about 15 years. This implies that the US stock market follows a long-term rhythm where a period of above average returns tends to be followed by a perio…

2012-03-10abs ↗pdf ↗

It is demonstrated that the US economy has on the long-term in reality been governed by the Keynesian approach to economics independent of the current official economical policy. This is done by calculating the two-point correlation function between the fluctuations of the DJIA and the US public debt. We find that the …

2011-07-15abs ↗pdf ↗

Paper proposes a model-free algorithm for CMDPs with long-term constraints, achieving optimal regret bounds.

problem Optimizing systems with long-term constraints where transition probabilities are unknown.
method Combines concepts from constrained optimization and Q-learning to propose an algorithm.
result Achieves optimal regret bounds for reward and constraint violation.

Combining experimental and observational data for long-term causal effects.

problem Estimating causal effects of treatment on long-term outcomes using mixed data types.
method Three approaches for fusing experimental and observational data: equal confounding, shared confounder, and proxy variables.
result Developed estimators for each approach and analyzed their robustness.

The paper targets optimal interventions for long-term outcomes using imputed data and policy learning.

problem Maximizing long-term outcomes observed only in the future.
method Imputing missing long-term outcomes and using a doubly-robust approach for policy evaluation and optimization.
result The approach outperforms simple short-term proxies and achieves significant revenue impact over three years.