Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

23466891 · Jun 202019922001200920172026
48 results for sequential thinking

Simple model outperforms neural networks on language understanding tasks.

problem Neural networks struggle with creating novel expressions from familiar ones.
method Attention-inspired modification of a baseline model, focusing on sequential thinking and acting.
result Simple model achieves good performance on gSCAN tasks, validating the benchmark.

Human inertial thinking schemes can be formed through learning, which are then applied to quickly solve similar problems later. However, when problems are significantly different, inertial thinking generally presents the solutions that are definitely imperfect. In such cases, people will apply creative thinking, such a…

2018-03-01abs ↗pdf ↗

State variables are easily the most subtle dimension of sequential decision problems. This is especially true in the context of active learning problems (bandit problems") where decisions affect what we observe and learn. We describe our canonical framework that models {\it any} sequential decision problem, and present…

2020-02-14abs ↗pdf ↗

CausalGame benchmarks LLM agents' causal thinking in games.

problem Evaluating causal thinking in AI Scientists with LLMs.
method Interactive games with 14 scenarios incorporating selection bias, measurement error, and hidden confounders.
result None of the 30 LLM agents demonstrated reliable causal thinking, with the best model achieving only 68.0% survival.

Popular culture has contemplated societies of thinking machines for generations, envisioning futures from utopian to dystopian. These futures are, arguably, here now-we find ourselves at the doorstep of technology that can at least simulate the appearance of thinking, acting, and feeling. The real question is: now what…

2019-08-30abs ↗pdf ↗

A new reinforcement learning method for robots thinking and moving simultaneously.

problem Concurrent control in robotic systems where actions must be decided while the system is still evolving.
method Continuous-time Bellman equations, discretization aware of system delays, and architectural extension to deep reinforcement learning.
result The method successfully handles tasks requiring simultaneous decision-making and action execution.

Model learns brevity by exposing to easy problems, improving efficiency without explicit length penalties.

problem Excessive verbosity in step-by-step reasoning models trained with RLVR.
method Retaining and up-weighting moderately easy problems as implicit length regularizers.
result Model generates solutions that are, on average, nearly twice as short without explicit length penalties.

Thinking LLMs struggle with stock prediction, especially as data complexity increases.

problem Evaluating the performance of 'thinking' LLMs in stock prediction, especially under varying levels of cross-sectional complexity.
method Rolling 48m/1m walk-forward evaluation, comparing direct LLMs, TLLMs, and classical learners on cross-sectional ranking loss, MSE, and backtests with transaction costs.
result TLLMs' ranking quality deteriorates as cross-sectional complexity grows, while direct LLMs remain stable.

New algorithm trains neural nets on simple skills to learn complex tasks faster.

problem Learning complex tasks through simple imitation.
method Train neural networks on simple, easy-to-learn skills to accelerate learning of complex, hard-to-learn tasks.
result Consistently outperforms state-of-the-art baseline in training speed and performance.

DGP learns speech recognition by modeling complex relationships between utterances.

problem Modeling complex relationships in speech recognition without relational data.
method Bayesian nonparametric deep learning method (DGP) that generates infinite probabilistic graphs.
result DGP successfully infers relationships among utterances without relational data during training.

Recent progress in artificial intelligence (AI) has renewed interest in building systems that learn and think like people. Many advances have come from using deep neural networks trained end-to-end in tasks such as object recognition, video games, and board games, achieving performance that equals or even beats humans …

2016-04-01abs ↗pdf ↗

The success of deep neural networks has inspired many to wonder whether other learners could benefit from deep, layered architectures. We present a general framework called forward thinking for deep learning that generalizes the architectural flexibility and sophistication of deep neural networks while also allowing fo…

2017-05-20abs ↗pdf ↗

Breiman's paper sparked debate on the future of statistics and machine learning.

problem The tension between traditional statistical modeling and model-free machine learning approaches.
method Discussion of the implications of machine learning's success and the need for new inferential approaches.
result The importance of understanding 'why' and 'if' questions in machine learning is now recognized.

Research suggests using deep learning for better recommendation systems.

problem Recommender systems rely on proxies for A/B testing, leading to random success.
method Advocates for using deep learning to improve recommendation performance.
result Deep learning can potentially optimize reward in recommendation systems.

In this paper we study n-composition series of affine manifolds. One composition series are classified using gerbe theory. It is natural to think that n-composition series must be classified using n-gerbe theory. In the last section of this, we propose a notion of abelian n-gerbe theory

2001-05-24abs ↗pdf ↗

We introduce Deep Reasoning Networks (DRNets), an end-to-end framework that combines deep learning with reasoning for solving complex tasks, typically in an unsupervised or weakly-supervised setting. DRNets exploit problem structure and prior knowledge by tightly combining logic and constraint reasoning with stochastic…

2019-06-03abs ↗pdf ↗

The paper converts metric bounds to distance function Hölder bounds and proves compactness theorems.

problem Proving geometric stability results with scalar curvature bounds.
method Transforming LpL^p bounds to Hölder bounds for distance functions.
result Compactness theorems and convergence guarantees for Riemannian manifolds.

We argue that the present crisis and stalling economy continuing since 2007 are rooted in the delusionary belief in policies based on a "perpetual money machine" type of thinking. We document strong evidence that, since the early 1980s, consumption has been increasingly funded by smaller savings, booming financial prof…

2012-12-12abs ↗pdf ↗

We prove new results on existence of solutions for the prescribed gaussian curvature problem on the euclidean sphere S^2. Those results are achieved by relating this problem with the holomorphic triples theory on Riemann surfaces. We think this approach might be applied to study some other semi-linear elliptic equation…

2015-03-19abs ↗pdf ↗

Doctors often rely on their past experience in order to diagnose patients. For a doctor with enough experience, almost every patient would have similarities to key cases seen in the past, and each new patient could be viewed as a mixture of these key past cases. Because doctors often tend to reason this way, an efficie…

2018-09-10abs ↗pdf ↗

New method uses causal thinking to make AI fairer decisions.

problem Designing fair machine learning models that treat equal individuals equally and unequals unequally.
method Rank-preserving interventional distributions and warping method.
result Warping method effectively identifies discriminated individuals and mitigates unfairness.

We prove some general results about quasi-actions on trees and define Property (QFA), which is analogous to Serre's Property (FA), but in the coarse setting. This property is shown to hold for a class of groups, including SL(n,Z)SL(n,\Z) for n3n\geq 3. We also give a way of thinking about Property (QFA) by breaking it down …

2003-10-06abs ↗pdf ↗

In this short paper, we re-derive the Bochner formula for the Laplacian by considering local variations of volume. The derivation is rooted in the fact that the Laplacian of a function measures the volume variation along the flow of the gradient vector of the function. Possible extensions of this approach/technique are…

2013-06-17abs ↗pdf ↗

This is a survey on the geometry of warped products, without, or essentially with only soft, calculation. Somewhere in the paper, the goal was to give a synthetic account since existing approaches are rather analytic. Somewhere else, we have interpreted statements, especially by means of a physical terminology. This is…

2011-07-02abs ↗pdf ↗

We introduce Threatened Markov Decision Processes (TMDPs) as an extension of the classical Markov Decision Process framework for Reinforcement Learning (RL). TMDPs allow suporting a decision maker against potential opponents in a RL context. We also propose a level-k thinking scheme resulting in a novel learning approa…

2019-08-22abs ↗pdf ↗

The classical Brody's theorem asserts the equivalence between two notions of hyperbolicity for compact complex spaces, one named after Kobayashi and one expressed in terms of lack of non constant holomorphic entire functions (compactness is only used to prove the harder implication). We extend this theorem to Deligne-M…

2012-01-12abs ↗pdf ↗

Given an n-term L-infinity algebra L, we construct a Kan simplicial manifold which we think of as the 'Lie n-group' integrating L. This extends work of Getzler math.AT/0404003 . In the case of an ordinary Lie algebra, our construction gives the simplicial classifying space of the corresponding simply connect Lie group.…

2006-03-23abs ↗pdf ↗

Hybrid framework injects TSLM insights into GRLM for robust time-series reasoning.

problem Lack of domain-specific knowledge in large language models for time-series reasoning.
method Hybrid knowledge-injection framework combining RLVR for efficient knowledge transfer.
result Consistently outperforms existing models by 7.9%-26.1% on multivariate time-series benchmarks.

Given any closed Kaehler manifold we define, following an idea by Eugenio Calabi, a Riemannian metric on the space of Kaehler metrics regarded as an infinite dimensional manifold. We prove several geometrical features of the resulting space, some of which we think were already known to Calabi. In particular, the space …

2010-04-30abs ↗pdf ↗