Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

265379105 · Jun 202019922001200920172026
48 results for analogical reasoning

Few-shot visual reasoning model learns analogical relationships from small data.

problem Training deep models on few samples for visual reasoning tasks.
method Meta-analogical contrastive learning to enforce structural similarity between training and test samples.
result Method outperforms state-of-the-art on RAVEN dataset with scarce training data.

SCL discovers compositional structures in analogical reasoning tasks.

problem Discovering compositional structures in analogical reasoning tasks like Raven's Progressive Matrices.
method Proposes Scattering Compositional Learner (SCL) that composes neural networks in sequence.
result Achieves state-of-the-art performance on RPM datasets with significant improvements.

Building on a specific formalization of analogical relationships of the form "A relates to B as C relates to D", we establish a connection between two important subfields of artificial intelligence, namely analogical reasoning and kernel-based machine learning. More specifically, we show that so-called analogical propo…

2019-01-07abs ↗pdf ↗

ADR helps LLMs find and use historical analogies for foresight analysis.

problem LLMs struggle to find relevant historical analogies due to surface-level matching.
method Proposes CANA framework with mechanism alignment and cross-analogy confirmation.
result CANA improves historical analogy generation by up to 10%.

LLMs learn new tasks from unstructured data, but it depends on word co-occurrence and positional information.

problem Understanding how LLMs can learn new tasks from unstructured data without explicit training.
method Examined the capabilities of LLMs trained on unstructured data, focusing on sequence model requirements and training data structure.
result Many ICL capabilities can emerge from word co-occurrence in unstructured data, but positional information is crucial for certain tasks.

Object ranking or "learning to rank" is an important problem in the realm of preference learning. On the basis of training data in the form of a set of rankings of objects represented as feature vectors, the goal is to learn a ranking function that predicts a linear order of any new set of objects. In this paper, we pr…

2017-11-28abs ↗pdf ↗

Transformers solve parity problems efficiently with step-by-step reasoning.

problem Training transformers to solve complex, recursive problems like parity.
method Training a one-layer transformer to solve kk-parity, incorporating intermediate parities into the loss function, and using teacher forcing or augmented data.
result Transformers can learn parity in one gradient update with intermediate supervision or self-consistency checks.

We describe a post hoc test for the Sharpe ratio, analogous to Tukey's test for pairwise equality of means. The test can be applied after rejection of the hypothesis that all population Signal-Noise ratios are equal. The test is applicable under a simple correlation structure among asset returns. Simulations indicate t…

2019-11-11abs ↗pdf ↗

Optimal trading patterns adjust based on market efficiency and slippage costs.

problem Balancing active alphas and trading costs in active portfolios.
method Maximization of utility including projected alpha-based profits, slippage costs, and risk aversion.
result Optimal trading involves a no-trade zone width that scales as Δc1/2Δ\sim c^{1/2}, differing from stochastic settings.

In 2011 Enders, Müller and Topping showed that any blow up sequence of a Type I Ricci flow near a singular point converges to a non-trivial gradient Ricci soliton, leading them to conclude that for such flows all reasonable definitions of singular points agree with each other. We prove the analogous result for the harm…

2018-11-23abs ↗pdf ↗

An important problem in multi-label classification is to capture label patterns or underlying structures that have an impact on such patterns. This paper addresses one such problem, namely how to exploit hierarchical structures over labels. We present a novel method to learn vector representations of a label space give…

2014-12-22abs ↗pdf ↗

Reinforcement learning has gained wide popularity as a technique for simulation-driven approximate dynamic programming. A less known aspect is that the very reasons that make it effective in dynamic programming can also be leveraged for using it for distributed schemes for certain matrix computations involving non-nega…

2013-11-01abs ↗pdf ↗

In the eyes of a rationalist like Descartes or Spinoza, human reasoning is flawless, marching toward uncovering ultimate truth. A few centuries later, however, culminating in the work of Kahneman and Tversky, human reasoning was portrayed as anything but flawless, filled with numerous misjudgments, biases, and cognitiv…

2018-10-15abs ↗pdf ↗

The concept of explainability is envisioned to satisfy society's demands for transparency on machine learning decisions. The concept is simple: like humans, algorithms should explain the rationale behind their decisions so that their fairness can be assessed. While this approach is promising in a local context (e.g. to…

2019-10-03abs ↗pdf ↗

Dropout is a popular regularization technique in deep learning. Yet, the reason for its success is still not fully understood. This paper provides a new interpretation of Dropout from a frame theory perspective. By drawing a connection to recent developments in analog channel coding, we suggest that for a certain famil…

2018-10-14abs ↗pdf ↗

In Lorentzian manifolds of any dimension the concept of causal tensors is introduced. Causal tensors have positivity properties analogous to the so-called ``dominant energy condition''. Further, it is shown how to build, from ANY given tensor AA, a new tensor quadratic in AA and ``positive'', in the sense that it is …

2002-02-20abs ↗pdf ↗

Study of generalized knots and links, proving inequality involving crossing number and braid index.

problem Proving an inequality involving the minimal crossing number and braid index for generalized knots and links.
method Introducing generalized crossings and moves, proving inequality for generalized knots and links.
result Proved inequality involving total crossing number and braid index for generalized knots and links.

Online learners track optimal solutions with constant step-size.

problem Tracking optimal solutions in online learning settings.
method Established a link between steady-state performance and tracking performance using analogies with adaptive filters.
result Inferred tracking performance from steady-state expressions directly.

Entropy is a natural geometric quantity measuring the complexity of a surface embedded in R3\mathbb{R}^3. For dynamical reasons relating to mean curvature flow, Colding-Ilmanen-Minicozzi-White conjectured that the entropy of any closed surface is at least that of the self-shrinking two-sphere. We prove this conjecture …

2015-09-21abs ↗pdf ↗

Bob predicts a future observation based on a sample of size one. Alice can draw a sample of any size before issuing her prediction. How much better can she do than Bob? Perhaps surprisingly, under a large class of loss functions, which we refer to as the Cover-Hart family, the best Alice can do is to halve Bob's risk. …

2012-06-15abs ↗pdf ↗

We consider the problem of developing suitable learning representations (embeddings) for library packages that capture semantic similarity among libraries. Such representations are known to improve the performance of downstream learning tasks (e.g. classification) or applications such as contextual search and analogica…

2019-03-27abs ↗pdf ↗

This dissertation explores the integration of learning and analogy-making through the development of a computer program, called Analogator, that learns to make analogies by example. By "seeing" many different analogy problems, along with possible solutions, Analogator gradually develops an ability to make new analogies…

2020-01-18abs ↗pdf ↗

Analog forecasting uses local dynamics to predict chaotic systems.

problem Theoretical connections between analog forecasting and dynamical systems are overlooked.
method Local approximations of the system's dynamics, linear regression, and estimation of analog forecasting errors.
result Analog forecasting performances are highly linked to the local Jacobian matrix of the flow map.

Analog methods improve forecast accuracy in complex models.

problem Improving forecast accuracy in complex models like Lorenz-96.
method Constructing analogs using variational autoencoders for ensemble data assimilation.
result Constructed analogs perform as well as a full ensemble square root filter.

The paper evaluates the probability distributions of analog-to-target distances for multiple analogs.

problem Understanding the performance of analog applications through the distribution of distances to target states.
method Theoretical analysis and numerical experiments using dynamical systems theory.
result The size of the catalog and dimensionality affect the probability distributions of the K-best analogs.

In our previous paper (see this arxiv math.DG/0402171) for generic rank 2 vector distributions on n-dimensional manifold (n greater or equal to 5) we constructed a special differential invariant, the fundamental form. In the case n=5 this differential invariant has the same algebraic nature, as the covariant binary biq…

2004-02-12abs ↗pdf ↗

The homology groups of many natural sequences of groups {Gn}n=1\{G_n\}_{n=1}^{\infty} (e.g. general linear groups, mapping class groups, etc.) stabilize as nn \rightarrow \infty. Indeed, there is a well-known machine for proving such results that goes back to early work of Quillen. Church and Farb discovered that many sequ…

2012-01-23abs ↗pdf ↗

LaTRO optimizes latent reasoning in LLMs without external reward.

problem Training LLMs to perform complex reasoning tasks.
method Formulates reasoning as latent distribution sampling and optimizes via variational approaches.
result LLMs improve reasoning and evaluation quality through self-improvement.

Motivated by safety-critical applications, test-time attacks on classifiers via adversarial examples has recently received a great deal of attention. However, there is a general lack of understanding on why adversarial examples arise; whether they originate due to inherent properties of data or due to lack of training …

2017-06-13abs ↗pdf ↗

Auto-CEI improves LLM reasoning by balancing assertiveness and conservativeness.

problem Hallucinations and laziness in LLM reasoning tasks.
method Expert Iteration explores reasoning trajectories, guiding incorrect paths back on track and promoting appropriate 'I don't know' responses.
result Auto-CEI achieves superior alignment in logical reasoning, mathematics, and planning tasks.

A new method for math reasoning that allows for iterative correction.

problem Standard reasoning models commit to each token and cannot recover from early errors.
method Generative framework with latent thought vectors for iterative self-correction.
result 30 rethinking iterations surpass baselines with 15 times more parameters.

Inferring new facts from existing knowledge graphs (KG) with explainable reasoning processes is a significant problem and has received much attention recently. However, few studies have focused on relation types unseen in the original KG, given only one or a few instances for training. To bridge this gap, we propose Co…

2019-06-13abs ↗pdf ↗

Transformers learn multi-step reasoning through gradient descent.

problem Understanding how transformers solve symbolic multi-step reasoning tasks.
method Theoretical analysis of gradient descent dynamics and multi-phase training.
result Trained one-layer transformers can solve both backward and forward reasoning tasks with generalization guarantees.

Early stopping methods reduce unnecessary reasoning steps in LLMs by monitoring uncertainty signals.

problem LLMs sometimes generate unnecessary reasoning steps, especially under uncertainty.
method Statistically principled early stopping methods that monitor uncertainty signals during generation.
result Uncertainty-aware early stopping improves efficiency and reliability in LLM reasoning, especially in math reasoning.

Achieving artificial visual reasoning - the ability to answer image-related questions which require a multi-step, high-level process - is an important step towards artificial general intelligence. This multi-modal task requires learning a question-dependent, structured reasoning process over images from language. Stand…

2017-07-10abs ↗pdf ↗

FinTradeBench benchmarks LLMs for financial reasoning combining company fundamentals and market signals.

problem Challenges in evaluating financial reasoning models for LLMs.
method Developed a benchmark integrating company fundamentals and trading signals, using a calibration-then-scaling framework.
result Clear performance gap between LLMs, retrieval improves reasoning over textual fundamentals but not trading signals.

Hybrid framework injects TSLM insights into GRLM for robust time-series reasoning.

problem Lack of domain-specific knowledge in large language models for time-series reasoning.
method Hybrid knowledge-injection framework combining RLVR for efficient knowledge transfer.
result Consistently outperforms existing models by 7.9%-26.1% on multivariate time-series benchmarks.

Neural Logic Reasoning integrates deep learning and symbolic logic for better prediction tasks.

problem Lack of cognitive reasoning in deep neural networks limits their ability to solve complex prediction tasks.
method Proposes Logic-Integrated Neural Network (LINN) that learns logical operations and conducts propositional logical reasoning.
result LINN significantly outperforms state-of-the-art recommendation models in Top-K recommendation.

Forward-prediction models enhance physical reasoning, but only for specific tasks.

problem Improving physical reasoning in complex tasks involving many objects.
method Incorporated forward-prediction models into simple physical-reasoning agents and evaluated their performance on the PHYRE benchmark.
result Forward-prediction models improve physical-reasoning performance, especially on complex tasks, but generalization to new task templates is challenging.

Analog method solves portfolio optimization problems faster and more efficiently.

problem Accurate covariance matrix estimation and fast optimal portfolio selection for financial applications.
method Two-step process using equilibrium propagation and analog Hopfield networks.
result Fully analog pipeline calculates optimal portfolios in energy-efficient manner.