Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

4590135180 · May 202619922001200920172026
48 results for LLM Embeddings

This paper improves continuous adversarial training for LLMs using in-context learning theory.

problem Efficiently defending large language models (LLMs) against jailbreak attacks.
method The paper presents a theoretical analysis of continuous adversarial training (CAT) for LLMs based on in-context learning (ICL) theory, proving a robust generalization bound and proposing an improved regularization term.
result The robust generalization bound explains why CAT can defend against jailbreak prompts and shows that LLM robustness is related to embedding matrix singular values.

Compressed LLM embeddings improve noisy regression tasks without overfitting.

problem Noisy regression tasks with high signal-to-noise ratios.
method Comparison of embedding compression techniques using autoencoder hidden representations.
result Compression improves performance on noisy tasks like financial return prediction.

The paper introduces Relative Bias to quantify LLM bias systematically.

problem Quantifying bias in LLMs is challenging due to ambiguity and rapid model emergence.
method Relative Bias framework using Embedding Transformation and LLM-as-a-Judge methodologies.
result The two scoring methods show strong alignment, providing a systematic approach.

The study finds that supply chain information from LLM embeddings improves stock returns predictions.

problem Predicting stock returns using textual information from annual reports.
method Combining LLM embeddings of annual reports with supply chain knowledge graph propagation.
result Network-augmented embeddings significantly predict stock returns with a Sharpe ratio of 0.86 and alpha of 7.27%.

Novel method diagnoses large language models' reasoning abilities.

problem Fine-grained evaluation of large language models' reasoning abilities.
method Adapting cognitive diagnosis models to LLMs, estimating mastery profiles and Q-matrix, incorporating textual information.
result Accurate parameter recovery and insights into LLMs' capabilities.

Paper proposes using online text data to predict CPI with LLMs.

problem Forecasting Consumer Price Index (CPI) using low-frequency survey-based data.
method Develops an LLM-based approach combining online text time series with monthly CPI data.
result Establishes the asymptotic properties and provides prediction intervals for CPI forecasts.

Improves topic modeling using LLM embeddings and Poisson process.

problem Traditional topic modeling ignores word context; LLMs offer better contextual embeddings.
method Convert documents to word embeddings, model as Poisson process, estimate topics using flexible algorithm.
result Method integrates LLMs without fine-tuning, offers advantages over traditional methods.

BTZSC benchmarks zero-shot text classification across diverse models.

problem Systematically comparing zero-shot text classification across various models.
method Comprehensive benchmark of 22 datasets, comparing NLI cross-encoders, embedding models, rerankers, and instruction-tuned LLMs.
result Rerankers and instruction-tuned LLMs outperform NLI cross-encoders, with rerankers setting a new state-of-the-art.

Enhances stock return prediction using LLMs and hybrid models.

problem Insufficient use of semantic information and alignment of LLMs with stock features.
method LG model with three strategies for global information modeling and SCRL for embedding alignment.
result Superior performance in Rank Information Coefficient and returns compared to models relying only on stock features.

Modern LLMs fail at authorship attribution without fine-tuning, but topic embeddings outperform them.

problem Authorship attribution of the Federalist Papers using modern LLMs.
method Examined popular LLMs, compared word/phrase embeddings, and used Bayesian analysis with topic embeddings.
result Topic embeddings trained on 'function words' outperform default LLM embeddings in authorship attribution.

The paper tackles data misappropriation in LLMs by embedding watermarks and testing for their presence.

problem Detecting data misappropriation in LLMs trained on copyrighted data.
method Embedding watermarks, formulating as hypothesis testing, developing statistical framework, constructing test statistics, determining optimal thresholds, controlling errors, establishing asymptotic optimality.
result The proposed statistical testing framework effectively detects data misappropriation in LLMs.

SWIFT learns intrinsic rewards from LLM hidden states for efficient best-of-N sampling.

problem Efficiency and scalability of reward models for LLMs.
method SWIFT (Simple Weighted Intrinsic Feedback Technique) learns a reward function directly from LLM hidden states.
result SWIFT outperforms existing baselines by 12.7% on MATH dataset while using less than 0.005% of their parameters.

LLM evaluation suffers from systematic biases and lacks reliable positive judgments.

problem LLM evaluation suffers from systematic biases and lacks reliable positive judgments.
method Formulate LLM evaluation as a positive-unlabelled learning problem and propose a geometric auditing framework based on Partial Optimal Transport.
result Improved alignment with human preferences, increased robustness to presentation biases, and interpretable confidence estimates.

Text clustering method replaces centroids with summaries for interpretability and scalability.

problem Efficiently clustering text data while maintaining interpretability and scalability.
method k-NLPmeans and k-LLMmeans, which periodically replace numeric centroids with textual summaries.
result Consistently outperforms classical baselines and recent LLM-based clustering methods.

LLMs can memorize economic data and recall exact values before their training cutoff.

problem Evaluating the trustworthiness of LLMs' economic forecasts during their training period.
method Demonstrated through counterfactual forecasting and analysis of LLMs' recall ability.
result LLMs have memorized economic and financial data, leading to recall-level accuracy before their knowledge cutoff.

The paper introduces multicalibration to improve confidence scores in LLMs.

problem Improving the reliability and interpretability of confidence scores for LLMs.
method Forming groupings of prompt/completion pairs correlated with correctness, using clustering and self-annotation. Developing multicalibration algorithms to reduce overfitting.
result Our techniques yield confidence scores that significantly improve calibration and accuracy compared to existing methods.

SAGE improves memory efficiency by selectively adding, merging, or ignoring new facts.

problem Efficiently managing new facts in agentic LLMs to avoid costly write-time reasoning.
method SAGE uses a von Mises-Fisher-based density estimator to score and route candidate facts.
result SAGE achieves the best average token-F1 on LoCoMo and reduces add-phase API cost by 3.4x on GPT-4o-mini.

This paper improves retrieval for LLMs in financial document Q&A.

problem Suboptimal text chunk retrieval by RAG causes inaccuracies in LLM responses.
method Sophisticated chunking techniques, query expansion, metadata annotations, re-ranking algorithms, and embedding fine-tuning.
result Enhanced retrieval quality improves LLM performance and reliability.

Small LLMs outperform large ones on simple tasks without extra labelling costs.

problem Performance of large commercial models in simple classification tasks.
method Logistic Regression on small LLM embeddings.
result Small LLMs equal or outperform large LLMs in 'tens-of-shot' classification tasks.

This paper fine-tunes LLMs for stock return prediction using financial news.

problem Improving stock return forecasting accuracy using LLMs.
method Fine-tuning LLMs with text and forecasting modules, comparing encoder-only and decoder-only models, and integrating token-level representations.
result LLMs' aggregated token-level embeddings enhance return predictions for long-only and long-short portfolios.

A new method uses LLMs to discover causal pathways that affect fairness in machine learning.

problem Discovering fairness-relevant causal pathways in the presence of noise and confounding.
method Hybrid LLM-guided causal discovery framework combining active learning and dynamic scoring.
result LLM-guided methods, including the proposed active, dynamically scored variant, outperform baselines in recovering fairness-relevant structure under noisy conditions.

LLmFPCA-detect detects anomalies in sparse longitudinal text data using LLMs and mFPCA.

problem Challenges in detecting patterns and anomalies in sparse longitudinal textual data.
method Pairs LLM-based text embeddings with mFPCA to detect clusters and anomalies.
result LLmFPCA-detect outperforms state-of-the-art baselines on Amazon and Wikipedia datasets.

Framework controls uncertainty in LLMs without labels or probabilities.

problem Managing uncertainty in black-box LLMs without token-level probability or true labels.
method Integrates generative models, UCP, and conformal alignment to control uncertainty.
result Achieves close-to-nominal coverage and tighter thresholds than split UCP.

Randomized Geometric Algebra for Convex Neural Networks Optimizes Transfer Learning.

problem Training neural networks to global optimality via convex optimization.
method Randomized algorithms in Clifford's Geometric Algebra for hypercomplex vector spaces.
result Convex optimization and geometric algebra improve LLMs' robustness and reliability in transfer learning.

Paper uses LLMs for financial forecasting, overcoming sequence reasoning and multi-modal challenges.

problem Challenges in financial time series forecasting, especially cross-sequence reasoning and multi-modal signals.
method Combines LLMs with financial data and news, using zero-shot/few-shot inference and instruction-based fine-tuning.
result LLMs can offer explainable financial forecasts, leveraging cross-sequence reasoning and multi-modal information.

New analysis shows optimal embedding learning rate depends on vocabulary size, not just model width.

problem Optimal learning rate for language model embeddings is not well understood, especially with large vocabularies.
method Theoretical analysis of training dynamics, interpolation between μμP and LV regimes.
result Optimal embedding learning rate scales as Θ(width)Θ(\sqrt{width}) in the LV regime, not Θ(width)Θ(width) as μμP predicts.

A new metric GNQ audits LLMs for privacy risks during training.

problem Auditing LLMs for privacy risks during training is computationally hard.
method Gradient Uniqueness (GNQ) metric derived from gradient descent, BS-Ghost GNQ for efficiency.
result GNQ successfully predicts sequence extractability and reveals risk heterogeneity.

This paper integrates LLMs into SCD to improve causal inference accuracy.

problem Challenges in acquiring domain expert knowledge for causal models.
method Statistical causal prompting (SCP) for LLMs and prior knowledge augmentation for SCD.
result LLM-KBCI and SCD augmented with LLM-KBCI approach ground truths more closely.

A blindfolded LLM trading framework validates market signals without ticker memorization.

problem Ensuring LLMs trade based on genuine market understanding, not memorized data.
method Anonymize tickers and company names, verify signals through reasoning embeddings, and use PPO-DSR policy.
result Achieved Sharpe ratio of 1.40 +/- 0.22 across 20 seeds, robust in volatile markets.