LLMs overestimate stock returns and are less accurate at predicting extreme outcomes.
problem Behavioral biases in LLMs' stock return forecasts.
method Comparison of LLM forecasts with crowd-sourced estimates and historical data.
result LLMs overestimate stock returns and are less accurate at predicting extreme outcomes.
We detect lookahead bias in LLM forecasts using a novel statistical method.
problem Detecting lookahead bias in LLM-generated economic forecasts.
method Developed a statistical procedure using date-only recall queries and estimated Lookahead Propensity (LAP).
result LLM forecasts are contaminated with lookahead bias, as indicated by a positive interaction between LAP and the forecast in accuracy regressions.
Traditional methods outperform LLMs in forecasting corporate credit ratings.
problem Forecasting corporate credit ratings using LLMs.
method Comparison of traditional methods (XGBoost) and LLMs (LLaMA) on credit rating forecasting.
result XGBoost outperforms LLMs in forecasting corporate credit ratings.
Fine-tunes LLMs to correct bias in predictions.
problem LLMs exhibit bias in predictions from data.
method Supervised fine-tuning with Low-Rank Adaptation (LoRA).
result Fine-tuning corrects bias in both controlled and real-world settings.
Study shows awareness of reflexivity improves LLMs' financial forecasting accuracy.
problem Improving LLMs' ability to forecast financial markets during boom-bust cycles.
method Evaluated three LLMs under four conditions of reflexivity awareness in two market episodes.
result Reflexivity awareness improves forecasting accuracy differently across models and contexts.
LLMs can memorize economic data and recall exact values before their training cutoff.
problem Evaluating the trustworthiness of LLMs' economic forecasts during their training period.
method Demonstrated through counterfactual forecasting and analysis of LLMs' recall ability.
result LLMs have memorized economic and financial data, leading to recall-level accuracy before their knowledge cutoff.
This paper fine-tunes LLMs for stock return prediction using financial news.
problem Improving stock return forecasting accuracy using LLMs.
method Fine-tuning LLMs with text and forecasting modules, comparing encoder-only and decoder-only models, and integrating token-level representations.
result LLMs' aggregated token-level embeddings enhance return predictions for long-only and long-short portfolios.
Benchmark assesses forecasting models' ability to use textual context.
problem Forecasting models struggle with integrating textual context.
method Introduces a benchmark with numerical and textual data, evaluates various models.
result LLM prompting method outperforms other models.
LLM forecasting benchmarks suffer from information leakage, which confounds model performance.
problem LLM forecasting benchmarks suffer from information leakage.
method A retrieval-augmented LLM forecaster observes only decision-time information.
result The full pipeline obtains a median monthly Spearman rank IC of +0.154.
Paper uses LLMs for financial forecasting, overcoming sequence reasoning and multi-modal challenges.
problem Challenges in financial time series forecasting, especially cross-sequence reasoning and multi-modal signals.
method Combines LLMs with financial data and news, using zero-shot/few-shot inference and instruction-based fine-tuning.
result LLMs can offer explainable financial forecasts, leveraging cross-sequence reasoning and multi-modal information.
Computer science scans LLMs to understand and manipulate their economic forecasts.
problem Understanding and controlling the reasoning of large language models in economics.
method Brain scanning techniques applied to LLMs to identify and manipulate underlying concepts.
result LLMs can be steered to generate forecasts with specific biases, allowing for correction or simulation.
Improved crude oil price forecasting using multi-dimensional LLM sentiment signals.
problem Challenges in predicting crude oil prices due to unstructured news.
method Extracted five sentiment dimensions from GPT-4o, Llama 3.2-3b, and FinBERT models on energy-sector news articles.
result Combining GPT-4o and FinBERT yields the best predictive performance for weekly WTI crude oil futures returns.
BreakGPT predicts asset price surges using LLMs.
problem Predicting sharp upward movements in volatile financial markets.
method Adapts LLMs for time series forecasting, combining LLM capabilities with Transformer models.
result BreakGPT effectively captures local and global temporal dependencies.
LLMs improve stock price forecasting from financial news and reports.
problem Predicting stock prices with high accuracy and robustness.
method Analyzing financial news, reports, and transcripts using LLMs.
result LLMs can improve stock price forecasting but face practical challenges.
NIFTY dataset for financial forecasting models.
problem Improving financial market forecasting with LLMs.
method Two datasets for supervised and reinforcement learning.
result Demonstrates applications in stock price prediction.
New method evaluates language model forecasters by checking consistency of predictions.
problem Evaluating the performance of language model forecasters is difficult due to lack of ground truth.
method Developed a consistency check framework based on arbitrage to evaluate forecasters.
result Consistency metrics correlate with ground truth performance of LLM forecasters.
Transformers forecast time series in-context, improving efficiency and performance.
problem Overfitting and limited performance in time series forecasting.
method Reformulate time series forecasting as input tokens, aligning with in-context learning mechanisms.
result Consistently better performance across various settings (full-data, few-shot, zero-shot).
Study improves keyword forecasting in earnings-call prediction markets.
problem Accurately predicting future keyword mentions in earnings calls.
method Experiments on earnings-call mention markets, varying context and market probability, introducing MCP.
result Mixture of market probability and MCP yields the best forecasts.
Study uses LLMs to improve financial forecasting by integrating textual and numerical data.
problem Challenges in fusing multimodal information and measuring qualitative outputs from LLMs.
method Created context sets by segmenting daily securities reports into key factors and combining them with numerical data. Used dynamic updates and crafted prompts to assign scores to qualitative insights.
result LLMs outperform time-series models in market forecasting, though challenges remain.
This paper uses CausalGANs and RL with LLM to predict bond yields.
problem Challenges in financial bond yield forecasting due to data scarcity and market conditions.
method Proposes a novel framework combining CausalGANs, RL, and LLM for synthetic data generation and trading signals.
result Improves forecasting performance over existing methods with low Mean Absolute Error.
This paper predicts stock prices using LLMs and news embeddings.
problem Predicting stock prices with high accuracy and relevance.
method Integrates LLMs with stock name embeddings and attention mechanisms for news filtering.
result Reduces MAE by 7.11% compared to baseline.
ChatGPT predicts stock market reactions from news headlines without financial training.
problem Predicting stock price movements using non-financial data.
method Used post-knowledge-cutoff headlines to train ChatGPT-4, which forecasts stock market reactions.
result ChatGPT-4 can predict stock market reactions with high accuracy, especially for small stocks and negative news.
Survey finds LLMs match human economic expectations closely.
problem Understanding human economic expectations and their deviations.
method Survey of LLM's expectations based on news articles.
result LLM's expectations closely match existing surveys and exhibit deviations.
A model integrates CNN and LSTM with LLM for better stock forecasting.
problem Complex stock market prediction with volatile patterns and multifaceted data.
method Two-Level Conv-LSTM Neural Network with LLM for holistic stock advising.
result Improved prediction accuracy and contextual insights.
Study uses LLMs to improve Black-Litterman portfolio optimization.
problem Systematically generating investor views for Black-Litterman model.
method Translates LLM return forecasts and uncertainty into Black-Litterman inputs.
result LLM-driven portfolios outperform traditional baselines.
EDINET-Bench evaluates LLMs on complex financial tasks using Japanese financial statements.
problem Challenges in evaluating LLMs on financial tasks due to specialized expertise and scarce benchmarks.
method Developed EDINET-Bench, an open-source Japanese financial benchmark for LLMs on tasks like fraud detection and earnings forecasting.
result State-of-the-art LLMs perform only marginally better than logistic regression in financial tasks, highlighting the need for more realistic benchmarks.
A system for supervising decentralized finance risks using LLMs and structured evidence.
problem Supervising decentralized finance risks
method Forecast-grounded agentic supervision system
result Developed a system that scores tickets against a regulator-aligned ground truth and false-intervention rate.
DeXposure-Claw supervises decentralized finance risks by grounding LLM decisions in evidence.
problem Weak evidence leads to over-interventions by general-purpose LLM agents in decentralized finance.
method DeXposure-Claw uses a graph time-series foundation model to forecast exposure networks, turning forecasts into alerts and constraining escalation with data-health gates.
result DeXposure-Claw reduces false alarms and improves regulator alignment in decentralized finance risk supervision.
MoE-F combines LLMs online for better time-series prediction.
problem Combining multiple LLMs for online time-series prediction.
method Time-adaptive stochastic filtering techniques to combine experts.
result MoE-F achieves 17% absolute and 48.5% relative F1 measure improvement.
Mamba outperforms Reformer in minute-level stock prediction using LLM sentiment scores.
problem Improving minute-level stock market prediction accuracy in volatile markets.
method Combining sentiment scores from top LLMs with stock price data, training Mamba and Reformer models.
result Mamba achieved lower error rates across all tested LLMs, especially with LLaMA 3.3--70B.
Study shows GPT's earnings forecasts are human-like but not always accurate.
problem Information friction in AI-generated financial analysis.
method Examined GPT's earnings forecasts following corporate earnings releases and proposed a diagnostic framework.
result GPT's narrative attention is consistent and human-like but not always associated with higher forecast accuracy.
LLMs struggle with financial reasoning but can outperform the market with human oversight.
problem Financial reasoning failures in LLM-generated stock market predictions.
method Evaluated four LLMs using three prompting strategies and compared to human oversight.
result LLMs require human oversight to fully realize their potential in financial markets.
LLMs improve financial analysis by processing large data sets.
problem Traditional financial analysis methods struggle with large data volumes.
method Integrating LLMs for enhanced data processing and analysis.
result LLMs offer new capabilities for real-time financial decision-making.
Model uses LLM features to predict stock returns effectively.
problem Predicting stock returns from text data.
method Structured Event Representation (SER) model with attention mechanisms.
result SER-based model outperforms existing models in stock return prediction.
This study models FOMC policy decisions using debate-based LLMs.
problem Accurately predicting central bank policy decisions, especially FOMC's, is challenging.
method A novel framework that simulates FOMC's collective decision-making process through iterative rounds of LLMs interacting as agents.
result The debate-based approach significantly outperforms standard LLMs in prediction accuracy.
LLMs can predict CFO responses to economic surveys
problem Measuring business sentiment
method Prompting an LLM to role-play as a CFO
result LLM reproduces individual human responses
LLMs show potential for predicting financial returns, contrary to common belief.
problem Common belief that LLMs are unsuitable for financial market returns prediction.
method Chronos model from Ansari et al. (2024) tested on largest American single stocks.
result LLMs can predict time series that are nearly random, generating alpha.
LLMs learn probability density functions in-context, showing distinct learning trajectories.
problem Density estimation of time series data in LLMs.
method Intensive Principal Component Analysis (InPCA) to visualize and analyze LLMs' learning dynamics.
result LLMs follow similar learning trajectories in a low-dimensional InPCA space, distinct from traditional methods.
Paper proposes using online text data to predict CPI with LLMs.
problem Forecasting Consumer Price Index (CPI) using low-frequency survey-based data.
method Develops an LLM-based approach combining online text time series with monthly CPI data.
result Establishes the asymptotic properties and provides prediction intervals for CPI forecasts.
RiskLabs uses LLMs to predict financial risks from multimodal data.
problem Financial risk prediction using AI techniques.
method Integrates multimodal financial data (textual, vocal, time series, news) into LLMs for prediction.
result Empirical results show effectiveness in forecasting market volatility and variance.
LLMs outperform strong tabular baselines on industrial car retrofit prediction.
problem Industrial retrofit planning on structured operational data
method Embedding features, direct prompted classification, and ML+LLM stacking
result LLMs outperform strong tabular baselines on industrial car retrofit prediction
Model uses LLMs to process numerical data guided by natural language descriptions.
problem Challenges in integrating prior knowledge into probabilistic models.
method Developed LLM Processes to condition numerical predictive distributions on natural language.
result Improved predictive performance and structured qualitative descriptions.
LLMs in financial markets show diverse behaviors, from stable to speculative, challenging rational expectations.
problem Understanding the economic behaviors of LLMs in financial markets.
method Simulated financial market with 15 LLMs of varying sizes and capabilities.
result LLMs exhibit a spectrum of behaviors, including speculative bubbles, inconsistent with rational expectations.
PPO optimizes LLM-generated alpha weights for better trading performance.
problem Adapting LLM-generated alphas for varying market conditions.
method Proximal Policy Optimization (PPO) for dynamic alpha weight adjustment.
result PPO-optimized strategy achieves higher Sharpe ratios and smaller drawdowns.
Fidel-TS creates a new benchmark for time series forecasting models.
problem Lack of high-quality benchmarks for time series forecasting models.
method Formalized high-fidelity benchmark principles, including data sourcing integrity, leak-free design, and structural clarity. Created Fidel-TS, a new large-scale benchmark.
result Demonstrated the limitations of prior benchmarks and potential discrepancies in model evaluation.
New scaling laws optimize model size, training, and inference for better performance.
problem Trade-off between model size and inference cost in modern LLMs.
method Train-to-Test (T2) scaling laws that jointly optimize model size, training tokens, and inference samples. result Optimal pretraining decisions shift into overtraining regime, leading to stronger performance.
Study uses LLMs to categorize financial tweets, revealing useful sentiment signals.
problem Discovering meaningful sentiment signals from unstructured financial social media data.
method Leveraged LLMs to automatically label financial tweets with event categories and aligned with returns.
result Certain event labels consistently yield negative alpha, with statistically significant Sharpe ratios and information coefficients.
Analyst reports contain valuable information for investment decisions.
problem Investment value in analyst reports is not fully understood or utilized.
method Embedded analyst reports with LLMs and ML forecasts of future returns.
result Portfolios formed on analyst report narratives outperform numerical forecasts and established factors.