SusGen-GPT improves financial NLP and ESG report generation.
problem Lack of advanced NLP tools for finance and ESG domains.
method Developed SusGen-30K dataset and SusGen-GPT models.
result Achieved state-of-the-art performance in financial NLP tasks.
Survey of financial LLMs in finance.
problem Limited research on Financial LLMs (FinLLMs).
method Chronological overview of PLMs, comparison of techniques, performance evaluations, and advanced tasks.
result Compilation of accessible datasets and benchmarks for AI research in finance.
LLM Pro Finance Suite enhances financial NLP with instruction-tuned models.
problem Limited NLP capabilities for financial tasks in generalist models.
method Instruction-tuned large language models fine-tuned on financial data.
result Consistent improvement over state-of-the-art baselines in finance tasks.
This study uses NLP to detect financial risks from documents.
problem Detecting and predicting financial risks in documents.
method NLP model design, text preprocessing, feature extraction, machine learning.
result NLP model effectively identifies and predicts financial risks.
Improved financial sentiment analysis using LLMs with retrieval augmentation.
problem Limited performance of traditional NLP models in financial sentiment analysis.
method Retrieval-augmented Large Language Models (LLMs) with instruction tuning.
result Achieved 15% to 48% performance gain in accuracy and F1 score.
InvestLM is a financial domain LLM tuned on LLaMA-65B for investment advice.
problem Improving financial text understanding and advice generation for investment.
method Curated financial instruction dataset, LLaMA-65B, less-is-more-for-alignment approach.
result InvestLM provides comparable responses to state-of-the-art commercial models.
BloombergGPT is a large language model trained on financial data, outperforming existing models on financial tasks.
problem Lack of specialized large language models for finance.
method Trained on a 363 billion token dataset augmented with 345 billion tokens from general datasets, using a 50 billion parameter model.
result BloombergGPT outperforms existing models on financial tasks without sacrificing performance on general LLM benchmarks.
QUACKIE creates a new benchmark for NLP interpretability.
problem Evaluating NLP interpretability methods is challenging due to biased ground truths.
method Formulated a custom classification task from question-answering datasets, generating unbiased ground truths.
result Demonstrated the effectiveness of current interpretability methods on the new benchmark.
FINCH dataset enables financial Text-to-SQL tasks, improving model evaluation.
problem Lack of a large-scale financial dataset for Text-to-SQL tasks.
method Curated financial dataset (FINCH), benchmarking reasoning and language models.
result Proposed FINCH Score for more accurate financial model evaluation.
Framework quantifies financial NLP robustness under regime shifts.
problem Semantic and causal drift in financial news narratives.
method Four metrics: FCAS, PCS, TSV, NLICS.
result Transformer models are more affected by semantic drift.
News embeddings improve volatility forecasts.
problem Improving volatility forecasting accuracy.
method Transformed news text into embeddings, evaluated standalone and combined with benchmarks.
result News contains useful predictive information, especially for stock-related content.
This paper benchmarks FinGPT for financial datasets using open-source large language models.
problem Challenges in integrating GPT-based models with financial datasets.
method Instruction Tuning paradigm for open-source large language models adapted for financial contexts.
result Demonstrates the effectiveness and adaptability of FinGPT in financial tasks.
BERTopic enhances stock market prediction by analyzing sentiment in topic models.
problem Improving stock price prediction accuracy using sentiment analysis.
method Employed BERTopic for sentiment analysis of stock market comments integrated with deep learning models.
result Enhanced model performance through topic sentiment integration.
The paper improves cryptocurrency price forecasting using deep learning and NLP on financial, blockchain, and social media data.
problem Improving cryptocurrency price forecasting accuracy and profitability.
method Integrates financial, blockchain, and social media data; applies BART MNLI model for sentiment analysis; uses deep learning NLP models; compares with traditional methods; uses local extrema as predictive targets.
result Significantly improves forecasting accuracy and profitability of cryptocurrency price predictions.
SCROLLS benchmarks long text NLP tasks, improving existing models.
problem Short NLP benchmarks ignore long texts; SCROLLS addresses this.
method Handpicked long-text datasets for summarization, QA, and inference tasks.
result Improvement potential on SCROLLS tasks, as indicated by initial baselines.
A benchmark for NLP models trained on text datasets.
problem Limited access to high-performance clusters for NAS experiments.
method Created a search space for recurrent neural networks on text datasets and trained 14k architectures.
result Demonstrated the potential of precomputed NAS results for NLP.
Study analyzes deep learning models for financial sentiment in earnings calls.
problem Leveraging NLP for sentiment analysis in financial transcripts.
method Comparative analysis of BERT, FinBERT, and ULMFiT models.
result Models' strengths and limitations in financial sentiment analysis.
ST-GAN predicts stock trends using financial news and data.
problem Predicting financial trends in stock markets.
method ST-GAN combines NLP and technical indicators using GAN technology.
result Significant improvement over existing models in stock price forecasting.
Study improves cryptocurrency price prediction using unlabeled text data.
problem Predicting cryptocurrency returns from unlabelled text data.
method Introduced weak learning approach to finetune BERT on unlabeled text data.
result Finetuning pretrained NLP models with weak labels enhances forecast accuracy.
The Hype Index measures media attention to equities using NLP.
problem Quantifying media attention to equities for volatility analysis.
method Constructs News Count-Based and Capitalization Adjusted Hype Indices using NLP.
result The Hype Index family provides valuable tools for stock volatility analysis.
We introduce HUBERT which combines the structured-representational power of Tensor-Product Representations (TPRs) and BERT, a pre-trained bidirectional Transformer language model. We show that there is shared structure between different NLP datasets that HUBERT, but not BERT, is able to learn and leverage. We validate …
Deep learning models predict financial market trends from social media leaders.
problem Predicting financial market trends using social media data.
method Deep learning models trained on NLP analysis of leaders' Twitter handles.
result Substantial improvement in financial market prediction accuracy.
ChatGPT enhances GNN for stock movement prediction.
problem Predicting stock movements using textual data.
method Integrates ChatGPT's graph inference into GNN for stock movement forecasting.
result Model outperforms state-of-the-art benchmarks in stock movement forecasting.
Modeling investor behavior from financial advisor notes using NLP.
problem Identifying behavioral coaching opportunities for financial advisors.
method Topic modeling and supervised classification model.
result Predicting investor needs during adverse market conditions.
Study predicts market bubbles using machine learning and financial news sentiment.
problem Predicting market bubbles in the S&P 500 index.
method Three-step approach combining financial news sentiment and macroeconomic indicators.
result Proposed three-step ensemble approach significantly improves bubble prediction accuracy.
Qwen3-8B outperforms classical models in financial text classification.
problem Financial text classification for trading systems and sentiment analysis.
method Noisy Embedding Instruction Finetuning and Rank-stabilized Low-Rank Adaptation.
result Qwen3-8B achieves better classification accuracy and fewer training epochs.
Algorithm improves SLR efficiency in financial narratives.
problem Fragmented understanding of financial narratives.
method NLP, clustering, interpretability tools.
result Unified narrative modeling approaches needed.
System segments Form 10-K documents into Item sections for financial analysis.
problem Segmenting Form 10-K documents into Item sections for efficient financial analysis.
method Developed an automatic Form 10-K Itemization system using NLP techniques.
result System achieves a retrieval rate of 93% for segmenting Item sections.
This paper improves NLP interpretability by using sentence segments instead of words.
problem Limitations of word-based sampling in explaining complex BERT models.
method Using sentence segments as elementary building blocks for NLP interpretability.
result Improved fidelity of the explainer on a benchmark classification task.
Deep models for financial transactions are vulnerable to adversarial attacks, especially when adding transaction tokens.
problem Vulnerability of deep models to adversarial attacks on financial transaction records.
method Examine adversarial attacks and defenses on transaction records data, considering black-box attacks and adding transaction tokens.
result A few generated transactions can fool a deep-learning model, highlighting the need for robustness improvements.
System detects relevant financial news and predictions from unstructured text.
problem Manual extraction of relevant financial information from news is cumbersome and error-prone.
method Topic modeling with LDA, co-reference resolution, multi-paragraph segmentation, and temporal analysis.
result ROUGE-L values for relevant text and predictions/forecasts were 0.662 and 0.982, respectively.
Detects systematic anomalies in consumer complaints using NLP.
problem Detecting small, frequent anomalies in consumer complaints.
method NLP conversion of narratives, followed by anomaly detection algorithm.
result Demonstrates effectiveness of NLP for detecting systematic anomalies.
Solves the challenge of retrieving item-specific financial information from Form 10-Q filings.
problem Retrieving item-specific information from Form 10-Q filings with varying formats and machine-readable hierarchy.
method Complements a rule-based algorithm with a Convolutional Neural Network (CNN) image classifier to itemize 10-Q files.
result Demonstrates a generalized pipeline for rapid data retrieval from a large volume of textual data.
FinAI-BERT classifies AI disclosures in financial reports with high accuracy.
problem Systematic detection of AI-related disclosures in financial reports.
method Fine-tuned transformer-based model on a curated dataset.
result Achieved near-perfect classification performance (99.37% accuracy).
Study shows integrating acoustic features in financial forecasting models can degrade performance.
problem Predicting stock market volatility from corporate earnings calls using speech features.
method Empirical investigation of acoustic feature extraction in teleconference environments using a two-stream late-fusion architecture.
result Integrating acoustic features via late fusion significantly degraded performance, reducing recall to 47.08%.
The study enhances financial rule matching using NLP without datasets.
problem Performing semantic matching between financial rules and policies.
method Outperforming pre-trained models with NLP techniques using free resources.
result Improved semantic matching between financial rules and policies.
DeepTrust uses NLP to quickly identify and verify financial anomalies on Twitter.
problem Unreliable information in financial markets leading to unexpected price changes.
method Machine learning for anomaly detection, NLP for information retrieval and reliability assessment.
result DeepTrust outperforms baseline classifiers in identifying financial anomalies.
Improved financial VA intent classification accuracy.
problem Determining user intents for unseen open intents.
method Supervised pre-training of intent representations using prefix-tuning and fine-tuning.
result 1.63% - 2.07% higher accuracy on banking77 benchmark.
StakeBench evaluates language understanding by linking comments to market commitments, improving model alignment with real-world outcomes.
problem Existing financial NLP benchmarks measure perceived language rather than market commitments.
method StakeBench uses observable market behavior to supervise models, testing their ability to detect commitments, identify sides, and project odds.
result Models partially recover position-side signals but struggle with later tasks, highlighting structural failures.
Paper proposes a hybrid model for financial time series prediction using sentiment analysis.
problem Challenges in forecasting in non-stationary, complex environments with heterogeneous data.
method Hybrid model combining GANs with NLP-based sentiment analysis.
result Hybrid model enhances robustness in non-stationary environments.
Cryptonite tests NLP models with cryptic crossword clues.
problem Ambiguity in language poses a challenge for NLP models.
method Cryptic crossword dataset based on cryptic clues.
result Fine-tuning T5-Large on Cryptonite achieves only 7.6% accuracy.
BoostTransformer uses boosting to improve transformer efficiency and accuracy.
problem Heavy computational resources and hyperparameter tuning in transformer architectures.
method Augments transformers with boosting principles through subgrid token selection and importance-weighted sampling, incorporating a least square boosting objective directly into the pipeline.
result BoostTransformer demonstrates faster convergence and higher accuracy compared to standard transformers.
System detects financial forecasts in tweets, achieving high precision.
problem Detecting financial forecasts in social media messages.
method Natural Language Processing and Machine Learning techniques for real-time analysis.
result Achieves over 90% precision for financial forecasts.
The paper analyzes word embeddings and their failure to distinguish polarized terms.
problem Word embeddings fail to correctly distinguish terms with opposite polarities.
method Mathematical analysis of word2vec model, synthetic corpus generation, empirical assessment.
result Word embeddings treat antonyms as frequentist synonyms, leading to mixed polarity terms.
System detects financial news temporality combining NLP and ML.
problem Separate context from predictions in financial news.
method Combines NLP and ML, extracts dominant tenses.
result High detection precision compared to baseline.
The paper analyzes how news sentiment of companies can affect market movements.
problem Understanding how news sentiment impacts market performance and volatility.
method Applied NLP techniques to analyze news sentiment of 87 companies over 7 years.
result Strong media sentiment towards one company can indicate significant changes in sentiment towards related companies.
Study categorizes mutual funds using natural language processing from unstructured data.
problem Categorizing mutual funds using unstructured data for financial analysis.
method Used natural language processing models to classify mutual funds from their investment strategy descriptions.
result High accuracy in categorizing mutual funds using NLP from unstructured data.
Transfer learning, where a model is first pre-trained on a data-rich task before being fine-tuned on a downstream task, has emerged as a powerful technique in natural language processing (NLP). The effectiveness of transfer learning has given rise to a diversity of approaches, methodology, and practice. In this paper, …