Improved sentiment analysis with multimodal data.
problem Cross-modal sentiment analysis in social media, customer service, and video blogs.
method Gated mechanism for attention-based learning of cross-modal interactions, with experiments on CMU-MOSI and CMU-MOSEI datasets.
result 1.6% and 1.34% absolute improvement over state-of-the-art.
With the increasing popularity of video sharing websites such as YouTube and Facebook, multimodal sentiment analysis has received increasing attention from the scientific community. Contrary to previous works in multimodal sentiment analysis which focus on holistic information in speech segments such as bag of words re…
Multimodal machine learning is a core research area spanning the language, visual and acoustic modalities. The central challenge in multimodal learning involves learning representations that can process and relate information from multiple modalities. In this paper, we propose two methods for unsupervised learning of j…
Study enhances cryptocurrency sentiment analysis using TikTok and Twitter data.
problem Lack of comprehensive sentiment analysis in cryptocurrency markets.
method Multimodal analysis of TikTok and Twitter data using large language models.
result TikTok's video sentiment influences speculative assets and short-term trends.
Multimodal fusion is considered a key step in multimodal tasks such as sentiment analysis, emotion detection, question answering, and others. Most of the recent work on multimodal fusion does not guarantee the fidelity of the multimodal representation with respect to the unimodal representations. In this paper, we prop…
Paper proposes ICCN to learn correlations between text, audio, and video for multimodal sentiment analysis.
problem Improving multimodal sentiment analysis by learning hidden correlations between text and audio/video features.
method Interaction Canonical Correlation Network (ICCN) using deep canonical correlation analysis (DCCA).
result Empirical results confirm the effectiveness of ICCN in capturing useful information from all three views.
We propose a novel approach to multimodal sentiment analysis using deep neural networks combining visual analysis and natural language processing. Our goal is different than the standard sentiment analysis goal of predicting whether a sentence expresses positive or negative sentiment; instead, we aim to infer the laten…
Recent Transformer-based contextual word representations, including BERT and XLNet, have shown state-of-the-art performance in multiple disciplines within NLP. Fine-tuning the trained contextual models on task-specific datasets has been the key to achieving superior performance downstream. While fine-tuning these pre-t…
Deep RL model uses multimodal data for better stock portfolio optimization.
problem Optimizing trading strategies for SP100 stocks using complex data sources.
method Multimodal deep reinforcement learning with state tensors, CNNs, and RNNs.
result Agent outperforms standard benchmarks in portfolio performance.
This paper improves stock price prediction using multimodal data.
problem Accurate stock price prediction with diverse data integration.
method Combining financial metrics, tweets, and news articles through multimodal machine learning.
result Significant performance improvement in stock price prediction by up to 5%.
DAM improves cryptocurrency trend forecasting using multimodal data.
problem Simplistic merging of sentiment data in cryptocurrency trend forecasting.
method Dual Attention Mechanism (DAM) integrating financial metrics and sentiment analysis.
result DAM outperforms conventional models by up to 20% in prediction accuracy.
Study improves stock movement prediction using multimodal data.
problem Inaccurate stock movement prediction due to incomplete multimodal data integration.
method Introduces MSGCA framework for robust multimodal fusion.
result MSGCA framework outperforms existing methods by 21.7% on multimodal datasets.
Multimodal sentiment analysis is a core research area that studies speaker sentiment expressed from the language, visual, and acoustic modalities. The central challenge in multimodal learning involves inferring joint representations that can process and relate information from these modalities. However, existing work l…
Study uses AI to analyze emojis for predicting cryptocurrency market trends.
problem Predicting cryptocurrency market trends using social media sentiment.
method Fine-tuned transformer-based BERT model for multimodal sentiment analysis of emojis.
result Emoji sentiment analysis outperforms text-only sentiment analysis in predicting market trends.
Multimodal research is an emerging field of artificial intelligence, and one of the main research problems in this field is multimodal fusion. The fusion of multimodal data is the process of integrating multiple unimodal representations into one compact multimodal representation. Previous research in this field has exp…
Computational modeling of human multimodal language is an emerging research area in natural language processing spanning the language, visual and acoustic modalities. Comprehending multimodal language requires modeling not only the interactions within each modality (intra-modal interactions) but more importantly the in…
There has been an increased interest in multimodal language processing including multimodal dialog, question answering, sentiment analysis, and speech recognition. However, naturally occurring multimodal data is often imperfect as a result of imperfect modalities, missing entries or noise corruption. To address these c…
Study investor sentiment and disagreement on StockTwits during COVID-19.
problem Understanding investor beliefs and sentiment during the pandemic.
method Analysis of social media data (StockTwits) for investor messages.
result Sentiment and disagreement sharply decreased in early March 2020, followed by a reversal.
Study analyzes global public sentiment on DeFi from 2012-2022.
problem Global public sentiment on DeFi is understudied.
method Sentiment analysis, spatial econometrics, clustering, topic modeling.
result Economic development significantly influences DeFi engagement, especially after 2015.
ChatGPT struggles in predicting stock movements, underperforming traditional methods.
problem Predicting stock market movements using ChatGPT.
method Zero-shot analysis of ChatGPT's multimodal stock prediction capabilities.
result ChatGPT underperforms traditional methods and state-of-the-art models in predicting stock movements.
Study forecasts sub-city real estate prices weekly using radar and news sentiment.
problem Limited availability of reliable real estate price indicators at neighborhood and long horizons.
method Combining satellite radar signals and news sentiment to forecast sub-city real estate prices.
result The multimodal model reduces mean absolute error by 35% at long horizons (26-34 weeks).
Learning multimodal representations is a fundamentally complex research problem due to the presence of multiple heterogeneous sources of information. Although the presence of multiple modalities provides additional valuable information, there are two key challenges to address when learning from multimodal data: 1) mode…
We propose a novel method, Modality-based Redundancy Reduction Fusion (MRRF), for understanding and modulating the relative contribution of each modality in multimodal inference tasks. This is achieved by obtaining an (M+1)-way tensor to consider the high-order relationships between M modalities and the output laye…
Study improves cryptocurrency volatility forecasting using multiple data sources.
problem Improving accuracy of predicting cryptocurrency volatility.
method Developed CoMForE, a multimodal AdaBoost-LSTM ensemble model.
result Significantly improved cryptocurrency volatility forecasting (19.29% improvement).
This study improves stock price prediction using multimodal data.
problem Improving financial asset price forecasting accuracy.
method Combining candlestick time series and textual news flow data using LSTM and pre-trained models.
result Textual modality reduces MAPE by 55%.
Can textual data be compressed intelligently without losing accuracy in evaluating sentiment? In this study, we propose a novel evolutionary compression algorithm, PARSEC (PARts-of-Speech for sEntiment Compression), which makes use of Parts-of-Speech tags to compress text in a way that sacrifices minimal classification…
Unsupervised methods have proven effective for discriminative tasks in a single-modality scenario. In this paper, we present a multimodal framework for learning sparse representations that can capture semantic correlation between modalities. The framework can model relationships at a higher level by forcing the shared …
LLMs improve financial sentiment analysis in finance.
problem Defining and measuring financial sentiment.
method Investigation of sentiment measurement methods and LLMs.
result LLMs enhance financial sentiment analysis.
Sentiment analysis from news and social media predicts forex market movements.
problem Forecasting forex market movements using sentiment analysis.
method Lexicon-based analysis and Naive Bayes machine learning.
result Sentiment analysis is effective in predicting forex market movements.
The New Yorker publishes a weekly captionless cartoon. More than 5,000 readers submit captions for it. The editors select three of them and ask the readers to pick the funniest one. We describe an experiment that compares a dozen automatic methods for selecting the funniest caption. We show that negative sentiment, hum…
BERTopic enhances stock market prediction by analyzing sentiment in topic models.
problem Improving stock price prediction accuracy using sentiment analysis.
method Employed BERTopic for sentiment analysis of stock market comments integrated with deep learning models.
result Enhanced model performance through topic sentiment integration.
FinEAS models financial sentiment using BERT embeddings.
problem Financial sentiment analysis in markets.
method Supervised fine-tuning of BERT embeddings for financial texts.
result FinEAS outperforms vanilla BERT, LSTM, and FinBERT.
Improved financial sentiment analysis using simple instruction tuning of LLMs.
problem Lack of accurate financial sentiment analysis by large language models.
method Instruction tuning of general-purpose LLMs with a small portion of financial sentiment data.
result Significant improvement in financial sentiment analysis, especially in complex scenarios.
Study combines sentiment analysis with traditional models for better S&P 500 trading.
problem Improving trading performance in volatile markets.
method Sentiment analysis from financial news, GPT-2, FinBERT, combined with technical indicators and time-series models.
result Combining sentiment-driven insights with traditional models improves trading performance.
Study evaluates if LLMs have company-specific biases in financial sentiment analysis.
problem Evaluating if large language models exhibit company-specific biases in financial sentiment analysis.
method Comparing sentiment scores with and without company names, constructing economic models, and empirical analysis.
result LLMs show company-specific biases in sentiment analysis, impacting investor behavior and stock prices.
New formula classifies product reviews into higher and lower ratings based on sentiment analysis.
problem Lack of research on using sentiment analysis for classifying text into ratings.
method Redefined sentiment proportions as a triangle structure to derive variables for classifying text into higher and lower ratings.
result Proved a dependence exists between sentiments and ratings.
FinGPT uses LLMs for real-time market sentiment analysis.
problem Real-time market sentiment analysis for trading.
method Synthesizes financial news and social media data, integrates with technical indicators, uses FinGPT for sentiment analysis.
result Generates actionable trading signals using LLMs.
Improved financial sentiment analysis using LLMs with retrieval augmentation.
problem Limited performance of traditional NLP models in financial sentiment analysis.
method Retrieval-augmented Large Language Models (LLMs) with instruction tuning.
result Achieved 15% to 48% performance gain in accuracy and F1 score.
Study compares BERT with other sentiment analysis models.
problem Comparing sentiment analysis techniques.
method Used four models: Sent WordNet, logistic regression, LSTM, and BERT on IMDB movie reviews.
result BERT outperformed other models in sentiment classification.
R package sentometrics analyzes text sentiment for predictions.
problem Unlocking value from textual data using sentiment analysis.
method Optimized textual sentiment indexation with R package sentometrics.
result Forecasted CBOE Volatility Index using text sentiment data.
Study uses Granger causality to show investor sentiment influences stock prices.
problem Understanding the relationship between investor sentiment and stock market movements.
method Applied Granger causality to analyze the relationship between close price index and sentiment score.
result Sentiment analysis shows a positive correlation with stock price movements.
Study uses sentiment analysis to predict implied volatility surface, improving prediction accuracy.
problem Improving prediction accuracy of implied volatility surface.
method Constructed daily high-frequency sentiment data, used VAR method, deep learning (BERT, LSTM), FFT, EMD for sentiment decomposition.
result High-frequency sentiment correlates with ATM options' implied volatility, low-frequency with DOTM options.
This paper analyzes financial sentiment using LLMs and FinBERT, improving accuracy with few-shot examples.
problem Financial sentiment analysis for market evaluation.
method Application of large language models and FinBERT, with focus on prompt engineering and few-shot learning.
result GPT-4o achieves similar sentiment classification accuracy to FinBERT with fewer examples.
Study uses sentiment analysis to predict cryptocurrency token returns in virtual reality.
problem Predicting cryptocurrency token returns in virtual reality economies.
method Used BERT for sentiment analysis and developed LSTM models integrating multi-modal features.
result Multi-modal model significantly outperforms price-only baseline in prediction accuracy.
This study evaluates LLMs for sentiment analysis in stock price prediction.
problem Improving stock price prediction accuracy using LLMs for news sentiment analysis.
method Compared 3 LLMs (DeBERTa, RoBERTa, FinBERT) for sentiment-driven stock prediction.
result DeBERTa outperforms other models with 75% accuracy, and ensemble model increases accuracy to 80%.
This paper proposes a new HDP based online review rating regression model named Topic-Sentiment-Preference Regression Analysis (TSPRA). TSPRA combines topics (i.e. product aspects), word sentiment and user preference as regression factors, and is able to perform topic clustering, review rating prediction, sentiment ana…
Research integrates sentiment analysis with reinforcement learning for better trading strategies.
problem Improving trading performance by integrating sentiment data.
method Developed a sentiment-driven trading system using a large language model and reinforcement learning.
result Sentiment signals from FinGPT improve trading performance when combined with technical indicators.
The ability to identify sentiment in text, referred to as sentiment analysis, is one which is natural to adult humans. This task is, however, not one which a computer can perform by default. Identifying sentiments in an automated, algorithmic manner will be a useful capability for business and research in their search …