Optimal text-based indices track VIX and inflation.
problem Maximizing contemporaneous relation or predictive performance with target variables.
method Optimizing text-based indices focusing on VIX and inflation expectations.
result Superior performance compared to existing indices.
Interactive game approach extracts action graphs from specialized text.
problem Action graph extraction from specialized procedural text.
method Interpreting procedural text as game instructions, using a learning agent to simulate and execute the procedure.
result Framework complements existing approaches and enables richer learning.
Paper tackles treatment leakage in text-based causal inference, proposing methods to mitigate bias.
problem Treatment leakage in text-as-confounder applications introduces bias in causal estimates.
method Formal definitions, four text distillation methods (passage removal, classification, salient feature removal, nullspace projection).
result Moderate distillation optimally balances bias reduction against confounder retention.
This work trains a model to generate all valid commands for text-based games.
problem Generating valid commands for text-based games.
method Training generative models on a dataset of text-based game contexts.
result The best model can generate valid commands unseen at training and achieves high F1 score.
Study shows text-based news veracity models don't generalize across U.S. and U.K.
problem Generalizability of text-based news veracity detection models across countries.
method Testing news veracity models on U.S. and U.K. news data.
result Text-based classifiers perform poorly when trained on one country's news data and tested on another.
KG-A2C agent learns natural language IF games by reasoning and constraining action spaces.
problem Challenges of natural language understanding, partial observability, and combinatorially large action spaces in IF games.
method Builds a dynamic knowledge graph while exploring, constraining actions using templates.
result Outperforms current IF agents across various games with larger action spaces.
RecoBERT uses a language model to recommend items from catalogs.
problem Harnessing language models for text-based item recommendations.
method RecoBERT is a BERT-based approach that learns specialized language models for item recommendations without requiring labeled data.
result RecoBERT outperforms other techniques in inferring item similarities from textual catalogs.
This thesis evaluates text-based vs audio-based classification of mental health interviews.
problem Classifying psychiatric illness using text-based methods.
method Design and evaluate a text classification network on mental health interviews, using belabBERT.
result Text-based classification is a strong alternative to audio-based methods.
Improved RL for TBGs by pruning irrelevant tokens and bootstrapping.
problem RL methods fail to generalize in TBGs with small data.
method CREST for irrelevant token removal, bootstrapped Q-learning.
result Improved generalization in unseen TextWorld games.
New text as data techniques offer a great promise: the ability to inductively discover measures that are useful for testing social science theories of interest from large collections of text. We introduce a conceptual framework for making causal inferences with discovered measures as a treatment or outcome. Our framewo…
We introduce TextWorld, a sandbox learning environment for the training and evaluation of RL agents on text-based games. TextWorld is a Python library that handles interactive play-through of text games, as well as backend functions like state tracking and reward assignment. It comes with a curated list of games whose …
MoleculeSTM learns from molecule structures and texts for better drug design.
problem Lack of integration between chemical structures and textual knowledge in AI drug discovery.
method Jointly learns chemical structures and texts via contrastive learning, using a large dataset.
result MoleculeSTM achieves state-of-the-art performance in zero-shot tasks like structure-text retrieval and molecule editing.
Learning how to act when there are many available actions in each state is a challenging task for Reinforcement Learning (RL) agents, especially when many of the actions are redundant or irrelevant. In such cases, it is sometimes easier to learn which actions not to take. In this work, we propose the Action-Elimination…
GENs model generates sparse graphs from text-based inputs, achieving high validity.
problem Efficiently modeling and generating sparse graphs with unique and valid structures.
method RNN-based GENs model trained with an examination mechanism to predict graph characters.
result Moderate to high validity achieved in LGI strings for sparse graph generation.
Q*BERT learns to navigate text-based games by building a knowledge graph.
problem Text-based games have bottlenecks that standard RL agents struggle to overcome.
method Q*BERT learns a knowledge graph and uses intrinsic motivation to detect and overcome bottlenecks.
result Q*BERT outperforms state-of-the-art agents in text games, including Zork.
WideDTA predicts drug-target binding affinity using text-based information.
problem Predicting drug-target binding affinity is a major challenge in drug discovery.
method WideDTA uses chemical and biological textual sequence information, including protein sequence, ligand SMILES, protein domains and motifs, and maximum common substructure words.
result WideDTA outperformed DeepDTA on the KIBA dataset, indicating the word-based sequence representation is a promising alternative.
Adversarial tweets can fool stock prediction models, causing financial loss.
problem Vulnerability of stock prediction models to adversarial attacks on social media.
method Solving combinatorial optimization problems with semantic and budget constraints to generate adversarial tweets.
result Adversarial tweets can fool stock prediction models and cause significant financial loss.
Study enhances cryptocurrency sentiment analysis using TikTok and Twitter data.
problem Lack of comprehensive sentiment analysis in cryptocurrency markets.
method Multimodal analysis of TikTok and Twitter data using large language models.
result TikTok's video sentiment influences speculative assets and short-term trends.
LeDeepChef learns to play multiple cooking games well.
problem Designing a general RL agent for multiple games of the same family.
method Actor-critic framework, action-space pruning, hierarchical RL, specialized module.
result LeDeepChef outperformed competitors on a diverse set of cooking games.
Study improves cryptocurrency price prediction using unlabeled text data.
problem Predicting cryptocurrency returns from unlabelled text data.
method Introduced weak learning approach to finetune BERT on unlabeled text data.
result Finetuning pretrained NLP models with weak labels enhances forecast accuracy.
Text-based analysis methods allow to reveal privacy relevant author attributes such as gender, age and identify of the text's author. Such methods can compromise the privacy of an anonymous author even when the author tries to remove privacy sensitive content. In this paper, we propose an automatic method, called Adver…
TBIP uses texts to quantify lawmakers' political positions.
problem Quantifying lawmakers' political positions from speeches, tweets, etc.
method Unsupervised probabilistic topic model analyzing texts.
result TBIP separates lawmakers by party and infers ideal points close to vote-based.
Paper proposes HGAT for detecting fake news on HIN.
problem Viral spread of fake news causing social harm.
method Hierarchical Graph Attention Network (HGAT) for node representation learning in HIN.
result HGAT outperforms text-based and network-based models.
This study reviews text-based stock market analysis methods.
problem Insufficient analysis of unstructured textual data in stock market predictions.
method Reviews existing literature, covers data types, representation techniques, and analysis methods.
result Identifies open problems and suggests future research directions.
Simplified image clustering achieves competitive results without text-based embeddings.
problem Complexity and resource requirements of state-of-the-art clustering methods.
method SCP: trains a small cluster head using pre-trained vision model features and positive data pairs.
result SCP achieves highly competitive performance on various benchmark datasets.
We have applied the Zipf method to extract the ζ′ exponent for seven financial indices (DAX, FTSE; DJIA, NASDAQ, S&P500; Hang-Seng and Nikkei 225), after having translated the signals into a text based on two letters. We follow considerations based on the signal Hurst exponent and the notion of a time dependent Zipf …
Paper proposes ICCN to learn correlations between text, audio, and video for multimodal sentiment analysis.
problem Improving multimodal sentiment analysis by learning hidden correlations between text and audio/video features.
method Interaction Canonical Correlation Network (ICCN) using deep canonical correlation analysis (DCCA).
result Empirical results confirm the effectiveness of ICCN in capturing useful information from all three views.
SWIFT learns intrinsic rewards from LLM hidden states for efficient best-of-N sampling.
problem Efficiency and scalability of reward models for LLMs.
method SWIFT (Simple Weighted Intrinsic Feedback Technique) learns a reward function directly from LLM hidden states.
result SWIFT outperforms existing baselines by 12.7% on MATH dataset while using less than 0.005% of their parameters.
NegToMe uses images to guide text-based models away from unwanted visual elements.
problem Insufficient text-based adversarial guidance for complex visual concepts.
method Negative token merging (NegToMe) using visual features from reference images.
result Significantly enhances output diversity and reduces visual similarity to copyrighted content.
Industry datasets used for text classification are rarely created for that purpose. In most cases, the data and target predictions are a by-product of accumulated historical data, typically fraught with noise, present in both the text-based document, as well as in the targeted labels. In this work, we address the quest…
The group affect or emotion in an image of people can be inferred by extracting features about both the people in the picture and the overall makeup of the scene. The state-of-the-art on this problem investigates a combination of facial features, scene extraction and even audio tonality. This paper combines three addit…
Paper evaluates using app images for classification, improving accuracy.
problem Improving app classification accuracy when text descriptions are missing or inadequate.
method Used OCR, pic2vec, captionbot.ai, and object detection to convert images into text or vectors for classification.
result Improved classification accuracy of 96% for some app categories when images are added.
Study earnings calls to predict stock price movements, finding them more predictive than traditional data.
problem Improving investment decisions by analyzing earnings calls for stock price predictions.
method Graph Neural Network based approach to process and analyze earnings call transcripts.
result Earnings call transcripts are more predictive of stock price movements than traditional hard data.
Extracts credit-relevant information from earnings calls.
problem Investors do not fully internalize credit-relevant information from earnings calls.
method Develops a novel technique to extract credit-relevant information from earnings call text.
result The extracted information forecasts future credit spread changes and firm profitability.
NLP techniques improve drug discovery by analyzing chemical and protein text.
problem Improving drug discovery through better analysis of chemical and protein text.
method Natural language processing techniques applied to biochemical entities.
result Enhanced prediction of molecular properties and design of novel molecules.
Differentiable mask prunes deep networks for vision and text.
problem Efficiently compressing deep networks for edge devices.
method Introduces a differentiable mask for sparsity induction.
result Successfully prunes weights, filters, and nodes of convolutional and recurrent networks.
Traditional methods outperform LLMs in forecasting corporate credit ratings.
problem Forecasting corporate credit ratings using LLMs.
method Comparison of traditional methods (XGBoost) and LLMs (LLaMA) on credit rating forecasting.
result XGBoost outperforms LLMs in forecasting corporate credit ratings.
Model uses LLM features to predict stock returns effectively.
problem Predicting stock returns from text data.
method Structured Event Representation (SER) model with attention mechanisms.
result SER-based model outperforms existing models in stock return prediction.
Study analyzes Facebook reactions to scholarly articles.
problem Lack of analysis on click-based responses to scholarly content.
method Developed a new dataset of Facebook Reactions, analyzed statistical trends, and trained/tested supervised learning algorithms.
result Preliminary tests suggest stratification in user following based on page subject matter.
Paper proposes a new word embedding method optimizing word similarity.
problem Optimizing word similarity in embedding space.
method Two-step random walks between words via topics to learn an optimal embedding simplex.
result Our method outperforms existing approaches in various queries.
In the wake of the still ongoing global financial crisis, bank interdependencies have come into focus in trying to assess linkages among banks and systemic risk. To date, such analysis has largely been based on numerical data. By contrast, this study attempts to gain further insight into bank interconnections by tappin…
A new method combines topological features with graph convolutional networks for improved paper classification.
problem Classifying papers based on their content and structure.
method Combining topological features of nodes with information propagation through Graph Convolutional Networks (GCN).
result The method improves classification accuracy on CiteSeer and Cora datasets, matching or exceeding text-based classification results.
ChatGPT enhances GNN for stock movement prediction.
problem Predicting stock movements using textual data.
method Integrates ChatGPT's graph inference into GNN for stock movement forecasting.
result Model outperforms state-of-the-art benchmarks in stock movement forecasting.
Social media conversations unfold based on complex interactions between users, topics and time. While recent models have been proposed to capture network strengths between users, users' topical preferences and temporal patterns between posting and response times, interaction patterns between topics has not been studied…
Recent advances in Representation Learning and Adversarial Training seem to succeed in removing unwanted features from the learned representation. We show that demographic information of authors is encoded in -- and can be recovered from -- the intermediate representations learned by text-based neural classifiers. The …
Deep learning model improves Vietnamese NER accuracy.
problem Vietnamese named entity recognition (NER) accuracy.
method Combining Bi-LSTM and CRF with word embeddings and semantic features.
result Achieved state-of-the-art NER results on VLSP2016 dataset.
Shapley values explain financial language models, aligning with domain knowledge.
problem Lack of explainability in financial applications of large language models.
method Shapley value analysis for financial textual data.
result Shapley values provide consistent explanations with financial reasoning.
Relational machine learning studies methods for the statistical analysis of relational, or graph-structured, data. In this paper, we provide a review of how such statistical models can be "trained" on large knowledge graphs, and then used to predict new facts about the world (which is equivalent to predicting new edges…