In this work, we study abstractive text summarization by exploring different models such as LSTM-encoder-decoder with attention, pointer-generator networks, coverage mechanisms, and transformers. Upon extensive and careful hyperparameter tuning we compare the proposed architectures against each other for the abstractiv…
New TC variant dTC better fits motion planning for some systems.
problem Improving motion planning for autonomous systems.
method Defined and computed new homotopy invariant dTC.
result dTC and dcat provide better motion planning solutions.
Paper introduces new indicators for forecasting crude oil prices using short news headlines.
problem Forecasting crude oil prices from short, noisy news headlines using LDA.
method Developed two novel indicators for topic and sentiment from short text data, and applied AdaBoost.RT.
result AdaBoost.RT with the proposed indicators outperforms benchmarks in crude oil forecasting.
Developed text classification system for Azerbaijani language.
problem Text clustering problem in Azerbaijani language.
method Machine learning and embedding techniques.
result System successfully categorizes news, product reviews, and more.
New families of Lie groups with special foliations discovered.
problem Characterizing left-invariant foliations on semi-Riemannian Lie groups.
method Classifying foliations generated by specific subgroups.
result Constructing new families of Lie groups with conformal minimal foliations.
Most of the information is stored as text, so text mining is regarded as having high commercial potential. Aiming at the semantic constraint problem of classification methods based on sparse representation, we propose a weighted recurrent neural network (W-RNN), which can fully extract text serialization semantic infor…
New method detects text changes under dependencies, outperforming baselines.
problem Detecting structural changes in m-dependent text data. method Kernel change-point detection under m-dependence. result Consistent and weakly consistent detection of change points in m-dependent text. System detects relevant financial news and predictions from unstructured text.
problem Manual extraction of relevant financial information from news is cumbersome and error-prone.
method Topic modeling with LDA, co-reference resolution, multi-paragraph segmentation, and temporal analysis.
result ROUGE-L values for relevant text and predictions/forecasts were 0.662 and 0.982, respectively.
New coarse LS-category introduced for groups and spaces.
problem Large-scale topological properties of groups and spaces.
method Introducing a coarse analog of Lusternik-Schnirelmann category for metric spaces.
result Established lower and upper bounds for geometrically finite and bicombable groups.
Deep learning models outperform classical methods in text classification.
problem Improving text classification accuracy using deep learning.
method Comprehensive review of deep learning models and datasets for text classification.
result Deep learning models outperform classical methods on various text classification tasks.
Combines BERT and graph CNN for improved text classification.
problem Text classification problems
method Combining BERT embedding and graph convolutional neural network
result Graph CNN model performs better than classical models combined with BERT
Study shows text-based news veracity models don't generalize across U.S. and U.K.
problem Generalizability of text-based news veracity detection models across countries.
method Testing news veracity models on U.S. and U.K. news data.
result Text-based classifiers perform poorly when trained on one country's news data and tested on another.
This paper introduces a number of new intrinsically 3-linked graphs through five new constructions. We then prove that intrinsic 3-linkedness is not preserved by Y∇ moves. We will see that the graph M, which is obtained through a Y∇ move on (PG)∗∗(PG), is not intrinsically 3-linked.
New text as data techniques offer a great promise: the ability to inductively discover measures that are useful for testing social science theories of interest from large collections of text. We introduce a conceptual framework for making causal inferences with discovered measures as a treatment or outcome. Our framewo…
Single-stage neural architecture improves text-to-image synthesis.
problem Combining text and image generation is challenging.
method Used deep residual networks and sentence interpolation.
result Achieved state-of-the-art performance with single-stage training.
New distress dictionary improves bankruptcy prediction from disclosure text.
problem Bankruptcy prediction from financial disclosures.
method Proposes a distress dictionary based on managers' sentences, quantifies linguistic features, and builds predictive models.
result Predictive models based on the distress dictionary outperform existing methods.
StonkBERT predicts stock price movements using company text data.
problem Can language models predict medium-run stock price movements?
method Fine-tuning transformer-based language models (BERT) on company text data (news articles, blogs, annual reports) for stock price performance classification.
result StonkBERT shows substantial improvement in predictive accuracy compared to traditional models, with news articles providing the best results.
Enhances GNNs with text features for better fake news detection.
problem Detecting disinformation on social media using GNNs.
method Integrates Transformer-based textual features into GNNs.
result Contextual text representations improve GNN performance by 33.8% in Macro F1.
A new text representation model combines CNN and VAE for better semantic extraction.
problem Difficult to effectively extract semantic features and distinguish polysemy in text data.
method Integrates CNN for feature extraction and VAE for consistent Gaussian distribution.
result The model outperforms traditional classification algorithms in text classification tasks.
Early detection and precise characterization of emerging topics in text streams can be highly useful in applications such as timely and targeted public health interventions and discovering evolving regional business trends. Many methods have been proposed for detecting emerging events in text streams using topic modeli…
New formula classifies product reviews into higher and lower ratings based on sentiment analysis.
problem Lack of research on using sentiment analysis for classifying text into ratings.
method Redefined sentiment proportions as a triangle structure to derive variables for classifying text into higher and lower ratings.
result Proved a dependence exists between sentiments and ratings.
This thesis evaluates text-based vs audio-based classification of mental health interviews.
problem Classifying psychiatric illness using text-based methods.
method Design and evaluate a text classification network on mental health interviews, using belabBERT.
result Text-based classification is a strong alternative to audio-based methods.
Optimal text-based indices track VIX and inflation.
problem Maximizing contemporaneous relation or predictive performance with target variables.
method Optimizing text-based indices focusing on VIX and inflation expectations.
result Superior performance compared to existing indices.
Unified framework improves NLP tasks by converting diverse problems into text-to-text format.
problem Improving natural language processing tasks through transfer learning.
method Unified text-to-text transformer framework, comparing various pre-training objectives and architectures.
result Achieved state-of-the-art results on multiple NLP benchmarks.
Let M be an n-dimensional complete Riemannian manifold with Ricci curvature ≥n−1. In \cite{colding1, colding2}, Tobias Colding, by developing some new techniques, proved that the following three condtions: 1) dGH(M,Sn)→0; 2) the volume of M Vol(M)→Vol(Sn); 3) the radius of $M…
New method compares feature importance and rule extraction for text data interpretability.
problem Unexpected differences in explanations from feature importance and rule extraction methods.
method Proposes a new approach to compare explanations from different methods.
result Different methods can lead to unexpected explanations, even for simple models.
HyperBERT enhances BERT for node classification on text-attributed hypergraphs.
problem Challenges in capturing hypergraph structure and text attributes in node classification.
method Mixing hypergraph-aware layers with BERT for improved node classification.
result HyperBERT achieves state-of-the-art results on text-attributed hypergraph benchmarks.
HawkesLLM models text generation with temporal influence, improving semantic alignment under limited memory.
problem Path-dependent uncertainty in agentic text-simulation systems.
method HawkesLLM framework separates temporal influence modeling from text generation, using a multivariate Hawkes process and a language model.
result HawkesLLM improves late-stage semantic alignment under a compact prompt-memory budget.
Study improves cryptocurrency price prediction using unlabeled text data.
problem Predicting cryptocurrency returns from unlabelled text data.
method Introduced weak learning approach to finetune BERT on unlabeled text data.
result Finetuning pretrained NLP models with weak labels enhances forecast accuracy.
A new framework uses text descriptions to improve protein design.
problem Lack of effective methods to incorporate textual descriptions in protein design.
method ProteinDT framework that combines text and protein structural information.
result ProteinDT significantly improves protein design accuracy and performance.
MoleculeSTM learns from molecule structures and texts for better drug design.
problem Lack of integration between chemical structures and textual knowledge in AI drug discovery.
method Jointly learns chemical structures and texts via contrastive learning, using a large dataset.
result MoleculeSTM achieves state-of-the-art performance in zero-shot tasks like structure-text retrieval and molecule editing.
A new text clustering method using NMF and LSA improves stability and performance.
problem Text data's large, sparse term-document matrix makes clustering difficult.
method Proposes a new feature agglomeration method based on NMF and deterministic K-Means initialization.
result Significantly improves clustering performance and stability.
Textual network embedding leverages rich text information associated with the network to learn low-dimensional vectorial representations of vertices. Rather than using typical natural language processing (NLP) approaches, recent research exploits the relationship of texts on the same edge to graphically embed text. How…
We define a new method to estimate centroid for text classification based on the symmetric KL-divergence between the distribution of words in training documents and their class centroids. Experiments on several standard data sets indicate that the new method achieves substantial improvements over the traditional classi…
New method explains high-dimensional text classifiers.
problem Limited explainability tools for high-dimensional inputs and neural networks.
method Theoretical high-dimensional properties in neural networks.
result Improved explainability for neural network classifiers.
A new reinforcement learning framework separates users into risk-tolerant and risk-averse groups for better performance.
problem Improving performance for risk-averse users in reinforcement learning.
method Introducing a tiered reinforcement learning approach with two policies: πextO and πextE. result Achieving constant regret for risk-averse users, independent of the number of episodes.
Develops a machine learning framework for identifying authorship in texts.
problem Identifying the author of texts, especially when authors are unknown or multiple.
method Formulates authorship identification as a text categorization problem, uses supervised machine learning with stylometric features.
result A model accurately predicts authorship with high accuracy, especially with linguistic stylometric features.
A new method improves text generation quality and diversity.
problem Exposure bias in Maximum Likelihood Estimation for text generation.
method ψ-MLE, a new training scheme based on density ratio estimation.
result ψ-MLE outperforms Maximum Likelihood Estimation and other models in text generation quality and diversity.
Convolutional neural network (CNN) is a neural network that can make use of the internal structure of data such as the 2D structure of image data. This paper studies CNN on text categorization to exploit the 1D structure (namely, word order) of text data for accurate prediction. Instead of using low-dimensional word ve…
In a variety of application domains the content to be recommended to users is associated with text. This includes research papers, movies with associated plot summaries, news articles, blog posts, etc. Recommendation approaches based on latent factor models can be extended naturally to leverage text by employing an exp…
A method for disentangling text representations without supervision.
problem Challenges in learning disentangled representations of natural language.
method Information-theoretic guidance to induce independent style and content embeddings.
result High quality disentangled representations in terms of content and style preservation.
New method improves image generation for inverse problems using text prompts.
problem Suboptimal performance of existing latent diffusion models for inverse problems.
method Prompt tuning and latent variable projection to optimize text embeddings.
result P2L method outperforms existing methods on various inverse problem tasks.
A new presentation of a quotient of braid groups leads to a new type of Burnside group.
problem Understanding the structure of quotient groups of braid groups.
method Purely group-theoretic methods, including presentations and finiteness results.
result A new presentation for the kernel of a truncated quotient map of braid groups.
New method considers subjectivity in text analysis using 'Room Theory'.
problem Detecting emotions in text considering subjective context.
method Framework Theory, Word2Vec, similarity measure between words.
result Measures relative relevance of emotions for a document.
New tool for parallel and private stochastic convex optimization reduces query complexity.
problem Parallel and private stochastic convex optimization with reduced query complexity.
method Reweighted Stochastic Query (ReSQue) estimator combined with ball oracle acceleration.
result Achieves state-of-the-art complexities for SCO in parallel and private settings.
Hungarian text processing improved with efficient, accurate NLP pipelines.
problem Improving text processing for Hungarian language.
method Implemented in spaCy framework, focusing on efficiency and accuracy.
result Near state-of-the-art performance in all text preprocessing steps.
New rigidity result for non-orientable manifolds with scalar curvature constraints.
problem Area rigidity for non-orientable manifolds with scalar curvature constraints.
method Developed a technique to extract from a non-vanishing higher index a geometrically useful family of almost D-harmonic sections. result Area rigidity for non-orientable manifolds with scalar curvature constraints.
Entity linking is the task of mapping potentially ambiguous terms in text to their constituent entities in a knowledge base like Wikipedia. This is useful for organizing content, extracting structured data from textual documents, and in machine learning relevance applications like semantic search, knowledge graph const…