New method learns more diverse topics from text documents considering paragraph structure.
problem Classic Topic Models ignore word position and use symmetric priors, limiting topic diversity.
method Exploits paragraph structure to distinguish between general and specific topics.
result Shows improved topic diversity and relevance in structured documents.
Bayesian approach improves paragraph vector entropy and uncertainty in text analysis.
problem Capturing semantic relationships in text of varying lengths.
method Probabilistic generative model for paragraph vectors with Bayesian inference.
result Entropy of paragraph vectors decreases with document length and uncertainty improves performance in text analysis.
A classical link in 3-space can be represented by a Gauss paragraph encoding a link diagram in a combinatorial way. A Gauss paragraph may code not a classical link diagram, but a diagram with virtual crossings. We present a criterion and a linear algorithm detecting whether a Gauss paragraph encodes a classical link. W…
A Gauss paragraph is a combinatorial formulation of a generic closed curve with multiple components on some surface. A virtual string is a collection of circles with arrows that represent the crossings of such a curve. Every closed curve has an underlying virtual string and every virtual string has an underlying Gauss …
The paper constructs minimal realizations of signed Gauss paragraphs using graph theory.
problem Constructing minimal realizations of signed Gauss paragraphs on surfaces.
method Theory of embedded graphs on oriented and compact PL-surfaces, intersection pairing of immersed PL-normal curves.
result The genus of the ambient surface can be a function of the maximum number of Carter's circles.
Paper develops a framework for generating coherent image captions using visual features and hierarchical topics.
problem Generating semantically coherent paragraphs to describe image content.
method Plug-and-play hierarchical-topic-guided image paragraph generation framework integrating visual extractor and deep topic model.
result Proposed models can distill interpretable multi-layer semantic topics and generate diverse and coherent captions.
The paper identifies patterns in language model weights used for memorizing paragraphs.
problem Locating the specific mechanisms and weights used by language models to memorize paragraphs.
method Examined gradients and attention patterns in language models to identify memorized paragraphs.
result Gradients of memorized paragraphs have a distinguishable spatial pattern, and localized attention heads are involved in paragraph memorization.
This work speeds up unsupervised sentence learning using paragraph coherence.
problem Training fast unsupervised sentence encoders.
method Discourse-based objective function for neural network training.
result Models trained with this method are faster and perform well.
Framework learns sentence order from paragraphs using attention and transformer networks.
problem Learning to order sentences from a paragraph.
method Bidirectional sentence encoder and self-attention transformer network for ranking.
result Framework outperforms state-of-the-art methods on sentence ordering and discrimination tasks.
This study compares feature extraction methods using Neural Networks and Latent Dirichlet Allocation for movie synopses.
problem Extracting meaningful features from movie synopses for pattern detection and recommendation.
method Employed Latent Dirichlet Allocation for topic modeling and Neural Networks for distributed paragraph representations.
result Latent Dirichlet Allocation can provide meaningful features for movie synopses, comparable to Neural Networks.
Improved text embeddings enhance retrieval from a knowledge base.
problem Efficiently retrieving relevant paragraphs from a large knowledge base.
method Used Stanford Question Answering Dataset (SQuAD) for open-domain question answering. Compared various text-embedding methods and trained deep residual neural models for retrieval.
result Training deep residual neural models for retrieval purposes significantly improves paragraph recall.
A new model analyzes document structure and customer shopping patterns.
problem Understanding document structure and customer shopping patterns.
method Variational EM algorithm for multilayer correlated topic modeling.
result MCTM successfully captures document structure and customer shopping patterns.
Convolutional autoencoding improves long text reconstruction.
problem Text reconstruction quality decreases with text length.
method Sequence-to-sequence, purely convolutional and deconvolutional autoencoding.
result Better at reconstructing and correcting long paragraphs.
Transformer models improve query-document retrieval efficiency and accuracy.
problem Efficiently retrieve relevant documents from large corpora for query matching.
method Designed paragraph-level pre-training tasks to optimize embedding-based Transformer models.
result Transformer models significantly outperform BM-25 and non-Transformer embedding models.
A new system learns entity representations to improve local entity disambiguation.
problem Local entity disambiguation in text.
method Entity-ELMo (E-ELMo) approach for contextual entity representation.
result Outperforms state-of-the-art models by 0.5% on AIDA test-b.
The paper evaluates different vector space models for text similarity.
problem Measuring semantic text similarity in natural language processing.
method Comparison of TFIDF, topic models, and neural models for patent-to-patent similarity.
result TFIDF performs well for longer, technical texts or finer distinctions.
Project aims to improve coherence in language generation models.
problem Models often generate inconsistent text that diverges from the prompt.
method Trained a sentence pair coherence classifier and co-trained GPT-2 with this coherence objective.
result Fine-tuned model generates coherent paragraphs without diverging.
An unsupervised method clusters patient incident reports for content analysis.
problem Lack of methods to extract interpretable content from electronic healthcare records.
method Combines text-embedding with paragraph vectors and graph-theoretical multiscale community detection.
result Extracts high-intrinsic-consistency groups of patient incident reports.
Gestalt combines two models to improve SQuAD2.0 performance.
problem Improving the accuracy of answering questions in context paragraphs.
method A stacking ensemble of ALBERT and RoBERTa models, combined with a CNN-based meta-model.
result Best ensemble achieved 87.117 EM and 90.306 F1 scores, improving baseline by 0.55% and 0.61% respectively.
Paper proposes a method for semi-supervised learning of molecular representations.
problem Learning representations of molecules in a semi-supervised manner.
method Unsupervised hierarchical feature extraction algorithm using neural message passing.
result Method outperforms existing methods in benchmark datasets.
AutoML-GPT uses GPT to automate AI model training.
problem Manual model selection and tuning requires significant human effort.
method Develops task-oriented prompts and utilizes LLMs for automated training.
result Achieves remarkable results in various AI tasks.
Proposes a new RNN for language generation capturing long-range dependencies.
problem Capturing long-range word dependencies and sentence order in text corpora.
method Recurrent Hierarchical Topic-Guided RNN with dynamic deep topic model.
result Outperforms larger-context RNN-based language models and learns interpretable topics.
Benchmark evaluates financial misinformation detection models, revealing weaknesses without external context.
problem Detecting financial misinformation without external references.
method RFC Bench at paragraph level, two tasks: reference-free detection and comparison-based diagnosis.
result Performance improves with comparative context, revealing model weaknesses in reference-free settings.
Paper proposes a neural network for generating better questions from text.
problem Automatic generation of relevant questions from sentences and paragraphs.
method Adaptive copying recurrent neural network model with a copying mechanism added to a bidirectional LSTM architecture.
result The model outperforms state-of-the-art methods in question generation metrics.
Recursive neural networks mimic QCD for jet physics.
problem Improving jet physics predictions using machine learning.
method Analogies between QCD and natural languages for jet clustering.
result Recursive architectures are more accurate and data efficient than previous methods.
StoryGen uses images to generate coherent text from multiple images.
problem Generating coherent text from multiple images.
method Designing a Relational Text Data Generator algorithm to relate features from plural images.
result The model can generate meaningful paragraphs containing extracted features from input images.
Quantum analysis tags news for sentiment and entities.
problem Identifying bias in news reporting.
method Continuous data collection, NER and sentiment analysis.
result A corpus of tagged news articles for public use.
New graph embedding method improves link prediction and node classification.
problem Improving graph embedding methods for better node representation.
method Spectral-biased random walks with neighborhood similarity bias.
result Significantly improves link prediction and node classification.
In this paper, we obtain a new abstract formula relating eigenvalues of a self-adjoint operator to two families of symmetric and skew-symmetric operators and their commutators. This formula generalizes earlier ones obtained by Harrell, Stubbe, Hook, Ashbaugh, Hermi, Levitin and Parnovski. We also show how one can use t…
Proposes spherical text embedding for better directional similarity.
problem Directional similarity is more effective but unsupervised text embeddings are typically learned in Euclidean space.
method Develops a spherical generative model and an efficient optimization algorithm for unsupervised word and paragraph embeddings.
result Achieves state-of-the-art performances on various text embedding tasks.
Classifies CAD model descriptions and names from product websites.
problem Distinguishing product descriptions from other text and identifying product names.
method Paragraph vectors, character-level LSTM, word embeddings LSTM tagger.
result Promising results for distinguishing product descriptions and names.
Study finds stocks with higher cyber risk scores outperform others, indicating a market-wide cyber risk premium.
problem Identifying and quantifying firms' cyber risks and their impact on stock performance.
method Machine learning algorithm to analyze disclosures and a dedicated cyber corpus.
result High cyber risk stocks significantly outperform others, indicating a market-wide cyber risk premium.
Entity-GCN model answers multi-document questions by reasoning across documents.
problem Answering questions based on multiple documents and cross-document relations.
method Graph Convolutional Networks (GCNs) applied to a graph of mentions and their relations.
result Achieves state-of-the-art results on WikiHop dataset.
We show that special cycles generate a large part of the cohomology of locally symmetric spaces associated to orthogonal groups. We prove in particular that classes of totally geodesic submanifolds generate the cohomology groups of degree n of compact congruence p-dimensional hyperbolic manifolds "of simple type" a…
SCROLLS benchmarks long text NLP tasks, improving existing models.
problem Short NLP benchmarks ignore long texts; SCROLLS addresses this.
method Handpicked long-text datasets for summarization, QA, and inference tasks.
result Improvement potential on SCROLLS tasks, as indicated by initial baselines.
Two new methods improve coherence modeling without complex machine translation.
problem Improving neural coherence modeling for better sentence ordering.
method Two novel methods combining regression and context concatenation.
result Achieves state-of-the-art Kendall-tau and positional accuracy scores.
Our work proves robustness of embedding schemes to discrete changes in text.
problem Discrete changes in text, like replacing a word, affect model robustness.
method Formal proofs and quantitative bounds for embedding schemes (concatenation, TF-IDF, Paragraph Vector).
result Embedding schemes are robust to discrete changes in text with Hölder or Lipschitz properties.
Improved handwriting recognition for historical documents with minimal labeled data.
problem Challenges in recognizing historical documents, especially lack of text-line annotations.
method Trained a deep CRNN system on 10% labeled data, augmented with crafted multiscale data, and applied model-based normalization.
result Achieved second best result in ICDAR2017 competition on publicly available READ dataset.
Sherlock uses deep learning to accurately detect data types from column headers.
problem Detecting accurate semantic types of data columns for data science tasks.
method Sherlock is a multi-input deep neural network trained on a corpus of 686,765 data columns.
result Sherlock achieves a support-weighted F1 score of 0.89, outperforming existing methods.
Improved text summarization using neural semantic encoders with hierarchical structure.
problem Capturing long-term dependencies in text summarization.
method Proposed a novel hierarchical Neural Semantic Encoder (NSE) model augmented with lemma and PoS tags.
result Significantly outperformed state-of-the-art models in ROUGE metric.
Deep learning predicts mismatched ratings in Amazon reviews.
problem Identifying reviews with mismatched ratings on Amazon.
method Converted reviews to vectors using paragraph vector, trained a recurrent neural network with gated recurrent unit, incorporated semantic relationships.
result Model accurately predicts rating mismatches and provides feedback.
The paper explores convergence and structure of spaces with scalar curvature and entropy bounds, introducing new dp convergence.
problem Understanding convergence and structure of spaces with scalar curvature and entropy bounds.
method Introduces dp convergence for rectifiable Riemannian spaces and proves compactness and regularity theorems. result Spaces with small scalar and entropy bounds dp converge to rectifiable Riemannian spaces. This paper tackles text infilling, a task of filling missing text portions, and presents a self-attention model that outperforms other methods.
problem The task of filling missing text portions, especially when the number and length of missing portions are unknown.
method A self-attention model with segment-aware position encoding and bidirectional context modeling, trained on extensive supervised data.
result The self-attention model significantly outperforms other approaches, setting a strong baseline for future research.
ECC Analyzer uses LLMs to predict stock volatility from ECCs.
problem Leveraging unstructured ECC data for stock volatility prediction.
method Uses large language models to extract and fuse textual and audio features from ECCs.
result ECC Analyzer outperforms traditional benchmarks in volatility prediction.
The present article is the final part of a series on the classification of the totally geodesic submanifolds of the irreducible Riemannian symmetric spaces of rank 2. After this problem has been solved for the 2-Grassmannians in my previous papers cited in the present paper as [K1] and [K2], and for the space SU(3)/SO(…
We prove that for a relatively hyperbolic group G there is a sequence of relatively hyperbolic proper quotients such that their growth rates converge to the growth rate of G. Under natural assumptions, the same conclusion holds for the critical exponent of a cusp-uniform action of G on a hyperbolic metric space. As a c…
Transformer models are compared to curved spacetime in General Relativity.
problem Understanding the geometric structure of Transformer models.
method Geometric analogy to General Relativity, focusing on attention and curvature effects.
result Transformer token embeddings exhibit curvature, affecting their evolution over layers.
NukeBERT improves performance on nuclear domain Q&A with less training data.
problem Lack of annotated data for nuclear domain Q&A.
method Developed NQuAD dataset and NukeBERT model incorporating novel BERT vocabulary technique.
result NukeBERT outperformed BERT significantly on NQuAD.