Extracts parallel sentences for machine translation.
problem Data sparsity in multilingual natural language processing.
method Bidirectional recurrent neural network approach.
result Significant improvements in machine translation performance.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,051 papers · 148 categories
Trend · papers per month
48 results for “parallel sentence extraction”
Parallel sentences are a relatively scarce but extremely useful resource for many applications including cross-lingual retrieval and statistical machine translation. This research explores our methodology for mining such data from previously obtained comparable corpora. The task is highly practical since non-parallel m…
CURE extracts relations without supervision by clustering similar entity pairs.
problem Extracting relations unsupervised without considering sentence correlations.
method CURE uses Encoder-Decoder architecture for self-supervised learning and clustering similar relations.
result CURE outperforms state-of-the-art models on NYT and UNPC datasets.
Multi-domain machine translation enhancements by parallel data extraction from comparable corporacs.CL
Parallel texts are a relatively rare language resource, however, they constitute a very useful research material with a wide range of applications. This study presents and analyses new methodologies we developed for obtaining such data from previously built comparable corpora. The methodologies are automatic and unsupe…
Paper proposes a novel model to improve n-ary cross-sentence relation extraction by addressing noisy data and non-consecutive sentences.
problem Noisy labeled data and non-consecutive sentences in n-ary cross-sentence relation extraction.
method Two-level agent reinforcement learning model and hybrid attention mechanism/PCNN approach.
result The model reduces the impact of noisy data and achieves better performance.
Paper uses AC-GAN to generate high-quality relational sentences for relation extraction.
problem Limited training data for relation extraction models.
method Auxiliary Classifier Generative Adversarial Networks (AC-GANs).
result Significantly improved performance of relation extraction.
This study improves sentence embeddings from BERT models.
problem Capturing the underlying meaning of sentences using BERT models.
method Comprehensive review and testing of various sentence embedding extraction and refinement methods.
result Representation-shaping techniques significantly improve sentence embeddings from BERT-based and simple baseline models.
Parallel sentences are a relatively scarce but extremely useful resource for many applications including cross-lingual retrieval and statistical machine translation. This research explores our new methodologies for mining such data from previously obtained comparable corpora. The task is highly practical since non-para…
Improves document summarization by combining word embeddings and n-grams.
problem Exact word matching fails to measure semantic similarity between sentences.
method Uses deep embedding features and tf-idf features to improve sentence similarity measure; builds an improved sentence similarity graph; employs a submodular objective function; develops a Transformer-based compression model.
result Outperforms tf-idf based approach and achieves state-of-the-art performance on DUC04 dataset.
This work tackles extractive compression by formulating it as tree transduction.
problem Extractive compression as a challenging natural language processing problem.
method Formulated as a parse tree transduction problem, using a deep neural model with Long Short-Term Memory extended to consider parent-child relationships.
result Achieves state-of-the-art performance on sentence compression benchmarks.
Two methods generate parallel data for GEC, improving neural models' performance.
problem Lack of parallel data for GEC.
method Two approaches to generate large parallel datasets from Wikipedia data.
result Neural GEC models trained on generated corpora perform similarly and surpass state-of-the-art.
CGMH uses Metropolis-Hastings sampling to generate sentences with complex constraints.
problem Generating sentences with specific constraints while maintaining fluency and naturalness.
method CGMH employs Metropolis-Hastings sampling for constrained sentence generation.
result CGMH outperforms previous methods in various constrained sentence generation tasks.
Towards automatic extractive text summarization of A-133 Single Audit reports with machine learningcs.CL
Automates summarizing federal grant audits with machine learning.
problem Manual analysis of large federal grant audits is time-consuming and error-prone.
method Sentence clustering, k-means, proximity to centroids, human input for refinement.
result Automated summaries are comparable to human-generated ones using ROUGE metric.
Unsupervised scheme ranks sentences in text documents based on semantic importance.
problem Ranking sentences in text documents without labeled data.
method Extracts essential words and phrases, constructs semantic phrase and sentence graphs, applies PageRank, combines scores, and optimizes for topic diversity.
result SSR outperforms individual judges and compares favorably with combined rankings on benchmarks.
A new model improves relation extraction accuracy through relation-gated adversarial learning.
problem Relation extraction from sentences is challenging due to expensive human annotation and noisy distant supervision.
method Proposes relation-gated adversarial learning for relation extraction, extending domain adaptation methods.
result The model outperforms previous domain adaptation methods and improves accuracy of distance supervised relation extraction.
The paper presents a neural machine translation system for Wolof.
problem Low-resource conditions for translating French to Wolof.
method Developed a bidirectional LSTM-based encoder-decoder architecture with attention mechanisms.
result Best model achieved a 47% BLEU score for French-Wolof translation.
BERT helps summarize lecture content efficiently.
problem Efficiently summarize lecture content for students.
method Used BERT for text embeddings and KMeans clustering.
result Improved text summarization for lecture content.
Drug-drug interaction (DDI) is a major cause of morbidity and mortality and a subject of intense scientific interest. Biomedical literature mining can aid DDI research by extracting evidence for large numbers of potential interactions from published literature and clinical databases. Though DDI is investigated in domai…
We introduce BilBOWA (Bilingual Bag-of-Words without Alignments), a simple and computationally-efficient model for learning bilingual distributed representations of words which can scale to large monolingual datasets and does not require word-aligned parallel training data. Instead it trains directly on monolingual dat…
The paper improves ESG taxonomy and classifies sentences as sustainable or unsustainable.
problem Improving ESG taxonomy and classifying sentences based on ESG factors.
method For ESG taxonomy, used Sentence-BERT models. For sentence classification, combined RoBERTa with a multi-layer perceptron.
result Significant performance improvement and high accuracy in classifying sentences.
Neural machine translation is a relatively new approach to statistical machine translation based purely on neural networks. The neural machine translation models often consist of an encoder and a decoder. The encoder extracts a fixed-length representation from a variable-length input sentence, and the decoder generates…
Hi-RES framework extracts medical relations from articles and EHRs.
problem Manual annotation bottleneck in relation extraction.
method Labeling sentences, creating improved negative samples, using pretrained language models, and combining EHR embeddings.
result Significant accuracy increases in relation extraction, up to 0.998 for disorder-location relations.
Proposes a new RNN for language generation capturing long-range dependencies.
problem Capturing long-range word dependencies and sentence order in text corpora.
method Recurrent Hierarchical Topic-Guided RNN with dynamic deep topic model.
result Outperforms larger-context RNN-based language models and learns interpretable topics.
End-to-end model extracts nested terms without extra features.
problem Automatic term extraction for nested terms.
method Deep learning model that predicts conceptual terms within fixed sentence lengths.
result High recall and comparable precision on term extraction task.
New document embedding method finds more relevant tech docs.
problem Computing document similarities for technical content.
method Hybrid approach using graph techniques to extract keyphrases and score sentences.
result Proposed methods outperform baselines up to 27% in NDCG.
Continuous speech recognition from brain activity without vocalization.
problem Recognizing silent speech from EEG signals.
method Implemented a CTC ASR model using EEG signals.
result Demonstrated feasibility of EEG for continuous silent speech recognition.
A new method extracts events and their arguments efficiently from text.
problem Efficiently extract event information from texts with long-range dependencies and associations.
method Graph Convolutional Networks with shortest dependency paths to capture syntactic relationships.
result Significant improvement over state-of-the-art methods.
Systems rank PubMed abstracts and sentences for RDoC criteria, achieving high mAP and MAA.
problem Lack of RDoC labeled datasets and complex labelling process hinder full use of RDoC framework.
method Attention-based neural topic models, supervised and unsupervised sentence ranking models, BM25, BoW, TF-IDF.
result Best systems achieved 1st rank with 0.86 mAP and 0.58 MAA.
This paper classifies tweets into positive and negative sentiments using distributed word and sentence representations.
problem Classifying tweets into positive and negative sentiments.
method Used distributed representations of words and sentences, and LSTM and CNN networks for classification.
result Achieved accuracies as high as 81%.
This study analyzes financial equity research reports to identify frequently asked questions and automates 80% of them.
problem Insufficient empirical analysis of questions answered in financial equity research reports.
method Analyzed 72 financial equity research reports, classifying sentences into 169 unique question archetypes. Used public corporate reports to classify questions' potential for automation.
result Approximately 80% of financial equity research reports can be automated, with 78.7% of questions automatable.
Sequence learning improves query expansion in information retrieval.
problem Improving query expansion in information retrieval systems.
method Used sequence to sequence algorithms to extract keywords from sentence embeddings and trained a neural network on open datasets.
result Sequence to sequence models can capture complex query expansion relations in word embeddings.
CLIP dataset helps extract action items from hospital discharge notes.
problem Lost action items in long discharge notes hinder information sharing.
method Created CLIP dataset of annotated discharge notes, used multi-aspect extractive summarization, trained models on pre-trained language models and context.
result Best models improved by incorporating context and pre-trained language models.
A new method uses PSO to optimize sentence weights for user-oriented document summaries.
problem Handling information overload in documents through efficient summarization.
method Particle Swarm Optimization (PSO) to identify and weight sentence features.
result Improved accuracy in summarization compared to previous methods.
FAKTA automates fact checking across media sources.
problem Automating fact checking across diverse media sources.
method Unified framework integrating document retrieval, stance detection, evidence extraction, and linguistic analysis.
result FAKTA predicts factuality and provides evidence for claims.
Extracts biological context from biomedical texts to associate with events.
problem Identifying biological context and associating it with biochemical events in texts.
method Analyzed an annotated corpus and developed classifiers using syntactic, distance, and frequency features.
result Developed and evaluated classifiers for context-event association.
Deep learning model extracts medical treatment-problem relationships.
problem Mining relationships between treatments and medical problems.
method Hybrid approach combining deep learning and rule-based systems.
result System achieved promising performance on medical relation extraction task.
Study evaluates gender bias in relation extraction systems.
problem Gender bias in relation extraction systems.
method Created WikiGenderBias dataset, evaluated systems for bias, analyzed bias mitigation techniques.
result NRE systems exhibit gender bias in predictions.
Extract fairness policies from legal documents using machine learning.
problem Extract fairness policies from legal documents for AI applications.
method Two approaches based on semantic relatedness: Wordnet-based similarity and vector-based similarity.
result Vector-based similarity outperforms classical Wordnet-based similarity.
Study of sentence representations in AI shows parallels to human learning.
problem Understanding how AI systems learn and generalize from training data.
method Diagnostic tests, performance analysis, training distribution effects, representation changes with augmentations.
result AI systems can learn abstract rules and generalize under certain conditions, similar to human zero-shot reasoning.
Paper introduces methods to automatically generate SOAP notes from patient-physician conversations.
problem Burden of creating digital SOAP notes by physicians.
method Cluster2Sent algorithm for summarizing patient-physician conversations.
result Cluster2Sent algorithm outperforms existing methods by 8 ROUGE-1 points.
ExpBERT uses natural language explanations to improve text interpretation.
problem Improving text interpretation for relation extraction tasks.
method Fine-tuning BERT on MultiNLI to interpret natural language explanations.
result ExpBERT matches a BERT baseline but requires less labeled data and improves performance.
Automatic summarisation is a popular approach to reduce a document to its main arguments. Recent research in the area has focused on neural approaches to summarisation, which can be very data-hungry. However, few large datasets exist and none for the traditionally popular domain of scientific publications, which opens …
Paper develops a new unsupervised scoring function for cross-lingual document alignment.
problem Aligning documents across different languages for NLP tasks.
method Uses cross-lingual sentence embeddings to compute semantic distances and guides document alignment.
result The proposed scoring function outperforms current methods by 7-22% on various language pairs.
Paper presents a novel neural network method for topic detection in micro-blogs.
problem Challenging topic detection without known topic count.
method Unsupervised neural sentence embedding model with attention mechanism.
result Improved clustering algorithm (RADBSCAN) discovers topics based on dataset character.
A new model improves machine translation by accounting for translation ambiguity.
problem Translation ambiguity in parallel corpora leads to inconsistent models.
method A deep generative model with latent variables to handle local variation.
result The model consistently outperforms existing baselines on multiple language pairs.
Determinantal point processes (DPPs), which arise in random matrix theory and quantum physics, are natural models for subset selection problems where diversity is preferred. Among many remarkable properties, DPPs offer tractable algorithms for exact inference, including computing marginal probabilities and sampling; ho…
Recent work on learning multilingual word representations usually relies on the use of word-level alignements (e.g. infered with the help of GIZA++) between translated sentences, in order to align the word embeddings in different languages. In this workshop paper, we investigate an autoencoder model for learning multil…
DSE learns sentence embeddings from cross-attention models to speed up sentence-pair similarity computation.
problem Computing sentence-pair similarity is computationally expensive when candidate sentences are large.
method Distilled Sentence Embedding (DSE) based on knowledge distillation from cross-attentive models.
result DSE significantly outperforms ELMO variants and other sentence embedding methods, accelerating computation by several orders of magnitude.