ATD measures language distance using neural models, recovering linguistic groupings.
problem Lack of a unified quantitative measure for cross-linguistic distance.
method Pretrained multilingual language models, attention mechanisms, optimal transport.
result ATD quantifies representational distance between languages, recovering linguistic groupings.
Paper proposes a method to align word embedding models in a joint latent space.
problem Challenges in aligning variations of word embedding models.
method Generative process using synthetic data points based on linguistic relationships.
result Substantial improvements in recovering embeddings of local neighborhoods.
We present the Bayesian Echo Chamber, a new Bayesian generative model for social interaction data. By modeling the evolution of people's language usage over time, this model discovers latent influence relationships between them. Unlike previous work on inferring influence, which has primarily focused on simple temporal…
Interpersonal relations are fickle, with close friendships often dissolving into enmity. In this work, we explore linguistic cues that presage such transitions by studying dyadic interactions in an online strategy game where players form alliances and break those alliances through betrayal. We characterize friendships …
Computational model uncovers linguistic universals.
problem Manual processing of linguistic typology by linguists is time-consuming and leaves key universals unexplored.
method Presented a computational model to identify known and new linguistic universals.
result The model successfully identifies known universals and uncovers new ones.
Study shows adding noise to training data improves speech synthesis system's performance under noisy test conditions.
problem Impact of noisy linguistic features on neural network-based speech synthesis systems.
method Comparison of systems using ideal and corrupted linguistic features in training and test sets.
result Adding noise to training data can regularize the model and improve performance under noisy test conditions.
A new method extracts linguistic objects from text using CNNs.
problem Lack of interpretability in deep learning models for text.
method Weighted extension of Text Deconvolution Saliency (wTDS) measure.
result Extracts interpretable linguistic objects from text.
GTI network learns linguistic features for multi-task sequence tagging.
problem Improving neural model performance on multi-task sequence tagging without explicit features.
method GTI network with neural gate modules to learn relations between tasks.
result GTI network outperforms baselines on chunking and NER tasks.
Paper tackles zero-shot learning for semantic image interpretation.
problem Extracting structured semantic descriptions from images requires complete training sets, which are often unavailable.
method Uses Logic Tensor Networks to leverage logical constraints and similarities among relationships in the training set.
result Background knowledge can alleviate the incompleteness of training sets, improving zero-shot learning performance.
Proposes a method to interpret linguistic data models using parse trees and least-squares scores.
problem Interpreting trained classification models in linguistic data sets.
method Assigns least-squares based importance scores to words in a sentence using syntactic constituency structure and relates them to the Banzhaf value in coalitional game theory.
result Demonstrates the effectiveness of the proposed method in aiding interpretability and diagnostics for language models.
Model predicts upcoming discourse referents using linguistic and script knowledge.
problem Predicting upcoming discourse referents based on linguistic knowledge.
method Built a computational model that predicts referents using linguistic knowledge and scripts.
result Script knowledge significantly improves model estimates of human predictions.
The paper analyzes how CNNs interpret NLP tasks and identify linguistic features.
problem Understanding how CNNs capture linguistic features in NLP tasks.
method Visualization techniques and error analysis to interpret CNNs.
result Identified how CNNs capture different linguistic features and their impact on model performance.
The paper tackles model selection for unseen tasks by capturing relationships among checkpoints.
problem Deciding which model combinations are likely to be effective for a new task is difficult.
method The paper models the task space as a Gaussian process and identifies representative checkpoints using mutual information and a greedy algorithm.
result Representative checkpoints generalize to new tasks with superior performance.
The starting point of this article is the question "How to retrieve fingerprints of rhythm in written texts?" We address this problem in the case of Brazilian and European Portuguese. These two dialects of Modern Portuguese share the same lexicon and most of the sentences they produce are superficially identical. Yet t…
Study investigates how simple speech sounds can form abstract categories.
problem How do abstract categories like phonemes emerge from speech exposure?
method Used modeling techniques to test Memory-Based Learning and Error-Correction Learning.
result Error-Correction Learning models can learn abstractions, identifying phone inventory and grouping.
Study shows how socioeconomic status influences language use on Twitter.
problem Global variability of linguistic patterns due to socioeconomic factors.
method Multivariate analysis of French Twitter corpus and socioeconomic data.
result People with higher socioeconomic status use more standard language.
Linguistic calibration improves long-form text confidence.
problem LMs hallucinate, leading to suboptimal decisions.
method Defining linguistic calibration, training framework, reinforcement learning.
result Llama 2 7B is significantly more calibrated than baselines.
The abstract discusses parallels between Galois theory and Stone-Weierstrass theorem in various fields.
problem Connecting distinguishing power and expressive power in different fields.
method Elementary theorem connecting distinguishing power and expressive power.
result Foundational principle in linguistics linking distinguishing power and expressive power.
BERT captures linguistic features in separate semantic and syntactic subspaces.
problem Understanding how transformer models like BERT represent linguistic features internally.
method Qualitative and quantitative investigations of BERT's internal representations.
result Evidence of a fine-grained geometric representation of word senses and syntactic representations.
A novel method for visual question answering using scene graphs and reinforcement learning.
problem Answering free-form questions about images with deep linguistic and visual understanding.
method Context-driven, sequential reasoning based on scene graphs and reinforcement learning.
result Our method almost reaches human performance on the GQA dataset.
Study evaluates natural language models' ability to generalize across tasks.
problem Natural language models struggle with generalizing to new tasks.
method Empirical evaluation of state-of-the-art models using new metrics.
result Models require extensive in-domain training and are prone to forgetting.
ContextBench benchmarks methods for generating linguistically fluent inputs that activate specific latent features in language models.
problem Identifying inputs that trigger specific behaviours or latent features in language models.
method Context modification and benchmarking methods like Evolutionary Prompt Optimisation (EPO) with LLM-assistance and diffusion model inpainting.
result Enhanced methods achieve state-of-the-art performance in balancing elicitation effectiveness and fluency.
This paper investigates how large language models achieve neural collapse, a phenomenon linked to generalization.
problem Neural collapse in large language models under imbalanced and token-rich conditions.
method Empirical investigation of scaling and regularization effects on CLMs' progression towards neural collapse.
result Neural collapse properties develop with scale and regularization, linked to generalization in language modeling.
Measures compositionality in machine learning representations.
problem Evaluating how compositional structure is reflected in learned representations.
method Measures compositionality by approximating true representation-producing models with composed primitives.
result Characterizes compositional structure in various settings.
Investigates neural TTS systems for Japanese and English.
problem Improving neural TTS systems for high-quality speech synthesis.
method Comparative study of neural sequence-to-sequence TTS vs. DNN pipeline TTS, varying model architecture, parameter size, and language.
result A neural sequence-to-sequence TTS system requires sufficient model parameters and a powerful encoder for high-quality speech synthesis.
Enhances speech quality in noisy environments using symbolic sequential modeling.
problem Improving speech quality in noisy conditions.
method Incorporates symbolic sequential modeling into speech enhancement framework.
result Significant improvement in speech quality metrics (PESQ, STOI) on TIMIT dataset.
This paper generalizes graph representation for diverse data types.
problem Representing and querying hybrid data types in a unified way.
method Introducing a directed Tensor-Typed Multi-Graph with embeddings.
result Unified representation for visual, linguistic, and auditory data.
A fast kernel-based measure for sparse linguistic expressions.
problem Efficiently measuring co-occurrence in sparse linguistic data.
method Derives PHSIC from HSIC, estimates it linearly, and uses various kernels.
result Empirically, PHSIC outperforms PMI in accuracy and learning speed.
In regression problems, the use of TSK fuzzy systems is widely extended due to the precision of the obtained models. Moreover, the use of simple linear TSK models is a good choice in many real problems due to the easy understanding of the relationship between the output and input variables. In this paper we present FRU…
Paper tackles deconfounding age effects in dementia detection models.
problem Dementia detection models are affected by age, leading to potential non-generalizable accuracies.
method Proposes fair representation learning to learn age-invariant representations.
result Best models compromise accuracy by only 2.56% and 1.54% on clinical datasets.
Expanding spoken language understanding to handle complex entities and intents.
problem Handling compound entities and intents in spoken language understanding.
method Introducing a domain-agnostic shallow parser that handles linguistic coordination, learning domain-independent and slot-independent features.
result The model learns to segment conjunct boundaries of various phrasal categories and improves generalization across different slot types using adversarial training.
Qwant Research improves clinical case matching and information retrieval.
problem Matching and retrieving relevant clinical cases and discussions.
method Approach based on language models and preprocessings, information extraction system using neural networks and linguistic analysis.
result Very encouraging results in information extraction accuracy.
Paper proposes MMD-Sense-Analysis for detecting word sense shifts.
problem Detecting and interpreting shifts in word meanings over time.
method Leverages Maximum Mean Discrepancy (MMD) to identify and explain word sense changes.
result Demonstrates effectiveness of MMD-Sense-Analysis through empirical results.
We introduce Markov substitute processes, a new model at the crossroad of statistics and formal grammars, and prove its main property : Markov substitute processes with a given support form an exponential family.
Analysts use vague language in reports to convey useful information about future payoffs.
problem Lack of precise numerical forecasts in analyst reports.
method Empirical analysis of analyst reports to assess the predictive power of linguistic tone.
result The textual tone of analyst reports has predictive power for forecast errors and subsequent revisions, especially when language is vague and uncertainty is high.
Study shows mutual information can reward structure learning agents without expert systems.
problem Designing rewards for structure learning agents in natural language environments.
method Revisited Information Theory of unsupervised induction of phrase-structure grammars, using random sets of linguistic samples.
result Empirical evidence that simulated semantic structures can be distinguished from random ones by mutual information among their constituents.
Study uses social media to analyze COVID-19 impact.
problem Understanding the global impact of COVID-19.
method Machine learning and linguistic tools to analyze social media posts.
result Automatic detection of positive reports of COVID-19.
Analyzes Twitter users' opinions on self-driving cars.
problem Understanding public perception of self-driving cars.
method Annotated Twitter dataset, topic modeling, sentiment classification using Twitter features.
result People are generally optimistic but also concerned about self-driving cars.
Analyzes word usage on Reddit to reveal patterns in human behavior.
problem Understanding the broader heterogeneity in human behavior.
method Dimension reduction on Reddit text data to analyze word usage and topics.
result Pronouns can characterize two dimensions capturing differences in word usage.
This work decouples language from math problems to enable cross-language learning.
problem Current machine learning representations are language dependent.
method Inspired by linguistics, the work learns language agnostic representations.
result Models trained on one language achieve similar accuracies in other languages.
OT domain adaptation improves aphasia detection across languages.
problem Detecting aphasia in low-resource languages with limited data.
method Utilized OT domain adaptation to map linguistic features across multiple languages.
result OT domain adaptation significantly improved F1 scores for French and Mandarin aphasia detection.
Preserves content while changing style in text.
problem Text style transfer often fails to preserve content.
method Leverages linguistic information in structured supervisions.
result Significant improvement in content preservation and style transfer.
EigenNoise provides a competitive word vector initialization scheme without pre-training data.
problem Improving word vector initialization without pre-training data.
method EigenNoise uses a dense, independent co-occurrence model to initialize word vectors.
result EigenNoise can approach GloVe performance without pre-training data.
Corpus poisoning can manipulate word meanings in word embeddings, affecting natural language processing tasks.
problem Controlling word meanings via corpus modifications.
method Developed an explicit expression over corpus features to control word embeddings.
result Demonstrated the ability to manipulate word meanings in word embeddings, affecting various downstream tasks.
New RL framework learns task completion without prior knowledge.
problem Learning task completion without linguistic or perceptual knowledge.
method Sequentially imagining visual goals and choosing actions.
result Framework outperforms flat and hierarchical architectures.
Paper predicts Indian stocks using news psycholinguistic features.
problem Predicting Indian stock market performance using financial news.
method Hybrid intelligent models using psycholinguistic variables (LIWC and TAALES) from news articles.
result GMDH and GRNN are statistically the best techniques for prediction.
New distress dictionary improves bankruptcy prediction from disclosure text.
problem Bankruptcy prediction from financial disclosures.
method Proposes a distress dictionary based on managers' sentences, quantifies linguistic features, and builds predictive models.
result Predictive models based on the distress dictionary outperform existing methods.
This paper analyzes text in financial disclosures to improve financial analysis.
problem Insufficient analysis of unstructured text in financial disclosures.
method Reviews and explores methods in computational linguistics and NLP.
result Highlights limitations of sentiment metrics and suggests future research areas.