Federated learning improves wake word detection in smart home devices.
problem Out-of-domain issues with continuously running speech-based models.
method Federated learning with adaptive averaging strategy.
result Reduces communication rounds and upstream communication costs.
Deep learning detects microsleep episodes in EEG data.
problem Automatic detection of microsleep episodes (MSEs) in EEG data.
method Convolutional neural networks (CNNs) and LSTM networks were implemented to analyze MWT data.
result Deep learning algorithms showed good performance close to human experts in detecting MSEs.
Efficient keyword spotting model using dilated convolutions and gating.
problem Keyword spotting in resource-constrained environments.
method End-to-end temporal modeling with dilated convolutions, gated activations, and residual connections.
result Our model outperforms LSTM-based keyword spotting with a significant decrease in false rejection rate.
Paper proposes MMD-Sense-Analysis for detecting word sense shifts.
problem Detecting and interpreting shifts in word meanings over time.
method Leverages Maximum Mean Discrepancy (MMD) to identify and explain word sense changes.
result Demonstrates effectiveness of MMD-Sense-Analysis through empirical results.
New method predicts wind farm power and wakes using weather patterns.
problem Inefficient and computationally intensive wind energy resource assessment.
method Unsupervised clustering of ERA5 data on wind velocity, WRF simulations at cluster centers, and post-processing.
result Accurate long-term predictions of power and wakes with reduced computational time.
The paper rethinks the use of exponential averaging in machine learning optimization.
problem The inefficiency of using exponential averaging in optimization algorithms.
method The paper connects EA-CM algorithms to Wake of Quadratic regularized models and proposes new algorithms, KLD-WRM.
result The new algorithms outperform existing methods like K-FAC on MNIST.
Paper proposes using word embeddings to detect trolls in social media debates.
problem Preventing online harassment through rapid detection of offensive posts.
method Word embedding models for identifying fast-changing topics and negative content.
result GloVe model helps in discovering new keywords for trolling detection.
NRWS improves training of SBNs and HMs using natural gradient.
problem Training Sigmoid Belief Networks and Helmholtz Machines efficiently.
method Exploits block-diagonal structure of Fisher Information Matrices to use natural gradient.
result NRWS and NBiHM achieve better log-likelihood and faster convergence.
A new method for training generative models with sparse supervision.
problem Training deep generative models with sparse and varying supervision.
method Caffeinated Wake-Sleep (CWS) method, combining reweighted wake-sleep and teacher-forcing.
result The CWS method is robust to variable length supervision and performs well on various datasets.
Improved aspect detection from few seed keywords.
problem Fine-grained aspect detection from user reviews is labor-intensive.
method Weakly supervised co-training with student-teacher approach.
result Significant improvement in F1 scores over previous methods.
Enhanced neural model detects misinformation by considering author context.
problem Plateaued accuracy in traditional rumor classifiers.
method Ensemble neural architecture with word-level attention and author context.
result Promising results on Twitter dataset, detecting rumors more accurately.
New method improves variational inference for better posterior approximation.
problem Challenges in minimizing inclusive KL divergence for amortized variational inference.
method Likelihood-tempered sequential Monte Carlo samplers to estimate inclusive KL gradient.
result SMC-Wake method fits variational distributions more accurately than existing methods.
Community detection is a fundamental task in social network analysis. In this paper, first we develop an endorsement filtered user connectivity network by utilizing Heider's structural balance theory and certain Twitter triad patterns. Next, we develop three Nonnegative Matrix Factorization frameworks to investigate th…
Proves global existence and uniqueness of solutions for Einstein-scalar-field equations.
problem Global existence and uniqueness of solutions for specific Einstein-scalar-field equations.
method Proves global existence and uniqueness of classical solutions with small initial data and wake-like decaying null infinity.
result Global existence and uniqueness of solutions for the equations with wake-like decaying null infinity.
Fluctuations in heart rate are intimately tied to changes in the physiological state of the organism. We examine and exploit this relationship by classifying a human subject's wake/sleep status using his instantaneous heart rate (IHR) series. We use a convolutional neural network (CNN) to build features from the IHR se…
Proposes RTL model for sentiment classification and key word detection in online reviews.
problem Sentiment classification and key word detection in online reviews for hospitality industry.
method Regularized Text Logistic (RTL) regression model.
result RTL model achieves satisfactory classification performance and identifies key word features.
Study automates detection of visitation disruptions in ICU patients.
problem Difficulty in detecting frequent visitation disruptions in ICU patients.
method Used DensePose R-CNN model to count people in video frames, analyzed disruptions and patient outcomes.
result Automated method detects visitation disruptions, impacts on pain and length of stay examined.
The paper develops algorithms to detect stability and Morse properties in various groups.
problem Detecting stability and Morse properties in finitely generated groups.
method Various detection and decidability algorithms for stability and Morse properties in specific types of groups.
result The algorithms provide a way to determine if a subgroup is stable or Morse in specific group types.
A new method learns latent variable updates directly, not approximating the posterior.
problem Intractable maximum-likelihood learning for complex latent-variable models.
method Amortised learning using wake-sleep Monte-Carlo strategy.
result Demonstrated effectiveness on various complex models.
We investigate cobordisms of free knots. Free knots and links are also called homotopy classes of Gauss words and phrases. We define a new strong invariant of free knots which allows to detect free knots not cobordant to the trivial one.
We present a novel method for hierarchical topic detection where topics are obtained by clustering documents in multiple ways. Specifically, we model document collections using a class of graphical models called hierarchical latent tree models (HLTMs). The variables at the bottom level of an HLTM are observed binary va…
Team QCRI-MIT detects hyperpartisan news with 72.9% accuracy.
problem Detecting hyperpartisan news from biased political content.
method Logistic regression model using engineered features from propaganda detection.
result Significant performance improvements with better feature pre-processing.
Global anchor method detects language shifts and domain adaptation.
problem Detecting corpus-level language shifts and domain adaptation.
method Global anchor method for comparing word embeddings.
result Global anchor method is superior to alignment method in applicability and implementation.
Classifies CAD model descriptions and names from product websites.
problem Distinguishing product descriptions from other text and identifying product names.
method Paragraph vectors, character-level LSTM, word embeddings LSTM tagger.
result Promising results for distinguishing product descriptions and names.
DBQ quantizes lightweight networks efficiently for resource-constrained devices.
problem High computational and storage complexity of deep neural networks on resource-constrained devices.
method A differentiable non-uniform quantizer that can be mapped onto efficient ternary-based dot product engines.
result Achieves state-of-the-art results with minimal training overhead and best accuracy-complexity trade-off.
We outline a rigorous algorithm, first suggested by Casson, for determining whether a closed orientable 3-manifold M is hyperbolic, and to compute the hyperbolic structure, if one exists. The algorithm requires that a procedure has been given to solve the word problem in π_1(M).
New method debiases word embeddings for multiclass settings like race and religion.
problem Word embeddings in online texts perpetuate human stereotypes, including race and religion.
method Proposes a novel methodology to debias word embeddings in multiclass settings.
result Demonstrates robust multiclass debiasing that maintains NLP task efficacy.
The simplicial condition and other stronger conditions that imply it have recently played a central role in developing polynomial time algorithms with provable asymptotic consistency and sample complexity guarantees for topic estimation in separable topic models. Of these algorithms, those that rely solely on the simpl…
We study biinvariant word metrics on groups. We provide an efficient algorithm for computing the biinvariant word norm on a finitely generated free group and we construct an isometric embedding of a locally compact tree into the biinvariant Cayley graph of a nonabelian free group. We investigate the geometry of cyclic …
Improved acoustic word embeddings using shared decoder in multi-view encoders.
problem Learning discriminative acoustic word embeddings from text labels.
method Combining Siamese multi-view encoders with a shared decoder network to maximize the relationship between acoustic and text embeddings.
result 11.1% relative improvement in average precision on acoustic word discrimination task with WSJ dataset.
The study evaluates 62 classifiers for detecting online toxic comments.
problem Identifying and classifying toxic online commentary.
method Systematic evaluation of 62 classifiers representing 19 algorithmic families on the Jigsaw dataset.
result Simple bad word lists are most predictive of offensive commentary.
SleepNet detects sleep disorders using neural networks trained on PSG data.
problem Automated detection of sleep disorders like apnea and hypopnea.
method Dense Convolutional Neural Network (DRCNN) trained on Polysomnography (PSG) data.
result SleepNet achieved the first place in a sleep arousal detection challenge.
New tool detects weak and strong Islamophobic hate speech on social media.
problem Detecting Islamophobic hate speech on social media is challenging due to its varied nature.
method Built a multi-class classifier distinguishing between non-Islamophobic, weak Islamophobic, and strong Islamophobic content using GloVe word embeddings.
result Accuracy of 77.6% and balanced accuracy of 83% on a dataset of 109,488 tweets.
Most popular word embedding techniques involve implicit or explicit factorization of a word co-occurrence based matrix into low rank factors. In this paper, we aim to generalize this trend by using numerical methods to factor higher-order word co-occurrence based arrays, or \textit{tensors}. We present four word embedd…
Detects out-of-distribution sentences in Neural Machine Translation.
problem Identifying sentences from a different language than the training data.
method Developed a new uncertainty measure for long sequences of words in Transformers.
result Shows ability to identify Dutch sentences as German input.
TVO tightens variational inference bounds for deep models.
problem Improving variational inference bounds for deep models.
method Introduces thermodynamic variational objective (TVO) connecting variational inference and thermodynamic integration.
result TVO provides tighter lower bound to log marginal likelihood than ELBO.
Stochastic control-flow models (SCFMs) are a class of generative models that involve branching on choices from discrete random variables. Amortized gradient-based learning of SCFMs is challenging as most approaches targeting discrete variables rely on their continuous relaxations---which can be intractable in SCFMs, as…
Monitoring the biomedical literature for cases of Adverse Drug Reactions (ADRs) is a critically important and time consuming task in pharmacovigilance. The development of computer assisted approaches to aid this process in different forms has been the subject of many recent works. One particular area that has shown pro…
System identifies language of transliterated text.
problem Users struggle to understand non-native language transliterated text.
method Feature extraction of phonetic syllables using LSTM network.
result System accurately identifies language of transliterated text.
Framework for lifelong learning using eigentasks to avoid forgetting and transfer knowledge.
problem Avoiding forgetting and transferring knowledge in lifelong learning.
method Eigentask framework: skills paired with generative models, wake-sleep cycle for learning and consolidation.
result Improved performance in supervised continual learning, evidence of forward knowledge transfer.
Paper benchmarks Bengali language classification tasks using MConv-LSTM network.
problem Lack of computational resources for NLP tasks in under-resourced languages like Bengali.
method Built three datasets, BengFastText word embeddings, and MConv-LSTM network for hate speech detection, document classification, and sentiment analysis.
result BengFastText yields up to 92.30%, 82.25%, and 90.45% F1-scores in document classification, sentiment analysis, and hate speech detection respectively.
Study fixed point indices and words at infinity for graph selfmaps.
problem Estimate indices of fixed point classes for graph selfmaps.
method Extend attracting fixed words at infinity, use relative train track technique, algebraic approach.
result Upper bound for attracting fixed words of injective endomorphisms of free groups.
Paper presents MTTDSC for better target-specific sentiment classification.
problem Improving accuracy in detecting and aggregating sentiments towards specific targets in social media.
method MTTDSC uses a multi-task learning approach with an auxiliary task for passage-level sentiment classification and a main task for target-specific sentiment classification.
result MTTDSC outperforms state-of-the-art baselines in sentiment classification.
Transformer model estimates keywords for better audio captioning.
problem Indeterminacy in word selection for audio events/scenes.
method Transformer-based model with keyword estimation.
result Achieved state-of-the-art performance in AAC.
Study examines biases in clinical word embeddings, revealing performance gaps across groups.
problem Biases in clinical word embeddings leading to performance differences across groups.
method Pretrained BERT models on MIMIC-III, fill-in-the-blank method, fairness evaluation on clinical tasks.
result Classifiers trained from BERT representations exhibit statistically significant differences in performance across groups.
Malicious web content is a serious problem on the Internet today. In this paper we propose a deep learning approach to detecting malevolent web pages. While past work on web content detection has relied on syntactic parsing or on emulation of HTML and Javascript to extract features, our approach operates directly on a …
Paper tackles toxic comment detection using deep learning.
problem Automatic detection of toxic comments on the internet.
method Designs binary classification and regression-based approaches using DNN.
result BERT fine-tuning outperforms other methods.
IITK wins FinSim 2020 task on financial hypernym detection.
problem Classifying financial terms into hypernym concepts in an external ontology.
method Used context-dependent and context-independent word embeddings (Word2vec and BERT) for classification.
result Ranked 1st based on mean rank and accuracy metrics.