Automated test model creation from semi-structured requirements.
problem Lack of automated solution for test model creation from requirements.
method Machine Learning for semi-structured requirement detection and rule-based translation.
result 86% time savings with no loss of quality.
A new model for analyzing large SSDs using tags and text.
problem Modeling large-scale semi-structured documents efficiently.
method Tag-Weighted Topic Model (TWTM) with variational inference and MapReduce.
result Efficient and robust model for tags, text, and document modeling.
System suggests clinical concepts in real-time for faster note creation.
problem Efficiently creating structured clinical notes with minimal keystrokes.
method Contextual autocompletion using shallow neural networks.
result Reduces keystrokes by 67% in real hospital environments.
Bayesian method for semi-structured models accounts for both types of uncertainty.
problem Lack of work on epistemic uncertainty in semi-structured regression models.
method Bayesian approximation with subspace inference for joint posterior sampling.
result Validated approach recovers structured effect posteriors and approaches full-space posterior.
This paper extends semi-structured networks to functional data.
problem Maintaining interpretability in functional data analysis while capturing non-linearities and interactions.
method Proposes a functional SSN method that scales well and improves predictive performance.
result The functional SSN method accurately recovers underlying signals and performs favorably compared to competing methods.
New PHO formula improves SSNs performance.
problem Suboptimal network estimation and degenerated predictions in SSNs.
method Non-invasive post-hoc orthogonalization (PHO) to identify model components.
result Better estimation and prediction quality in SSNs.
Proposes a new model to analyze mortgage delinquency transitions.
problem Analyzing mortgage delinquency transitions in a flexible yet identifiable way.
method Combines structured additive predictor with neural network for complex interactions, orthogonalising components for identifiability.
result The semi-structured model provides modest gains in discrimination compared to a structured model, especially in the early prediction spans.
COMET learns concepts for few-shot learning, improving performance.
problem Few-shot learning challenges in machine learning.
method Meta-learning with human-interpretable concept dimensions.
result Significant improvement in 1-shot learning tasks.
Study reveals issues with neural autoregressive models and proposes mode recovery cost.
problem Unreasonable affinity of neural autoregressive models to short and long sequences.
method Investigates modes of ground-truth, empirical, and decoding-induced distributions via mode recovery cost.
result Mode recovery cost varies depending on ground-truth distribution and impacts decoding-induced distribution.
Study reduces redundant information in multi-modal datasets.
problem Redundant information increases data size and costs.
method Multimodal framework using entropy, mutual info, Lasso, SHAP, PCA, topic modeling.
result Significant feature space can be pruned with minimal loss in performance.
Flexible framework for deep distributional regression models.
problem Learning conditional distributions from semi-structured data.
method Combines additive regression models with deep networks using TensorFlow.
result State-of-the-art predictive performance with interpretability.
BF-VI improves posterior approximation in complex models.
problem Inefficient posterior approximations in complex models.
method Combines normalizing flows and Bernstein polynomial transformations.
result BF-VI outperforms other VI methods in approximating complex multivariate posteriors.
Polytopic Matrix Factorization models data as latent vectors from a polytope, maximizing determinant for identifiability.
problem Data decomposition with semi-structured latent vectors and polytope constraints.
method Model input data as latent vectors from a polytope, using determinant maximization for identifiability.
result Identifiability condition for polytopes with specific symmetry restrictions.
Framework uses deep learning to analyze large documents and identify their logical structure.
problem Analyzing large, multi-themed documents with diverse topics.
method Deep learning techniques to model and extract logical and semantic structure.
result Framework effectively identifies and classifies different sections of documents.
Entity-GCN model answers multi-document questions by reasoning across documents.
problem Answering questions based on multiple documents and cross-document relations.
method Graph Convolutional Networks (GCNs) applied to a graph of mentions and their relations.
result Achieves state-of-the-art results on WikiHop dataset.
A new method for document network embedding interprets and generalizes well.
problem Lack of interpretability and generalization to new documents in existing methods.
method Introduces Topic-Word Attention (TWA) and Inductive Document Network Embedding (IDNE) to generate document representations.
result Achieves state-of-the-art performance on various networks and produces meaningful representations.
A new model CDTM improves text classification by concentrating document topics.
problem Unsupervised text classification with diverse topic distributions.
method Imposes an exponential entropy penalty on document topic distribution to encourage concentration.
result More coherent topics and concentrated, sparse document-topic distributions.
New document embedding method finds more relevant tech docs.
problem Computing document similarities for technical content.
method Hybrid approach using graph techniques to extract keyphrases and score sentences.
result Proposed methods outperform baselines up to 27% in NDCG.
Deep learning captures semantic structure of large documents.
problem Understanding complex, structured documents like scholarly articles and business reports.
method Deep learning-based document ontology to capture semantic structure and domain-specific concepts.
result The ontology enhances semantic indexing for better understanding by humans and machines.
Improved self-supervised learning for document images.
problem Performance of self-supervised pre-training on document images is poor.
method Proposed context-aware alternatives and a novel multi-modal method.
result Novel method outperforms other self-supervised methods on document image classification.
MarlRank uses multi-agent reinforcement learning to improve document ranking.
problem Neglecting mutual information among documents in ranking models.
method Formulated as a multi-agent Markov Decision Process (MDP), each document predicts relevance considering its own and similar documents features and actions.
result Significant performance gains over state-of-the-art baselines on LETOR benchmark datasets.
Generative topic embedding combines local and global patterns for document representation.
problem Representing documents in a continuous space using both local and global patterns.
method Proposes a variational inference model to generate topic embeddings and document representations.
result Performs better than existing methods in document classification tasks.
DocParser parses document structures from renderings like PDFs and scans.
problem Parsing complete hierarchical document structures from renderings.
method End-to-end system with novel weak supervision approach.
result Significant improvement in document structure parsing performance.
CCAligned creates a massive web document dataset for cross-lingual research.
problem Identifying comparable documents across different languages.
method Using URL signals to label web documents and mining Common Crawl corpus.
result Release of a dataset with over 392 million URL pairs from 8144 language pairs.
A new nonparametric model discovers hidden topics in document networks without knowing the number of topics in advance.
problem Discovering hidden topics in document networks without knowing the number of topics in advance.
method Proposes a nonparametric relational topic model using dependent gamma processes to represent topic interests of documents and their network structure.
result Can discover hidden topics and their number simultaneously using a posterior inference algorithm.
Paper develops a new unsupervised scoring function for cross-lingual document alignment.
problem Aligning documents across different languages for NLP tasks.
method Uses cross-lingual sentence embeddings to compute semantic distances and guides document alignment.
result The proposed scoring function outperforms current methods by 7-22% on various language pairs.
A scalable topic model for large document collections using MapReduce.
problem Scalability issues in topic modeling for large document collections.
method Correlated Topic Model with variational Expectation-Maximization in MapReduce framework.
result Comparable topic coherences with LDA in MapReduce framework.
A new method for measuring document similarity using hierarchical optimal transport.
problem Inability to measure semantic similarities and scalability issues in past document similarity measures.
method Model documents as distributions over topics, topics as distributions over words, solve optimal transport problem on topics.
result Hierarchical optimal transport provides better interpretability and scalability with comparable performance.
Paper introduces WFR metric for better document distance measurement.
problem Measuring semantic similarity between texts of different lengths.
method Apply Wasserstein-Fisher-Rao (WFR) metric from unbalanced optimal transport theory.
result WFR document distance significantly improves over WMD for texts of different lengths.
We develop a nested hierarchical Dirichlet process (nHDP) for hierarchical topic modeling. The nHDP is a generalization of the nested Chinese restaurant process (nCRP) that allows each word to follow its own path to a topic node according to a document-specific distribution on a shared tree. This alleviates the rigid, …
Bi-LSTM classifies legal documents for Brazil's supreme court.
problem Clogging of Brazil's supreme court due to high volume of lawsuit cases.
method Used a Bidirectional Long Short-Term Memory (Bi-LSTM) network.
result Successfully classified legal documents for efficient case allocation.
Study improves document processing in banking with multimodal analytics.
problem Raising operational efficiency in banking through document-intensive processes.
method Comparative analysis of text classifiers and multimodal model (LayoutXLM) on company register extracts.
result Incorporating layout information in a model substantially increases performance.
A new model analyzes document structure and customer shopping patterns.
problem Understanding document structure and customer shopping patterns.
method Variational EM algorithm for multilayer correlated topic modeling.
result MCTM successfully captures document structure and customer shopping patterns.
Document clustering and topic modeling are two closely related tasks which can mutually benefit each other. Topic modeling can project documents into a topic space which facilitates effective document clustering. Cluster labels discovered by document clustering can be incorporated into topic models to extract local top…
Improved TF-IDF for word relevance in health-care social media documents.
problem Determining word relevance in informal documents.
method Semantic Sensitive TF-IDF (STF-IDF) method.
result Decreased TF-IDF mean error rate by 50% to 13.7%.
This paper improves topic modeling by embedding words and topics together.
problem Topic models struggle with short documents and approximate inference.
method Model each document as a mixture of word embeddings and each topic as a mixture of topic embeddings.
result The method optimizes topic embeddings to minimize semantic differences between words and topics.
Improved bio-surveillance through automated document classification.
problem Tracking infectious diseases across global news alerts.
method Recurrent neural networks, TF-IDF, Naive Bayes, logistic regression.
result 97% recall and 93.3% accuracy in bio-surveillance event classification.
Develops scalable autoencoder for document networks.
problem Sparse and skewed latent node representations in document relational networks.
method Combines graph Poisson factor analysis with Weibull-based graph inference networks.
result Extracts high-quality hierarchical latent document representations.
Paper proposes LAHA to improve XMTC by integrating document content and label correlation.
problem Challenges in tagging documents with most relevant labels from a large label set.
method Hybrid attention deep neural network model (LAHA) that combines multi-label self-attention and adaptive fusion strategies.
result LAHA outperforms state-of-the-art methods, especially on tail labels.
Top2Vec finds topic vectors from documents and words without needing stop words or custom settings.
problem Topic modeling weaknesses, including needing known topics, stop words, and custom settings.
method Joint document and word semantic embedding to find topic vectors automatically.
result Top2Vec finds more informative and representative topics than probabilistic models.
Contrastive learning helps linear models understand document topics.
problem Document classification with limited labeled data.
method Contrastive learning applied to document topic modeling.
result Linear models can recover topic posterior information from contrastive learning representations.
Generative model predicts user interest for document recommendations.
problem Improving document recommendation systems.
method Learned document representations and Gaussian mixture model of user interest.
result Generative model outperforms traditional LSA in predictive performance.
Active learning reduces font classification data needs for historical documents.
problem Identifying fonts in historical documents for OCR accuracy.
method Active learning strategy using image features and bag-of-word representation.
result Combination of uncertainty and diversity sampling achieves 89% accuracy with 17% labeled data.
Proposes new listwise learning-to-rank models to address rating ties and document relevance.
problem Rating ties and document relevance in existing listwise learning-to-rank models.
method Models ranking as selecting documents from a candidate set based on unique rating levels. Uses a new loss function and adapted RNN model for refining prediction scores.
result Models notably outperform state-of-the-art learning-to-rank models on four public datasets.
List-CVAE optimizes document slates directly, improving recommendation performance.
problem Optimizing document slates for better user interest capture.
method List-CVAE learns document distributions conditioned on user responses to generate optimal slates.
result List-CVAE outperforms traditional ranking methods consistently across various document corpora.
Improves retrieval accuracy for hierarchical documents, especially for distant matches.
problem Limited expressive power of dual encoder models in hierarchical retrieval.
method Proves feasibility of DEs for HR, introduces pretrain-finetune recipe to improve long-distance retrieval.
result Pretrain-finetune boosts recall on long-distance pairs from 19% to 76%.
A framework for document classification using keywords and unlabeled data.
problem Classifying documents without labels but with relevant keywords.
method Theoretical framework for optimizing AUC and other metrics.
result Effective use of keywords and unlabeled data for classification.
This paper speeds up WMD computation for multiple queries efficiently.
problem Efficiently computing the semantic dissimilarity between text documents.
method Adapting the Sinkhorn-Knopp algorithm to compute WMD of one document against many targets in parallel.
result 67x speedup on 96 cores compared to sequential and naive parallel methods.