arXiv research

FLDCRF improves sequence labeling performance with latent dynamics interactions.

Paper combines latent state space with CRF for improved autoregressive text generation.

Enhances sequence labeling with embedded-state latent CRFs.

Conditional Random Fields (CRF) have been widely used in a variety of computer vision tasks. Conventional CRFs typically define edges on neighboring image pixels, resulting in a sparse graph such that efficient inference can be performed. However, these CRFs fail to model long-range contextual relationships. Fully-conn…

Hidden Markov Chains and Linear-chain CRFs are equivalent.

LC-CRFs are equivalent to HMMs, and MPM/MAP classifiers can be reformulated as CRFs.

CAT is a new ASR toolkit using CRF and CTC for state-of-the-art speech recognition.

Paper introduces combinatorial Ricci flows on infinite disk triangulations.

NCRF transducers improve sequence labeling across tasks.

New algorithm improves CRF inference and learning.

We consider the problem of training probabilistic conditional random fields (CRFs) in the context of a task where performance is measured using a specific loss function. While maximum likelihood is the most common approach to training CRFs, it ignores the inherent structure of the task's loss function. We describe alte…

Unsupervised RNNGs perform similarly to supervised ones in language modeling and grammar induction.

Locally-contextual CRFs improve sequence labeling performance.

We give several equivalent characterizations of orthogonal subbundles of the generalized tangent bundle defined, up to B-field transform, by almost product and local product structures. We also introduce a pure spinor formalism for generalized CRF-structure and investigate the resulting decomposition of the de Rham ope…

New CRF model segments music into chords with rich features.

FGN improves Chinese NER by integrating glyph information and interactive context.

CAT toolkit combines hybrid and E2E approaches for efficient speech recognition.

CRF model improves protein secondary structure prediction.

New Polish word embeddings improve temporal expression recognition.

A generalized F-structure is a complex, isotropic subbundle $E$ of $T_cM\oplus T^*_cM$ ($T_cM=TM\otimes_{\mathds{R}}\mathds{C}$ and the metric is defined by pairing) such that $E\cap\bar E^{\perp}=0$. If $E$ is also closed by the Courant bracket, $E$ is a generalized CRF-structure. We show that a generalized F-structur…

A new method reduces feature size in CRFs for faster training.

The article confirms Thurston's conjecture for a specific class of 3-manifolds using combinatorial Ricci flow.

In this work, we introduce a deep-structured conditional random field (DS-CRF) model for the purpose of state-based object silhouette tracking. The proposed DS-CRF model consists of a series of state layers, where each state layer spatially characterizes the object silhouette at a particular point in time. The interact…

Often we wish to predict a large number of variables that depend on each other as well as on other observed variables. Structured prediction methods are essentially a combination of classification and graphical modeling, combining the ability of graphical models to compactly model multivariate data with the ability of …

AC-RNN improves RNN for sequence labeling tasks.

This work investigates the training of conditional random fields (CRFs) via the stochastic dual coordinate ascent (SDCA) algorithm of Shalev-Shwartz and Zhang (2016). SDCA enjoys a linear convergence rate and a strong empirical performance for binary classification problems. However, it has never been used to train CRF…

Conditional Random Fields (CRFs) are undirected graphical models, a special case of which correspond to conditionally-trained finite state machines. A key advantage of these models is their great flexibility to include a wide array of overlapping, multi-granularity, non-independent features of the input. In face of thi…

In an earlier paper, we studied manifolds $M$ endowed with a generalized F structure $Φ\in End(TM\oplus T^*M)$, skew-symmetric with respect to the pairing metric, such that $Φ^3+Φ=0$. Furthermore, if $Φ$ is integrable (in some well-defined sense), $Φ$ is a generalized CRF structure. In the present paper we study quasi-…

Deep neural networks improve music phrase segmentation.

We apply stochastic average gradient (SAG) algorithms for training conditional random fields (CRFs). We describe a practical implementation that uses structure in the CRF gradient to reduce the memory requirement of this linearly-convergent stochastic gradient method, propose a non-uniform sampling scheme that substant…

Gaussian CRFBC model for binary classification with latent variables.

Detecting and explaining anomalies is a challenging effort. This holds especially true when data exhibits strong dependencies and single measurements need to be assessed and analyzed in their respective context. In this work, we consider scenarios where measurements are non-i.i.d, i.e. where samples are dependent on co…

Paper proposes neural approach for Chinese named entity recognition.

The paper studies a rebalanced dataset for imbalanced classification using Centered Random Forests.

Deep structured output learning shows great promise in tasks like semantic image segmentation. We proffer a new, efficient deep structured model learning scheme, in which we show how deep Convolutional Neural Networks (CNNs) can be used to estimate the messages in message passing inference for structured prediction wit…

Scrubbing PHI data from medical records is now efficient and scalable with SpaCy.

We introduce a conceptually novel structured prediction model, GPstruct, which is kernelized, non-parametric and Bayesian, by design. We motivate the model with respect to existing approaches, among others, conditional random fields (CRFs), maximum margin Markov networks (M3N), and structured support vector machines (S…

Automated extraction of concepts from patient clinical records is an essential facilitator of clinical research. For this reason, the 2010 i2b2/VA Natural Language Processing Challenges for Clinical Records introduced a concept extraction task aimed at identifying and classifying concepts into predefined categories (i.…

State-of-the-art sequence labeling systems traditionally require large amounts of task-specific knowledge in the form of hand-crafted features and data pre-processing. In this paper, we introduce a novel neutral network architecture that benefits from both word- and character-level representations automatically, by usi…

Alternative optimizer outperforms gradient descent in weakly-supervised CNN segmentation.

We study stock market instability by using cross-correlations constructed from the return time series of 366 stocks traded on the Tokyo Stock Exchange from January 5, 1998 to December 30, 2013. To investigate the dynamical evolution of the cross-correlations, cross-correlation matrices are calculated with a rolling win…

Method uses random forest with distance covariance for transfer learning in healthcare.

We apply mixup regularization to RNNs for improved performance.

We consider higher-order linear-chain conditional random fields (HO-LC-CRFs) for sequence modelling, and use sum-product networks (SPNs) for representing higher-order input- and output-dependent factors. SPNs are a recently introduced class of deep models for which exact and efficient inference can be performed. By com…

Deep learning model improves Vietnamese NER accuracy.

We give polynomial-time algorithms for the exact computation of lowest-energy (ground) states, worst margin violators, log partition functions, and marginal edge probabilities in certain binary undirected graphical models. Our approach provides an interesting alternative to the well-known graph cut paradigm in that it …

New approach uses synthetic labels to train models on scarce annotated data for surgical phase recognition.

In this note we provide detailed derivations of two versions of small-variance asymptotics for hierarchical Dirichlet process (HDP) mixture models and the HDP hidden Markov model (HDP-HMM, a.k.a. the infinite HMM). We include derivations for the probabilities of certain CRP and CRF partitions, which are of more general…