arXiv research

Neural networks learn more efficiently with hidden factorial structures.

This work speeds up fHMM analysis by tensor algebra.

In this paper, we develop a parameter estimation method for factorially parametrized models such as Factorial Gaussian Mixture Model and Factorial Hidden Markov Model. Our contributions are two-fold. First, we show that the emission matrix of the standard Factorial Model is unidentifiable even if the true assignment ma…

We propose algorithms for approximate filtering and smoothing in high-dimensional Factorial hidden Markov models. The approximation involves discarding, in a principled way, likelihood factors according to a notion of locality in a factor graph associated with the emission distribution. This allows the exponential-in-d…

Factorial Hidden Markov Models (FHMMs) are powerful models for sequential data but they do not scale well with long sequences. We propose a scalable inference and learning algorithm for FHMMs that draws on ideas from the stochastic variational inference, neural network and copula literatures. Unlike existing approaches…

The past decade has seen substantial work on the use of non-negative matrix factorization and its probabilistic counterparts for audio source separation. Although able to capture audio spectral structure well, these models neglect the non-stationarity and temporal dynamics that are important properties of audio. The re…

NoMoPy models noise as HMM/FHMM in Python.

Bayesian inference for factorial hidden Markov models is challenging due to the exponentially sized latent variable space. Standard Monte Carlo samplers can have difficulties effectively exploring the posterior landscape and are often restricted to exploration around localised regions that depend on initialisation. We …

Factorial hidden Markov models (FHMMs) are powerful tools of modeling sequential data. Learning FHMMs yields a challenging simultaneous model selection issue, i.e., selecting the number of multiple Markov chains and the dimensionality of each chain. Our main contribution is to address this model selection issue by exte…

Natural image statistics exhibit hierarchical dependencies across multiple scales. Representing such prior knowledge in non-factorial latent tree models can boost performance of image denoising, inpainting, deconvolution or reconstruction substantially, beyond standard factorial "sparse" methodology. We derive a large …

We consider the problem of joint modelling of metabolic signals and gene expression in systems biology applications. We propose an approach based on input-output factorial hidden Markov models and propose a structured variational inference approach to infer the structure and states of the model. We start from the class…

Many practical techniques for probabilistic inference require a sequence of distributions that interpolate between a tractable distribution and an intractable distribution of interest. Usually, the sequences used are simple, e.g., based on geometric averages between distributions. When models are expressed as probabili…

We apply belief propagation to a Bayesian bipartite graph composed of discrete independent hidden variables and discrete visible variables. The network is the Discrete counterpart of Independent Component Analysis (DICA) and it is manipulated in a factor graph form for inference and learning. A full set of simulations …

spex-LVM infers interpretable latent factors from biomedical data.

Designs efficient factorial experiments for product design under budget constraints.

We study a novel spline-like basis, which we name the "falling factorial basis", bearing many similarities to the classic truncated power basis. The advantage of the falling factorial basis is that it enables rapid, linear-time computations in basis matrix multiplication and basis matrix inversion. The falling factoria…

Relational data-like graphs, networks, and matrices-is often dynamic, where the relational structure evolves over time. A fundamental problem in the analysis of time-varying network data is to extract a summary of the common structure and the dynamics of the underlying relations between the entities. Here we build on t…

New factorial power constants improve optimization convergence rates.

Bayesian neural networks improve uncertainty estimation in 3D point cloud segmentation for factory planning.

CUBE explains models by balanced experiments and contrasts.

Factorial moments are convenient tools in nuclear physics to characterize the multiplicity distributions when phase-space resolution ($Δ$) becomes small. For uncorrelated particle production within $Δ$, Gaussian statistics holds and factorial moments $F_q$ are equal to unity for all orders $q$. Correlations between par…

We assume that a high-dimensional datum, like an image, is a compositional expression of a set of properties, with a complicated non-linear relationship between the datum and its properties. This paper proposes a factorial mixture prior for capturing latent properties, thereby adding structured compositionality to deep…

New method uses Rashomon sets to improve Bayesian inference in factorial designs.

New findings show single-treatment effects are unidentifiable in factorial experiments.

High-throughput 3D control training system achieves 100,000 FPS.

Deep model learns complex latent codes without assuming factor structure.

Factorial moments are convenient tools in particle physics to characterize the multiplicity distributions when phase-space resolution ($Δ$) becomes small. They include all correlations within the system of particles and represent integral characteristics of any correlation between these particles. In this letter, we sh…

Existence of Kähler-Einstein metrics on toric varieties proven.

We prove the factoriality of the following nodal threefolds: a complete intersection of hypersurfaces $F$ and $G\subset\mathbb{P}^{5}$ of degree $n$ and $k$ respectively, where $G$ is smooth, $|\mathrm{Sing}(F\cap G)|\leqslant(n+k-2)(n-1)/5$, $n\geqslant k$; a double cover of a smooth hypersurface $F\subset\mathbb{P}^{…

This paper introduces the factorial marked temporal point process model and presents efficient learning methods. In conventional (multi-dimensional) marked temporal point process models, event is often encoded by a single discrete variable i.e. a marker. In this paper, we describe the factorial marked point processes w…

The paper explores how AI trading agents' similar information representation can cause financial market instability.

New method disentangles sources of different timescales in planetary seismic data.

Additionally to the extensive use in clinical medicine, biological age (BA) in legal medicine is used to assess unknown chronological age (CA) in applications where identification documents are not available. Automatic methods for age estimation proposed in the literature are predicting point estimates, which can be mi…

Bayesian segmentation and uncertainty estimation improve 3D model accuracy for factory planning.

New method amplifies hidden structure in complex networks.

We study local, global and local-to-global properties of threefolds with certain singularities. We prove criteria for these threefolds to be rational homology manifolds and conditions for threefolds to satisfy rational Poincaré duality. We relate the topological Euler characteristic of elliptic Calabi-Yau threefolds wi…

In this paper, we present a data science automation system called Prediction Factory. The system uses several key automation algorithms to enable data scientists to rapidly develop predictive models and share them with domain experts. To assess the system's impact, we implemented 3 different interfaces for creating pre…

This paper reviews recent advances in Bayesian nonparametric techniques for constructing and performing inference in infinite hidden Markov models. We focus on variants of Bayesian nonparametric hidden Markov models that enhance a posteriori state-persistence in particular. This paper also introduces a new Bayesian non…

The work of Jørgensen and Thurston shows that there is a finite number N(v) of orientable hyperbolic 3-manifolds with any given volume v. In this paper, we construct examples showing that the number of hyperbolic knot complements with a given volume v can grow at least factorially fast with v. A similar statement holds…

A new approach to sensitivity analysis without the Sobol decomposition.

Conditional Random Fields (CRF) are frequently applied for labeling and segmenting sequence data. Morency et al. (2007) introduced hidden state variables in a labeled CRF structure in order to model the latent dynamics within class labels, thus improving the labeling performance. Such a model is known as Latent-Dynamic…

The paper describes a cover of strata of k-differentials with a formula for fiber cardinality.

Study optimizes CANN for actuarial tasks using RSM.

Distributions over rankings are used to model data in various settings such as preference analysis and political elections. The factorial size of the space of rankings, however, typically forces one to make structural assumptions, such as smoothness, sparsity, or probabilistic independence about these underlying distri…

We introduce a new paradigm that is important for community detection in the realm of network analysis. Networks contain a set of strong, dominant communities, which interfere with the detection of weak, natural community structure. When most of the members of the weak communities also belong to stronger communities, t…

We present a non-parametric Bayesian approach to structure learning with hidden causes. Previous Bayesian treatments of this problem define a prior over the number of hidden causes and use algorithms such as reversible jump Markov chain Monte Carlo to move between solutions. In contrast, we assume that the number of hi…

DABS uses a policy network to select experiments in high-dimensional design spaces.

Paper tackles hidden game problem in AI alignment and language games.