A new method for Boolean matrix factorisation outperforms existing approaches.
problem Decomposing binary data matrices into meaningful patterns and quantifying their combinations.
method Probabilistic generative model with Metropolised Gibbs sampler for efficient posterior inference.
result The method outperforms all existing approaches on real and simulated data.
We propose a new approach for Collaborative Filtering which is based on Boolean Matrix Factorisation (BMF) and Formal Concept Analysis. In a series of experiments on real data (Movielens dataset) we compare the approach with the SVD- and NMF-based algorithms in terms of Mean Average Error (MAE). One of the experimental…
Bayesian model learns optimal number of latent dimensions for Boolean data.
problem Optimal number of latent dimensions in Boolean data models.
method Indian Buffet Process prior over factor matrices for non-parametric Boolean factorisation.
result Posterior inference is efficient and the number of latent dimensions is transparently inferred.
Fast Bayesian NMF and Tri-Factorisation with improved convergence.
problem Difficult convergence in matrix tri-factorisation.
method Variational Bayesian algorithm for non-negative matrix factorisation and tri-factorisation.
result Faster convergence per iteration and wall-clock time than Gibbs sampling and non-probabilistic approaches.
The paper compares inference methods for Bayesian nonnegative matrix factorisation.
problem Improving prediction accuracy and pattern discovery in nonnegative matrix factorisation.
method Compared non-probabilistic, Gibbs sampling, variational Bayesian, and maximum-a-posteriori approaches.
result Variational Bayesian inference is a new and efficient approach for Bayesian nonnegative models.
This text investigates relations between two well-known family of algorithms, matrix factorisations and recursive linear filters, by describing a probabilistic model in which approximate inference corresponds to a matrix factorisation algorithm. Using the probabilistic model, we derive a matrix factorisation algorithm …
Bayesian HMF integrates multiple datasets for in/out-of-matrix prediction.
problem Data integration across different entity types and sparsity levels.
method Bayesian hybrid matrix factorisation model combining multiple methods.
result Consistently better in-matrix and out-of-matrix predictions compared to state-of-the-art methods.
VAE enhances NMF for probabilistic non-negative matrix factorisation.
problem Non-negative matrix factorisation with probabilistic coefficients.
method Design a VAE network with non-negative weights and non-negative Weibull distribution.
result Effective probabilistic NMF for generating new data and linking latent and input variables.
New algorithm for robust Boolean matrix factorization handles noise and missing data.
problem Robust probabilistic Boolean matrix factorization in the presence of noise and missing values.
method Probabilistic Expectation Maximization algorithm without latent factor assumptions.
result Outperforms state-of-the-art probabilistic algorithms on real data.
The study examines how prior and likelihood choices affect Bayesian matrix factorisation on small datasets.
problem Improving predictive performance of Bayesian matrix factorisation on small datasets.
method Review and comparison of 16 Bayesian matrix factorisation models across four groups: Gaussian-likelihood with real-valued priors, nonnegative priors, semi-nonnegative models, and Poisson-likelihood approaches.
result Poisson models give poor predictions, and nonnegative models are more constrained than real-valued ones.
Boolean matrix factorization and Boolean matrix completion from noisy observations are desirable unsupervised data-analysis methods due to their interpretability, but hard to perform due to their NP-hardness. We treat these problems as maximum a posteriori inference problems in a graphical model and present a message p…
Paper proposes algorithms for BMF using integer programming.
problem Approximating binary input matrix as product of two smaller binary factors.
method Alternating optimization strategy using integer programming to solve subproblems and combine solutions.
result Proposed algorithms outperform state of the art on medium-scale problems.
A Bayesian Boolean Matrix Factorization for cancer genomics
problem Identifying coordinated feature changes in cancer
method Bayesian Boolean Matrix Factorization
result Captures widespread, near-simultaneous chromosome-number changes
Develops a fast BMF approach for binary matrices.
problem Finding patterns in binary matrices for various applications.
method MEBF (Median Expansion for Boolean Factorization) using geometric segmentation and heuristic submatrix identification.
result Superior performance in reconstruction error and computational efficiency compared to existing methods.
Unified framework for non-negative matrices and tensors using Wasserstein loss.
problem Finding low-dimensional representations of high-dimensional datasets with non-negative constraints.
method Unified mathematical framework with a smoothed Wasserstein loss, convex dual formulation for efficient computation.
result Efficient solution for non-negative matrix and tensor factorisations with Wasserstein loss.
The paper develops algorithms for Boolean matrix factorization using IP and heuristics.
problem Approximating binary input matrices as products of smaller binary factors.
method Alternating optimization with integer programming and greedy/local-search heuristics.
result Proposed methods improve scalability and performance compared to existing techniques.
A new BMF algorithm outperforms existing methods using MDL.
problem Developing a BMF algorithm that performs well across multiple metrics.
method From-below Boolean matrix factorization algorithm based on MDL principle.
result The proposed algorithm outperforms existing methods in various experiments.
A new method relaxes Boolean Matrix Factorization to make it more efficient.
problem High computational cost of solving NP-hard combinatorial optimization problems in Boolean Matrix Factorization.
method Proposes a proximal gradient algorithm using an elastic-binary regularizer to relax BMF.
result Demonstrates improved runtime and better recall, loss, and interpretability on real-world data.
The paper shows how to recover true node positions from a graph or similarity matrix.
problem Recovering true distances and positions from a graph or similarity matrix.
method Two steps: matrix factorisation followed by nonlinear dimension reduction.
result Nonlinear dimension reduction can recover latent positions close to a manifold where geodesic distance is encoded.
The paper introduces false discovery rate control for BMF to avoid noisy patterns.
problem No guarantees exist for BMF patterns being real, not just noise.
method Proposes false discovery rate (FDR) to control BMF patterns, proving bounds on FDR.
result Improved BMF algorithms using theoretical FDR bounds for rank selection.
Paper solves low-rank Boolean matrix approximation using integer programming.
problem Finding low-rank approximations to Boolean matrices.
method Integer programming formulation with polynomial variables and constraints.
result First computationally tractable integer programming approach.
In this paper we formulate the nonnegative matrix factorisation (NMF) problem as a maximum likelihood estimation problem for hidden Markov models and propose online expectation-maximisation (EM) algorithms to estimate the NMF and the other unknown static parameters. We also propose a sequential Monte Carlo approximatio…
New framework reduces factorisation model run time by exploiting sparse vector geometry.
problem Inefficient inner product computations over large sparse vectors in real-time applications.
method Geometry-aware permutation maps on a tessellated unit sphere for sparse vector embeddings.
result Significant reduction in run time with minimal accuracy loss.
TGP enhances collaborative filtering with side information using Gaussian Processes.
problem Improving collaborative filtering with side information.
method Formulated a Tucker Gaussian Process (TGP) that incorporates low-rank matrix factorisation and side information.
result Enhanced predictive performance for collaborative filtering problems.
We develop a method to factorize symmetric sparse Boolean matrices efficiently.
problem Finding a symmetric factorization of a given matrix into a sparse, Boolean matrix.
method Polynomial-time algorithm based on bootstrapping higher-order information and tensor decomposition.
result A matrix with full column rank can be recovered with high probability when the matrix size is sufficiently large.
The study explores how Matrix Product States can represent boolean and continuous functions.
problem Representing arbitrary boolean and continuous functions using Matrix Product States.
method Developed a construction method for MPS to represent boolean gates and proved density in continuous function space.
result MPS can accurately represent arbitrary boolean functions and continuous functions densely.
Paper develops a decoder for sparse codes without encoder matrix, achieving optimal recovery.
problem Designing a decoder for sparse codes from linear measurements alone.
method Matrix factorization to recover encoder and sparse coding matrices from measurements.
result Decoder-Expander Based Factorisation recovers encoder and sparse coding matrix at optimal measurement rate with high probability.
The paper reformulates clustering as matrix factorization on the Stiefel manifold.
problem Clustering high-dimensional data like images and gene expression.
method Reformulates clustering as low-rank matrix estimation, using Burer-Monteiro factorization on the Stiefel manifold.
result Proves novel prediction bounds for clustering and proposes a componentwise Langevin sampler.
Identifying overlapping communities in networks is a challenging task. In this work we present a novel approach to community detection that utilises the Bayesian non-negative matrix factorisation (NMF) model to produce a probabilistic output for node memberships. The scheme has the advantage of computational efficiency…
A new algorithm MBMF improves recommendation accuracy and speed for sparse datasets.
problem Sparse and fluctuating predictions in recommender systems.
method MBMF uses magnitude constraints and Spherical coordinates to optimize faster than existing methods.
result MBMF outperforms existing algorithms in accuracy and speed on synthetic and real datasets.
For large matrix factorisation problems, we develop a distributed Markov Chain Monte Carlo (MCMC) method based on stochastic gradient Langevin dynamics (SGLD) that we call Parallel SGLD (PSGLD). PSGLD has very favourable scaling properties with increasing data size and is comparable in terms of computational requiremen…
Simpler method for separating and manipulating latent attributes in autoencoders.
problem Separating and manipulating latent attributes in autoencoders.
method Matrix subspace projection
result Our method allows for changing selected attributes while preserving other information.
Study uses NMF to analyze multimorbidity patterns in large EHR dataset.
problem Understanding and quantifying multimorbidity patterns over time.
method Non-negative Matrix Factorisation (NMF) for temporal phenotyping.
result Temporal characteristics of disease clusters reveal new multimorbidity patterns.
Decision Machines embeds decision trees into vector spaces for improved optimization.
problem Overfitting and difficulty in finding optimal decision tree structure.
method Embedding Boolean tests into a binary vector space and representing tree structure as matrices.
result Optimized decision trees with enhanced predictive power.
Representing 3D shape deformations by linear models in high-dimensional space has many applications in computer vision and medical imaging, such as shape-based interpolation or segmentation. Commonly, using Principal Components Analysis a low-dimensional (affine) subspace of the high-dimensional shape space is determin…
Interpretable text-response modelling for structured outcomes
problem Predicting structured responses alongside textual data
method Joint non-negative matrix factorisation and binomial regression
result Recovering stable response-relevant textual signals
We compute the categorified sl(N) link invariants as defined by Khovanov and Rozansky, for various links and values of N. This is made tractable by an algorithm for reducing tensor products of matrix factorisations to finite rank, which we implement in the computer algebra package Singular.
New open books defy positive factorisation in genus one.
problem Understanding Stein fillable contact structures and their monodromies.
method Constructing an infinite family of open books with specific properties.
result Monodromies of constructed open books do not admit positive factorisations.
Bayesian tensor factorization approximates a complex tree model.
problem Intractable size of state-transition matrix in Hidden Tree Markov Models.
method Tucker factorization of tensors for probabilistic interpretation.
result New model outperforms existing approximations on tree-structured data tasks.
Investigates offline RL in factorisable action spaces, overcoming overestimation bias.
problem Overestimation bias in value estimates for unseen state-action pairs.
method Value-decomposition approach in DecQN, adapted for factorised discrete action spaces.
result Demonstrates the effectiveness of factorised approach in offline RL.
New method synchronizes partial permutations using non-negative factorizations.
problem Synchronizing partial multi-matchings in a cycle-consistent manner.
method Non-negative factorization approach with spectral relaxation and rotation scheme.
result Guaranteed cycle-consistent results compared to existing methods.
Boolean logic used for neural network training and inference, with convergence analysis.
problem Discrete optimization in neural networks with Boolean logic.
method Boolean logic backpropagation with convergence analysis.
result First convergence analysis for Boolean logic in neural networks.
We study geodesic equations for a family of right-invariant Riemannian metrics on the group of diffeomorphisms of a compact manifold. The metrics descend to Fisher's information metric on the space of smooth probability densities. The right reduced geodesic equations are higher-dimensional generalisations of the μ--H…
In recommendation systems, one is interested in the ranking of the predicted items as opposed to other losses such as the mean squared error. Although a variety of ways to evaluate rankings exist in the literature, here we focus on the Area Under the ROC Curve (AUC) as it widely used and has a strong theoretical underp…
Study on functions computed by deep-layered machines finds same distribution in neural networks and Boolean circuits.
problem Understanding the space of functions computed by deep-layered machines.
method Investigation of Boolean functions on random-layered machines, including neural networks and Boolean circuits.
result The space of functions computed at large depth limit is characterized and the macroscopic entropy of Boolean functions is either monotonically increasing or decreasing with depth.
HZ transform applied to knot polynomials reveals hyperbolic knot structures.
problem Understanding the structure of knot polynomials and their factorisability.
method Applying the Harer-Zagier transform to knot polynomials and character expansions.
result Construction of an infinite family of hyperbolic knots and proof of factorisability in the 3-strand case.
New Fourier analysis method for non-uniform Boolean hypercube.
problem Non-uniform probability measures on the Boolean hypercube.
method ANOVA-based decomposition, explicit basis, least squares problem.
result Generalization of Fourier analysis for arbitrary probability measures.
A new deep learning method using Boolean logic reduces training and inference energy.
problem High computational and energy costs in deep learning training and inference.
method Introduces Boolean weights and inputs for efficient training using Boolean logic.
result Achieves full-precision accuracy in ImageNet classification and surpasses state-of-the-art results in semantic segmentation.