Paper extends 2D β-CNMF with exact multiplicative updates.
problem Improving nonnegative matrix factor deconvolution for 2D data.
method Derives exact multiplicative updates for β-CNMF factors. result The updates lead to monotonically decreasing β-divergence. In this letter, we generalize the convolutional NMF by taking the β-divergence as the contrast function and present the correct multiplicative updates for its factors in closed form. The new updates unify the β-NMF and the convolutional NMF. We state why almost all of the existing updates are inexact and approximat…
Proposes TS-NMF for 2D clustering, preserving spatial info.
problem Loss of spatial information in 2D data.
method Semi-Nonnegative Matrix Factorization with manifold learning.
result Improves clustering performance compared to state-of-the-art.
Paper presents a provably correct algorithm for CNMF under separable conditions.
problem Convolutive nonnegative matrix factorization (CNMF) under separable assumptions.
method Algorithm exploiting NMF model and existing separable NMF algorithms.
result Guaranteed solution in low noise settings, runs in polynomial time.
New algorithms improve NMF for extracting patterns from time series data.
problem Extracting short-lived temporal motifs from high-dimensional time series data.
method Extended HALS and ANLS algorithms for CNMF model.
result Improved performance on large-scale data compared to multiplicative updates.
The paper introduces a pooling mechanism for graph CNNs using NMF.
problem Pooling in graph structured data for efficient computation.
method Non-negative matrix factorization for node pooling.
result The pooling mechanism improves graph classification performance.
Paper proposes multiscale self-attentive convolutions for vision and language.
problem Improving language and vision understanding models using self-attention.
method Developed 1D and 2D Self Attentive Convolutions (SAC), multiscale SAC (MSAC).
result MSAC enhances model performance for vision and language tasks.
New neural model processes 2D data with long-range dependencies efficiently.
problem Limited receptive field of convolutions for complex 2D tasks.
method Proposes Matrix Shuffle-Exchange network with O(logn) layers and O(n2logn) complexity. result Exceeds convolutional and graph neural network baselines in long-range dependency modeling.
2D CNNs approximate Korobov functions with near-optimal rates.
problem Approximating Korobov functions using 2D CNNs.
method Constructive approach for 2D CNNs with ReLU activations and fully connected layers.
result 2D CNNs achieve near-optimal approximation rates for Korobov functions.
Overview of methods for rotating 2D and 3D data.
problem Processing data with equivariance/invariance under rotations.
method An overview of methods for 2D and 3D rotations.
result Identification of commonalities and links between methods.
Performance of neural networks can be significantly improved by encoding known invariance for particular tasks. Many image classification tasks, such as those related to cellular imaging, exhibit invariance to rotation. We present a novel scheme using the magnitude response of the 2D-discrete-Fourier transform (2D-DFT)…
Instantiation-Net reconstructs 3D mesh from single 2D image for right ventricle.
problem Reconstructing 3D shape from limited 2D images for surgical navigation.
method Combines DCNN for feature extraction and GCN for mesh reconstruction.
result Demonstrates practical strength and potential clinical use.
MaxVol NMF maximizes the volume of H in NMF for better sparse and interpretable solutions.
problem Finding interpretable and unique NMF solutions.
method Dual approach to MinVol NMF, maximizing the volume of H. result MaxVol NMF solutions correspond to clustering columns in disjoint clusters.
Nonnegative Matrix Factorization (NMF) was first introduced as a low-rank matrix approximation technique, and has enjoyed a wide area of applications. Although NMF does not seem related to the clustering problem at first, it was shown that they are closely linked. In this report, we provide a gentle introduction to clu…
A new NMF model for co-clustering and data approximation.
problem Finding a low rank approximation for nonnegative data.
method Generalizes separability assumption for NMF, proposing Co-Separable NMF (CoS-NMF).
result CoS-NMF outperforms state-of-the-art methods in co-clustering and data approximation.
In this paper, we propose a novel recurrent neural network architecture for speech separation. This architecture is constructed by unfolding the iterations of a sequential iterative soft-thresholding algorithm (ISTA) that solves the optimization problem for sparse nonnegative matrix factorization (NMF) of spectrograms.…
Study evaluates using multiple slices as input for CNNs in medical image segmentation.
problem Improving segmentation performance in medical images with limited computational resources.
method Compared pseudo-3D and 2D approaches using different CNN architectures and datasets.
result Multi-slice inputs did not significantly improve segmentation performance over 2D or 3D CNNs.
We propose an extension of Convolutional Neural Networks (CNNs) to graph-structured data, including strided convolutions and data augmentation on graphs. Our method matches the accuracy of state-of-the-art CNNs when applied on images, without any prior about their 2D regular structure. On fMRI data, we obtain a signifi…
Nonnegative matrix factorization (NMF) factorizes a non-negative matrix into product of two non-negative matrices, namely a signal matrix and a mixing matrix. NMF suffers from the scale and ordering ambiguities. Often, the source signals can be monotonous in nature. For example, in source separation problem, the source…
A new 2.5D U-net for 3D segmentation reduces memory constraints.
problem Large storage requirements for 3D convolutions in neural networks.
method Transform volumetric data into sequences of 2D images, apply 2D convolutions, and reconstruct.
result Outperforms existing methods in volumetric segmentation tasks.
Paper proposes DR-NMF for robust NMF with unknown noise model.
problem Robust NMF for unknown noise model.
method Multi-objective NMF with weighted-sum approach, DR-NMF via Frank-Wolfe algorithm.
result DR-NMF is robust to unknown noise model.
SON-NMF estimates nonnegative rank on-the-fly for NMF.
problem Estimating the nonnegative rank of data in NMF.
method Sum-of-norms (SON) regularization to reduce rank, combined with a first-order BCD algorithm.
result SON-NMF can automatically estimate the rank from data without prior knowledge.
Neural NMF discovers hierarchical topics in multilayer data.
problem Detecting latent hierarchical structure in multilayer data.
method Recursive application of nonnegative matrix factorization (NMF) in layers with backpropagation optimization.
result Neural NMF outperforms other hierarchical NMF methods in synthetic and real-world datasets.
BCAE-2D compresses 3D data from a time projection chamber at high speed.
problem Compressing high-speed, sparse 3D data from a time projection chamber.
method 2D Bicephalous Convolutional Autoencoder (BCAE-2D) approach.
result 3x speedup in compression throughput with improved reconstruction accuracy.
New method for sparse data using L1-NMF with improved sparsity control.
problem Sparse data with false zeros and heavy-tailed noise.
method Component-wise L1-NMF with weighted penalization and coordinate descent.
result Effective in handling sparse data with false zeros.
We simplify symmetric NMF by transforming it into a nonsymmetric problem, enabling faster and more efficient solutions.
problem Efficiently solving symmetric nonnegative matrix factorization (NMF).
method Transforming symmetric NMF into a nonsymmetric problem, applying fast alternating algorithms, and rigorously proving convergence.
result Fast algorithms for symmetric NMF can converge to a critical point at least at a sublinear rate.
We characterize the singular values of the linear transformation associated with a standard 2D multi-channel convolutional layer, enabling their efficient computation. This characterization also leads to an algorithm for projecting a convolutional layer onto an operator-norm ball. We show that this is an effective regu…
Nonnegative matrix factorization (NMF) has become a widely used tool for the analysis of high-dimensional data as it automatically extracts sparse and meaningful features from a set of nonnegative data vectors. We first illustrate this property of NMF on three applications, in image processing, text mining and hyperspe…
A new NMF variant tackles underdetermined problems with sparse and separable assumptions.
problem Underdetermined blind source separation, especially multispectral image unmixing.
method Sparse Separable Nonnegative Matrix Factorization (SSNMF) combining separability and sparsity assumptions. Algorithm based on SNPA and sparse nonnegative least squares.
result In noiseless settings, the algorithm recovers true underlying sources.
PL-NMF improves parallel NMF by optimizing data locality.
problem Data movement costs dominate in parallel NMF applications.
method Developed a parallel NMF algorithm based on HALS with data locality optimizations.
result Significant performance improvement over existing parallel NMF algorithms.
The paper introduces MU for NMF with β-divergences and disjoint constraints.
problem Nonnegative matrix factorization with constraints.
method Design multiplicative updates for NMF based on β-divergences with disjoint constraints. result Multiplicative updates satisfy constraints and decrease the objective function.
Bayesian Non-negative Matrix Factorization (NMF) is a promising approach for understanding uncertainty and structure in matrix data. However, a large volume of applied work optimizes traditional non-Bayesian NMF objectives that fail to provide a principled understanding of the non-identifiability inherent in NMF-- an i…
Unified NMF models for various noise distributions, improving feature extraction.
problem Inadequate assumptions for NMF under complex data distributions.
method Unified framework using MM-algorithms for traditional and convex NMF under Tweedie and Negative Binomial models.
result Unified multiplicative update rules for all models, including novel updates for convex NMF.
Near-convex archetypal analysis improves interpretability and fitting error in NMF.
problem High data fitting error in traditional archetypal analysis.
method Introduces near-convex archetypal analysis (NCAA) that combines AA and NMF.
result NCAA achieves lower data fitting error than state-of-the-art methods.
A new convex model tackles noisy separable NMF with provable correctness.
problem Noisy separable NMF with multiple data points near basis vectors.
method Smooth separability assumption, convex model, fast gradient method.
result The convex model provably recovers factors in the presence of noise.
In this paper, we introduce and provide a short overview of nonnegative matrix factorization (NMF). Several aspects of NMF are discussed, namely, the application in hyperspectral imaging, geometry and uniqueness of NMF solutions, complexity, algorithms, and its link with extended formulations of polyhedra. In order to …
Nonnegative matrix factorization (NMF) has been actively investigated and used in a wide range of problems in the past decade. A significant amount of attention has been given to develop NMF algorithms that are suitable to model time series with strong temporal dependencies. In this paper, we propose a novel state-spac…
Autonomous driving requires 3D perception of vehicles and other objects in the in environment. Much of the current methods support 2D vehicle detection. This paper proposes a flexible pipeline to adopt any 2D detection network and fuse it with a 3D point cloud to generate 3D information with minimum changes of the 2D d…
We propose a geometric assumption on nonnegative data matrices such that under this assumption, we are able to provide upper bounds (both deterministic and probabilistic) on the relative error of nonnegative matrix factorization (NMF). The algorithm we propose first uses the geometric assumption to obtain an exact clus…
Improved clustering of extra-financial data using NMF with data separation.
problem High correlations and complex data structure in extra-financial datasets.
method Applying non-negative matrix factorization (NMF) with an initial data separation step.
result Enhanced clustering quality compared to PCA.
Paper uses CNNs to classify heart sounds from short segments.
problem Classifying heart sounds from short segments of individual beats.
method Developed a 1D-CNN and 2D-CNN ensemble for feature learning and score-level fusion.
result ECNN ensemble achieved 89.22% accuracy and 89.94% sensitivity on the PhysioNet CinC 2016 database.
Convolutional LSTM detects emphysema in lung cancer screening images.
problem Learning disease signatures from weakly annotated volumetric medical images.
method 3D volumetric images analyzed as a sequence of 2D images using convolutional LSTM.
result Convolutional LSTM model outperformed other methods in detecting emphysema.
Paper accelerates and secures distributed NMF.
problem Efficiently processing large NMF matrices and maintaining data privacy.
method Proposes DSANLS framework with matrix sketching for acceleration and secure adaptation.
result DSANLS framework and secure adaptations for distributed NMF.
Non-negative matrix factorization (NMF) is a natural model of admixture and is widely used in science and engineering. A plethora of algorithms have been developed to tackle NMF, but due to the non-convex nature of the problem, there is little guarantee on how well these methods work. Recently a surge of research have …
Proposes a new NMF method incorporating neighborhood structure for better anomaly detection.
problem NMF's inability to incorporate neighborhood structure information limits its performance in nonlinear manifold structures.
method Integrates neighborhood structure information using Minimum Spanning Tree (MST) within NMF framework.
result Empirical results show superior performance in anomaly detection using the proposed method.
The paper develops new algorithms for KL-divergence NMF, proving convergence and performance.
problem Improving NMF for nonnegative data with KL divergence.
method Collect and analyze properties of KL objective function, propose and test new algorithms.
result Guaranteed non-increasing objective function for one proposed algorithm, global convergence.
New methods improve analysis of single cell RNA sequencing data.
problem High dimensionality and complexity of scRNA-seq data.
method Topological Nonnegative Matrix Factorization (TNMF) and Robust Topological NMF (rTNMF).
result TNMF and rTNMF significantly outperform other NMF-based methods.
A new model BGAR(1) improves temporal NMF for time series data.
problem Temporal NMF models lack a well-defined stationary distribution.
method Introduced a new Gamma Markov chain model BGAR(1) to overcome the limitation of previous models.
result BGAR(1) model has a well-defined stationary distribution.