This paper strengthens the computational separation between multimodal and unimodal learning, showing unimodal learning is hard on typical instances.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
We simplify information measure computation using learned features.
Reservoir computing's success depends on mapping different input time series to separable states.
This paper provides a mathematical framework for time-delay reservoir computing.
Study shortest non-separating curves on non-orientable surfaces, proving NP-hardness and tractability.
This paper proposes an alternative algorithm for multichannel variational autoencoder (MVAE), a recently proposed multichannel source separation approach. While MVAE is notable in its impressive source separation performance, the convergence-guaranteed optimization algorithm and that it allows us to estimate source-cla…
New approach models computer network activity as mixtures of sources.
The paper establishes a nearly-sharp statistical threshold for efficient learning in Latent MDPs with separated components.
Two commonly arising computational tasks in Bayesian learning are Optimization (Maximum A Posteriori estimation) and Sampling (from the posterior distribution). In the convex case these two problems are efficiently reducible to each other. Recent work (Ma et al. 2019) shows that in the non-convex case, sampling can som…
This work addresses the problem of learning sparse representations of tensor data using structured dictionary learning. It proposes learning a mixture of separable dictionaries to better capture the structure of tensor data by generalizing the separable dictionary learning model. Two different approaches for learning m…
Efficient neural network for audio source separation.
The complement of a non-separating planar graph contains a K_n minor.
A new method speeds up overlapping group lasso computations.
Quantum computers outperform classical methods in density modeling.
The paper introduces toric separable geometries and finds new extremal metrics.
Algorithm finds frequencies, amplitudes, and phases of sinusoids in noisy data.
Separating an audio scene into isolated sources is a fundamental problem in computer audition, analogous to image segmentation in visual scene analysis. Source separation systems based on deep learning are currently the most successful approaches for solving the underdetermined separation problem, where there are more …
A parallel algorithm learns efficient Kronecker product dictionaries.
We compute the automorphism groups of the Torelli complex and the complex of separating curves for all but finitely many compact orientable surfaces. As an application, we show that the abstract commensurators of the Torelli group and the Johnson kernel for such surfaces are naturally isomorphic to the extended mapping…
Mirror flow optimizes separable data problems, converging to a maximum margin classifier.
Safe screening rule improves Group SLOPE efficiency.
Separating an audio scene such as a cocktail party into constituent, meaningful components is a core task in computer audition. Deep networks are the state-of-the-art approach. They are trained on synthetic mixtures of audio made from isolated sound source recordings so that ground truth for the separation is known. Ho…
Study on size and depth of neural networks for approximating benign functions, showing barriers and explicit results.
Gaussian process (GP) audio source separation is a time-domain approach that circumvents the inherent phase approximation issue of spectrogram based methods. Furthermore, through its kernel, GPs elegantly incorporate prior knowledge about the sources into the separation model. Despite these compelling advantages, the c…
We compute the Floer homology of mapping classes which do not have any pseudo-Anosov components in the sense of Thurston's theory of surface diffeomorphisms. The formula for the Floer homology is obtained from a topological separation of fixed points and a separation mechanism for Floer connecting orbits. As examples, …
New separation concepts for Anosov representations help bound Thurston asymmetric metric.
This work introduces sequential neural beamforming, which alternates between neural network based spectral separation and beamforming based spatial separation. Our neural networks for separation use an advanced convolutional architecture trained with a novel stabilized signal-to-noise ratio loss function. For beamformi…
New kernels allow learning from non-separable data.
New criterion assesses cluster separability for validation.
AUC-spec optimizes graph-based SSL for complex label distributions.
Most data in genome-wide phylogenetic analysis (phylogenomics) is essentially multidimensional, posing a major challenge to human comprehension and computational analysis. Also, we can not directly apply statistical learning models in data science to a set of phylogenetic trees since the space of phylogenetic trees is …
Convolution Neural Network (CNN) has gained tremendous success in computer vision tasks with its outstanding ability to capture the local latent features. Recently, there has been an increasing interest in extending convolution operations to the non-Euclidean geometry. Although various types of convolution operations h…
A new method speeds up spectral normalization for neural nets.
slimTrain simplifies DNN training by separating features and adapting hyperparameters.
We define and discuss the first sparse coding algorithm based on closed-form EM updates and continuous latent variables. The underlying generative model consists of a standard `spike-and-slab' prior and a Gaussian noise model. Closed-form solutions for E- and M-step equations are derived by generalizing probabilistic P…
Randomly initialized neural networks can linearly separate arbitrary sets.
Numerous algorithms are used for nonnegative matrix factorization under the assumption that the matrix is nearly separable. In this paper, we show how to make these algorithms efficient for data matrices that have many more rows than columns, so-called "tall-and-skinny matrices". One key component to these improved met…
Recently, a family of tractable NMF algorithms have been proposed under the assumption that the data matrix satisfies a separability condition Donoho & Stodden (2003); Arora et al. (2012). Geometrically, this condition reformulates the NMF problem as that of finding the extreme rays of the conical hull of a finite set …
Logistic regression is one of the most popular methods in binary classification, wherein estimation of model parameters is carried out by solving the maximum likelihood (ML) optimization problem, and the ML estimator is defined to be the optimal solution of this problem. It is well known that the ML estimator exists wh…
Higher granularity in MoE models boosts expressivity exponentially.
This work simplifies SVM parameter selection using S&S ratio.
Models for audio source separation usually operate on the magnitude spectrum, which ignores phase information and makes separation performance dependant on hyper-parameters for the spectral front-end. Therefore, we investigate end-to-end source separation in the time-domain, which allows modelling phase information and…
In this work we show that randomized (block) coordinate descent methods can be accelerated by parallelization when applied to the problem of minimizing the sum of a partially separable smooth convex function and a simple separable convex function. The theoretical speedup, as compared to the serial method, and referring…
Improved tensor GLM estimation for complex data.
Nonnegative matrix factorization (NMF) is a linear dimensionality technique for nonnegative data with applications such as image analysis, text mining, audio source separation and hyperspectral unmixing. Given a data matrix and a factorization rank , NMF looks for a nonnegative matrix with columns and a …
Invariant obstructs separating coassociative 4-folds.
New non-separable covariance kernels for spatiotemporal data derived from harmonic oscillator physics.
Quantum speedup for Monte Carlo integration reduces integrand calls.