arXiv research

DCNs are fooled by Gabor noise patterns similar to adversarial perturbations.

Constructs Gabor frames for curved manifolds to detect boundaries.

The paper addresses instability in CNNs' first layer by proving max pooling's shift invariance.

A new model of V1 using orientation, frequency, and phase.

This paper studies non-asymptotic model selection for the general case of arbitrary design matrices and arbitrary nonzero entries of the signal. In this regard, it generalizes the notion of incoherence in the existing literature on model selection and introduces two fundamental measures of coherence---termed as the wor…

This article addresses the issue of representing electroencephalographic (EEG) signals in an efficient way. While classical approaches use a fixed Gabor dictionary to analyze EEG signals, this article proposes a data-driven method to obtain an adapted dictionary. To reach an efficient dictionary learning, appropriate s…

A new image completion method inspired by brain cells.

Training deep neural networks with the error backpropagation algorithm is considered implausible from a biological perspective. Numerous recent publications suggest elaborate models for biologically plausible variants of deep learning, typically defining success as reaching around 98% test accuracy on the MNIST data se…

A new uncertainty principle helps traders better understand market activity.

Olshausen and Field (OF) proposed that neural computations in the primary visual cortex (V1) can be partially modeled by sparse dictionary learning. By minimizing the regularized representation error they derived an online algorithm, which learns Gabor-filter receptive fields from a natural image ensemble in agreement …

Proposes a new method to improve CNNs' shift invariance and accuracy.

We present a machine learning model for the analysis of randomly generated discrete signals, modeled as the points of an inhomogeneous, compound Poisson point process. Like the wavelet scattering transform introduced by Mallat, our construction is naturally invariant to translations and reflections, but it decouples th…

Much work has been done refining and characterizing the receptive fields learned by deep learning algorithms. A lot of this work has focused on the development of Gabor-like filters learned when enforcing sparsity constraints on a natural image dataset. Little work however has investigated how these filters might expan…

A new model for complex cells accounts for insensitivity to image shifts.

The existing automatic fingerprint verification methods are designed to work under the assumption that the same sensor is installed for enrollment and authentication (regular matching). There is a remarkable decrease in efficiency when one type of contact-based sensor is employed for enrolment and another type of conta…

Study K-theory of Etesi $C^*$-algebras to understand smooth manifolds.

We describe a model for capturing the statistical structure of local amplitude and local spatial phase in natural images. The model is based on a recently developed, factorized third-order Boltzmann machine that was shown to be effective at capturing higher-order structure in images by modeling dependencies among squar…

Triangular, overlapping Mel-scaled filters ("f-banks") are the current standard input for acoustic models that exploit their input's time-frequency geometry, because they provide a psycho-acoustically motivated time-frequency geometry for a speech signal. F-bank coefficients are provably robust to small deformations in…

This paper proposes a representational model for image pairs such as consecutive video frames that are related by local pixel displacements, in the hope that the model may shed light on motion perception in primary visual cortex (V1). The model couples the following two components: (1) the vector representations of loc…

Deep convolutional neural networks have led to breakthrough results in practical feature extraction applications. The mathematical analysis of these networks was pioneered by Mallat, 2012. Specifically, Mallat considered so-called scattering networks based on identical semi-discrete wavelet frames in each network layer…

Modeling curvature-sensitive cells in visual cortex with geometric structures.

Classical models describe primary visual cortex (V1) as a filter bank of orientation-selective linear-nonlinear (LN) or energy models, but these models fail to predict neural responses to natural stimuli accurately. Recent work shows that models based on convolutional neural networks (CNNs) lead to much more accurate p…

This paper tackles spatio-temporal information preservation in machine learning.

We introduce a neural-network architecture, termed the constrained recurrent sparse autoencoder (CRsAE), that solves convolutional dictionary learning problems, thus establishing a link between dictionary learning and neural networks. Specifically, we leverage the interpretation of the alternating-minimization algorith…

Measures three types of noise in LLM evaluations.

The study investigates noise effects on parameter estimation for Ornstein-Uhlenbeck processes.

Noise in SGD affects overparameterized models, favoring sparse solutions.

L2R learns to denoise images without needing noise distribution knowledge.

Interpolating label noise makes models vulnerable to adversarial attacks.

NR-GANs learn clean images from noisy data.

We present a noise-injected version of the Expectation-Maximization (EM) algorithm: the Noisy Expectation Maximization (NEM) algorithm. The NEM algorithm uses noise to speed up the convergence of the EM algorithm. The NEM theorem shows that injected noise speeds up the average convergence of the EM algorithm to a local…

BeGIN benchmarks GNNs for instance-dependent label noise in graphs.

Enhanced consistency bounds derived for classification under a new noise condition.

Proposes a progressive label correction method for feature-dependent label noise.

New methods for handling time-varying label noise in time series classification.

NoiseRank reduces label noise without supervision, improving classification accuracy.

Paper tackles online control of linear systems with unbounded noise.

Efficient algorithm for halfspaces with specific noise conditions.

Study on noise models for noisy labels in NLP.

Using a Bayesian approach, we consider the problem of recovering sparse signals under additive sparse and dense noise. Typically, sparse noise models outliers, impulse bursts or data loss. To handle sparse noise, existing methods simultaneously estimate the sparse signal of interest and the sparse noise of no interest.…

TrustNet robustly learns noise patterns from trusted data to improve weakly-supervised classification.

Noise enhancement improves generalization in training.

New findings show noisy gradient descent can generalize well, even with non-SGD noise.

HeMPPCAT improves PCA for data with varying noise.

The paper examines various RL algorithms to address overestimation and noise issues.

Geometry-aware noise improves model generalization on complex manifolds.

A method uses confidence scores to handle noisy labels for each instance.

New insights into noise distribution for self-supervised learning.