Novel low-rank neural decoder improves -ECoG neural decoding.
problem Challenging neural decoding from high-dimensional -ECoG data.
method Low-rank structure in neural network decoder.
result Low-rank decoder outperforms standard PCA.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,051 papers · 148 categories
Trend · papers per month
48 results for “auditory cortex”
WaveNet reconstructs speech from brain activity, revealing acoustic features.
problem Reconstructing speech from brain activity with limited data.
method WaveNet model applied to STG intracranial recordings.
result WaveNet models reveal phoneme-level acoustic features.
Representations in the auditory cortex might be based on mechanisms similar to the visual ventral stream; modules for building invariance to transformations and multiple layers for compositionality and selectivity. In this paper we propose the use of such computational modules for extracting invariant and discriminativ…
End-to-end audio recognition system improves accuracy.
problem Improving accuracy in auditory object recognition.
method Proposes an end-to-end deep neural network with an 'inception nucleus' to learn features from raw waveforms.
result Bests current state-of-the-art approaches by 10.4 percentage points on Urbansound8k dataset.
New model for visual cortex border completion using bicycle wheel motions.
problem Understanding border completion in the visual cortex V1.
method Sub-Riemannian Hamiltonian formalism and bicycle wheel analogy.
result Analogies between visual cortex border completion and bicycle wheel motions.
New method for nonlinear Granger causality improves predictive relationships.
problem Challenges in applying Granger causality to nonlinear data.
method Permutation of covariate set, artificial neural networks, consistent variance estimation.
result Permutation method outperforms other techniques in predicting nonlinear relationships.
Automatic segmentation of auditory ossicles from CT images using Ricci curvature.
problem Automatic diagnosis of ossicles' diseases from 3D CT images of the head.
method Proposes a completely automatic method that locates and segments ossicles without manual labels or templates, using Ricci curvature in an energy function.
result Performance of the proposed method using discrete Forman-Ricci curvature is superior to state-of-the-art methods.
A new geometric model for V1 hypercolumns combines symplectic and spherical models.
problem Understanding the structure of V1 hypercolumns in the visual cortex.
method A differential geometric model based on conformal geometry.
result Combines features of symplectic and spherical models of hypercolumns.
Modeling curvature-sensitive cells in visual cortex with geometric structures.
problem Understanding the functional architecture of curvature-sensitive cells in the visual cortex.
method Geometric model based on Engel structure and SIM(2) symmetry.
result Identified SIM(2) as the natural symmetry group for curvature-sensitive cells.
New VAE models reveal hierarchical visual cortex computations.
problem Capturing hierarchical visual cortex computations in generative models.
method Sparse coding hierarchical VAEs trained on natural images with varied generative and recognition components.
result Representations similar to those in visual cortex emerge under inductive biases.
A fusion approach combines audio and video features for emotion recognition.
problem Continuous emotion recognition using both visual and auditory modalities.
method Pre-trained CNN features from video frames and minimalistic auditory descriptors. Fusion at feature or prediction level. SVR for prediction.
result Improves CCCs of 0.749 and 0.565 for arousal and valence respectively.
Modeling curvature-sensitive cells in visual cortex using manifold geometry.
problem Understanding how curvature influences cell function in the visual cortex.
method Developed a 4D manifold with canonical Engel structure to represent orientation, position, curvature, and scale.
result Characterized curvature-sensitive receptive profiles using left-invariant generators of the Engel structure.
Tiny Eats GRU detects eating episodes on a microcontroller.
problem Automatic dietary monitoring on low-power devices.
method Shallow gated recurrent unit (GRU) architecture on Arm Cortex M0+.
result Tiny Eats GRU achieves 95.15% accuracy with 4% memory usage and 6 ms latency.
The paper extends the functional geometry of the visual cortex to more complex architectures using contactization and symplectization.
problem Understanding the functional architecture of the visual cortex.
method Contactization and symplectization processes to extend the dimension of the space.
result Extension of the functional geometry of the visual cortex to more complex architectures.
The human auditory system is able to distinguish the vocal source of thousands of speakers, yet not much is known about what features the auditory system uses to do this. Fourier Transforms are capable of capturing the pitch and harmonic structure of the speaker but this alone proves insufficient at identifying speaker…
We propose a primitive called PJOIN, for "predictive join," which combines and extends the operations JOIN and LINK, which Valiant proposed as the basis of a computational theory of cortex. We show that PJOIN can be implemented in Valiant's model. We also show that, using PJOIN, certain reasonably complex learning and …
FANN-on-MCU enables efficient neural network inference on IoT devices.
problem Energy-efficient neural network inference on resource-constrained IoT devices.
method Open-source toolkit for ARM Cortex-M and RISC-V microcontrollers.
result Efficient neural network execution with low latency and power consumption.
This paper uses fuzzy C-Means clustering and sonification to analyze heart rate variability.
problem Identifying suitable features from HRV analysis for sonification.
method Unsupervised machine learning (fuzzy C-Means clustering) and sonification techniques.
result Improves sonification interpretability by selecting appropriate HRV features.
A new model of V1 using orientation, frequency, and phase.
problem Understanding the complex behavior of V1 simple cells.
method Developed a sub-Riemannian model based on Gabor functions.
result The model enhances images using orientation, frequency, and phase.
Decodes neural activity to detect context effects in natural settings.
problem Detecting context-dependent changes in neural encoding.
method Decoding-based approach controlling for confounding factors.
result Demonstrates context-dependent changes in neural encoding.
V1 cortex reconstructs images as Poisson equation solutions with varying weights.
problem Reconstructing images from V1 cortical cell receptive profiles.
method Solves a heterogeneous Poisson equation with varying weights representing neural connectivity.
result Reconstructions converge to homogeneous solutions using homogenization techniques.
Learning with hidden variablesq-bio.NC
Learning and inferring features that generate sensory input is a task continuously performed by cortex. In recent years, novel algorithms and learning rules have been proposed that allow neural network models to learn such features from natural images, written text, audio signals, etc. These networks usually involve de…
Classical models describe primary visual cortex (V1) as a filter bank of orientation-selective linear-nonlinear (LN) or energy models, but these models fail to predict neural responses to natural stimuli accurately. Recent work shows that models based on convolutional neural networks (CNNs) lead to much more accurate p…
Despite rapid advances in machine learning tools, the majority of neural decoding approaches still use traditional methods. Modern machine learning tools, which are versatile and easy to use, have the potential to significantly improve decoding performance. This tutorial describes how to effectively apply these algorit…
DCNs mimic neuronal networks for improved neural classification.
problem Lack of topological similarity between DNNs and biological neural networks.
method Developed DCNs with topologies inspired by real-world neuronal networks.
result High classification accuracy achieved by DCNs.
Introduces basic facts on early vision's functional architecture.
problem Accessibility of early vision's functional architecture for non-specialists.
method Survey of three neurogeometric models and discussion of the conformal model.
result Synthesis of symplectic and spherical models into the conformal model.
New model improves community detection in networks with strong assortativity.
problem Classic SBMs fail to recover assortative communities in networks with reduced information.
method Introduced a constrained SBM with strong assortativity constraints and efficient algorithms.
result Significant boost in community recovery capabilities, especially close to information-theoretic threshold.
Automated framework optimizes DNN deployment on Arm CPUs.
problem Lack of globally optimised DNN deployment across software levels.
method Reinforcement Learning search for automated design space exploration.
result Up to 4x improvement in performance and 2x reduction in memory.
Neurons in the visual cortex are correlated in their variability. The presence of correlation impacts cortical processing because noise cannot be averaged out over many neurons. In an effort to understand the functional purpose of correlated variability, we implement and evaluate correlated noise models in deep convolu…
Deep learning models outperform classical methods in forecasting neural activity.
problem Improving forecasting of neural activity using deep learning models.
method Systematic evaluation of eight probabilistic deep learning models against classical statistical models and baseline methods.
result Several deep learning models consistently outperform classical approaches in forecasting neural activity.
Inspired by brain's modality fusion, this paper detects active speakers from audio and video.
problem Detecting active speakers in noisy environments.
method Inspired by brain's superior colliculus, combines audio and visual data through specialized neural networks and a novel fusion layer.
result Achieved results greatly surpassing initial expectations, confirming the effectiveness of the proposed method.
BNNs enhance reservoir computing by acting as generalization filters.
problem Understanding how BNNs integrate with reservoir computing.
method Optogenetics and calcium imaging to record BNNs, reservoir computing framework.
result BNNs improve reservoir computing performance through generalization.
Fault-tolerant neural networks inspired by biological error correction codes.
problem Achieving reliable computation with unreliable neurons.
method Using biological error correction codes from grid cells in the mammalian cortex to develop a fault-tolerant neural network.
result Noisy biological neurons operate below a fault-tolerance threshold, suggesting a mechanism for reliable computation in the brain.
TMNs model brain memory systems for continual learning.
problem Catastrophic forgetting in neural networks.
method Triple Network architecture of GANs, incorporating brain-inspired algorithms.
result New state-of-the-art performance on class-incremental learning benchmarks.
Spatial-Spectral Boosting Analysis for Stroke Patients' Motor Imagery EEG in Rehabilitation Trainingstat.ML
Current studies about motor imagery based rehabilitation training systems for stroke subjects lack an appropriate analytic method, which can achieve a considerable classification accuracy, at the same time detects gradual changes of imagery patterns during rehabilitation process and disinters potential mechanisms about…
Improved cardiac arrhythmia detection in wearable devices with neural networks.
problem Resource constraints in low-power wearable devices for accurate arrhythmia detection.
method Adapted a convolutional-recurrent neural network to a low-power microcontroller, optimizing for precision and memory usage.
result Reduced score from 0.8 to 0.784 in fixed-point precision, with a 195.6KB memory footprint and 33.98MOps/s throughput.
EAST compresses deep ConvNets for tiny memory nodes.
problem Memory constraints in tiny devices for deep ConvNets.
method Encoding-Aware Sparse Training (EAST) with adaptive group pruning and LZ4 weight encoding.
result EAST achieves deep memory compression with lower sparsity and higher accuracy.
The paper proposes a model to learn motion perception in V1 using vector and matrix representations.
problem Motion perception in primary visual cortex (V1).
method Coupling vector representations of local contents and matrix representations of local pixel displacements.
result The model can learn Gabor-like filter pairs and infer local motions.
MRI identifies chronic symptoms in mTBI patients.
problem Chronic symptoms in mTBI patients are hard to characterize.
method Multi-parametric MRI and low-dimensional projection.
result MRI metrics correlate with patient symptoms.
High-contrast "gaudy" images improve the training of deep neural network models of visual cortexcs.CV
Gaudy images help train deep neural networks with less data.
problem Training deep neural networks with limited real data from visual cortex neurons.
method Used high-contrast binarized natural images (gaudy images) to train DNNs.
result Reduced training data needed for accurate DNN predictions of visual cortex neuron responses.
New eGRU unit improves keyword spotting on ultra-low-power devices.
problem Resource constraints of edge devices for neural network deployment.
method Optimized recurrent unit architecture for ultra-low power.
result eGRU is 60x faster and 10x smaller than GRU, maintaining accuracy.
Proposes a self-supervised method for generating spatial audio from monaural audio and video.
problem Generating spatial audio from monaural audio and video recordings is challenging and expensive.
method Uses a self-supervised network with an auxiliary classifier to classify video channels and generate spatial audio.
result The proposed method effectively generates spatial audio from monaural audio and video.
Constructs Gabor frames for curved manifolds to detect boundaries.
problem Signal analysis on curved manifolds with boundaries.
method Higher-dimensional Gabor frames for local linearizations.
result Detection of higher-dimensional boundaries in curved manifolds.
This paper automates the creation of low precision deep learning operators for mobile devices.
problem Deploying large deep learning models on low power devices is challenging due to limited compute capabilities and energy budgets.
method Introduces a workflow to generate high-performance low precision deep learning operators for multiple CPU architectures, including optimizations like memory tiling and vectorization.
result 1-bit and 2-bit convolutions achieve up to 16x and 2.3x speedups over 16-bit integer baselines on ARM Cortex-A53 CPU.
Graph Embedding Using Infomax for ASD Classification and Brain Functional Difference Detectioneess.IV
Graph embedding improves fMRI classification and reveals brain region differences in ASD.
problem Difficult to embed informative brain fMRI representations due to high dimensionality and low SNR.
method Modelled fMRI as a graph, used GNN to learn from graph data, incorporated mutual information loss (Infomax).
result Infomax graph embedding improves classification performance and reveals separable nodal representations of ASD and HC groups.
We focus on two supervised visual reasoning tasks whose labels encode a semantic relational rule between two or more objects in an image: the MNIST Parity task and the colorized Pentomino task. The objects in the images undergo random translation, scaling, rotation and coloring transformations. Thus these tasks involve…
The paper proposes using CWT and STFT for training neural speech models.
problem Training high-quality neural speech models.
method Proposes spectral amplitude and phase losses from STFT and CWT for training.
result Shows that CWT spectral loss can train a high-quality model as good as STFT-based loss.
The apparent stochasticity of in-vivo neural circuits has long been hypothesized to represent a signature of ongoing stochastic inference in the brain. More recently, a theoretical framework for neural sampling has been proposed, which explains how sample-based inference can be performed by networks of spiking neurons.…