Over the last several years, the use of machine learning (ML) in neuroscience has been rapidly increasing. Here, we review ML's contributions, both realized and potential, across several areas of systems neuroscience. We describe four primary roles of ML within neuroscience: 1) creating solutions to engineering problem…
CoNBONet improves reliability analysis of complex systems with fast, energy-efficient predictions.
problem Time-dependent reliability analysis of nonlinear systems under stochastic excitations is computationally demanding.
method CoNBONet combines deep operator networks with neuroscience-inspired neuron models for fast, energy-efficient inference.
result CoNBONet provides reliable coverage of failure probabilities with theoretical guarantees.
Neuroscience is undergoing faster changes than ever before. Over 100 years our field qualitatively described and invasively manipulated single or few organisms to gain anatomical, physiological, and pharmacological insights. In the last 10 years neuroscience spawned quantitative big-sample datasets on microanatomy, syn…
Neural networks with learned biases can approximate any function.
problem Whether neural networks with only learned biases can approximate any continuous function.
method Theoretical and numerical analysis of random weights and learned biases in neural networks.
result Feedforward and recurrent neural networks with random weights can approximate any continuous function and dynamical systems.
Cluster Quilting clusters fragmented data sets for neuroscience and genomics.
problem Clustering fragmented data sets in neuroscience and genomics.
method Cluster Quilting method using patch ordering, patchwise SVD, sequential linear mapping, and k-means.
result Cluster Quilting discovers more accurate clusters than other methods.
NeuroQuery synthesizes brain mapping evidence across diverse concepts.
problem Lack of comprehensive meta-analysis of human brain mapping across different mental processes and mechanisms.
method A multivariate model that predicts the spatial distribution of neurological observations given text describing an experiment, cognitive process, or disease.
result Captures relationships and neural correlates of 7,547 neuroscience terms across 13,459 neuroimaging publications.
Visualizes DNNs using topographic maps for better understanding.
problem Difficulty in understanding how DNNs solve tasks.
method Adapting neuroscience methods to visualize DNN activations.
result Improved transparency and interpretability of DNN-based systems.
AKOrN uses synchronized neurons to improve AI tasks.
problem Improving AI performance through better neural representations.
method AKOrN introduces synchronized neurons to replace threshold units.
result AKOrN improves performance across various AI tasks.
A simple thresholding technique improves graph selection in neural connectivity studies.
problem Graphical model selection for functional neural connectivity in the presence of latent variables.
method Apply a hard thresholding operator to graphical Lasso, neighborhood selection, or CLIME estimators.
result Thresholded estimators outperform existing methods in graph selection consistency and empirical results.
Novel method models dynamic brain graphs from time series data.
problem Generating hypotheses for dynamic brain states.
method Conditionally weighted superposition of static graphs.
result Improves f1-scores by 22-28% on average over baselines.
Researchers develop geodesics for a new metric on correlation matrices.
problem Lack of intrinsic tools for statistical analyses of correlation matrices.
method Developed geodesics for the quotient-affine metric on full-rank correlation matrices.
result Provided fundamental Riemannian operations for the quotient-affine metric.
PGPCA improves PCA for nonlinear data in neuroscience.
problem Nonlinear data distribution in neuroscience.
method Developed PGPCA for nonlinear manifolds, incorporating EM algorithm.
result PGPCA outperforms PPCA in modeling data around nonlinear manifolds.
Proposes a nonparametric approach for inferring spike train filters.
problem Modeling neuron information encoding from electrophysiological recordings.
method Gaussian process framework for joint inference of filters and hyperparameters.
result Automatic learning of filter temporal span and stimulus/history filters.
Geometric model explains music perception combining neuroscience and acoustics.
problem Rationalize and predict psycho-acoustic phenomena in music perception.
method Combining neuroscientific theories with acoustic observations, a geometric model of the space of all chords is created.
result The geometric model allows for rigorous studies of psychoacoustic quantities like roughness and harmonicity.
Bayesian optimization generates personalized face stimuli for cognitive neuroscience.
problem Lack of personalized face stimuli in cognitive neuroscience studies.
method Combines GANs with Bayesian optimization to identify individual response patterns to faces.
result Algorithm efficiently generates optimal faces maximizing individual subject's response.
Estimates curvature of network manifolds to understand community structure.
problem Understanding the geometry of network models to infer community structure.
method Develops hypothesis tests to determine manifold type, dimension, and curvature from noisy distance matrices.
result Consistently estimates manifold type, dimension, and curvature from Riemannian manifolds of constant curvature.
New AI learns like neurons, generalizing from sparse rewards.
problem Designing AI that learns without explicit instructions and applies that learning to sparse reward scenarios.
method Combining neuroscience principles with computational efficiency, creating the Neurons-in-a-Box architecture.
result The architecture can learn efficiently and generalize across various tasks, including challenging environments.
Proposes a model for classifying high-dimensional time series with interpretable parameters.
problem Challenges in classifying high-dimensional time series, especially in neuroscience.
method Model-based approach using sparsity in inverse spectral density matrices, with interpretability of model parameters.
result Model demonstrates consistency and sure screening property, enabling nuanced inferences.
PyBADS optimizes complex functions quickly and reliably.
problem Optimizing rough, noisy, and expensive functions with unknown gradients.
method Bayesian Adaptive Direct Search (BADS) algorithm.
result PyBADS performs well on both artificial and real-world problems.
Coherent Multiplex analyzes real-time wavelet coherence among multiple signals.
problem Identifying and visualizing coherence among multiple time series.
method Fast spectral similarity based on cosine similarity metrics of Fourier-transformed signals and sparse time-frequency wavelet coherence.
result Scalable real-time system for low-latency inference and monitoring of inter-signal relationships.
High-dimensional data simplifies problems, contrary to the curse of dimensionality.
problem Exponential difficulty in high-dimensional problems.
method Analysis of high-dimensional datasets and their geometric properties.
result Generic high-dimensional datasets exhibit simple geometric properties.
Active inference enhances RL by balancing exploration and exploitation.
problem Traditional RL's balance between exploration and exploitation is often suboptimal.
method Developed a new decision-making objective based on active inference.
result The new algorithm successfully balances exploration and exploitation on various RL benchmarks.
New VAE models reveal hierarchical visual cortex computations.
problem Capturing hierarchical visual cortex computations in generative models.
method Sparse coding hierarchical VAEs trained on natural images with varied generative and recognition components.
result Representations similar to those in visual cortex emerge under inductive biases.
We investigate time-dependent data analysis from the perspective of recurrent kernel machines, from which models with hidden units and gated memory cells arise naturally. By considering dynamic gating of the memory cell, a model closely related to the long short-term memory (LSTM) recurrent neural network is derived. E…
Deep learning has sparked a network of mutual interactions between different disciplines and AI. Naturally, each discipline focuses and interprets the workings of deep learning in different ways. This diversity of perspectives on deep learning, from neuroscience to statistical physics, is a rich source of inspiration t…
A Python package for GLHMM, a flexible HMM framework.
problem Handling diverse HMM applications in neuroscience.
method Stochastic variational inference for large datasets.
result Enables statistical testing and out-of-sample prediction.
Develops a method to model neural dynamics with flexible yet interpretable latent states.
problem Capturing complex nonlinear dynamics in neural time series while maintaining interpretability.
method Gaussian Process Switching Linear Dynamical System (gpSLDS) that balances expressiveness and interpretability.
result Favorable performance in comparison to rSLDS on synthetic and real neuroscience data.
SNVI combines likelihood estimation with variational inference for efficient Bayesian inference.
problem Bayesian inference in models with intractable likelihoods.
method Sequential Neural Variational Inference (SNVI) that combines likelihood-estimation with variational inference.
result SNVI is more computationally efficient than previous algorithms without sacrificing accuracy.
Computational models in fields such as computational neuroscience are often evaluated via stochastic simulation or numerical approximation. Fitting these models implies a difficult optimization problem over complex, possibly noisy parameter landscapes. Bayesian optimization (BO) has been successfully applied to solving…
Financial markets modeled like brain networks using dMNC.
problem Understanding latent dynamics in financial markets.
method Biologically inspired framework using dMNC.
result Structural persistence, regime shifts, and early warning signals identified.
New statistical inference method for high-dimensional Hawkes processes.
problem Uncertainty evaluation of network estimates in high-dimensional point process data.
method Develops a new statistical inference procedure using concentration inequalities and martingale central limit theory.
result Characterizes the convergence rate of test statistics for high-dimensional Hawkes processes.
Deep neural networks (DNNs) transform stimuli across multiple processing stages to produce representations that can be used to solve complex tasks, such as object recognition in images. However, a full understanding of how they achieve this remains elusive. The complexity of biological neural networks substantially exc…
Bayesian models explain human time perception biases.
problem Understanding human time perception using Bayesian inference.
method Agent-based machine learning models and empirical data analysis.
result Bayesian models can replicate human time estimation biases.
NeuroPaint infers missing brain area dynamics from multi-animal datasets.
problem Leveraging multi-animal datasets to understand interactions between brain areas.
method Masked autoencoding approach trained across animals with partial observations.
result Models can successfully reconstruct dynamics of unrecorded brain areas.
A new approach to learning in brain-like networks using adversarial algorithms.
problem Complex inter-dependencies in brain-like networks not compatible with conditional independence assumptions.
method Adversarial algorithm for learning models of perceptual processing.
result The approach can mimic known neural phenomena and yields testable hypotheses.
Paper reviews intrinsic motivations and their role in open-ended learning.
problem Understanding intrinsic motivations and their role in open-ended learning.
method Defining intrinsic motivations, presenting psychological/neuroscientific and computational models.
result Links between psychological/neuroscientific and computational models of intrinsic motivations.
A new model for sequential memory using temporal predictive coding.
problem Forming accurate memory of sequential stimuli in the brain.
method Proposes a novel PC-based model called temporal predictive coding (tPC).
result Shows that tPC models can accurately memorize and retrieve sequential inputs.
Randomized algorithm solves vector-valued regression problems with low-rank operators.
problem Vector-valued regression problems involving infinite-dimensional spaces.
method Randomized Reduced Rank Regression (R4) using Gaussian sketching for optimization.
result R4 estimators are efficient and accurate, with empirical risk close to optimal.
Two synthetic likelihood methods learn EBM of likelihood from simulator data for SBI.
problem Conduct inference from experimental observations using high-fidelity simulators.
method Learn conditional EBM of likelihood using synthetic data conditioned on parameters.
result Learned likelihood combined with prior yields posterior estimate for sampling.
Develops a new point process model for detecting neural spike sequences.
problem Detecting sparse sequences of neural spikes in high-dimensional spike trains.
method A point process model that represents sequence occurrences as marked events in continuous time, with learnable time warping parameters.
result Demonstrates improved detection and modeling of neural spike sequences.
Time-series data is being increasingly collected and stud- ied in several areas such as neuroscience, climate science, transportation, and social media. Discovery of complex patterns of relationships between individual time-series, using data-driven approaches can improve our understanding of real-world systems. While …
New framework for task-independent legged locomotion.
problem Building stable legged locomotion systems in robotics.
method Task-independent spiking central pattern generator using learning methods.
result Robotic legged locomotion at different speeds and within the same gait cycle.
TSNPE improves SBI efficiency and scalability.
problem Efficient and scalable simulation-based inference for complex models.
method Sequential inference with truncated proposals.
result TSNPE performs on par with previous methods and scales to complex models.
Advocates for Marr's levels of analysis to unify machine learning debates.
problem Challenges in aligning perspectives among machine learning researchers.
method Introduces Marr's levels of analysis from cognitive science and neuroscience.
result Marr's levels facilitate understanding and dissection of machine learning methods.
New AI-block models for clustering high-dimensional variables based on maxima of random processes.
problem Clustering high-dimensional variables with weakly dependent maxima of random processes.
method Asymptotic Independent block (AI-block) models and an algorithm for variable clustering.
result The proposed AI-block models and algorithm can effectively identify clusters in high-dimensional data.
Adversarial robustness of amortized Bayesian inference is studied, showing it can be improved.
problem Adversarial robustness of amortized Bayesian inference.
method Simulation-based estimation, regularization scheme based on Fisher information.
result Adversarial robustness can be improved with a regularization scheme.
New model for visual cortex border completion using bicycle wheel motions.
problem Understanding border completion in the visual cortex V1.
method Sub-Riemannian Hamiltonian formalism and bicycle wheel analogy.
result Analogies between visual cortex border completion and bicycle wheel motions.
Animals (especially humans) have an amazing ability to learn new tasks quickly, and switch between them flexibly. How brains support this ability is largely unknown, both neuroscientifically and algorithmically. One reasonable supposition is that modules drawing on an underlying general-purpose sensory representation a…