A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Researchers develop methods to learn neuron dynamics from colored noise.
A machine learning framework predicts self-induced stochastic resonance in neurons.
Deep neural networks solve parameter estimation for FitzHugh-Nagumo ODEs.
New method for online learning in interacting particle systems.
The FitzHugh-Nagumo equation provides a simple mathematical model of cardiac tissue as an excitable medium hosting spiral wave vortices. Here we present extensive numerical simulations studying long-term dynamics of knotted vortex string solutions for all torus knots up to crossing number 11. We demonstrate that FitzHu…
Method predicts multistable system states from sparse measurements.
Estimates log-likelihood of interacting particle systems using virtual particles.
Variational inference has had great success in scaling approximate Bayesian inference to big data by exploiting mini-batch training. To date, however, this strategy has been most applicable to models of independent data. We propose an extension to state space models of time series data based on a novel generative model…
We introduce and illustrate a new approach to the unknotting problem via the dynamics of vortex strings in a nonlinear partial differential equation of reaction-diffusion type. To untangle a given knot, a Biot-Savart construction is used to initialize the knot as a vortex string in the FitzHugh-Nagumo equation. Remarka…
Examines WENDy-IRLS algorithm's noise robustness and efficiency in various differential equations.
Neuron Shapley identifies key neurons in deep networks, improving model accuracy and fairness.
Describes explaining neurons in deep representations using compositional logical concepts.
SeReNe prunes neurons with low sensitivity to reduce network size.
Under-parameterized networks can either copy or average teacher weights, leading to universal optimal solutions.
This research investigates selectively pruning hyper and hypo neurons to improve neural network generalization.
Modeling hidden neurons in SNNs using mesoscopic approximations.
Topological methods improve neuron analysis and tracer injection summary.
Inspired by complexity and diversity of biological neurons, our group proposed quadratic neurons by replacing the inner product in current artificial neurons with a quadratic operation on input data, thereby enhancing the capability of an individual neuron. Along this direction, we are motivated to evaluate the power o…
We propose a new generic type of stochastic neurons, called -neurons, that considers activation functions based on Jackson's -derivatives with stochastic parameters . Our generalization of neural network architectures with -neurons is shown to be both scalable and very easy to implement. We demonstrate expe…
SpaRCe optimizes reservoir computing by learning neuron thresholds to improve performance and prevent forgetting.
It will be shown that according to theorems of K. Menger, every neuron grid if identified with a curve is able to preserve the adopted qualitative structure of a data space. Furthermore, if this identification is made, the neuron grid structure can always be mapped to a subset of a universal neuron grid which is constr…
Neural networks learn to mimic brain neurons with two-input activation functions, improving performance and robustness.
CHANI learns classification tasks with local transformations inspired by biology.
Despite our extensive knowledge of biophysical properties of neurons, there is no commonly accepted algorithmic theory of neuronal function. Here we explore the hypothesis that single-layer neuronal networks perform online symmetric nonnegative matrix factorization (SNMF) of the similarity matrix of the streamed data. …
Single neuron with ADA learns XOR and outperforms other functions.
Stable unactivated neurons reduce expressiveness in ReLU networks.
Deep neural networks (DNNs) are known for extracting useful information from large amounts of data. However, the representations learned in DNNs are typically hard to interpret, especially in dense layers. One crucial issue of the classical DNN model such as multilayer perceptron (MLP) is that neurons in the same layer…
Single-spike neurons can approximate as well as multi-spike neurons.
The challenge of assigning importance to individual neurons in a network is of interest when interpreting deep learning models. In recent work, Dhamdhere et al. proposed Total Conductance, a "natural refinement of Integrated Gradients" for attributing importance to internal neurons. Unfortunately, the authors found tha…
Optimal neuron activation functions improve neural network performance.
The artificial neural network is a popular framework in machine learning. To empower individual neurons, we recently suggested that the current type of neurons could be upgraded to 2nd order counterparts, in which the linear operation between inputs to a neuron and the associated weights is replaced with a nonlinear qu…
Novel 'strong neuron' improves deep learning efficiency and robustness.
The practical success of widely used machine learning (ML) and deep learning (DL) algorithms in Artificial Intelligence (AI) community owes to availability of large datasets for training and huge computational resources. Despite the enormous practical success of AI, these algorithms are only loosely inspired from the b…
With the recent success of deep neural networks in computer vision, it is important to understand the internal working of these networks. What does a given neuron represent? The concepts captured by a neuron may be hard to understand or express in simple terms. The approach we propose in this paper is to characterize t…
Single ReLU neuron's gradient dynamics reveal support vectors as key to generalization.
We view a neural network as a distributed system of which neurons can fail independently, and we evaluate its robustness in the absence of any (recovery) learning phase. We give tight bounds on the number of neurons that can fail without harming the result of a computation. To determine our bounds, we leverage the fact…
This paper presents a new artificial neuron model capable of learning its receptive field in the topological domain of inputs. The model provides adaptive and differentiable local connectivity (plasticity) applicable to any domain. It requires no other tool than the backpropagation algorithm to learn its parameters whi…
Novel method decorrelates neurons for better deep learning model generalization.
A neuron is a basic physiological and computational unit of the brain. While much is known about the physiological properties of a neuron, its computational role is poorly understood. Here we propose to view a neuron as a signal processing device that represents the incoming streaming data matrix as a sparse vector of …
Sometimes it is not enough for a DNN to produce an outcome. For example, in applications such as healthcare, users need to understand the rationale of the decisions. Therefore, it is imperative to develop algorithms to learn models with good interpretability (Doshi-Velez 2017). An important factor that leads to the lac…
New training method for ReLU networks achieves optimal weight size for memorization.
Improved Bayesian inference for neuronal ensemble inference reduces computational cost.
Gradient descent struggles with learning a single neuron with bias.
Over-parametrization speeds up learning a single neuron model.
The predictive power of neural networks often costs model interpretability. Several techniques have been developed for explaining model outputs in terms of input features; however, it is difficult to translate such interpretations into actionable insight. Here, we propose a framework to analyze predictions in terms of …
Method selects task-specific neurons for unsupervised transfer learning.
To understand how rich dynamics emerge in neural populations, we require models exhibiting a wide range of activity patterns while remaining interpretable in terms of connectivity and single-neuron dynamics. However, it has been challenging to fit such mechanistic spiking networks at the single neuron scale to empirica…
Neurons in cortical circuits exhibit coordinated spiking activity, and can produce correlated synchronous spikes during behavior and cognition. We recently developed a method for estimating the dynamics of correlated ensemble activity by combining a model of simultaneous neuronal interactions (e.g., a spin-glass model)…