New neural networks with variable time constants for better time-series prediction.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
In this paper, we introduce the notion of liquid time-constant (LTC) recurrent neural networks (RNN)s, a subclass of continuous-time RNNs, with varying neuronal time-constant realized by their nonlinear synaptic transmission model. This feature is inspired by the communication principles in the nervous system of small …
We study the computational capacity of a model neuron, the Tempotron, which classifies sequences of spikes by linear-threshold operations. We use statistical mechanics and extreme value theory to derive the capacity of the system in random classification tasks. In contrast to its static analog, the Perceptron, the Temp…
The apparent stochasticity of in-vivo neural circuits has long been hypothesized to represent a signature of ongoing stochastic inference in the brain. More recently, a theoretical framework for neural sampling has been proposed, which explains how sample-based inference can be performed by networks of spiking neurons.…
This paper examines the problem of locating outlier columns in a large, otherwise low-rank, matrix. We propose a simple two-step adaptive sensing and inference approach and establish theoretical guarantees for its performance; our results show that accurate outlier identification is achievable using very few linear sum…
This paper suggests a learning-theoretic perspective on how synaptic plasticity benefits global brain functioning. We introduce a model, the selectron, that (i) arises as the fast time constant limit of leaky integrate-and-fire neurons equipped with spiking timing dependent plasticity (STDP) and (ii) is amenable to the…
We introduce a technique that can automatically tune the parameters of a rule-based computer vision system comprised of thresholds, combinational logic, and time constants. This lets us retain the flexibility and perspicacity of a conventionally structured system while allowing us to perform approximate gradient descen…
We show that the standard stochastic gradient decent (SGD) algorithm is guaranteed to learn, in polynomial time, a function that is competitive with the best function in the conjugate kernel space of the network, as defined in Daniely, Frostig and Singer. The result holds for log-depth networks from a rich family of ar…
Study local foliations of surfaces with constant mean curvature and constant expansion in space-time.
This paper presents a general theory that aims at explaining timescales observed empirically in technology transitions and predicting those of future transitions. This framework is used further to derive a theory for exploring the dynamics that underlie the complex phenomenon of irreversible and path dependent price or…
In this work we develop a tractable structural model with analytical default probabilities depending on a random default barrier and possibly random volatility ideally associated with a scenario based underlying firm debt. We show how to calibrate this model using a chosen number of reference Credit Default Swap (CDS) …
This paper uses Bayesian optimization to efficiently identify stochastic dynamical systems.
Deep learning method improves myelin water fraction estimation.
New monitoring method detects ML risk models' performance changes in medical interventions.
LIQSS method improves accuracy and efficiency for power system simulations.
Gradient descent learns a neuron in noisy data.