Persistent neurons improve neural network optimization by leveraging previous solutions.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Novel method decorrelates neurons for better deep learning model generalization.
Neural networks are based on a simplified model of the brain. In this project, we wanted to relax the simplifying assumptions of a traditional neural network by making a model that more closely emulates the low level interactions of neurons. Like in an RNN, our model has a state that persists between time steps, so tha…
Study on neuron dynamics for XOR classification with zero-margin.
Paper estimates neural network size needed for topology learning.
Recurrent neural networks can be difficult to train on long sequence data due to the well-known vanishing gradient problem. Some architectures incorporate methods to reduce RNN state updates, therefore allowing the network to preserve memory over long temporal intervals. To address these problems of convergence, this p…
This work analyzes how different forms of compressibility affect adversarial robustness in neural networks.
Approaches for approximating persistent homology for large datasets.
Persistence landscapes map persistence diagrams into a function space, which may often be taken to be a Banach space or even a Hilbert space. In the latter case, it is a feature map and there is an associated kernel. The main advantage of this summary is that it allows one to apply tools from statistics and machine lea…
Proposes deep graph persistence to address neural persistence issues in deep learning.
Paper proves -means clustering works on persistence diagrams.
Formula for interleaving distance of rectangle persistence modules.
Describes explaining neurons in deep representations using compositional logical concepts.
This paper demonstrates the flaws of co-persistence theory proposed by Bollerslev and Engle (1993) which cause the theory can hardly be applied. With the introduction of the half-life of decay coefficient as the measure of the persistence, and both the weak definition of persistence and co-persistence in variance, this…
SeReNe prunes neurons with low sensitivity to reduce network size.
Optimizes wavelets for graph classification using spectral wavelet signatures and persistence diagrams.
Under-parameterized networks can either copy or average teacher weights, leading to universal optimal solutions.
New method for analyzing multiparameter persistence modules from smooth functions.
Develops robust persistence diagrams using kernel methods.
This paper interprets critical scales in persistent homology for compact metric spaces.
We develop Neuron Shapley as a new framework to quantify the contribution of individual neurons to the prediction and performance of a deep network. By accounting for interactions across neurons, Neuron Shapley is more effective in identifying important filters compared to common approaches based on activation patterns…
MuRiT efficiently computes multi-parameter persistence barcodes.
Modeling hidden neurons in SNNs using mesoscopic approximations.
Topological methods improve neuron analysis and tracer injection summary.
Persistent homology can recognize knotting in curves.
This article analyzes the relationship between co-persistence and hedging which indicates co-persistence ratio is just the long-term hedging ratio. The new method of exhaustive search algorithm for deriving co-persistence ratio is derived in the article. And we also develop a new hedging strategy of combining co-persis…
Despite the obvious similarities between the metrics used in topological data analysis and those of optimal transport, an optimal-transport based formalism to study persistence diagrams and similar topological descriptors has yet to come. In this article, by considering the space of persistence diagrams as a space of d…
Inspired by complexity and diversity of biological neurons, our group proposed quadratic neurons by replacing the inner product in current artificial neurons with a quadratic operation on input data, thereby enhancing the capability of an individual neuron. Along this direction, we are motivated to evaluate the power o…
Persistence diagrams are important descriptors in Topological Data Analysis. Due to the nonlinearity of the space of persistence diagrams equipped with their {\em diagram distances}, most of the recent attempts at using persistence diagrams in machine learning have been done through kernel methods, i.e., embeddings of …
Computational topology has recently known an important development toward data analysis, giving birth to the field of topological data analysis. Topological persistence, or persistent homology, appears as a fundamental tool in this field. In this paper, we study topological persistence in general metric spaces, with a …
We propose a new generic type of stochastic neurons, called -neurons, that considers activation functions based on Jackson's -derivatives with stochastic parameters . Our generalization of neural network architectures with -neurons is shown to be both scalable and very easy to implement. We demonstrate expe…
The choice of the control frequency of a system has a relevant impact on the ability of reinforcement learning algorithms to learn a highly performing policy. In this paper, we introduce the notion of action persistence that consists in the repetition of an action for a fixed number of decision steps, having the effect…
Given a compact geodesic space we apply the fundamental group and alternatively the first homology group functor to the corresponding Rips or Čech filtration of to obtain what we call a persistence. This paper contains the theory describing such persistence: properties of the set of critical points, their preci…
A new method compares persistent cycles in topological data.
Improved persistence spheres map measures to functions, stable under partial transport.
We introduce several geometric notions, including the width of a homology class, to the theory of persistent homology. These ideas provide geometric interpretations of persistence diagrams. Indeed, we give quantitative and geometric descriptions of the "life span" or "persistence" of a homology class. As a case study, …
This article addresses persistent tangles. These are tangles whose presence in a knot diagram forces that diagram to be knotted. We provide new methods for constructing persistent tangles. Our techniques rely mainly on the existence of non-trivial colorings for the tangles in question. Our main result in this article i…
It will be shown that according to theorems of K. Menger, every neuron grid if identified with a curve is able to preserve the adopted qualitative structure of a data space. Furthermore, if this identification is made, the neuron grid structure can always be mapped to a subset of a universal neuron grid which is constr…
Study cosmic structures using Topological Data Analysis and Persistence Energy.
New lattice path method for statistical inference of persistent diagrams.
The paper examines how long-memory dynamics, rough-volatility, and persistence affect equity volatility forecasting.
This review explores TDA and TDL beyond persistent homology.
Revises SWK for persistence diagrams using Figalli-Gigli distance.
New model predicts energy prices volatility by smoothing time variation and persistence.
Persistent homology reveals geometric features of metric spaces, especially geodesic circles.
Persistent Legendrian contact homology distinguishes knots using height functional.
Persistence diagrams, the most common descriptors of Topological Data Analysis, encode topological properties of data and have already proved pivotal in many different applications of data science. However, since the (metric) space of persistence diagrams is not Hilbert, they end up being difficult inputs for most Mach…
Topological data analysis and its main method, persistent homology, provide a toolkit for computing topological information of high-dimensional and noisy data sets. Kernels for one-parameter persistent homology have been established to connect persistent homology with machine learning techniques. We contribute a kernel…