arXiv research

Study on biharmonic hypersurfaces with specific recurrent operators in Euclidean space.

New framework shows $C^*$-simplicity for groups without certain subalgebras.

Let M be a CR submanifold of maximal CR dimension of a complex space form M. The shape operator A of the distinguished vector field ξ is recurrent if there exists a 1-form v such that \nabla A = A \otimes v. We show that M is an Euclidean space under the condition that A is recurrent.

RNN operators solve Newton's equations with large timesteps for molecular dynamics.

This paper develops a spectral theory of Markovian asset pricing models where the underlying economic uncertainty follows a continuous-time Markov process X with a general state space (Borel right process (BRP)) and the stochastic discount factor (SDF) is a positive semimartingale multiplicative functional of X. A key …

We study power expansions of the characteristic function of a linear operator $A$ in a $p|q$-dimensional superspace $V$. We show that traces of exterior powers of $A$ satisfy universal recurrence relations of period $q$. `Underlying' recurrence relations hold in the Grothendieck ring of representations of $\GL(V)$. The…

Learning modular structures which reflect the dynamics of the environment can lead to better generalization and robustness to changes which only affect a few of the underlying causes. We propose Recurrent Independent Mechanisms (RIMs), a new recurrent architecture in which multiple groups of recurrent cells operate wit…

Recurrent neural networks (RNNs) are omnipresent in sequence modeling tasks. Practical models usually consist of several layers of hundreds or thousands of neurons which are fully connected. This places a heavy computational and memory burden on hardware, restricting adoption in practical low-cost and low-power devices…

This paper investigates the role of sparsity in Reservoir Computing networks.

Study the boundary operator property on simplicial complexes, proving essential properties for Hodge theory.

For a knot $K$ in $S^3$, the $sl_2$-colored Jones function $J_K(n)$ is a sequence of Laurent polynomials in the variable $t$, which is known to satisfy non-trivial linear recurrence relations. The operator corresponding to the minimal linear recurrence relation is called the recurrence polynomial of $K$. The AJ conject…

We prove that there does not exist any real hypersurface in complex Grassmannians of rank two with semi-parallel structure Jacobi operator. With this result, the nonexistence of real hypersurface in complex Grassmannians of rank two with recurrent structure Jacobi operator is proved.

In this paper we present a recurrent relation for counting meaningful compositions of the higher-order differential operations on the space $R^{n}$ (n=3,4,...) and extract the non-trivial compositions of order higher than two.

New differential geometry perspective on orthogonal RNNs.

SKOLR uses linear RNNs to approximate Koopman operators for time-series forecasting.

We determine the structure of conformal powers of the Dirac operator on Einstein {\it Spin}-manifolds in terms of the product formula for shifted Dirac operators. The result is based on the techniques of higher variations for the Dirac operator on Einstein manifolds and spectral analysis of the Dirac operator on the as…

This paper deals with the enumeration of the higher order non-trivial compositions of the differential operations and the directional derivative in the space $R^n$ ($n \geq 3$). We present the recurrences for a counting the higher order non-trivial compositions.

Recurrent neural networks (RNNs) have been used extensively and with increasing success to model various types of sequential data. Much of this progress has been achieved through devising recurrent units and architectures with the flexibility to capture complex statistics in the data, such as long range dependency or l…

The paper introduces Causal Neural Operators to approximate operators in stochastic analysis.

New approach to understand recurrent policies as FSMs without minimization.

Modelling long-term dependencies is a challenge for recurrent neural networks. This is primarily due to the fact that gradients vanish during training, as the sequence length increases. Gradients can be attenuated by transition operators and are attenuated or dropped by activation functions. Canonical architectures lik…

A major challenge in the training of recurrent neural networks is the so-called vanishing or exploding gradient problem. The use of a norm-preserving transition operator can address this issue, but parametrization is challenging. In this work we focus on unitary operators and describe a parametrization using the Lie al…

The objective of the present paper is to prove the non-existence of real hypersurface with pseudo-parallel normal Jacobi operator in complex two-plane Grassmannians. As a corollary, we show that there does not exist any real hypersurface with semi-parallel or recurrent normal Jacobi operator in complex two-plane Grassm…

This paper describes recent development and test implementation of a continuous time recurrent neural network that has been configured to predict rates of change in securities. It presents outcomes in the context of popular technical analysis indicators and highlights the potential impact of continuous predictive capab…

Researchers create a star product on a Grassmannian with separation of variables.

This paper presents a novel Inter Catchment Wastewater Transfer (ICWT) method for mitigating sewer overflow. The ICWT aims at balancing the spatial mismatch of sewer flow and treatment capacity of Wastewater Treatment Plant (WWTP), through collaborative operation of sewer system facilities. Using a hydraulic model, the…

Enhances RSCNs with hybrid regularization for nonlinear dynamics.

Recurrent Neural Networks (RNNs) achieve state-of-the-art results in many sequence-to-sequence modeling tasks. However, RNNs are difficult to train and tend to suffer from overfitting. Motivated by the Data Processing Inequality (DPI), we formulate the multi-layered network as a Markov chain, introducing a training met…

There has been a recent shift in sequence-to-sequence modeling from recurrent network architectures to convolutional network architectures due to computational advantages in training and operation while still achieving competitive performance. For systems having limited long-term temporal dependencies, the approximatio…

This paper introduces CloudLSTM, a new branch of recurrent neural models tailored to forecasting over data streams generated by geospatial point-cloud sources. We design a Dynamic Point-cloud Convolution (DConv) operator as the core component of CloudLSTMs, which performs convolution directly over point-clouds and extr…

Recurrent neural networks (RNNs) are powerful architectures to model sequential data, due to their capability to learn short and long-term dependencies between the basic elements of a sequence. Nonetheless, popular tasks such as speech or images recognition, involve multi-dimensional input features that are characteriz…

New LCM aggregator improves GNN performance and efficiency.

The non-stationarity characteristic of the solar power renders traditional point forecasting methods to be less useful due to large prediction errors. This results in increased uncertainties in the grid operation, thereby negatively affecting the reliability and increased cost of operation. This research paper proposes…

Recurrent Neural Networks (RNNs), which are a powerful scheme for modeling temporal and sequential data need to capture long-term dependencies on datasets and represent them in hidden layers with a powerful model to capture more information from inputs. For modeling long-term dependencies in a dataset, the gating mecha…

New method compresses LSTM networks using MPS tensor trains.

Process Mining consists of techniques where logs created by operative systems are transformed into process models. In process mining tools it is often desired to be able to classify ongoing process instances, e.g., to predict how long the process will still require to complete, or to classify process instances to diffe…

Being able to forcast extreme volatility is a central issue in financial risk management. We present a large volatility predicting method based on the distribution of recurrence intervals between volatilities exceeding a certain threshold $Q$ for a fixed expected recurrence time $τ_Q$. We find that the recurrence inter…

New method for fMRI missing value imputation improves robustness.

Our goal is to compute the minimal-order recurrence of the colored Jones polynomial of the 7_4 knot, as well as for the first four double twist knots. As a corollary, we verify the AJ Conjecture for the simplest knot 7_4 with reducible non-abelian SL(2,C) character variety. To achieve our goal, we use symbolic summatio…

In this paper, we explore different ways to extend a recurrent neural network (RNN) to a \textit{deep} RNN. We start by arguing that the concept of depth in an RNN is not as clear as it is in feedforward neural networks. By carefully analyzing and understanding the architecture of an RNN, however, we find three points …

This paper describes a method for learning low-dimensional approximations of nonlinear dynamical systems, based on neural-network approximations of the underlying Koopman operator. Extended Dynamic Mode Decomposition (EDMD) provides a useful data-driven approximation of the Koopman operator for analyzing dynamical syst…

Recurrent neural networks are a widely used class of neural architectures. They have, however, two shortcomings. First, it is difficult to understand what exactly they learn. Second, they tend to work poorly on sequences requiring long-term memorization, despite having this capacity in principle. We aim to address both…

RNN(p) improves power consumption forecasts with interpretable models.

Improved electricity price forecasting model combining linear and non-linear structures.

Introduction: Machine learning provides fundamental tools both for scientific research and for the development of technologies with significant impact on society. It provides methods that facilitate the discovery of regularities in data and that give predictions without explicit knowledge of the rules governing a syste…

The pullback approach to global Finsler geometry is adopted. Three classes of recurrence in Finsler geometry are introduced and investigated: simple recurrence, Ricci recurrence and concircular recurrence. Each of these classes consists of four types of recurrence. The interrelationships between the different types of …

In processing and manufacturing industries, there has been a large push to produce higher quality products and ensure maximum efficiency of processes. This requires approaches to effectively detect and resolve disturbances to ensure optimal operations. While the control system can compensate for many types of disturban…

Recurrent neural networks (RNNs) have shown excellent performance in processing sequence data. However, they are both complex and memory intensive due to their recursive nature. These limitations make RNNs difficult to embed on mobile devices requiring real-time processes with limited hardware resources. To address the…