Hybrid framework prevents forgetting in continual learning.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
The professional services sector is at a turning point, with some industries showing growth opportunities.
Deep-SITAR uses autoencoders to predict growth patterns.
Effective plant growth and yield prediction is an essential task for greenhouse growers and for agriculture in general. Developing models which can effectively model growth and yield can help growers improve the environmental control for better production, match supply and market demand and lower costs. Recent developm…
Sharp stability threshold found for deep residual architectures.
New theory explains signal propagation in normalization-free transformers.
The paper proposes a neural network architecture inspired by Langevin Monte Carlo for sampling from target distributions.
Fibonacci Ensembles use Fibonacci weights to improve ensemble learning, inspired by natural growth patterns.
RocketStack integrates predictions from multiple base learners using a recursive stacking architecture up to ten levels.
Depth is a key component of Deep Neural Networks (DNNs), however, designing depth is heuristic and requires many human efforts. We propose AutoGrow to automate depth discovery in DNNs: starting from a shallow seed architecture, AutoGrow grows new layers if the growth improves the accuracy; otherwise, stops growing and …
The universal approximation property of various machine learning models is currently only understood on a case-by-case basis, limiting the rapid development of new theoretically justified neural network architectures and blurring our understanding of our current models' potential. This paper works towards overcoming th…
New method grows deep networks efficiently by dynamically pruning and growing layers.
We propose a neural architecture search (NAS) algorithm, Petridish, to iteratively add shortcut connections to existing network layers. The added shortcut connections effectively perform gradient boosting on the augmented layers. The proposed algorithm is motivated by the feature selection algorithm forward stage-wise …
Neural networks cannot approximate certain functions in Sobolev spaces, leading to unbounded parameter growth.
New scaling laws explain deep learning performance growth.
Paper uses time series transformers to predict investment success.
Historical economic growth in countries of the former USSR is analysed. It is shown that Unified Growth Theory is contradicted by the data, which were used, but not analysed, during the formulation of this theory. Unified Growth Theory does not explain the mechanism of economic growth. It explains the mechanism of Malt…
The Unified Growth Theory is a puzzling collection of myths based on illusions created by hyperbolic distributions. Some of these myths are discussed. The examination of data shows that the three stages of growth (Malthusian Regime, Post-Malthusian Regime and Modern Growth Regime) did not exist and that Industrial Revo…
Historical economic growth in Asia (excluding Japan) is analysed. It is shown that Unified Growth Theory is contradicted by the data, which were used (but not analysed) during the formulation of this theory. Unified Growth Theory does not explain the mechanism of economic growth. It explains the mechanism of Malthusian…
Study confined subgroups in groups with contracting elements, showing their growth rate is strictly greater than half of the ambient growth rate.
Growth rate of the world Growth Domestic Product (GDP) is analysed to determine possible pathways of the future economic growth. The analysis is based on using the latest data of the World Bank and it reveals that the growth rate between 1960 and 2014 was following a trajectory approaching asymptotically a constant val…
Historical economic growth in Latin America is analysed using the data of Maddison. Unified Growth Theory is found to be contradicted by these data in the same way as it is contradicted by the economic growth in Africa, Asia, former USSR, Western Europe, Eastern Europe and by the world economic growth. Paradoxically, U…
Growth rates of geodesics on modular orbifolds are studied.
Data describing historical economic growth are analysed. Included in the analysis is the world and regional economic growth. The analysis demonstrates that historical economic growth had a natural tendency to follow hyperbolic distributions. Parameters describing hyperbolic distributions have been determined. A search …
The study provides volume growth estimates for specific types of manifolds.
Study growth rates of subgroups in groups with a constricting element.
We present a quantitative characterisation of the fluctuations of the annualized growth rate of the real US GDP per capita growth at many scales, using a wavelet transform analysis of two data sets, quarterly data from 1947 to 2015 and annual data from 1800 to 2010. Our main finding is that the distribution of GDP grow…
Paper reviews and proves volume growth estimates for different types of gradient Ricci solitons.
Study groups with polynomial growth, finding structure and applications.
In many European countries the growth of the real GDP per capita has been linear since 1950. An explanation for this linearity is still missing. We propose that in artificial intelligence we may find models for a linear growth of performance. We also discuss possible consequences of the fact that in systems with linear…
Introduced by Gromov in the nineties, the systolic growth of a Lie group gives the smallest possible covolume of a lattice with a given systole. In a simply connected nilpotent Lie group, this function has polynomial growth, but can grow faster than the volume growth. We express this systolic growth function in terms o…
New proof shows not all Salem numbers are growth rates of Coxeter groups.
The purpose of this study is to measure the Total Factor Productivity (TFP) growth and determine the share of each of the economic growth sources in the mining sector of Iran. The time period of this study is 1355-1385 of the Solar Hijri calendar (roughly overlaying with the time period of 1976-2006 of the Gregorian ca…
We study ancient solutions of polynomial growth to heat equations on graphs, and extend Colding and Minicozzi's theorem [CM19] on manifolds to graphs: For a graph of polynomial volume growth, the dimension of the space of ancient solutions of polynomial growth is bounded by the product of the growth degree and the dime…
Deep neural networks perform well due to a balance of architecture, training, and structured data.
Remarkable achievements have been attained by deep neural networks in various applications. However, the increasing depth and width of such models also lead to explosive growth in both storage and computation, which has restricted the deployment of deep neural networks on resource-limited edge devices. To address this …
One of the fundamental postulates of the Unified Growth Theory is the claimed existence of three distinctly different regimes of economic growth governed by three distinctly different mechanisms of growth. However, Galor also proposed that the timing of these regimes is different for developed countries and for less-de…
The so-called great divergence in the income per capita is described in the Unified Growth Theory as the mind-boggling and unresolved mystery about the growth process. This mystery has now been solved: the great divergence never happened. It was created by the manipulation of data. Economic growth in various regions is…
Study homology growth in nonpositive curvature spaces, finding examples of torsion.
Study on Monge-Ampère equations with polynomial growth rates.
Paper proves volume growth estimate for steady gradient Ricci solitons.
For any manifold with polynomial volume growth, we show: The dimension of the space of ancient caloric functions with polynomial growth is bounded by the degree of growth times the dimension of harmonic functions with the same growth. As a consequence, we get a sharp bound for the dimension of ancient caloric functions…
Estimates growth loss in fund models and proposes a shrinkage method.
Galor discovered many mysteries of the growth process. He lists them in his Unified Growth Theory and wonders how they can be explained. Close inspection of his mysteries reveals that they are of his own creation. They do not exist. He created them by his habitually distorted presentation of data. One of his self-creat…
Two rigidity theorems for manifolds with nonnegative Ricci curvature and specific volume growth.
We define a large class of abstract Coxeter groups, that we call --spanned, and for which the word growth rate and the geodesic growth rate appear to be Perron numbers. This class contains a fair amount of Coxeter groups acting on hyperbolic spaces, thus corroborating a conjecture by Kellerhals and Perren. We a…
Sharp growth tightness proven for group quotients.
Bubbles are essential in certain economic models with high growth and low interest rates.