Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

74149223297 · Jun 202019922001200920172026
48 results for architecture growth

The professional services sector is at a turning point, with some industries showing growth opportunities.

problem Identifying growth opportunities in the professional services sector after decades of growth.
method A simple framework applied to the US economic context to diagnose growth opportunities.
result The professional services sector is expected to stall at a national level, but some industries still offer growth opportunities.

New theory explains signal propagation in normalization-free transformers.

problem Understanding signal propagation in normalization-free transformers.
method Deriving recurrence relations for activation statistics and APJNs across layers.
result Transformers with elementwise tanh-like nonlinearities exhibit subcritical signal propagation.

The paper proposes a neural network architecture inspired by Langevin Monte Carlo for sampling from target distributions.

problem Sampling from complex target distributions efficiently.
method A neural network architecture inspired by Langevin Monte Carlo is proposed to map samples from a simple reference distribution to samples from the target.
result The proposed neural network architecture achieves approximation rates in the Wasserstein-2 distance for smooth, log-concave target distributions.

Fibonacci Ensembles use Fibonacci weights to improve ensemble learning, inspired by natural growth patterns.

problem Improving ensemble learning methods to enhance model performance and interpretability.
method Introduces Fibonacci weights and a recursive ensemble dynamic to reduce variance and enrich representational depth.
result Fibonacci weighting can match or improve upon uniform averaging in ensemble learning experiments.

RocketStack integrates predictions from multiple base learners using a recursive stacking architecture up to ten levels.

problem Feature redundancy, complexity, and computational burden in deep stacking.
method Level-aware recursive stacking with pruning and compression techniques.
result Increasing accuracy with depth and outperforming standalone ensembles at later levels.

Depth is a key component of Deep Neural Networks (DNNs), however, designing depth is heuristic and requires many human efforts. We propose AutoGrow to automate depth discovery in DNNs: starting from a shallow seed architecture, AutoGrow grows new layers if the growth improves the accuracy; otherwise, stops growing and …

2019-06-07abs ↗pdf ↗

The universal approximation property of various machine learning models is currently only understood on a case-by-case basis, limiting the rapid development of new theoretically justified neural network architectures and blurring our understanding of our current models' potential. This paper works towards overcoming th…

2019-10-08abs ↗pdf ↗

New method grows deep networks efficiently by dynamically pruning and growing layers.

problem Training deep networks is computationally expensive and inefficient.
method Structured continuous sparsification starting from a small seed architecture.
result 49.7% inference FLOPs and 47.4% training FLOPs savings with 75.2% top-1 accuracy.

We propose a neural architecture search (NAS) algorithm, Petridish, to iteratively add shortcut connections to existing network layers. The added shortcut connections effectively perform gradient boosting on the augmented layers. The proposed algorithm is motivated by the feature selection algorithm forward stage-wise …

2019-05-31abs ↗pdf ↗

Neural networks cannot approximate certain functions in Sobolev spaces, leading to unbounded parameter growth.

problem Non-closedness of sets of neural networks in Sobolev spaces.
method Construction of sequences of neural networks whose realizations converge to functions not realizable by neural networks.
result Sets of realized neural networks are not closed in order-(m1)(m-1) Sobolev spaces Wm1,pW^{m-1,p} for p[1,]p \in [1,\infty].

Historical economic growth in Asia (excluding Japan) is analysed. It is shown that Unified Growth Theory is contradicted by the data, which were used (but not analysed) during the formulation of this theory. Unified Growth Theory does not explain the mechanism of economic growth. It explains the mechanism of Malthusian…

2015-12-16abs ↗pdf ↗

Study confined subgroups in groups with contracting elements, showing their growth rate is strictly greater than half of the ambient growth rate.

problem Understanding the growth rate of confined subgroups in groups with contracting elements.
method Through boundary actions, analyzing the Hopf decomposition and quotient growth.
result Confined subgroups have a growth rate strictly greater than half of the ambient growth rate.

Growth rate of the world Growth Domestic Product (GDP) is analysed to determine possible pathways of the future economic growth. The analysis is based on using the latest data of the World Bank and it reveals that the growth rate between 1960 and 2014 was following a trajectory approaching asymptotically a constant val…

2015-10-26abs ↗pdf ↗

Data describing historical economic growth are analysed. Included in the analysis is the world and regional economic growth. The analysis demonstrates that historical economic growth had a natural tendency to follow hyperbolic distributions. Parameters describing hyperbolic distributions have been determined. A search …

2015-09-09abs ↗pdf ↗

The study provides volume growth estimates for specific types of manifolds.

problem Estimating volume growth for Ricci solitons and quasi-Einstein manifolds.
method Similar to classical results, the study proves volume growth estimates for gradient Ricci solitons and quasi-Einstein manifolds.
result Sharp volume growth estimates for gradient shrinking Ricci solitons and upper bound volume growth estimates for quasi-Einstein manifolds.

Study growth rates of subgroups in groups with a constricting element.

problem Understanding growth rates of subgroups in groups with a constricting element.
method Examining the spectrum of relative and quotient exponential growth rates of quasi-convex subgroups.
result Determine when growth rates of subgroups are strictly smaller or coincide with the group's growth rate.

In many European countries the growth of the real GDP per capita has been linear since 1950. An explanation for this linearity is still missing. We propose that in artificial intelligence we may find models for a linear growth of performance. We also discuss possible consequences of the fact that in systems with linear…

2015-08-18abs ↗pdf ↗

Introduced by Gromov in the nineties, the systolic growth of a Lie group gives the smallest possible covolume of a lattice with a given systole. In a simply connected nilpotent Lie group, this function has polynomial growth, but can grow faster than the volume growth. We express this systolic growth function in terms o…

2016-12-02abs ↗pdf ↗

We study ancient solutions of polynomial growth to heat equations on graphs, and extend Colding and Minicozzi's theorem [CM19] on manifolds to graphs: For a graph of polynomial volume growth, the dimension of the space of ancient solutions of polynomial growth is bounded by the product of the growth degree and the dime…

2019-03-06abs ↗pdf ↗

Deep neural networks perform well due to a balance of architecture, training, and structured data.

problem Understanding why overparameterized DNNs perform well.
method Bayesian approach to analyze the interplay between network architecture, training algorithms, and data structure.
result Structured data and an inductive bias towards simple functions explain DNN success.

One of the fundamental postulates of the Unified Growth Theory is the claimed existence of three distinctly different regimes of economic growth governed by three distinctly different mechanisms of growth. However, Galor also proposed that the timing of these regimes is different for developed countries and for less-de…

2015-12-10abs ↗pdf ↗

The so-called great divergence in the income per capita is described in the Unified Growth Theory as the mind-boggling and unresolved mystery about the growth process. This mystery has now been solved: the great divergence never happened. It was created by the manipulation of data. Economic growth in various regions is…

2016-03-28abs ↗pdf ↗

Study homology growth in nonpositive curvature spaces, finding examples of torsion.

problem Understanding homology growth in nonpositive curvature spaces.
method Computing mod p homology growth of right-angled Artin groups and closed locally CAT(0) manifolds.
result Homology torsion grows exponentially in the index of subgroups, contradicting rational homology growth.

Study on Monge-Ampère equations with polynomial growth rates.

problem Analyzing solutions to Monge-Ampère equations with polynomial right-hand sides.
method Utilizing polynomial growth analysis to study regularity and growth rates of solutions.
result Translators for sub-affine-critical curvature flows are smooth and convex with specific growth rates.

For any manifold with polynomial volume growth, we show: The dimension of the space of ancient caloric functions with polynomial growth is bounded by the degree of growth times the dimension of harmonic functions with the same growth. As a consequence, we get a sharp bound for the dimension of ancient caloric functions…

2019-02-05abs ↗pdf ↗

Two rigidity theorems for manifolds with nonnegative Ricci curvature and specific volume growth.

problem Characterizing manifolds with nonnegative Ricci curvature and specific volume growth properties.
method Rigidity theorems based on volume growth and existence of harmonic functions.
result Conditions for the Riemannian universal cover to have Euclidean volume growth and existence of nonconstant linear growth harmonic functions.

We define a large class of abstract Coxeter groups, that we call \infty--spanned, and for which the word growth rate and the geodesic growth rate appear to be Perron numbers. This class contains a fair amount of Coxeter groups acting on hyperbolic spaces, thus corroborating a conjecture by Kellerhals and Perren. We a…

2019-12-11abs ↗pdf ↗