Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,051 papers · 148 categories

Trend · papers per month

11.4%22.8%34.1%45.5% · Jun 202019922001200920182026
48 results for collapsing initial data

Constructs initial data for multiple black holes with specified ADM parameters.

problem Forming multiple black holes with specific ADM parameters.
method Smooth, asymptotically flat vacuum initial data with prescribed ADM energy, momentum, and angular momentum.
result Maximal development of data results in spacetimes containing multiple black holes.

Uniform distance distortion estimate for Ricci flows with bounded scalar curvature.

problem Analyzing Ricci flows with collapsing initial data.
method Uniform distance distortion estimate through renormalized metric-measure quantities.
result Uniform lower bounds of the renormalized heat kernel match with the lower bound of the renormalized volume ratio, proving distance distortion estimate.

The Degasperis-Procesi equation's solutions define pseudospherical metrics and can lead to surface collapse.

problem Understanding the breakdown of manifolds determined by Cauchy problems of the Degasperis-Procesi equation.
method Analyzing the pseudospherical nature of local and non-local formulations of the Degasperis-Procesi equation.
result Solutions to Cauchy problems with non-trivial initial data define an orthonormal coframe for pseudospherical metrics.

We consider the mean curvature evolution of rotationally symmetric surfaces. Using numerical methods, we detect critical behavior at the threshold of singularity formation resembling the one of gravitational collapse. In particular, the mean curvature simulation of a one-parameter family of initial data reveals the exi…

2009-03-19abs ↗pdf ↗

We show some results for the L2L^2 curvature flow linked by the theme of addressing collapsing phenomena. First we show long time existence and convergence of the flow for SO(3)SO(3)-invariant initial data on S3S^3, as well as a long time existence and convergence statement for three-manifolds with initial L2L^2 norm of c…

2012-01-05abs ↗pdf ↗

The paper establishes principles for initializing and designing GNNs with ReLU activations to avoid oversmoothing and correlation collapse.

problem Oversmoothing and correlation collapse in deep ReLU GNNs.
method The paper derives and validates three principles for initialization and architecture selection in finite width graph neural networks with ReLU activations.
result Correct initialization, residual aggregation operators, and residual connections significantly improve early training dynamics in deep ReLU GNNs.

Batch normalization prevents rank collapse in deep networks, improving training stability.

problem Rank collapse in randomly initialized deep networks with increasing depth.
method Investigates spectral instabilities in random matrices and uses batch normalization to avoid rank collapse.
result Batch normalization prevents rank collapse in both linear and ReLU networks, improving training stability.

Layer normalization with activations prevents Gram matrix rank collapse at initialization.

problem Rank collapse in Gram matrices at initialization slows training in deep networks.
method Proved that layer normalization, with activation layers, biases Gram matrix towards identity matrix at exponential rate.
result Layer normalization with activations biases Gram matrix towards identity matrix at exponential rate with depth at initialization.

We study the mean curvature flow of hypersurfaces in Rn+1\R^{n+1}, with initial surfaces sufficiently close to the standard nn-dimensional sphere. The closeness is in the Sobolev norm with the index greater than n2+1\frac{n}{2}+1 and therefore it does not impose restrictions of the mean curvature of the initial surface. W…

2011-10-24abs ↗pdf ↗

Mathematical analysis shows annealing prevents mode collapse in Gaussian mixtures.

problem Mode collapse in variational inference for multimodal distributions.
method Analyzed annealing strategies for Gaussian mixtures, derived formulas, and tested on neural networks.
result Appropriately chosen annealing schemes can robustly prevent mode collapse.

Feature normalization prevents collapse in non-contrastive learning dynamics.

problem Non-contrastive learning can collapse into a single point due to lack of repulsive force.
method Extended previous theory based on L2 loss to cosine loss, considering feature normalization.
result Cosine loss induces stable equilibrium, preventing collapse even with insufficient repulsive force.

We study the evolution of wormhole geometries under Ricci flow using numerical methods. Depending on values of initial data parameters, wormhole throats either pinch off or evolve to a monotonically growing state. The transition between these two behaviors exhibits a from of critical phenomena reminiscent of that obser…

2008-08-06abs ↗pdf ↗

We show that if on a compact Kahler threefold there is a solution of the Kahler-Ricci flow which encounters a finite time collapsing singularity, then the manifold admits a Fano fibration. Furthermore, if there is finite time extinction then the manifold is Fano and the initial class is a positive multiple of the first…

2015-07-30abs ↗pdf ↗

We provide a direct proof of a non-collapsing estimate for compact hypersurfaces with positive mean curvature moving under the mean curvature flow: Precisely, if every point on the initial hypersurface admits an interior sphere with radius inversely proportional to the mean curvature at that point, then this remains tr…

2011-08-01abs ↗pdf ↗

Researchers found that avoiding synthetic data generation prevents model collapse in machine learning.

problem Model collapse in machine learning where models degenerate over generations.
method Comparing discard and augment workflows, focusing on Linear Regression.
result Theoretical evidence shows that for Linear Regression, test risk is bounded by π²/6 of original data alone.

In this paper, we investigate the mean curvature flows for an equifocal submanifold in a symmetric space of compact type and its focal submanifolds as initial data. It is known that equifocal submanifolds of codimension greater than one in irreducible symmetric spaces of compact type occur as principal orbits of Herman…

2009-08-21abs ↗pdf ↗

New insights into CE dynamics reveal how Hadamard initialization simplifies softmax.

problem Understanding the dynamics of cross-entropy training loss in deep learning.
method Analyzing a two-layer linear neural network with standard-basis vectors as inputs.
result Gradient flow on cross-entropy converges to neural collapse geometry, proving global convergence.

Under mean curvature flow, a closed, embedded hypersurface M(t)M(t) becomes singular in finite time. For certain classes of mean-convex mean curvature flows, we show the continuity of the first singular time TT and the limit set "M(T)M(T)", with respect to initial data. We employ an Angenent-like neck-pinching argument to…

2017-03-07abs ↗pdf ↗

KL annealing helps VAEs avoid posterior collapse and overfitting.

problem Posterior collapse and overfitting in VAEs.
method Theoretical analysis of learning dynamics with KL annealing.
result Posterior collapse is inevitable when ββ exceeds a threshold.

VAE training can lead to posterior collapse, which this paper addresses.

problem Posterior collapse in VAEs where the model learns to ignore latent variables.
method Investigates the dynamics of VAE training and proposes a simple modification to optimize the inference network.
result The proposed modification avoids posterior collapse and improves model performance.

A framework connects VAEs to GLMs for better model initialization and performance.

problem Understanding and optimizing loss function critical points in VAEs.
method Introducing a theoretical framework based on GLM and EDFs.
result Maximum likelihood initialization improves VAE performance.

This paper explores how kernel methods can explain data effects on neural collapse.

problem Understanding how data affects neural collapse in neural networks.
method Formulating NC1 as a function of kernel, specializing to NNGP and NTK, and exploring a data-aware Gaussian Process kernel.
result The NTK does not represent more collapsed features than the NNGP for Gaussian data, highlighting the limitations of data-independent kernels.

The paper connects neural collapse and low-rank bias in networks with L2 regularization.

problem Understanding the emergence of low-rank bias and neural collapse in L2-regularized networks.
method Unified theoretical framework linking TCV and rank of weight matrices, proving global optimality of DNC1, and establishing a benign landscape property.
result Zero TCV across intermediate layers minimizes representation cost under natural architectural constraints, and DNC1 is globally optimal.

We study finite-time collapsing limits of the continuity method. When the continuity method starting from a rational initial Kähler metric on a projective manifold encounters a finite-time volume collapsing, this projective manifold admits a Fano fibration over a lower dimensional base. In this case, we prove the conti…

2016-12-05abs ↗pdf ↗

Study eigenvalues of surfaces with collapsing handles or cross caps.

problem Understanding eigenvalues on surfaces with added handles or cross caps.
method Careful construction of surfaces with collapsing handles or cross caps; analysis of eigenvalues under different conditions.
result Eigenvalues of the first eigenvalue on surfaces can be strictly increased or decreased based on initial symmetries.

A submanifold in space forms is isoparametric if the normal bundle is flat and principal curvatures along any parallel normal fields are constant. We study the mean curvature flow with initial data an isoparametric submanifold in Euclidean space and sphere. We show that the mean curvature flow preserves the isoparametr…

2007-06-25abs ↗pdf ↗

It is shown that a hypersurface of a space form is the initial data for a solution to the mean curvature flow by parallel hypersurfaces if, and only if, it is isoparametric. By solving an ordinary differential equation, explicit solutions are given for all isoparametric hypersurfaces of space forms. In particular, for …

2017-10-05abs ↗pdf ↗

Paper proves existence of anisotropic dynamical horizons in gravitational collapse.

problem Existence of apparent horizons in gravitational collapse.
method Scale-critical hyperbolic method and non-perturbative elliptic techniques.
result Smooth and spacelike apparent horizons emerge from general initial data in gravitational collapse.

Study curve shortening flow on Riemann surfaces with conical singularities.

problem Evolution of curves on Riemann surfaces with singular points.
method Curve shortening flow governed by a degenerate quasilinear parabolic equation.
result Evolving curves stay fixed at singular points and show collapsing and convergence results.

We study the behaviour of the Kähler-Ricci flow on projective bundles. We show that if the initial metric is in a suitable Kähler class, then the fibers collapse in finite time and the metrics converge subsequentially in the Gromov-Hausdorff sense to a metric on the base.

2011-07-11abs ↗pdf ↗

Nested Chinese Restaurant Process (nCRP) topic models are powerful nonparametric Bayesian methods to extract a topic hierarchy from a given text corpus, where the hierarchical structure is automatically determined by the data. Hierarchical Latent Dirichlet Allocation (hLDA) is a popular instance of nCRP topic models. H…

2017-02-23abs ↗pdf ↗

We investigate the Chern-Ricci flow, an evolution equation of Hermitian metrics, on Inoue surfaces. These are non-Kahler compact complex surfaces of type Class VII. We show that, after an initial conformal change, the flow always collapses the Inoue surface to a circle at infinite time, in the sense of Gromov-Hausdorff…

2015-01-29abs ↗pdf ↗

New study shows MLE can avoid model collapse with gradual synthetic data addition.

problem Model collapse in generative models trained on synthetic data.
method Theoretical study of maximum likelihood estimation (MLE) under iterative training with accumulating synthetic data.
result Non-asymptotic bounds show MLE can avoid model collapse even as real data fraction vanishes.

We introduce a novel framework for adversarial training where the target distribution is annealed between the uniform distribution and the data distribution. We posited a conjecture that learning under continuous annealing in the nonparametric regime is stable irrespective of the divergence measures in the objective fu…

2017-05-21abs ↗pdf ↗

Verification helps prevent model collapse when training on synthesized data.

problem Model collapse when training on generated data.
method Theoretical characterization using Gaussian mixtures, linear classifiers, and linear verifiers to assess synthesized data quality.
result Verifiers can prevent model collapse and correlate with performance.