Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

83167250333 · Jun 202019922001200920172026
48 results for dimensional collapse

ContraNorm prevents dimensional collapse in GNNs and Transformers.

problem Dimensional collapse in Graph Neural Networks and Transformers.
method Proposes ContraNorm, a novel normalization layer inspired by contrastive learning.
result Proves ContraNorm alleviates both complete and dimensional collapse under certain conditions.

Bayesian deep learning faces posterior collapse due to likelihood vs. prior competition.

problem Posterior collapse in Bayesian deep learning models.
method Identified competition between likelihood and prior regularization in a linear latent variable model.
result Posterior collapse is related to neural and dimensional collapse, suggesting a broader learning issue.

High-dimensional VAEs inevitably collapse to prior, requiring large datasets for good performance.

problem Posterior collapse in VAEs leads to poor representation learning quality.
method Analyzed a minimal VAE in a high-dimensional limit, evaluating conditions for posterior collapse with respect to beta and dataset size.
result VAEs face 'inevitable posterior collapse' beyond a certain beta threshold, regardless of dataset size.

In this paper we extend the works of Tancer and of Malgouyres and Francés, showing that (d,k)(d,k)-collapsibility is NP-complete for dk+2d\geq k+2 except (2,0)(2,0). By (d,k)(d,k)-collapsibility we mean the following problem: determine whether a given dd-dimensional simplicial complex can be collapsed to some kk-dimensional sub…

2017-03-20abs ↗pdf ↗

Finite simply connected 2-complexes with nonpositive planar curvature are collapsible.

problem Understanding the collapsibility of 2-complexes with specific curvature properties.
method Analyzing the fundamental groups and sectional curvatures of 2-complexes.
result Finite simply connected 2-complexes with nonpositive planar curvature are collapsible.

In this paper, we study the collapsing behaviour of negative Kähler-Einstein metrics along degenerations of canonical polarized manifolds. We prove that for a toroidal degeneration of canonical polarized manifolds with the total space Q\mathbb{Q}-factorial, the Kähler-Einstein metrics on fibers collapse to a lower dim…

2015-05-18abs ↗pdf ↗

Mathematical analysis shows annealing prevents mode collapse in Gaussian mixtures.

problem Mode collapse in variational inference for multimodal distributions.
method Analyzed annealing strategies for Gaussian mixtures, derived formulas, and tested on neural networks.
result Appropriately chosen annealing schemes can robustly prevent mode collapse.

Variational autoencoders often collapse, showing latent variables are non-identifiable.

problem Posterior collapse in variational autoencoders due to non-identifiable latent variables.
method Proves latent variable non-identifiability causes posterior collapse. Proposes latent-identifiable models using Brenier maps and input convex neural networks.
result Latent-identifiable models resolve posterior collapse and provide meaningful representations.

Theoretical work on mode collapse in variational inference models.

problem Mode collapse in variational inference models, where models focus on a few modes instead of all possible ones.
method Theoretical investigation of mode collapse in Gaussian mixture models, identifying key low-dimensional statistics and equations governing their evolution.
result Mode collapse is present even in favorable scenarios, driven by mean alignment and vanishing weight mechanisms.

Restrictions are obtained on the topology of a compact divergence-free null hypersurface in a four-dimensional Lorentzian manifold whose Ricci tensor is zero or satisfies some weaker conditions. This is done by showing that each null hypersurface of this type can be used to construct a family of three-dimensional Riema…

1995-10-06abs ↗pdf ↗

Study minimal volume entropy for free-by-cyclic groups and 2D right-angled Artin groups.

problem Characterize minimal volume entropy for aspherical simplicial complexes with these groups as fundamental groups.
method Algebraic and geometric characterization, using fiber π1π_1-growth collapse and non-collapsing assumptions.
result Provide bounds and criteria for minimal volume entropy in aspherical simplicial complexes.

We prove that a 3-dimensional compact Riemannian manifold which is locally collapsed, with respect to a lower curvature bound, is a graph manifold. This theorem was stated by Perelman and was used in his proof of the geometrization conjecture.

2010-05-27abs ↗pdf ↗

Improves SVGD for high-dimensional Bayesian inference by reducing variance collapse.

problem Variance collapse in SVGD reduces accuracy and diversity of estimation.
method Augmented Message Passing SVGD (AUMP-SVGD) method, a two-stage optimization procedure.
result AUMP-SVGD achieves satisfactory accuracy and overcomes variance collapse in various benchmark problems.

Generative diffusion models gradually memorize training data, losing independent dimensions.

problem Understanding how generative diffusion models memorize training data, especially on low-dimensional manifolds.
method Measuring latent dimensionality via the learned score field, proposing a geometric memorization theory.
result Generative diffusion models experience a smooth collapse of their capacity to vary across independent directions as data become scarce, leading to near point-wise replication of salient features.

Study inradius collapsed manifolds with lower Ricci curvature bounds, proving properties of their limits.

problem Characterizing limits of inradius collapsed manifolds with lower Ricci curvature bounds.
method Analyzing families of manifolds with specific curvature and boundary conditions, proving properties of the limits.
result Limits of inradius collapsed manifolds have at most two boundary components and a lower Ricci curvature bound.

The paper studies how certain submanifolds collapse to lower-dimensional ones.

problem The study of mean curvature flow of submanifolds and their convergence behavior.
method Explicit examples of mean curvature flow of (2m-1)-dimensional submanifolds converging to (2m-2)-dimensional ones.
result Explicit examples of mean curvature flow of submanifolds converge to lower-dimensional submanifolds in complex manifolds.

Aspherical manifolds with bounded curvature have non-trivial abelian subgroups in their fundamental groups.

problem Understanding the fundamental groups of aspherical manifolds under certain curvature conditions.
method Analyzing the collapsing behavior of manifolds with bounded Ricci curvature and diameter.
result The fundamental groups of such manifolds have non-trivial finitely generated abelian normal subgroups.

Study on K3 surfaces' collapsing and special Kähler structures.

problem Understanding the structure of K3 surfaces' collapsing metrics.
method Analyzing M2\mathfrak{M}_2 and establishing connections to SKSs and Jacobian elliptic K3 surfaces.
result Established a bijection between integral singular SKSs on P1\mathbb{P}^1 and Jacobian elliptic K3 surfaces.

Geometric theory of projection heads in self-supervised learning.

problem Dimensional collapse and information invariance trade-off in projection heads.
method Geometric modeling of projection heads as Riemannian metrics, analyzing Hessian eigenvalues, and tracking optimization geometry.
result Smooth nonlinear heads induce negative curvature, preventing collapse; linear and ReLU heads cannot.

Our main result is that if a generic convex domain in Rn\R^n collapses to a domain in Rn1\R^{n-1}, then the difference between the first two Dirichlet eigenvalues of the Euclidean Laplacian, known as the fundamental gap, diverges. The boundary of the domain need not be smooth, merely Lipschitz continuous. To motivate th…

2008-10-27abs ↗pdf ↗

In this paper we describe the topology of 4-dimensional closed orientable Riemannian manifolds with a uniform lower bound of sectional curvature and with a uniform upper bound of diameter which collapse to metric spaces of lower dimensions. This enables us to understand the set of homeomorphism classes of closed orient…

2012-05-02abs ↗pdf ↗

We analyze the topology and geometry of a polyhedron of dimension 2 according to the minimum size of a cover by PL collapsible polyhedra. We provide partial characterizations of the polyhedra of dimension 2 that can be decomposed as the union of two PL collapsible subpolyhedra in terms of their simple homotopy type and…

2018-02-05abs ↗pdf ↗

The paper analyzes graph Laplacians on manifolds with curvature bounds and applies to non-collapsed spaces.

problem Analyzing spectral properties of graph Laplacians on manifolds with curvature constraints.
method Quantitative bounds on eigenvalues and eigenfunctions of graph Laplacians constructed from random variables on manifolds with uniform lower Ricci curvature bounds.
result Spectral convergence of graph Laplacians on manifolds with curvature bounds and in non-collapsed spaces.

Given a projective hyperkahler manifold with a holomorphic Lagrangian fibration, we prove that hyperkahler metrics with volume of the torus fibers shrinking to zero collapse in the Gromov-Hausdorff sense (and smoothly away from the singular fibers) to a compact metric space which is a half-dimensional special Kahler ma…

2017-05-09abs ↗pdf ↗

Constructs special Lagrangian submanifolds in Calabi-Yau 3-folds.

problem Constructing special Lagrangian submanifolds in collapsing Calabi-Yau 3-folds.
method Constructs special Lagrangian submanifolds in collapsing Calabi-Yau 3-folds fibered by K3 surfaces.
result Special Lagrangian submanifolds shrink to 1-dimensional graphs in the base as the 3-folds collapse.

We prove that an open manifold MM of dimension at least 55 which admits a complete CAT(0) polyhedral metric is pseudo-collarable, its fundamental group at infinity is strongly perfectly semistable and has vanishing Chapman-Siebenmann obstruction τ(M)τ_{\infty}(M). Moreover, this implies that MM is topologically collap…

2015-12-20abs ↗pdf ↗