Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,738 papers · 148 categories

Trend · papers per month

58116173231 · Jun 202019922001200920172026
48 results for sparse degree-two edge collapses

We construct the first explicit example of a simplicial 3-ball B_{15,66} that is not collapsible. It has only 15 vertices. We exhibit a second 3-ball B_{12,38} with 12 vertices that is collapsible and evasive, but not shellable. Finally, we present the first explicit triangulation of a 3-sphere S_{18, 125} (with only 1…

2013-03-08abs ↗pdf ↗

Polygonal meshes provide an efficient representation for 3D shapes. They explicitly capture both shape surface and topology, and leverage non-uniformity to represent large flat regions as well as sharp, intricate features. This non-uniformity and irregularity, however, inhibits mesh analysis efforts using neural networ…

2018-09-16abs ↗pdf ↗

Topic models, and more specifically the class of Latent Dirichlet Allocation (LDA), are widely used for probabilistic modeling of text. MCMC sampling from the posterior distribution is typically performed using a collapsed Gibbs sampler. We propose a parallel sparse partially collapsed Gibbs sampler and compare its spe…

2015-06-11abs ↗pdf ↗

New method for matching bipartite and unipartite graphs without collapsing.

problem Matching between bipartite and unipartite networks without losing information.
method Formulated as an undirected graphical model, aligns graphs without collapsing.
result Consistent method with conditions for exact recovery of matching solution.

Classifies actions of tori on manifolds up to diffeomorphisms.

problem Classifying actions of tori on manifolds up to diffeomorphisms.
method Using triples (Q, λ, c) to classify actions, where Q is a manifold-with-corners, λ is a unimodular labelling, and c is a cohomology class.
result Classifies locally standard smooth actions of T up to equivariant diffeomorphisms.

Paper shows how to represent Milnor's triple linking number using chord diagrams and doodle invariants.

problem Tackles the representation of Milnor's triple linking number.
method Establishes an analogous description for Milnor's triple linking number using counts of chord diagrams and doodle invariants.
result Shows that Milnor's triple linking number can be represented in terms of chord diagrams and doodle invariants.

Study financial contagion and risk in sparse networks with directed edges.

problem Analyzing systemic risk in sparse financial networks with balance-sheet interactions.
method Linear fraction of institutions with zero out-degree, sender-truncated subgraph G_sh, adversarial and random systemic events, explicit fan-in accumulation bound.
result Maximal forward reachability in G_sh is O(log n) with high probability in the subcritical regime, and multi-hit defaults are negligible in the supercritical regime.

ACERL embeds networks into a low-dimensional space preserving structural and semantic properties.

problem Challenges in brain connectivity data analysis with subject-specific, high-dimensional, and sparse networks.
method Contrastive learning of augmented network pairs with adaptive random masking.
result Achieves minimax optimal convergence rate for edge representation learning.

New method handles structural uncertainty in graphs better than existing models.

problem Handling heterophily and structural noise in semi-supervised learning on graphs.
method Sparse signed message passing network that models a posterior distribution over signed adjacency matrices.
result Our method outperforms strong baseline models on heterophilic benchmarks under both synthetic and real-world structural noise.

Enhances neural architecture search efficiency and prevents performance collapse.

problem Improving memory efficiency and preventing performance collapse in neural architecture search.
method Employing continuous relaxation strategy and gradient-based optimization for over-parameterized BCNN construction, introducing Confident Learning Rate and partial channel connections.
result NAS-v2 delivers state-of-the-art search efficiency on CIFAR-10 and ImageNet.

Sparse connectivity improves generalization in neural networks below the Edge of Stability.

problem Generalization guarantees for fully-connected networks fail at the Edge of Stability.
method Analyzed sparse connectivity's impact on generalization in two-layer ReLU networks.
result Sparse connectivity changes the effective constraint, leading to non-vacuous generalization bounds.

Graph Neural Networks (GNNs) have proved to be an effective representation learning framework for graph-structured data, and have achieved state-of-the-art performance on many practical predictive tasks, such as node classification, link prediction and graph classification. Among the variants of GNNs, Graph Attention N…

2019-12-02abs ↗pdf ↗

We analyze the degree-two part of the Torelli group's associated graded.

problem Understanding the structure of the degree-two part of the Torelli group's associated graded.
method We use algebraic topology and group theory to analyze the structure of the degree-two part of the Torelli group's associated graded.
result The abelian group Γ2I/Γ3IΓ_2 \mathcal{I} / Γ_3 \mathcal{I} is torsion-free and described as a lattice in a rational vector space.

This paper extends neural collapse to regression problems, revealing key features and structures.

problem Understanding the structure learned by deep neural networks in regression tasks.
method Established Neural Regression Collapse (NRC) across different models, analyzing feature and weight alignments.
result Deep neural regression models exhibit a collapsed feature space, aligning with target dimensions and covariances.

New CRM models for sparse networks with linear edge growth.

problem Modeling extremely sparse networks with tractable properties.
method Introduced a new class of CRMs with index of variation α∈(0,1] based on mixtures of stable or generalized gamma processes.
result Models produce networks with near-linear edge growth, aligning with empirical evidence.

Gradient descent on LSE objectives implicitly performs EM, leading to collapse without volume control.

problem Gradient collapse in autoencoders without volume control.
method Introduced a single-layer encoder with an LSE objective and InfoMax regularization for volume control.
result Gradient--responsibility identity holds exactly; LSE alone collapses; variance prevents dead components; decorrelation prevents redundancy.

VINNAS uses variational inference to avoid mode collapse in neural architecture search.

problem Mode collapse in gradient-based NAS methods, leading to suboptimal architectures.
method Differentiable variational inference with variational dropout and automatic relevance determination.
result State-of-the-art accuracy with up to twice fewer non-zero parameters.

New analysis shows how attention masks and LayerNorm prevent rank collapse in transformers.

problem Rank collapse in transformer models with increasing depth.
method General analysis of rank collapse under self-attention, considering attention masks and LayerNorm.
result Self-attention with LayerNorm can prevent rank collapse and maintain a rich set of equilibria.

This paper considers the problem of clustering a partially observed unweighted graph---i.e., one where for some node pairs we know there is an edge between them, for some others we know there is no edge, and for the remaining we do not know whether or not there is an edge. We want to organize the nodes into disjoint cl…

2011-04-25abs ↗pdf ↗

New metrics improve scRNA-seq perturbation modeling by reducing mode collapse.

problem Outperformed by simple mean prediction in scRNA-seq perturbation modeling.
method Introduce DEG-aware metrics (WMSE, Rw2(Δ)R^{2}_{w}(Δ)) and negative/positive baselines.
result WMSE loss function reduces mode collapse and improves model performance.

FedDST trains sparse sub-networks to improve efficiency in federated learning.

problem Efficiently train large models on resource-limited edge devices with limited network bandwidth.
method Dynamic sparse training to reduce model size and communication.
result FedDST outperforms existing methods in federated learning, especially in non-i.i.d. settings.

Architectures for sparse hierarchical representation learning have recently been proposed for graph-structured data, but so far assume the absence of edge features in the graph. We close this gap and propose a method to pool graphs with edge features, inspired by the hierarchical nature of chemistry. In particular, we …

2019-08-06abs ↗pdf ↗

Proposes a Bayesian approach for automatic node selection in sparse neural networks.

problem Reduces structural complexity and computational speedup in large-scale predictive models.
method Uses spike-and-slab Gaussian priors and variational Bayes approach for node selection.
result Establishes variational posterior consistency and optimal contraction rates for sparse networks.

In the Network Inference problem, one seeks to recover the edges of an unknown graph from the observations of cascades propagating over this graph. In this paper, we approach this problem from the sparse recovery perspective. We introduce a general model of cascades, including the voter model and the independent cascad…

2015-05-21abs ↗pdf ↗

We study hyperbolic cohomology classes in the general context of simplicial complexes and prove homological invariance statements for them. We relate the existence of hyperbolic cohomology classes to the non-amenability of the fundamental group. In degree two we clarify the relation between hyperbolic and atoroidal cla…

2008-08-11abs ↗pdf ↗

We propose a dynamic edge exchangeable network model that can capture sparse connections observed in real temporal networks, in contrast to existing models which are dense. The model achieved superior link prediction accuracy on multiple data sets when compared to a dynamic variant of the blockmodel, and is able to ext…

2017-10-11abs ↗pdf ↗

Study on GD and SGD over diagonal networks, focusing on stepsizes and regularisation.

problem Understanding the impact of stochasticity and large stepsizes on gradient descent and SGD solutions.
method Investigation of GD and SGD over diagonal linear networks with macroscopic stepsizes, proving convergence and characterizing solutions.
result Large stepsizes consistently benefit SGD for sparse regression problems, but can hinder GD recovery of sparse solutions, especially in the edge of stability regime.

Sparse incidence tensors can represent a variety of structured data. For example, we may represent attributed graphs using their node-node, node-edge, or edge-edge incidence matrices. In higher dimensions, incidence tensors can represent simplicial complexes and polytopes. In this paper, we formalize incidence tensors,…

2019-05-27abs ↗pdf ↗

We calculate the twisted Reidemeister torsion of the complement of an iterated torus knot associated with a representation of its fundamental group to the complex special linear group of degree two. We also show that the twisted Reidemeister torsions associated with various representations appear in the asymptotic expa…

2016-02-15abs ↗pdf ↗

We investigate the problem of factorizing a matrix into several sparse matrices and propose an algorithm for this under randomness and sparsity assumptions. This problem can be viewed as a simplification of the deep learning problem where finding a factorization corresponds to finding edges in different layers and valu…

2013-11-13abs ↗pdf ↗

Evidential Softmax preserves multimodality in sparse probability distributions for generative models.

problem Sparse probability distributions in deep generative models make exact marginalization computationally intractable.
method Introduce ev-softmax, a sparse normalization function that preserves multimodality and can be trained with probabilistic loss functions.
result ev-softmax outperforms existing techniques in distributional accuracy and dimensionality reduction.

New algorithm estimates edge density of random graphs robustly, achieving optimal breakdown point.

problem Estimating edge density of Erdős-Rényi graphs under adversarial edge manipulation.
method Sum-of-Squares (SoS) hierarchy, constructing constant-degree certificates for concentration.
result First polynomial-time algorithm with optimal breakdown point and matching error guarantees.

The functional and structural representation of the brain as a complex network is marked by the fact that the comparison of noisy and intrinsically correlated high-dimensional structures between experimental conditions or groups shuns typical mass univariate methods. Furthermore most network estimation methods cannot d…

2013-10-24abs ↗pdf ↗

New pruning method for sparse additive models speeds up causal structure learning.

problem Efficiently prune spurious edges from fully-connected DAG induced by estimated topological order.
method Sparse additive models combined with randomized tree embedding and group-wise sparse regression.
result Significantly faster than existing pruning methods while maintaining comparable accuracy.