Sharp boundaries for detecting dense subhypergraphs established.
problem Detecting dense subhypergraphs in random hypergraphs.
method Established sharp detection boundaries for known and unknown edge probabilities.
result Sharp detectable regions differ significantly from graph counterparts.
Dense neural networks can't approximate all functions.
problem Approximation capabilities of dense neural networks.
method Model compression approach combining weak regularity lemma and graph neural networks.
result Existence of Lipschitz continuous functions not approximable by dense neural networks.
Generative model captures hubs and dense communities in social networks.
problem Capturing both hubs and dense communities in social networks.
method Graphon mixture model with a new condition on sparse graphs.
result Estimation of hub normalized degree and graphon for sparse components.
New examples of rigid Lie foliations with dense leaves found.
problem Infinitesimal rigidity of Lie foliations with dense leaves.
method Construction of specific Lie foliations.
result First examples of infinitesimally rigid Riemannian foliations with dense leaves.
The key idea of current deep learning methods for dense prediction is to apply a model on a regular patch centered on each pixel to make pixel-wise predictions. These methods are limited in the sense that the patches are determined by network architecture instead of learned from data. In this work, we propose the dense…
Study on detecting and recovering hidden dense cycles in random graphs.
problem Detecting and recovering hidden dense cycles in random graphs.
method Information-theoretic analysis of thresholds for detection and recovery.
result Characterization of information-theoretic thresholds for detection and recovery.
Generic Hitchin representations generate dense subgroups.
problem Understanding dense subgroups in SL_n(R) representations.
method Using a theorem by Rapinchuk, Benyash-Krivetz, and Chernousov.
result Generic Hitchin representations are strongly dense.
New lattices in higher dimensions have dense surface subgroups.
problem Finding dense subgroups in higher-dimensional arithmetic lattices.
method Exhibited nonuniform arithmetic lattices in SO(n,1).
result Contain Zariski-dense surface subgroups.
We discuss dense embeddings of surface groups and fully residually free groups in topological groups. We show that a compact topological group contains a nonabelian dense free group of finite rank if and only if it contains a dense surface group. Also, we obtain a characterization of those Lie groups which admit a dens…
New solver MPLP++ outperforms existing solvers for dense graph models.
problem Efficiently solving dense, discrete Graphical Models with pairwise potentials.
method Dual Block-Coordinate Ascent with MPLP++ modification.
result MPLP++ significantly outperforms existing solvers, including TRWS.
New framework for dense weighted networks with community-specific patterns.
problem Dense networks with varying edge weights across communities.
method Proposes a new model with functions mapping node characteristics to edge weights, requiring few parameters.
result Developed a bootstrap methodology for generating new networks.
ViCE uses superpixels to enhance self-supervised learning for better dense visual embeddings.
problem Lack of high-resolution feature maps from self-supervised models.
method Superpixels for dense representation learning, contrasting over regions.
result Improves unsupervised semantic segmentation on benchmarks like Cityscapes and COCO.
Bi-Lipschitz rigidity theorem for dense subgroups of algebraic groups.
problem Characterizing dense subgroups of algebraic groups.
method Bi-Lipschitz rigidity theorem for Zariski dense discrete subgroups.
result No C1-smooth slim limit set for higher rank semisimple algebraic groups. Inducing sparseness while training neural networks has been shown to yield models with a lower memory footprint but similar effectiveness to dense models. However, sparseness is typically induced starting from a dense model, and thus this advantage does not hold during training. We propose techniques to enforce sparsen…
The study finds conditions for certain groups to be dense in a specific mathematical space.
problem Conditions for linear reflection groups to be dense in a projective space.
method Analyzes necessary and sufficient conditions for Zariski-density, applies to Coxeter groups and surface subgroups.
result Establishes conditions for Zariski-dense subgroups in SLn(Z) for various n. DenseHMM improves HMMs by learning dense representations that enable gradient-based optimization.
problem Learning dense representations for hidden states and observables in HMMs.
method DenseHMM uses kernelized transition probabilities and two optimization schemes.
result DenseHMM achieves superior performance and expressiveness compared to standard HMMs.
Detection of dense cycles in graphs reveals a gap between easy detection and hard recovery.
problem Detecting and recovering dense cycles in Erdős-Rényi graphs.
method Characterization of computational thresholds for detection and recovery using low-degree polynomial algorithms.
result A gap exists between the detection and recovery thresholds for certain parameter regimes.
New representations of hyperbolic 3-manifold groups into larger groups.
problem Finding representations of hyperbolic 3-manifold groups into larger matrix groups.
method Holonomy representations from projective deformations of hyperbolic structures.
result First examples of strongly dense representations into SL(4,R) and SU(3,1). This paper explores loss landscapes of sparse neural networks, finding unique characteristics compared to dense networks.
problem Understanding the loss landscape of sparse neural networks, especially one-hidden-layer networks.
method Analyzes sparse networks with dense and sparse final layers, focusing on linear and non-linear models.
result Sparse networks can have no spurious valleys under certain conditions, but spurious valleys and minima can exist for wide sparse networks.
Develops hyperparameter transfer methods for Dense Associative Memories.
problem Challenges in transferring hyperparameters for DenseAMs due to unique architecture and activation functions.
method Derives explicit prescriptions for hyperparameter transfer from small to large models.
result Excellent agreement between theoretical and empirical results.
Detects dense subhypergraphs in heterogeneous random hypergraphs.
problem Testing for the existence of a dense subhypergraph in heterogeneous random hypergraphs.
method Established detection boundaries and constructed asymptotically powerful and adaptive tests.
result Developed tests for distinguishing between null and alternative hypotheses.
As an important part of the power system, power load forecasting directly affects the national economy. The data shows that improving the load forecasting accuracy by 0.01% can save millions of dollars for the power industry. Therefore, improving the accuracy of power load forecasting has always been the pursuing goals…
In each manifold M modeled on a finite or infinite dimensional cube [0,1]n we construct a closed nowhere dense subset S⊂M (called a spongy set) which is a universal nowhere dense set in M in the sense that for each nowhere dense subset A⊂M there is a homeomorphism h:M→M such that $h(A)\sub…
Odd-dimensional SL(n,Q) contains dense surface subgroups.
problem Finding dense subgroups in SL(n,Q) for odd n.
method Constructing a continuous path of representations.
result Existence of dense surface subgroups in SL(n,Q) for odd n.
Classifies manifolds with dense conjugacy classes in their mapping class groups.
problem Classifying manifolds based on conjugacy classes in their mapping class groups.
method Analyzing connected orientable 2-manifolds and their mapping class groups.
result Mapping class groups of certain manifolds have dense conjugacy classes.
The paper finds dense subgroups in certain Lie groups.
problem Finding dense subgroups in Lie groups.
method Constructing dense surface subgroups in specific Lie groups.
result Uniform lattices contain infinitely many dense Hitchin representations.
Sparse Hopfield model improves memory retrieval with fewer connections.
problem Memory retrieval efficiency with fewer connections.
method Sparse extension of Hopfield model, derived from sparse entropic regularizer.
result Sparse Hopfield model achieves tighter error bounds and better performance.
Paper develops Dense NN models for temporal-spatial data with improved performance.
problem Improving predictive performance and robustness in temporal-spatial modeling.
method Fully connected neural networks with ReLU activation, non-asymptotic bounds, manifold modeling, short-range dependence.
result Demonstrates superior performance in temporal-spatial modeling across various synthetic functions.
New GPU kernels boost deep learning speed and memory efficiency.
problem Sparse deep learning matrices are not well-suited for existing sparse kernels.
method Identified favorable properties of sparse matrices from deep learning, developed high-performance GPU kernels for sparse matrix operations.
result 27% of single-precision peak performance on Nvidia V100 GPUs achieved with new kernels.
Method generates dense fields from sparse measurements without needing spatial statistics or examples.
problem Generating dense physical fields from sparse measurements.
method Introduces a differentiable numerical simulator into neural network training.
result Superior results on fluid mechanics problems compared to statistical and neural network methods.
New method estimates precision matrices without models, achieving dense, consistent, and model-free properties.
problem Lack of methods that are dense, consistent, and model-free for precision matrix estimation.
method General class of estimators that unify dense, consistent, and model-free properties within a nonasymptotic framework.
result Ridgeless regression exhibits the double descent phenomenon, establishing a precision matrix analogue to linear regression's double descent.
Deforms surface groups to be Zariski dense in SL(n,R)
problem Finding Zariski dense surface groups in SL(n,R)
method Deforming K-integral representations of surface groups result Generalizes Long and Thistlethwaite's method to SL(n,R)
Sparse Transformers can approximate dense Transformers with only O(n) connections.
problem Can sparse Transformers approximate arbitrary sequence-to-sequence functions?
method Proposed sufficient conditions for universal approximation and proved that sparse Transformers with O(n) connections can approximate dense models.
result Sparse Transformers with O(n) connections can approximate the same function class as dense models with n^2 connections.
Paper tackles dense subgraph discovery with noisy feedback.
problem Discover dense subgraphs in edge-weighted graphs with noisy feedback.
method Proposes polynomial-time and scalable algorithms for dense subgraph discovery.
result Polynomial-time algorithm obtains nearly-optimal solution with high probability.
Generative models can still learn from contaminated data, but with limitations.
problem How much contamination can generative models tolerate?
method Characterized robustness under contaminated enumerations, proving generation is achievable for all countable collections if contamination fraction converges to zero.
result Generation under contamination is achievable for all countable collections if contamination fraction converges to zero, but dense generation is strictly less robust.
Wave fronts on certain surfaces become dense.
problem Density of wave fronts on surfaces.
method Proof of density for specific surfaces.
result Wave fronts become dense on flat torus, square billiard, Klein bottle, and cube surface.
Example shows dense subgroup of SL5(Z) not finitely presented.
problem Finding dense subgroups of SL5(Z) that are not finitely presented.
method Discussing an example of a Zariski-dense finitely generated subgroup of SL5(Z).
result Example shows a subgroup that is dense but not finitely presented.
The paper finds free semigroups in dense subgroups of Lie groups with critical exponents arbitrarily close to the subgroup's.
problem Finding free semigroups with critical exponents arbitrarily close to a subgroup's in dense subgroups of Lie groups.
method Analyzing Zariski dense discrete subgroups of Lie groups, showing the existence of free semigroups with critical exponents arbitrarily close to the subgroup's.
result The existence of free semigroups with critical exponents arbitrarily close to the subgroup's in dense subgroups of Lie groups.
We study approximations of the partition function of dense graphical models. Partition functions of graphical models play a fundamental role is statistical physics, in statistics and in machine learning. Two of the main methods for approximating the partition function are Markov Chain Monte Carlo and Variational Method…
We prove that every Bers slice of quasi-Fuchsian space is Zariski dense in the character variety.
A dense amalgam connects boundaries of groups split by finite subgroups.
problem Understanding boundaries of groups split by finite subgroups.
method Introducing dense amalgam and applying it to EZ-boundaries. result Boundaries of groups split by finite subgroups have a dense amalgam structure.
The study finds dense orbits and absolute period leaves for complex flows.
problem Existence of dense orbits for real Rel flows on holomorphic 1-forms.
method Established a density criterion for mSL(2,R)-orbit closures, verified using explicit constructions. result Found dense leaves and examples of absolute period foliation.
We solve 6-DoF localisation and 3D reconstruction using deep state-space models.
problem 6-DoF localisation and dense 3D reconstruction in spatial environments.
method Approximate Bayesian inference in a deep state-space model combining learning and domain knowledge.
result Near state-of-the-art performance on UAV flight data.
Study of conjugacy classes in infinite-type surfaces' mapping class groups.
problem Characterizing conjugacy classes in infinite-type surfaces' mapping class groups.
method Model-theoretic methods developed by Kechris, Rosendal, and Truss.
result Detailed classification of conjugacy classes in mapping class groups of infinite-type surfaces.
Model pruning seeks to induce sparsity in a deep neural network's various connection matrices, thereby reducing the number of nonzero-valued parameters in the model. Recent reports (Han et al., 2015; Narang et al., 2017) prune deep networks at the cost of only a marginal loss in accuracy and achieve a sizable reduction…
We address feature interpretation and reproducibility issues in dense nets, proposing a modified loss function.
problem Feature interpretation and reproducibility issues in dense nets.
method Proposed a modified loss function to circumvent basis collapse.
result Substantially concise nets with 100x fewer parameters and lower MSE loss.
Crowdsourcing is a strategy to categorize data through the contribution of many individuals. A wide range of theoretical and algorithmic contributions are based on the model of Dawid and Skene [1]. Recently it was shown in [2,3] that, in certain regimes, belief propagation is asymptotically optimal for data generated f…
Neural networks are dense among Lipschitz functions with fixed Lipschitz constant.
problem Characterizing neural network approximations to Lipschitz functions.
method Analyzing L-Lipschitz neural networks and their density in L-Lipschitz functions. result One layer neural networks are dense in the set of all L-Lipschitz functions.