The paper characterizes biconservative surfaces in hyperbolic 4-space.
problem Characterizing biconservative surfaces in hyperbolic 4-space.
method Establishing intrinsic conditions and analyzing geometric properties.
result Biconservative surfaces in hyperbolic 4-space satisfy a specific intrinsic condition.
Many recently trained neural networks employ large numbers of parameters to achieve good performance. One may intuitively use the number of parameters required as a rough gauge of the difficulty of a problem. But how accurate are such notions? How many parameters are really needed? In this paper we attempt to answer th…
GeLoRA optimizes LoRA fine-tuning by dynamically adjusting ranks based on intrinsic dimensionality.
problem Efficient fine-tuning of large language models with limited computational resources.
method GeLoRA computes intrinsic dimensionality to adaptively select LoRA ranks, balancing expressivity and efficiency.
result GeLoRA consistently outperforms recent baselines within the same parameter budget on multiple tasks.
New method tightens sub-Gaussian concentration inequalities.
problem Estimating variance-type parameters of sub-Gaussian distributions.
method Using sub-Gaussian intrinsic moment norm to maximize normalized moments.
result Provides tighter sub-Gaussian concentration inequalities.
Study provides bounds for estimating intrinsic dimension using Gaussian kernels.
problem Estimating intrinsic dimension from data.
method Finite-sample concentration and anti-concentration bounds for Gaussian kernel sums.
result Explicit dependence on sample size, bandwidth, and geometric parameters.
Deep networks can approximate functions with fewer learnable parameters than previously thought.
problem High computational costs due to large number of parameters in deep neural networks.
method Theoretical design of ReLU networks with a few intrinsic parameters and numerical experiments.
result ReLU networks with a small number of intrinsic parameters can achieve good approximations of functions.
Deep multi-task learning benefits from low intrinsic dimensionality, leading to better generalization.
problem Improving generalization in deep multi-task learning with high-dimensional models.
method Parametrizing multi-task networks in a low-dimensional space using random expansions and weight compression.
result First non-vacuous generalization bounds for deep multi-task networks are derived.
One popular hypothesis of neural network generalization is that the flat local minima of loss surface in parameter space leads to good generalization. However, we demonstrate that loss surface in parameter space has no obvious relationship with generalization, especially under adversarial settings. Through visualizing …
Given k>=2, we construct a (2k-2)-parameter family of properly embedded minimal surfaces in H^2 x R invariant by a vertical translation T, called Saddle Towers, which have total intrinsic curvature 4 pi(1-k), genus zero and 2k vertical Scherk-type ends in the quotient by T. As limits of those Saddle Towers, we obtain J…
New method estimates deep neural network's intrinsic dimension for better generalization.
problem Estimating intrinsic dimension of deep neural networks for generalization.
method Topological data analysis (TDA) and persistent homology (PHD).
result Efficient algorithm to estimate PHD in deep neural networks.
Paper extends Bayesian Cramér-Rao bound with geometric considerations.
problem Estimation of covariance matrices with geometric structures.
method Intrinsic Bayesian Cramér-Rao bound with Riemannian geometry.
result Performance bounds for covariance matrix estimation.
Three training regimes found for scale-invariant neural networks on the sphere.
problem Training scale-invariant neural networks on the sphere with varying effective learning rate.
method Investigated three regimes of training: convergence, chaotic equilibrium, and divergence.
result Discovered three distinct training regimes with unique characteristics.
Paper examines global Covid-19 data complexity and finds low intrinsic dimensions.
problem Understanding the complexity of Covid-19 data across countries.
method Used a Bayesian mixture model (Hidalgo) to estimate intrinsic dimensionality.
result Covid-19 data projects onto two low-dimensional manifolds without significant loss of information.
Unified framework for singular statistical models using observable charts.
problem Non-identifiability and breakdown of classical asymptotic theory in singular models.
method Invariant framework based on observable charts to define local coordinate systems in model space.
result Observable order provides a lower bound on KL divergence vanishing rate in singular models.
We consider non-parametric estimation and inference of conditional moment models in high dimensions. We show that even when the dimension D of the conditioning variable is larger than the sample size n, estimation and inference is feasible as long as the distribution of the conditioning variable has small intrinsic…
Defines a new family of curves in space with applications.
problem Finding shapes similar to whirls in space.
method Intrinsic equation of curvature and torsion, position vector with arc length parameter.
result Necessary and sufficient conditions for the existence of the family of curves.
Study on rolling Stiefel manifolds with specific metrics.
problem Intrinsic and extrinsic rolling of Stiefel manifolds with α-metrics. method Investigation of intrinsic rolling of normal naturally reductive homogeneous spaces, derivation of ODEs for rolling, and explicit solutions.
result Explicit solutions for intrinsic and extrinsic rolling of Stiefel manifolds.
The paper analyzes the intrinsic exploration terms in policy-gradient algorithms.
problem Exploration in policy-gradient algorithms and its impact on policy optimization.
method Numerical optimization criteria and stochastic gradient analysis.
result Exploration techniques improve policy optimization by smoothing the learning objective and modifying gradient estimates.
The focus of this paper is on intrinsic methods to detect overfitting. By intrinsic methods, we mean methods that rely only on the model and the training data, as opposed to traditional methods (we call them extrinsic methods) that rely on performance on a test set or on bounds from model complexity. We propose a famil…
Meta-learner infers subtask graph to adapt quickly to unknown tasks.
problem Adapting to unknown tasks with unknown subtask dependencies in few-shot RL.
method Meta-learner with Subtask Graph Inference (MSGI) and UCB-inspired intrinsic reward.
result Accurately infers latent task parameters and adapts more efficiently.
New metric explains neural network performance, simplifying generalization error calculation.
problem Precise characterization of neural network generalization error.
method Introducing Representation Gap, linking to intrinsic dimension and equivariant diffusion models.
result Asymptotic equivalent of Representation Gap is governed by intrinsic dimension, easy to estimate.
When analyzing empirical data, we often find that global linear models overestimate the number of parameters required. In such cases, we may ask whether the data lies on or near a manifold or a set of manifolds (a so-called multi-manifold) of lower dimension than the ambient space. This question can be phrased as a (mu…
We uniquely and explicitly reconstruct the instantaneous intrinsic metric of the Kerr-Newman Event Horizon from the spectrum of its Laplacian. In the process we find that the angular momentum parameter, radius, area; and in the uncharged case, mass, can be written in terms of these eigenvalues. In the uncharged case th…
Polynomial chaos surrogates handle intrinsic noise in stochastic models.
problem Handling intrinsic noise in stochastic models with parametric uncertainty.
method Developed a PCE surrogate on a joint space of intrinsic and parametric uncertainty using Rosenblatt transformations and Karhunen-Loeve expansion.
result Quantified intrinsic noise contribution to model output variance using PCE Sobol indices.
Introduces intrinsic Hopf-Lax semigroup linking to intrinsic slope.
problem Understanding intrinsic Hopf-Lax semigroup and its relation to intrinsic slope.
method Introduces and proves the link between intrinsic Hopf-Lax semigroup and intrinsic slope.
result Intrinsic Hopf-Lax semigroup is a subsolution of Hamilton-Jacobi type equality.
Diffusion means converge to extrinsic means for long times on spheres.
problem Understanding the long-time behavior of diffusion means on manifolds.
method Introduced diffusion means as a parameterized family of location statistics on manifolds, and analyzed their convergence to extrinsic means for long times.
result For real projective spaces and connected compact symmetric spaces, the long-time limit of diffusion means is conjectured to be the extrinsic mean in the isometric embedding.
A method uses ITD and XGBoost for precise power transformer fault diagnosis.
problem Fault diagnosis of power transformers using DGA data.
method Ranking DGA parameters by skewness, extracting ITD features, and using an XGBoost classifier.
result The method achieves over 95% accuracy in classification.
Study shows one-dimensional location-scale-shape models are flat in Wasserstein geometry.
problem Investigating curvature in location-scale-shape models under Wasserstein metric.
method Introduced location-scale-shape model and investigated its geometry.
result Location-scale-shape model is intrinsically flat but extrinsically curved in Wasserstein geometry.
Framework for uncertainty estimation in training parameters.
problem Estimating uncertainty in training parameters.
method Marginalizing hyperparameters as random variables, investigating various forms of marginalisation.
result Some marginalisations can reliably estimate uncertainty without extensive tuning.
Neural networks' performance scales with data size, explained by data manifold dimensionality.
problem Understanding the scaling of neural network performance with the number of parameters.
method Explained by the intrinsic dimension of the data manifold, confirmed through teacher/student framework and various datasets.
result The scaling exponent α is approximately 4 divided by the intrinsic dimension d of the data manifold.
This study examines Gaussian processes on Riemannian manifolds and proves contraction rates.
problem Comparing intrinsic vs. extrinsic Gaussian processes on Riemannian manifolds.
method Proves optimal contraction rates for intrinsic Matérn Gaussian processes on compact Riemannian manifolds.
result Intrinsic Gaussian processes on Riemannian manifolds achieve better performance than extrinsic ones.
New method adapts DLMs to intrinsic data dependence without prior knowledge.
problem Understanding how unmasking schedules affect DLM generation quality.
method Adapts unmasking schedule to target data distribution's dependence structure.
result Sampling convergence guarantees improve for low-complexity distributions.
A parametric manifold is a manifold on which all tensor fields depend on an additional parameter, such as time, together with a parametric structure, namely a given (parametric) 1-form field. Such a manifold admits natural generalizations of Lie differentiation, exterior differentiation, and covariant differentiation, …
Capsule Networks improve autonomous navigation in sparse environments.
problem Challenges in reinforcement learning for sparse reward environments.
method Caps-EM pairs CapsNets with Advantage Actor Critic, using fewer parameters.
result Caps-EM achieves significant time improvements and fewer parameters compared to competing methods.
Survey of intrinsically linked or knotted graphs.
problem Understanding graphs that are inherently knotted or linked.
method Survey of existing results.
result Discussion of known properties of intrinsically linked or knotted graphs.
The intrinsic geometry of the Kerr ergosurface on constant Boyer-Lindquist (BL), Kerr, and Doran time slices is characterized. Unlike the BL slice, which had been previously studied, the other slices (i) do not have conical singularities at the poles (except the Doran slice in the extremal limit), (ii) have finite pola…
The paper studies properties of intrinsically Lipschitz constants in metric spaces.
problem Investigating properties of intrinsically Lipschitz constants.
method Introduced Leibniz and product formulas for intrinsic slope.
result Formulated Leibniz and product formulas for intrinsic slope.
On a sub-Riemannian manifold we define two type of Laplacians. The \emph{macroscopic Laplacian} Δω, as the divergence of the horizontal gradient, once a volume ω is fixed, and the \emph{microscopic Laplacian}, as the operator associated with a sequence of geodesic random walks. We consider a general class of rando…
The study introduces a new stickiness parameter for stock prices using a non-linear model.
problem Understanding how closely individual stocks follow a stock index's price movements.
method Developed a non-linear pricing model inspired by tectonic plate movements to measure stickiness.
result Defined a stickiness parameter for stock price returns using a novel model.
A projective parameter of a geodesic on a Finsler space is defined to be solution of a certain ODE. Using projective parameter and Funk metric, one can construct a projectively invariant intrinsic pseudo-distance on a Finsler space. In the present work, solutions of the projective parameter's ODE are characterized with…
Gromov proposed to extract the (differential) geometric content of a sub-riemannian space exclusively from its Carnot-Carathéodory distance. One of the most striking features of a regular sub-riemannian space is that it has at any point a metric tangent space with the algebraic structure of a Carnot group, hence a homo…
We introduce new sufficient conditions for intrinsic knotting and linking. A graph on n vertices with at least 4n-9 edges is intrinsically linked. A graph on n vertices with at least 5n-14 edges is intrinsically knotted. We also classify graphs that are 0, 1, or 2 edges short of being complete partite graphs with respe…
New graph shows edge deletion/contraction doesn't always result in intrinsically linked graphs.
problem Edge operations in intrinsically knotted graphs don't always produce intrinsically linked graphs.
method Presented a new intrinsically knotted graph.
result Edge operations in intrinsically knotted graphs don't always result in intrinsically linked graphs.
This paper contains the technical foundations from stochastic differential geometry for the construction of geometrically intrinsic nonlinear recursive filters. A diffusion X on a manifold N is run for a time interval T, with a random initial condition. There is a single observation consisting of a nonlinear function o…
New method estimates intrinsic dimensionality using angles, not distances.
problem Estimating local intrinsic dimensionality accurately.
method Introduces a new estimator using the distribution of angles between neighbor points.
result New estimator behaves similarly but complementarily to existing measures of intrinsic dimensionality.
A directed graph G is intrinsically linked if every embedding of that graph contains a non-split link L, where each component of L is a consistently oriented cycle in G. A tournament is a directed graph where each pair of vertices is connected by exactly one directed edge. We consider intr…
We classify graphs that are 0, 1, or 2 edges short of being complete partite graphs with respect to intrinsic linking and intrinsic knotting. In addition, we classify intrinsic knotting of graphs on 8 vertices. For graphs in these families, we verify a conjecture presented in Adams' "The Knot Book": If a vertex is remo…
In many complex dynamical systems, artificial or natural, one can observe self-organization of patterns emerging from local rules. Cellular automata, like the Game of Life (GOL), have been widely used as abstract models enabling the study of various aspects of self-organization and morphogenesis, such as the emergence …