Improved bounds on neural network regions using activation histograms.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Study shows how near crushing singularities, Kasner-like regions can exist.
The study estimates the expressiveness of GCNs with bounds on the number of linear regions.
Study on bit threads and their locking properties in holographic spacetimes.
A new method to measure neural network expressiveness using tighter upper bounds.
Estimates the upper bound of linear regions in spheres centered at specific data points in ReLU neural networks.
Using region crossing changes, we define a new invariant called the multi-region index of a knot. We prove that the multi-region index of a knot is bounded from above by twice the crossing number of the knot. In addition, we show that the minimum number of generators of the first homology of the double branched cover o…
We can compare the expressiveness of neural networks that use rectified linear units (ReLUs) by the number of linear regions, which reflect the number of pieces of the piecewise linear functions modeled by such networks. However, enumerating these regions is prohibitive and the known analytical bounds are identical for…
We investigate the complexity of deep neural networks (DNN) that represent piecewise linear (PWL) functions. In particular, we study the number of linear regions, i.e. pieces, that a PWL function represented by a DNN can attain, both theoretically and empirically. We present (i) tighter upper and lower bounds for the m…
This work generalizes bounds on the number of linear regions in CPWL NNs.
Region crossing change for a knot or a proper link is an unknotting operation. In this paper, we provide a sharp upper bound on the region unknotting number for a large class of torus knots and proper links. Also, we discuss conditions on torus links to be proper.
Given a discrete subgroup of the isometries of n-dimensional hyperbolic space there is always a region kept precisely invariant under the stabilizer of a parabolic fixed point, called the Margulis region. While in dimensions 2 and 3 this region is a horoball, it has in general a more complicated shape due to the existe…
The paper improves confidence regions for band-limited functions using tighter norm bounds and majority voting.
In this paper we present a new approach for tightening upper bounds on the partition function. Our upper bounds are based on fractional covering bounds on the entropy function, and result in a concave program to compute these bounds and a convex program to tighten them. To solve these programs effectively for general r…
Defines renormalized volume for bounded regions in asymptotically hyperbolic Einstein spaces.
We present a framework to derive upper bounds on the number of regions that feed-forward neural networks with ReLU activation functions are affine linear on. It is based on an inductive analysis that keeps track of the number of such regions per dimensionality of their images within the layers. More precisely, the info…
Study on unknotting twisted knots using arc shift and region arc shift moves.
New bounds for Neyman-Pearson region using -divergences.
Bayesian model averaging under predictor redundancy
We prove that there are no minimal hypersurfaces properly immersed in any region of the Euclidean space bounded by unstable minimal cones. We also prove the analogous result for -minimal hypersurfaces.
TRM improves long-horizon LLM RL by masking divergent sequences.
For an arrangement of pseudolines in the real projective plane let us denote by the number of vertices incident to lines. We obtain a linear on inequality similar to the Hirzebruch one, but with an elementary proof. We present an algorithm for producing lower bounds of the number of regions basing o…
TRM improves long-horizon reinforcement learning for LLMs by masking divergent sequences.
Recently dictionary screening has been proposed as an effective way to improve the computational efficiency of solving the lasso problem, which is one of the most commonly used method for learning sparse representations. To address today's ever increasing large dataset, effective screening relies on a tight region boun…
Stochastic partition models divide a multi-dimensional space into a number of rectangular regions, such that the data within each region exhibit certain types of homogeneity. Due to the nature of their partition strategy, existing partition models may create many unnecessary divisions in sparse regions when trying to d…
Reweighting improves risk bounds in certain data regions.
In this paper we consider the problem of minimizing the relative perimeter under a volume constraint in the interior of a conically bounded convex set, i.e., an unbounded convex body admitting an \emph{exterior} asymptotic cone. Results concerning existence of isoperimetric regions, the behavior of the isoperimetric pr…
We show that for a large class of hyperbolic knots and links, we can determine bounds on the volume of the link complement from combinatorial information given by a link diagram. Specifically, there is a universal constant C such that if a knot or link admits a prime, twist reduced diagram with at least 2 twist regions…
The paper extends Reshetnyak's theorem to Lorentzian length spaces with upper curvature bounds.
3D Ricci flows have bounded diameter before Type I singularities.
Study on bounds of knot untangling for specific types of knots.
OneFlow detects anomalies by finding a minimal volume region, outperforming other methods.
Flow adjusts curvature to avoid a fixed region, proving bounds and regularity.
We derive Gaussian approximations for random forest predictions using region-based stabilization.
Neural network accuracy improves with denser training samples.
The SPS method constructs confidence regions for true parameters with optimal sample complexity.
We show that if a knot admits a prime, twist-reduced diagram with at least 4 twist regions and at least 6 crossings per twist region, then every non-trivial Dehn filling of that knot is hyperbolike. A similar statement holds for links. We prove this using two arguments, one geometric and one combinatorial. The combinat…
The developments of deep neural networks (DNN) in recent years have ushered a brand new era of artificial intelligence. DNNs are proved to be excellent in solving very complex problems, e.g., visual recognition and text understanding, to the extent of competing with or even surpassing people. Despite inspiring and enco…
We prove a comparison theorem for the isoperimetric profiles of simple closed curves evolving by the normalized curve shortening flow: If the isoperimetric profile of the region enclosed by the initial curve is greater than that of some `model' convex region with exactly four vertices and with reflection symmetry in bo…
We consider the problem of model selection in Gaussian Markov fields in the sample deficient scenario. The benchmark information-theoretic results in the case of d-regular graphs require the number of samples to be at least proportional to the logarithm of the number of vertices to allow consistent graph recovery. When…
In this paper, we discuss the region unknotting number of different classes of 2-bridge knots. In particular, we provide region unknotting number for the classes of -bridge knots whose Conway notation is and . By generalizing, we also provide a sharp up…
Region-specific linear models are widely used in practical applications because of their non-linear but highly interpretable model representations. One of the key challenges in their use is non-convexity in simultaneous optimization of regions and region-specific models. This paper proposes novel convex region-specific…
We prove that every bounded strictly -convex region equipped with the Kobayashi metric is hyperbolic in the sense of Gromov. We apply this result to the study of the dynamics of pseudo-holomorphic maps.
In this paper, aimed at exploring the fundamental properties of isoperimetric region in -manifold which is asymptotic to Anti-de Sitter-Schwarzschild manifold with scalar curvature , we prove that connected isoperimetric region with cannot slide off to …
New concepts of barriers and black regions defined for Lorentzian manifolds.
New method calibrates reference distributions for bounded support.
The paper examines stability of ReLU networks in tangent space and activation regions.
The paper develops methods for constructing confidence regions for regression functions in binary classification.