Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

109218326435 · Jun 202019922001200920172026
48 results for Information Plane

Review of information plane analyses in neural networks, highlighting mixed results and methodological challenges.

problem Understanding the relationship between information-theoretic compression and neural network performance.
method Literature review and detailed analysis of information quantity estimation methods.
result Information plane compression is not necessarily information-theoretic but compatible with geometric compression.

The Information Plane theory predicts autoencoders do not compress input information.

problem Understanding the training dynamics of hidden layers in autoencoders.
method Derive a theoretical convergence for the Information Plane of autoencoders using a Gram-matrix based mutual information estimator.
result Ideal autoencoders with a large bottleneck layer size do not compress input information, while a small size causes compression only in the encoder layers.

We give a criterion for a projective surface to become a quotient of a fake projective plane. We also give a detailed information on the elliptic fibration of a (2,3)(2,3)-elliptic surface that is the minimal resolution of a quotient of a fake projective plane. As a consequence, we give a classification of Q{\mathbb Q}-h…

2010-10-02abs ↗pdf ↗

Results on 88-dimensional topological planes are scattered in the literature. It is the aim of the present paper to give a survey of these geometries, in particular of information obtained after the appearance of the treatise Compact Projective Planes or not included in this book. For some theorems new proofs are give…

2014-02-03abs ↗pdf ↗

RNNs are suboptimal at compressing past sensory inputs for future prediction.

problem RNNs do not optimally compress past sensory inputs for future prediction.
method Investigated RNNs trained with maximum likelihood and found they extract unnecessary information. Injected noise into hidden states to improve performance.
result Injecting noise into RNN hidden states improves predictive information, sample quality, likelihood, and classification performance.

We show that under certain symmetry, the images of complete harmonic embeddings from the complex plane into the hyperbolic plane is completely determined by the geometric information of the vertical measured foliation and is independent of the horizontal measured foliation of the corresponding Hopf differentials.

2005-02-24abs ↗pdf ↗

The paper extends curve deformation methods in Minkowski plane.

problem Studying deformations of curves in the Minkowski plane considering their geometry and singularities.
method Extends methods from [17, 18] to analyze 2-parameter families of curves in Minkowski plane.
result Obtains geometry of deformed curves, including inflections, vertices, and lightlike points.

In information theory, Fisher information and Shannon information (entropy) are respectively used to quantify the uncertainty associated with the distribution modeling and the uncertainty in specifying the outcome of given variables. These two quantities are complementary and are jointly applied to information behavior…

2018-07-10abs ↗pdf ↗

Despite their great success in practical applications, there is still a lack of theoretical and systematic methods to analyze deep neural networks. In this paper, we illustrate an advanced information theoretic methodology to understand the dynamics of learning and the design of autoencoders, a special type of deep lea…

2018-03-30abs ↗pdf ↗

The paper examines FDL and SF algorithms using information bottleneck theory.

problem Understanding the behavior of FDL algorithms using information-theoretic terms.
method Formalization of FDL in information-theoretic terms, using information planes to analyze SF algorithm.
result Empirical support for the conjecture about the dynamics of FDL.

In this paper, we consider the intensity surface of a 2D image, we study the evolution of the symmetry sets (and medial axes) of 1-parameter families of iso-intensity curves. This extends the investigation done on 1-parameter families of smooth plane curves (Bruce and Giblin, Giblin and Kimia, etc.) to the general case…

2009-12-01abs ↗pdf ↗

New IP analysis for deep neural networks using Rényi's entropy and tensor kernels.

problem Estimating mutual information in high-dimensional hidden layers of deep neural networks.
method Matrix-based Rényi's entropy coupled with tensor kernels for convolutional layers.
result First comprehensive IP analysis of large-scale DNNs and CNNs.

The abstract aims to generalize classical curve concepts to uniquely define complex curves.

problem Lack of sufficient information to distinguish between different curves.
method Generalizing classical concepts of curvature and torsion to higher algebraic curvatures.
result Each analytic branch of a complex curve is uniquely defined by higher algebraic curvatures.

Classifies compact radio sources in the Galactic plane using machine learning.

problem Challenges in processing large volumes of radio continuum survey data.
method Produced a curated dataset of ~20,000 images, trained two classifiers: gradient-boosted decision trees and convolutional neural networks.
result High classification accuracy (F1-score>90%) for separating Galactic objects from the extragalactic background.

Using symplectic topology and the Radon transform, we prove that smooth 4-dimensional projective planes are diffeomorphic to CP2\mathbb{CP}^2. We define the notion of a plane curve in a smooth projective plane, show that plane curves in high dimensional regular planes are lines, prove that homeomorphisms preserving plan…

2004-12-27abs ↗pdf ↗

Stable planes are locally isomorphic to classical projective planes.

problem Characterizing stable planes that are locally isomorphic to classical projective planes.
method Analyzing properties of stable planes and comparing them to classical projective planes over specific fields.
result Simply connected stable planes with connected lines are isomorphic to open subplanes of classical projective planes.

Any subset of the plane can be approximated by a set of square pixels. This transition from a shape to its pixelation is rather brutal since it destroys geometric and topological information about the shape. Using a technique inspired by Morse Theory, we algorithmically produce a PL approximation of the original shape …

2011-05-13abs ↗pdf ↗

Criteria for sharksfin and deltoid singularities from plane to plane, with applications.

problem Identifying and understanding singularities in plane-to-plane mappings.
method Providing criteria and geometric meanings for singularities.
result Geometric meanings and criteria for sharksfin and deltoid singularities.

Applications of machine learning tools to problems of physical interest are often criticized for producing sensitivity at the expense of transparency. To address this concern, we explore a data planing procedure for identifying combinations of variables -- aided by physical intuition -- that can discriminate signal fro…

2017-09-28abs ↗pdf ↗

This thesis explores bifoliated planes and their group actions from Anosov flows.

problem Understanding bifoliated planes and their group actions from Anosov flows.
method Analyzes bifoliated planes associated with Anosov flows and describes their properties.
result Shows left-orderability of groups acting on bifoliated planes and describes bifoliated planes from specific families of Anosov flows.

We use reduced homogeneous coordinates to study Riemannian geometry of the octonionic (or Cayley) projective plane. Our method extends to the para-octonionic (or split octonionic) projective plane, the octonionic projective plane of indefinite signature, and the hyperbolic dual of the octonionic projective plane; we di…

2007-02-22abs ↗pdf ↗

The paper classifies singularities of plane congruences and affine distance functions.

problem Classifying singularities of plane congruences and affine distance functions.
method Classification through 2-parameter plane congruences in \(\mathbb{R^4}\) and affine normal plane congruences.
result Generic singularities of plane congruences and affine distance functions are classified.

New findings on plane waves in 3D spacetimes, showing non-unimodular elliptic plane waves are unique.

problem Classifying Lorentz homogeneous spaces of dimension 3, focusing on plane waves.
method Revisiting and relaxing usual completeness assumptions, characterizing homogeneous plane waves.
result Non-unimodular elliptic plane waves are unique and non-extendable, geodesically complete only if symmetric.

Weak lensing maps contain information beyond two-point statistics on small scales. Much recent work has tried to extract this information through a range of different observables or via nonlinear transformations of the lensing field. Here we train and apply a 2D convolutional neural network to simulated noiseless lensi…

2018-02-04abs ↗pdf ↗