Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

103206308411 · Jun 202019922001200920172026
48 results for mathematical representations

Review of mathematical representations for biomolecular data.

problem Complexity and high dimensionality of biomolecular datasets hinder ML applications.
method Developed low-dimensional and scalable mathematical representations using algebraic topology, differential geometry, and graph theory.
result Mathematical representations improve protein-ligand binding predictions and other biomolecular applications.

Math theory explains how neural networks learn abstract representations.

problem Understanding how neural networks learn abstract representations.
method Mathematical theory reformulating network optimization into mean field optimization over neural preactivations.
result Abstract representations of latent variables are guaranteed to appear in neural networks trained on tasks that depend on these variables.

Importance of theorem dedicated to isomorphisms consist in statement that they allow to identify different mathematical objects which have something common from the point of view of certain model. This paper considers morphisms of \Ts representation of F\mathfrak{F}\Hyph algebra and morphisms of \Ts representation of …

2008-03-18abs ↗pdf ↗

This note summarizes in an informal way some geometric properties of Anosov representations into the symplectic group, which were presented in a talk at the conference What is Next. The mathematical legacy of Bill Thurston, held in June 2014 in Cornell.

2016-02-10abs ↗pdf ↗

New method characterizes surface quadrilateral layouts as special immersions.

problem Characterize surface quadrilateral layouts mathematically.
method Characterizes quadrilateral layouts as special immersions of a cut representation of the surface into the Euclidean plane.
result Mathematically describes and generalizes integer grid maps.

The paper develops mathematical models for neural networks using non-compact symmetric spaces.

problem Developing mathematical models for neural networks using non-compact symmetric spaces.
method Introducing layers modeled as non-compact symmetric spaces, each mapped onto the next by solvable group homomorphisms.
result Group theoretical construction of separators for all non-compact symmetric spaces and uniformization of specific surfaces.

HOPE uses Hilbert space to deconstruct deep network representations.

problem Deconstructing learned representations in deep networks is challenging.
method Introduces Hilbert Operator for Progressive Encoding (HOPE) to deconstruct network weights.
result HOPE provides an unbiased approach to network compression and fine-tuning.

GNNs learn graph representations, with new theory on their power and limitations.

problem Understanding the capabilities and limitations of GNNs.
method Theoretical analysis of GNNs, focusing on approximation and learning properties.
result New insights into the representation, generalization, and extrapolation of GNNs.

We describe four algorithms for neural network training, each adapted to different scalability constraints. These algorithms are mathematically principled and invariant under a number of transformations in data and network representation, from which performance is thus independent. These algorithms are obtained from th…

2013-03-04abs ↗pdf ↗

Unified approach for learning state representations from streaming data.

problem Learning reusable state representations from high-dimensional, non-stationary data.
method Unified mathematical formulation for learning latent relations, enabling flexible and principled shaping of latent space.
result Improved understanding and evaluation of existing unsupervised learning approaches.

Explores tensor products in hyperdimensional computing.

problem Understanding tensor products in hyperdimensional computing.
method Generalized results from graph embeddings to vector symbolic architectures and hyperdimensional computing.
result Tensor product is the most general and expressive representation with errorless unbinding and detection.

This study provides a new mathematical structure for Koopman eigenfunctions.

problem Understanding and representing nonlinear dynamics as linear.
method Theoretical, analytical, and numerical approaches to Koopman eigenfunction space.
result Equivalence of minimal generating set and maximal independent set, defining conditions for independence.

We provide an integral representation for the (implied) copulas of dependent random variables in terms of their moment generating functions. The proof uses ideas from Fourier methods for option pricing. This representation can be used for a large class of models from mathematical finance, including Lévy and affine proc…

2011-08-04abs ↗pdf ↗

Deep networks are mathematically equivalent to kernel machines learned by gradient descent.

problem Understanding the learned representations of deep learning models.
method Using gradient descent to learn deep networks, showing they are equivalent to kernel machines.
result Deep network weights are a superposition of training examples, revealing the learned function.

This a free translation with additional explanations of {\em Processus à Accroissement Independants Chapitre I: La Décomposition de Paul Lévy}, by J.L. Bretagnolle, in {\em Ecole d'Eté de Probabilités}, Lecture Notes in Mathematics 307, Springer 1973. The Lévy-Khintchine representation of infinitely divisible distribut…

2015-06-09abs ↗pdf ↗

Mathematical approach assesses human resource competences accurately.

problem Accurate assessment and representation of human resource competences.
method Detailed quantification scheme and mathematical approach.
result Flexible tools for optimal job assignment and recruitment.

Braid groups are an important and flexible tool used in several areas of science, such as Knot Theory (Alexander's theorem), Mathematical Physics (Yang-Baxter's equation) and Algebraic Geometry (monodromy invariants). In this note we will focus on their algebraic-geometric aspects, explaining how the representation the…

2019-05-09abs ↗pdf ↗

Investigates the effects of nondominated sets of probability measures in robust models of finance.

problem Uncertainty in financial models due to multiple possible probability measures.
method Analyzes various results from mathematical finance literature under the assumption of nondominated sets of probability measures.
result Many classical results in robust models do not hold when the set of measures is nondominated.

We present an unsupervised approach for discovering semantic representations of mathematical equations. Equations are challenging to analyze because each is unique, or nearly unique. Our method, which we call equation embeddings, finds good representations of equations by using the representations of their surrounding …

2018-03-24abs ↗pdf ↗

The paper explains knowledge distillation by analyzing visual concepts in DNNs.

problem Understanding how knowledge distillation affects the learning of visual concepts in deep neural networks.
method The paper proposes three hypotheses and designs mathematical metrics to evaluate feature representations of DNNs.
result The hypotheses were verified through experiments on various DNNs.

The dissertation establishes a contexture theory to mathematically characterize representation learning.

problem The lack of a scientific understanding of representation learning in foundation models.
method Introduces the contexture theory as a unified framework for analyzing representation learning methods.
result Representation learning is optimal when the association between input and context is neither too strong nor too weak.

The Burau representation is a fundamental bridge between the braid group and diverse other topics in mathematics. A 1974 question of Birman asks for a description of the image; in this paper we give a "strong approximation" to the answer. Since a 1984 paper of Squier it has been known that the Burau representation pres…

2019-03-27abs ↗pdf ↗

The study uncovers latent capabilities of language models via causal representation learning.

problem Rigorous causal evaluations of language model capabilities are challenging due to confounding effects and computational costs.
method Proposes a causal representation learning framework to identify latent capability factors as causally interrelated after controlling for a common confounder (base model).
result Identifies a three-node linear causal structure explaining performance variations across 1500 models and six benchmarks.

Finding a new mathematical representations for graph, which allows direct comparison between different graph structures, is an open-ended research direction. Having such a representation is the first prerequisite for a variety of machine learning algorithms like classification, clustering, etc., over graph datasets. In…

2014-04-17abs ↗pdf ↗

Persistent homology (PH) is a rigorous mathematical theory that provides a robust descriptor of data in the form of persistence diagrams (PDs). PDs exhibit, however, complex structure and are difficult to integrate in today's machine learning workflows. This paper introduces persistence bag-of-words: a novel and stable…

2018-12-21abs ↗pdf ↗

We propose a paradigm to deep-learn the ever-expanding databases which have emerged in mathematical physics and particle phenomenology, as diverse as the statistics of string vacua or combinatorial and algebraic geometry. As concrete examples, we establish multi-layer neural networks as both classifiers and predictors …

2017-06-08abs ↗pdf ↗

MSA compares neural representations' intrinsic geometry for better understanding.

problem Existing similarity measures fail to capture subtle distinctions between neural network solutions.
method Metric similarity analysis (MSA) using Riemannian geometry.
result MSA can disentangle features of neural computations and compare nonlinear dynamics.

We provide various formulations of knot homology that are predicted by string dualities. In addition, we also explain the rich algebraic structure of knot homology which can be understood in terms of geometric representation theory in these formulations. These notes are based on lectures in the workshop "Physics and Ma…

2015-10-07abs ↗pdf ↗

Transformer architectures show significant promise for natural language processing. Given that a single pretrained model can be fine-tuned to perform well on many different tasks, these networks appear to extract generally useful linguistic features. A natural question is how such networks represent this information in…

2019-06-06abs ↗pdf ↗

This paper presents the first use of graph neural networks (GNNs) for higher-order proof search and demonstrates that GNNs can improve upon state-of-the-art results in this domain. Interactive, higher-order theorem provers allow for the formalization of most mathematical theories and have been shown to pose a significa…

2019-05-24abs ↗pdf ↗

The problem behind this paper is the proper measurement of the degree of quality/acceptability/distance to arbitrage of trades. We are narrowing the class of coherent acceptability indices introduced by Cherny and Madan (2007) by imposing an additional mathematical property. For this, we introduce the notion of a conca…

2011-04-04abs ↗pdf ↗

Study dual representations for quasiconvex systemic risk measures.

problem Finding dual representations for quasiconvex systemic risk measures.
method Abstract infinite-dimensional setting, explicit formula for penalty function, nonstandard minimax inequality.
result Explicit formula for the penalty function of quasiconvex compositions.

It has long been recognized that the invariance and equivariance properties of a representation are critically important for success in many vision tasks. In this paper we present Steerable Convolutional Neural Networks, an efficient and flexible class of equivariant convolutional networks. We show that steerable CNNs …

2016-12-27abs ↗pdf ↗

While it has become common to perform automated translations on natural language, performing translations between different representations of mathematical formulae has thus far not been possible. We implemented the first translator for mathematical formulae based on recursive neural networks. We chose recursive neural…

2018-11-10abs ↗pdf ↗

Data visualization and interaction with large data sets is known to be essential and critical in many businesses today, and the same applies to research and teaching, in this case, when exploring large and complex mathematical objects. GAP is a computer algebra system for computational discrete algebra with an emphasis…

2018-06-19abs ↗pdf ↗