New invertible transformations improve flow-based generative models.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Random features are improved by variance-reducing couplings, enhancing machine learning models.
A normalizing flow models a complex probability density as an invertible transformation of a simple base density. Flows based on either coupling or autoregressive transforms both offer exact density evaluation and sampling, but rely on the parameterization of an easily invertible elementwise transformation, whose choic…
Paper proves CFlows can approximate any diffeomorphism and applies it in Bayesian optimization.
Normalizing flows attempt to model an arbitrary probability distribution through a set of invertible mappings. These transformations are required to achieve a tractable Jacobian determinant that can be used in high-dimensional scenarios. The first normalizing flow designs used coupling layer mappings built upon affine …
A normalizing flow models a complex probability density as an invertible transformation of a simple density. The invertibility means that we can evaluate densities and generate samples from a flow. In practice, autoregressive flow-based models are slow to invert, making either density estimation or sample generation sl…
This article studies the geometry of moduli spaces of G2-manifolds, associative cycles, coassociative cycles and deformed Donaldson-Thomas bundles. We introduce natural symmetric cubic tensors and differential forms on these moduli spaces. They correspond to Yukawa couplings and correlation functions in M-theory. We ex…
In the two papers of this series, we initiate the development of a new approach to implementing the concept of symmetry in classical field theory, based on replacing Lie groups/algebras by Lie groupoids/algebroids, which are the appropriate mathematical tools to describe local symmetries when gauge transformations are …
We study a class of Poisson tensors on a fibered manifold which are compatible with the fiber bundle structure by the so-called almost coupling condition. In the case of a -dimensional orientable fibered manifolds with -dimensional bases, we describe a global behavior of almost coupling Poisson tensors and their …
New normalizing flows in hyperbolic space improve posterior modeling for hierarchical data.
We investigate the low-dimensional structure of deterministic transformations between random variables, i.e., transport maps between probability measures. In the context of statistics and machine learning, these transformations can be used to couple a tractable "reference" measure (e.g., a standard Gaussian) with a tar…
Study reveals geometric context of second-order superintegrable systems.
Many recent invertible neural architectures are based on coupling block designs where variables are divided in two subsets which serve as inputs of an easily invertible (usually affine) triangular transformation. While such a transformation is invertible, its Jacobian is very sparse and thus may lack expressiveness. Th…
There are eight possible Pin groups that can be used to describe the transformation behaviour of fermions under parity and time reversal. We show that only two of these are compatible with general relativity, in the sense that the configuration space of fermions coupled to gravity transforms appropriately under the spa…
Flexible framework for CMTF with ADMM for various constraints and couplings.
We consider type II string theory in space-time backgrounds which admit eight supercharges and can be characterized by the existence of an SU(3) x SU(3) structure. We show that the couplings of such backgrounds strongly resemble the couplings of four-dimensional N=2 supergravities and precisely coincide with the N=2 co…
We review the fundamentals of coupling constant metamorphosis (CCM) and the Stäckel transform, and apply them to map integrable and superintegrable systems of all orders into other such systems on different manifolds. In general, CCM does not preserve the order of constants of the motion or even take polynomials in the…
We give geometric explanations and proofs of various mirror symmetry conjectures for -invariant Calabi-Yau manifolds when instanton corrections are absent. This uses fiberwise Fourier transformation together with base Legendre transformation. We discuss mirror transformations of (i) moduli spaces of complex stru…
Study finds Stäckel equivalence for superintegrable systems via invariant quadrics.
CF-INNs can approximate any invertible function, resolving a long-standing problem.
A relation between gravity on Poisson manifolds proposed in arXiv:1508.05706 and Einstein gravity is investigated. The compatibility of the Poisson and Riemann structures defines a unique connection, the contravariant Levi-Civita connection, and leads to the idea of the contravariant gravity. The Einstein-Hilbert-type …
This paper shows how to approximate any log-concave distribution using well-conditioned affine coupling flows.
CAP-BM learns complex-valued data's amplitude and phase distributions.
DS2CF-Net learns hierarchical representations with deep coupled factorization and enriched prior.
Unified SVD compression fails in practical tasks, highlighting the importance of per layer activation reconstruction.
Transformers model contextual relations using probabilistic measures, revealing their expressive power.
Triangular flows ensure statistical consistency and fast rates in generative modeling.
We derive a system of equations governing the coupled gravitational and electromagnetic perturbations of Reissner-Nordström spacetime. The equations are derived in the context of global non-linear stability of Reissner-Nordström under axially symmetric polarized perturbations, as a generalization of the recent work on …
The paper explores transformations between power law problems and geodesics on cones.
We relate Miura type transformations (MTs) over an evolution system to its zero-curvature representations with values in Lie algebras g. We prove that certain homogeneous spaces of g produce MTs and show how to distinguish these spaces. For a scalar translation-invariant evolution equation this allows to classify all M…
A novel gravity theory based on Poisson Generalized Geometry is investigated. A gravity theory on a Poisson manifold equipped with a Riemannian metric is constructed from a contravariant version of the Levi-Civita connection, which is based on the Lie algebroid of a Poisson manifold. Then, we show that in Poisson Gener…
In prior work the authors introduced a parabolic flow for pluriclosed metrics, referred to as pluriclosed flow. We also demonstrated that this flow, after certain gauge transformations, gives a class of solutions to the renormalization group flow of the nonlinear sigma model with B-field. Using these transformations, w…
DGP learns speech recognition by modeling complex relationships between utterances.
In trying to provide explicit deformations of quadrics the starting point of our investigation is to use Bianchi's link between real deformations of totally real regions of real paraboloids and various totally real forms of the sine-Gordon equation coupled with Bianchi's simple observation that the vacuum soliton of th…
The Black Box Variational Inference (Ranganath et al. (2014)) algorithm provides a universal method for Variational Inference, but taking advantage of special properties of the approximation family or of the target can improve the convergence speed significantly. For example, if the approximation family is a transforma…
The framework of normalizing flows provides a general strategy for flexible variational inference of posteriors over latent variables. We propose a new type of normalizing flow, inverse autoregressive flow (IAF), that, in contrast to earlier published flows, scales well to high-dimensional latent spaces. The proposed f…
Many problems in machine learning involve calculating correspondences between sets of objects, such as point clouds or images. Discrete optimal transport provides a natural and successful approach to such tasks whenever the two sets of objects can be represented in the same space, or at least distances between them can…
Normalizing flows are shown to be equivalent to Bayesian networks, revealing new insights.
Method extracts features from signals for classification with explainability.
We describe an averaging procedure on a Dirac manifold, with respect to a class of compatible actions of a compact Lie group. Some averaging theorems on the existence of invariant realizations of Poisson structures around (singular) symplectic leaves are derived. We show that the construction of coupling Dirac structur…
Improved flow-based models capture dependencies better with multi-scale autoregressive priors.
By carrying out a rational transformation on the base curve of the Seiberg-Witten curve for supersymmetric pure -gauge theory, we obtain a family of Jacobian elliptic K3 surfaces of Picard rank 17. The isogeny relating the Seiberg-Witten curve for pure -ga…
The paper prices weather contracts using a complex temperature model.
Paper classifies minimal graph transformations into new families of surfaces.
New analysis shows how cross-entropy training shapes attention in transformers.
Exploiting low-rank structure of the user-item rating matrix has been the crux of many recommendation engines. However, existing recommendation engines force raters with heterogeneous behavior profiles to map their intrinsic rating scales to a common rating scale (e.g. 1-5). This non-linear transformation of the rating…
A new method for approximating softmax and Gaussian kernels with reduced error.
New equations describe surfaces with constant curvature.