Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

4590135180 · Jun 202019922001200920172026
48 results for Non-linear Embeddings

This paper introduces an acceleration structure for hyperbolic embeddings.

problem Efficiently embedding and visualizing high-dimensional data in hyperbolic spaces.
method Building upon a polar quadtree, the paper introduces a new acceleration structure for hyperbolic embeddings.
result The new method computes embeddings in significantly less time compared to existing methods.

Graph embedding learns low-dimensional representations for nodes in a graph and effectively preserves the graph structure. Recently, a significant amount of progress has been made toward this emerging research area. However, there are several fundamental problems that remain open. First, existing methods fail to preser…

2019-05-16abs ↗pdf ↗

We introduce a new distance metric for non-linear embeddings of Tempered Exponential Measures.

problem Non-linear embeddings of Tempered Exponential Measures (TEMs).
method Parameterization of finite discrete TEMs via Legendre functions, introducing tempered Hilbert co-simplex distance.
result Established a generalization of the Hilbert log cross-ratio simplex distance to a tempered Hilbert co-simplex distance.

Unified framework for non-linear attention using modern Hopfield networks.

problem Improving transformer model's understanding of complex relationships and efficiency.
method Proposes an energy functional based on Modern Hopfield Networks (MNH) to unify linear and non-linear attention mechanisms.
result Context wells encapsulate contextual relationships among tokens, offering a richer representation of non-linear data.

We propose a novel node embedding of directed graphs to statistical manifolds, which is based on a global minimization of pairwise relative entropy and graph geodesics in a non-linear way. Each node is encoded with a probability density function over a measurable space. Furthermore, we analyze the connection between th…

2019-05-24abs ↗pdf ↗

A new method estimates rare failure events in complex systems.

problem Estimating the probability of rare failure events in non-linear systems.
method Stochastic Spectral Embedding (SSE) combined with modifications for efficient rare event estimation.
result Rare failure probability decomposed into conditional probabilities for easier computation.

The paper generalizes equivariant neural networks on homogeneous spaces to the non-linear setting.

problem Equivariant neural networks on homogeneous spaces.
method Deriving generalized steerability constraints for non-linear equivariant layers.
result The universality of the derived construction for non-linear equivariant layers.

SAFLe solves federated learning's trade-off between non-linearity and scalability.

problem Federated Learning's high communication overhead and performance collapse on non-IID data.
method SAFLe introduces a structured head of bucketed features and sparse, grouped embeddings, mathematically equivalent to a high-dimensional linear regression.
result SAFLe achieves a new state-of-the-art in analytic FL, outperforming linear AFL and multi-round DeepAFL.

Proves local isometric embedding of low-differentiability metrics in 3D space.

problem Isometric embedding of metrics of low differentiability in Euclidean 3-space.
method Simplified notation, geodesic and level parameters, solutions of initial value problems for first order non-linear PDEs, classical linear algebraic systems.
result Local isometric embedding exists for metrics of C1 differentiability.

The local linear embedding algorithm (LLE) is a non-linear dimension-reducing technique, widely used due to its computational simplicity and intuitive approach. LLE first linearly reconstructs each input point from its nearest neighbors and then preserves these neighborhood relations in the low-dimensional embedding. W…

2008-08-06abs ↗pdf ↗

Broadens Jourdain and Martini's method to non-linear stochastic processes.

problem Applying pricing methods to non-linear stochastic processes.
method Analyzes from probabilistic and analytic viewpoints, extending Jourdain and Martini's method.
result Broadens applicability of pricing methods to non-linear frameworks.

Improved CAEs reduce training time and enhance generalization.

problem Stability issues in Concrete Autoencoders (CAEs) for feature selection.
method Indirectly Parameterized Concrete Autoencoders (IP-CAEs) learn parameters of Gumbel-Softmax distributions.
result IP-CAEs achieve significant improvements in generalization and training time.

Matrix completion works well for smooth non-linear structures, even without low-rank assumptions.

problem Matrix completion for smooth non-linear structures.
method Nuclear-norm penalization for matrices lying in a low-dimensional non-linear manifold.
result Nuclear-norm penalization is minimax rate optimal for recovering smooth non-linear matrices with missing data.

A basic problem in machine learning is to find a mapping ff from a low dimensional latent space Y\mathcal{Y} to a high dimensional observation space X\mathcal{X}. Modern tools such as deep neural networks are capable to represent general non-linear mappings. A learner can easily find a mapping which perfectly fits a…

2018-11-05abs ↗pdf ↗

Diffusion maps are an emerging data-driven technique for non-linear dimensionality reduction, which are especially useful for the analysis of coherent structures and nonlinear embeddings of dynamical systems. However, the computational complexity of the diffusion maps algorithm scales with the number of observations. T…

2018-02-23abs ↗pdf ↗

We propose to formulate multi-label learning as a estimation of class distribution in a non-linear embedding space, where for each label, its positive data embeddings and negative data embeddings distribute compactly to form a positive component and negative component respectively, while the positive component and nega…

2019-11-17abs ↗pdf ↗

Improves hierarchical clustering in Euclidean space using autoencoders.

problem Lack of unsupervised methods for learning hierarchical structure in Euclidean space.
method Variational autoencoder with Gaussian mixture prior, rescaling latent space, and Ward's linkage.
result Improved dendrogram purity and Moseley-Wang cost function results.

We propose a new embedding method which is particularly well-suited for settings where the sample size greatly exceeds the ambient dimension. Our technique consists of partitioning the space into simplices and then embedding the data points into features corresponding to the simplices' barycentric coordinates. We then …

2020-02-05abs ↗pdf ↗

Manifold embedding algorithms map high-dimensional data down to coordinates in a much lower-dimensional space. One of the aims of dimension reduction is to find intrinsic coordinates that describe the data manifold. The coordinates returned by the embedding algorithm are abstract, and finding their physical or domain-r…

2018-11-29abs ↗pdf ↗

Modeling dynamical systems is important in many disciplines, e.g., control, robotics, or neurotechnology. Commonly the state of these systems is not directly observed, but only available through noisy and potentially high-dimensional observations. In these cases, system identification, i.e., finding the measurement map…

2014-10-28abs ↗pdf ↗

This study compares mtl architectures for renewable power generation forecasting.

problem Forecasting expected power generation for renewable power plants.
method Comparative study of mtl architectures including Hard parameter sharing, cross-stitch network, sluice network, and task embedding.
result Emerging Relation Network (ERN) and task embedding provide significant improvements in forecasting.

In this paper, we generalize the famous Hasimoto's transformation by showing that the dynamics of a closed unidimensional vortex filament embedded in a three-dimensional manifold of constant curvature gives rise under Hasimoto's transformation to the non-linear Schrodinger equation. We also give a natural interpretatio…

2012-04-24abs ↗pdf ↗

In this paper, benefiting from the strong ability of deep neural network in estimating non-linear functions, we propose a discriminative embedding function to be used as a feature extractor for clustering tasks. The trained embedding function transfers knowledge from the domain of a labeled set of morphologically-disti…

2018-05-07abs ↗pdf ↗

The paper studies how adding an ℓ2 penalty affects network embeddings.

problem The impact of ℓ2 regularization on network embeddings.
method Analyzes the asymptotic behavior of ℓ2 regularized node2vec embeddings under graphon theory.
result The learned embeddings asymptotically form a graphon with a nuclear-norm-type penalty.

We discuss from a geometric point of view the connection between the renormalization group flow for non--linear sigma models and the Ricci flow. This offers new perspectives in providing a geometrical landscape for 2D quantum field theories. In particular we argue that the structure of Ricci flow singularities suggests…

2010-01-20abs ↗pdf ↗

Variational auto-encoder frameworks have demonstrated success in reducing complex nonlinear dynamics in molecular simulation to a single non-linear embedding. In this work, we illustrate how this non-linear latent embedding can be used as a collective variable for enhanced sampling, and present a simple modification th…

2018-01-02abs ↗pdf ↗

Generalizing the canonical symplectization of contact manifolds, we construct an infinite dimensional non-linear Stiefel manifold of weighted embeddings into a contact manifold. This space carries a symplectic structure such that the contact group and the group of reparametrizations act in a Hamiltonian fashion with eq…

2019-09-24abs ↗pdf ↗

The paper proves local isometric embeddings for singular metrics near a point.

problem Existence of local isometric embeddings for singular Riemannian metrics.
method Ramified local isometric embeddings using Leray's ramified Cauchy-Kovalevskaya Theorem.
result Existence of local analytic isometric embeddings into Euclidean space.