Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,694 papers · 148 categories

Trend · papers per month

20416181 · Jun 202019922001200920172026
48 results for Tensor Tricks

We show that solutions to certain higher-order intrinsic geometric flows on a compact manifold, including some flows generated by the ambient obstruction tensor, are unique. With the goal of providing a complete self-contained proof, details surrounding map covariant derivatives and a careful application of the DeTurck…

2014-07-16abs ↗pdf ↗

A popular trick for computing a pairwise co-occurrence matrix is the product of an incidence matrix and its transpose. We present an analog for higher order tuple co-occurrences using the face-splitting product, or alternately known as the transpose Khatri-Rao product. These higher order co-occurrences encode the commo…

2020-02-15abs ↗pdf ↗

We investigate the relationship between the algebra of tensor categories and the topology of framed 3-manifolds. On the one hand, tensor categories with certain algebraic properties determine topological invariants. We prove that fusion categories of nonzero global dimension are 3-dualizable, and therefore provide 3-di…

2013-12-27abs ↗pdf ↗

Bayesian Tensor Network combines prior and data likelihood for efficient prediction and parameter estimation.

problem Overfitting and poor performance in Tensor Network models.
method Introduce prior distribution, use Laplace approximation for posterior predictive distribution, and propose stable initialization for parameter estimation.
result Reduces overfitting and improves performance of Tensor Network models.

Kernelized cumulants improve statistical analysis in high-dimensional spaces.

problem Statistical analysis in high-dimensional spaces with low variance estimators.
method Extending cumulants to RKHS using tensor algebra and kernel trick.
result Kernelized cumulants provide new all-purpose statistics with computational tractability.

The Gumbel-max trick and its extensions simplify sampling from categorical distributions in machine learning.

problem Sampling from categorical distributions with unnormalized probabilities.
method Extensions of the Gumbel-max trick for various applications.
result Simplified and efficient methods for sampling and gradient estimation.

A new gradient estimator for categorical distributions reduces bias and variance.

problem Intractability of gradients for categorical distributions in discrete latent variable models.
method CatLog-Derivative trick and IndeCateR gradient estimator.
result IndeCateR reduces bias and variance of gradients for categorical distributions.

Retail Product Image Classification is an important Computer Vision and Machine Learning problem for building real world systems like self-checkout stores and automated retail execution evaluation. In this work, we present various tricks to increase accuracy of Deep Learning models on different types of retail product …

2020-01-12abs ↗pdf ↗

We demonstrate that the uniqueness of solutions to a broad class of parabolic geometric evolution equations can be proven via a direct and essentially classical energy argument which avoids the DeTurck trick entirely. Previously, we have used a variation of this technique to give an alternative proof and slight extensi…

2014-12-31abs ↗pdf ↗

Embolic volume of compact manifolds is defined in terms of Berger's embolic inequality. In this paper, we show a result of relating embolic volume to the first Betti number. The proof relies on Gromov's covering argument appeared in systolic geometry. Berger called this method covering trick. We exploit and present mor…

2019-11-02abs ↗pdf ↗

Expands Bredon's trick for applications in geometry and topology.

problem Local-to-global extension principles in geometric and topological contexts.
method Novel applications and frameworks for stratified pseudomanifolds, Ricci flow, and persistent homology.
result Establishes Bredon's trick as a unifying framework.

We observe that gradients computed via the reparameterization trick are in direct correspondence with solutions of the transport equation in the formalism of optimal transport. We use this perspective to compute (approximate) pathwise gradients for probability distributions not directly amenable to the reparameterizati…

2018-06-05abs ↗pdf ↗

We introduce a family of pairwise stochastic gradient estimators for gradients of expectations, which are related to the log-derivative trick, but involve pairwise interactions between samples. The simplest example of our new estimator, dubbed the fundamental trick estimator, is shown to arise from either a) introducin…

2019-01-31abs ↗pdf ↗

The Gumbel trick is a method to sample from a discrete probability distribution, or to estimate its normalizing partition function. The method relies on repeatedly applying a random perturbation to the distribution in a particular way, each time solving for the most likely configuration. We derive an entire family of r…

2017-06-13abs ↗pdf ↗

This work optimizes LLMs by reformulating attention networks and solving them in matrix multiplication time.

problem Optimizing the one-layer attention network objective function in LLMs.
method Provides an iterative greedy algorithm to train the loss function up to ε in time proportional to matrix multiplication.
result Solves the attention regression problem in matrix multiplication time.

An online reinforcement learning algorithm is anytime if it does not need to know in advance the horizon T of the experiment. A well-known technique to obtain an anytime algorithm from any non-anytime algorithm is the "Doubling Trick". In the context of adversarial or stochastic multi-armed bandits, the performance of …

2018-03-19abs ↗pdf ↗

Inference in popular nonparametric Bayesian models typically relies on sampling or other approximations. This paper presents a general methodology for constructing novel tractable nonparametric Bayesian methods by applying the kernel trick to inference in a parametric Bayesian model. For example, Gaussian process regre…

2011-03-09abs ↗pdf ↗

Study geometric flows of G2-structures, determining curvature and torsion invariants.

problem Investigate geometric flows of G2-structures and their invariants.
method Explicitly compute differential invariants, decompose curvature and torsion, analyze principal symbols.
result Established short-time existence and uniqueness for geometric flows of G2-structures.

The reparameterization trick has become one of the most useful tools in the field of variational inference. However, the reparameterization trick is based on the standardization transformation which restricts the scope of application of this method to distributions that have tractable inverse cumulative distribution fu…

2019-11-06abs ↗pdf ↗

Boltzmann machines (BMs) are appealing candidates for powerful priors in variational autoencoders (VAEs), as they are capable of capturing nontrivial and multi-modal distributions over discrete variables. However, non-differentiability of the discrete units prohibits using the reparameterization trick, essential for lo…

2018-05-18abs ↗pdf ↗

We discuss replica analytic continuation using several simple models in order to prove mathematically the validity of replica analysis, which is used in a wide range of fields related to large scale complex systems. While replica analysis consists of two analytical techniques, the replica trick (or replica analytic con…

2016-06-23abs ↗pdf ↗

Tricks adversarial attacks to target specific classes, improving classifier accuracy.

problem Recent adversarial defense approaches have failed to protect classifiers from untargeted attacks.
method Target Training defense tricks untargeted attacks into targeted attacks on designated classes, then derives the real class.
result 86.2% accuracy for CW-L2 (confidence=0) in CIFAR10, outperforming unsecured classifiers.

The reparameterization trick is widely used in variational inference as it yields more accurate estimates of the gradient of the variational objective than alternative approaches such as the score function method. Although there is overwhelming empirical evidence in the literature showing its success, there is relative…

2018-09-27abs ↗pdf ↗

Low-variance gradient estimation is crucial for learning directed graphical models parameterized by neural networks, where the reparameterization trick is widely used for those with continuous variables. While this technique gives low-variance gradient estimates, it has not been directly applicable to discrete variable…

2016-11-04abs ↗pdf ↗

We stabilize the Kumaraswamy distribution for efficient sampling and differentiation.

problem Numerical instabilities in the Kumaraswamy distribution's inverse CDF and log-pdf.
method Identified and resolved numerical issues, introduced a stabilized KS distribution.
result Stabilized Kumaraswamy distribution supports efficient sampling and differentiation.

Proposes a new model for RANS simulations with uncertainty.

problem Uncertainty in Reynolds-averaged Navier-Stokes simulations.
method Data-driven closure model with aleatoric uncertainty, Bayesian formulation, sparse indirect data.
result Accurate probabilistic predictions, even in regions of model error.

The paper proves symplectic neighbourhood theorems for stratified subspaces.

problem Finding symplectic neighbourhoods of stratified subspaces.
method Analogy with Weinstein's neighbourhood theorem, strong version of Moser's trick, and tubular neighbourhood theorem.
result Generalization of existing constructions for exotic Lagrangians.