BigGAN achieves state-of-the-art image synthesis on ImageNet.
problem Generating high-fidelity images from complex datasets like ImageNet.
method Trained a large-scale GAN with orthogonal regularization and a truncation trick.
result Improved Inception Score (IS) of 166.5 and Frechet Inception Distance (FID) of 7.4.
Paper proposes a new estimator for generic discrete distributions.
problem Estimating gradients for stochastic nodes in deep generative models.
method Generalized Gumbel-Softmax estimator using truncation, Gumbel-Softmax trick, and linear transformation.
result Efficacy and practical value demonstrated in synthetic examples and topic models.
Maps embed manifolds using heat kernels of connection Laplacian.
problem Embedding manifolds in Euclidean space.
method Using heat kernels of the connection Laplacian and truncated heat kernels.
result Maps can be made arbitrarily close to isometries.
Chromatic Learning reduces feature dimensions for sparse datasets.
problem Sparse, high-dimensional data challenges traditional learning methods.
method Graph coloring over co-occurrence graph to create dense feature representation.
result Compresses sparse datasets significantly while maintaining model accuracy.
Paper defines embolic volume and relates it to Betti number using the covering trick.
problem Relating embolic volume to topological invariants.
method Covering trick from systolic geometry applied to Berger's inequality.
result Relates embolic volume to the first Betti number.
Study of skateboard flips as continuous curves in SO(3) group.
problem Characterize skateboard flip tricks as continuous motions.
method Model flips as curves in SO(3), analyze lifts to S3, derive formulas. result There are only four distinct flip tricks up to continuous deformation.
A new method centers outliers in robust PCA without manual intervention.
problem Outliers in robust PCA require manual centering, complicating the analysis.
method Introduces a 'bias trick' to automatically center non-outliers.
result First optimal RPCA algorithm with automatic centering.
Nash's theorem proved with Günther's trick
problem Proving Nash's smooth embedding theorem
method Using Günther's trick
result Nash's theorem proved
Explains Conway's tangle trick and its mathematical origins.
problem Understanding the relationship between braids and elliptic curves.
method Discusses the tangle trick, its mathematical underpinnings, and historical context.
result Establishes the connection between braids and elliptic curves.
Unified framework for gradient estimation in combinatorial spaces.
problem Scaling relaxed gradient estimators to large combinatorial distributions.
method Introducing stochastic softmax tricks within the perturbation model framework.
result Stochastic softmax tricks improve model performance and discover more latent structure.
We prove all knots can be transformed into a trefoil using special diagrams.
problem Transforming any knot into a trefoil using magic tricks.
method Introducing knotholder diagrams to encode transformations.
result All knots can be transformed into a trefoil.
Geometric trick simplifies link homotopy and concordance.
problem Homotopy and concordance of links in homology spheres.
method Relative Whitney trick to remove double points.
result Links in homology spheres can be simplified to topologically slice links.
The Gumbel-max trick and its extensions simplify sampling from categorical distributions in machine learning.
problem Sampling from categorical distributions with unnormalized probabilities.
method Extensions of the Gumbel-max trick for various applications.
result Simplified and efficient methods for sampling and gradient estimation.
Tricks improve retail product image classification accuracy.
problem Retail Product Image Classification
method Various tricks including a new LCA layer, Instagram-pretrained Convnet, and Maximum Entropy loss.
result Increased accuracy of fine-tuned convnets by a large margin.
A new gradient estimator for categorical distributions reduces bias and variance.
problem Intractability of gradients for categorical distributions in discrete latent variable models.
method CatLog-Derivative trick and IndeCateR gradient estimator.
result IndeCateR reduces bias and variance of gradients for categorical distributions.
Establishes necessary and sufficient conditions for smooth triviality of Lie subalgebras and Lie ideals, and proves Moser's trick for foliations.
problem Smooth triviality of Lie subalgebras and Lie ideals
method Establishing necessary and sufficient conditions and proving Moser's trick for foliations
result Direct proof of Moser's trick for foliations
Triple-point Whitney trick classifies ornaments of 3-manifolds.
problem Classifying ornaments of 3-manifolds in high dimensions.
method Triple-point Whitney trick applied to orientable manifolds.
result Classification of ornaments by the μ-invariant.
Alexander trick applied to homology spheres for manifold homeomorphisms.
problem Group of homeomorphisms of contractible manifolds.
method Strong uniqueness statement for one-sided h-cobordisms.
result Group of homeomorphisms is contractible for d≥6. Expands Bredon's trick for applications in geometry and topology.
problem Local-to-global extension principles in geometric and topological contexts.
method Novel applications and frameworks for stratified pseudomanifolds, Ricci flow, and persistent homology.
result Establishes Bredon's trick as a unifying framework.
The problem of an arbitrary truncated Levy flight description using the method of cumulant approach has been solved. The set of cumulants of the truncated Levy distribution given the assumption of arbitrary truncation has been found. The influence of truncation shape on the truncated Levy flight properties in the Gauss…
Paper generalizes reparameterization trick for broader applicability.
problem Limited applicability of reparameterization trick to specific distributions.
method Introduces a generalized transformation-based gradient method.
result Proposed model combines advantages of control variates and generalized reparameterization.
Bredon's trick helps extend local properties to global topological spaces.
problem Extending local properties to global topological spaces.
method Bredon's trick for local properties to global spaces.
result Bredon's trick allows for natural alternative demonstrations of classic results.
Truncated CauchyNMF robustly learns subspaces from noisy data.
problem Outliers in non-negative matrix factorization (NMF) cause failure.
method Proposes Truncated CauchyNMF loss to handle outliers.
result Theoretical analysis and experimental validation show Truncated CauchyNMF's robustness.
Efficiently estimate Boolean product distribution parameters from truncated samples.
problem Estimating parameters of Boolean product distributions from truncated samples.
method Introducing fatness of truncation set, using membership queries, and adapting Stochastic Gradient Descent.
result Efficiently learn Boolean product distributions from truncated samples with small sample complexity.
Reparameterization trick yields more accurate gradient estimates in variational inference.
problem Improving gradient estimates in variational inference.
method Idealized analysis of mean-field Gaussian approximations and quadratic log densities.
result Marginal variances of reparameterization gradient are smaller than score function gradient.
In the paper "On Truncated Variation of Brownian Motion with Drift" (Bull. Pol. Acad. Sci. Math. 56 (2008), no.4, 267 - 281) we defined truncated variation of Brownian motion with drift, Wt=Bt+μt,t≥0, where (Bt) is a standard Brownian motion. Truncated variation differs from regular variation by neglect…
We observe that gradients computed via the reparameterization trick are in direct correspondence with solutions of the transport equation in the formalism of optimal transport. We use this perspective to compute (approximate) pathwise gradients for probability distributions not directly amenable to the reparameterizati…
The Gumbel trick is a method to sample from a discrete probability distribution, or to estimate its normalizing partition function. The method relies on repeatedly applying a random perturbation to the distribution in a particular way, each time solving for the most likely configuration. We derive an entire family of r…
Optimal algorithm learns Gaussian under halfspace truncation with minimal samples.
problem Learning a Gaussian distribution truncated to an unknown halfspace.
method Efficient algorithm using n=ildeO(d2/ε2) samples and runtime dominated by empirical covariance matrix computation. result Optimal sample and time complexity bounds for learning a Gaussian under halfspace truncation.
An online reinforcement learning algorithm is anytime if it does not need to know in advance the horizon T of the experiment. A well-known technique to obtain an anytime algorithm from any non-anytime algorithm is the "Doubling Trick". In the context of adversarial or stochastic multi-armed bandits, the performance of …
New method for constructing truncated vine copulas.
problem High-dimensional parameter space in vine copulas.
method Propose a new score and algorithm for constructing truncated vines.
result New algorithms exploit conditional independences.
Study of embedding calculus using infinite operads.
problem Spaces of embeddings and automorphisms of manifolds.
method Infinite operadic towers and Morita (∞,2)-categories. result Generalization of embedding calculus to bordism categories.
Inference in popular nonparametric Bayesian models typically relies on sampling or other approximations. This paper presents a general methodology for constructing novel tractable nonparametric Bayesian methods by applying the kernel trick to inference in a parametric Bayesian model. For example, Gaussian process regre…
New methods for estimating gradients of expectations using pairwise interactions.
problem Estimating gradients of expectations for complex models.
method Introducing new pairwise stochastic gradient estimators based on the log-derivative trick and reparameterisation.
result New estimators are unbiased and offer variance reduction compared to the log-derivative estimator.
Paper proposes approximate Stein classes for efficient truncated density estimation.
problem Difficulties in estimating truncated density models due to intractable normalising constants and boundary conditions.
method Adapts score matching to solve the problem, introduces approximate Stein classes and a novel discrepancy measure, TKSD.
result TKSD does not require a fixed weighting function and can be evaluated using only boundary samples, leading to improved accuracy.
Paper defines new risk measures for elliptical distributions.
problem Risk measurement for elliptical distributions.
method DTM, DTS, DTK definitions and formula derivation for specific distributions.
result Explicit formulas for DTE, DTV, DTS, and DTK for various distributions.
New trick builds hyperbolic manifolds from compact ones, proving some don't virtually fiber.
problem Proving some hyperbolic manifolds don't virtually fiber.
method Hyperbolic reflection group trick, embedding theory, manifold topology.
result Constructed Gromov hyperbolic 7-manifolds that don't virtually fiber over a circle.
Paper proposes a method to estimate truncated density models using Score Matching.
problem Estimating parameters of truncated probability densities.
method Score Matching with a novel weight function derived from Stein discrepancy.
result The proposed method minimizes a weighted Fisher divergence and corrects outlier-trimming bias.
New DP framework using data truncation for efficient estimation.
problem Differential privacy in unbounded data support.
method Data truncation, exponential family distributions, maximum likelihood estimation, DP stochastic gradient descent.
result Near-optimal sample complexity for Gaussian mean and covariance estimation.
The study offers conditions for Darboux charts on specific types of manifolds.
problem Existence of Darboux charts on weakly symplectic manifolds.
method Using Moser's trick to find sufficient conditions.
result Sufficient conditions for Darboux charts on weakly symplectic manifolds.
Boltzmann machines (BMs) are appealing candidates for powerful priors in variational autoencoders (VAEs), as they are capable of capturing nontrivial and multi-modal distributions over discrete variables. However, non-differentiability of the discrete units prohibits using the reparameterization trick, essential for lo…
Unified framework for mean testing under truncation bias.
problem High-dimensional mean testing under arbitrary truncation.
method Characterizes fundamental limits and develops a simple second-order test.
result Unified framework connects finite-moment, sub-Gaussian, and median-regular structural regimes.
Score matching method improves density estimation for truncated data on manifolds.
problem Density estimation for truncated data on manifolds with intractable normalising constant.
method Truncated score matching extended to Riemannian manifolds with boundary.
result Score matching estimator approximates true parameter values with low error.
The paper provides estimates for flows on Riemannian manifolds using truncated expansions.
problem Quantifying the relationship between flows on Riemannian manifolds and their truncated logarithms.
method Using truncated versions of the Magnus and Baker-Cambel-Hausdorff-Dynkin expansions.
result Quantitative estimates between flows and their truncated logarithms.
Link framings can only change when a 3-manifold has a non-separating sphere.
problem Understanding how framings of links can change in 3-manifolds.
method Using McCullough's work on mapping class groups and the Dirac trick.
result Link framings can only change in specific 3-manifolds with a non-separating sphere.
Algorithm estimates Gaussian parameters under unknown truncation sets.
problem Estimating Gaussian parameters when samples are truncated to unknown sets.
method Efficient algorithm for arbitrary unknown truncation sets, using Gaussian surface area as complexity measure.
result Algorithm works for large families of sets including intersections of halfspaces and general convex sets.
New method for simplifying knots with specific properties.
problem Understanding knots with a specific unknotting number.
method Derive and apply the Montesinos trick for proper rational tangle replacement.
result Prove that knots with proper rational unknotting number one are prime and classify certain types.
A new method samples sequences without replacement using Gumbel-Top-k trick.
problem Sampling sequences without replacement from large domains efficiently.
method Gumbel-Top-k trick applied to Stochastic Beam Search.
result Efficient sampling with linear model evaluations in k.