Adaptive-stepsize MCMC sampling inspired by Adam optimizer.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
WALNUTS improves sampling efficiency and robustness for multi-scale distributions.
Improved MUSE boosts performance and reduces error in Bayesian inference.
Delayed rejection HMC improves sampling efficiency for multiscale distributions.
Study constructs non-funnel foliations in 3D manifolds.
A new layer, funnel, reduces dimensionality in flows for better performance.
The paper tackles decision making problems with funnel structure in email marketing campaigns.
Funnel-Transformer reduces computation by compressing sequence data.
Paper uses Shapley values to identify key confounders in product funnel data.
We establish a sharp geometric constant for the upper bound on the resonance counting function for surfaces with hyperbolic ends. An arbitrary metric is allowed within some compact core, and the ends may be of hyperbolic planar, funnel, or cusp type. The constant in the upper bound depends only on the volume of the cor…
Cross-lingual Text Classification (CLC) consists of automatically classifying, according to a common set C of classes, documents each written in one of a set of languages L, and doing so more accurately than when naively classifying each document via its corresponding language-specific classifier. In order to obtain an…
Descending phase retrieval algorithms show a phase transition with increasing sample complexity.
In this paper we prove that any Riemannian surface, with no restriction of curvature at all, can be decomposed into blocks belonging just to some of these types: generalized Y-pieces, generalized funnels and halfplanes.
A novel method for estimating Bayesian network (BN) parameters from data is presented which provides improved performance on test data. Previous research has shown the value of representing conditional probability distributions (CPDs) via neural networks(Neal 1992), noisy-OR gates (Neal 1992, Diez 1993)and decision tre…
New method for Bayesian neural networks with unbounded weights.
Multidimensional time series are sequences of real valued vectors. They occur in different areas, for example handwritten characters, GPS tracking, and gestures of modern virtual reality motion controllers. Within these areas, a common task is to search for similar time series. Dynamic Time Warping (DTW) is a common di…
We introduce the Pitman Yor Diffusion Tree (PYDT) for hierarchical clustering, a generalization of the Dirichlet Diffusion Tree (Neal, 2001) which removes the restriction to binary branching structure. The generative process is described and shown to result in an exchangeable distribution over data points. We prove som…
A major problem for the learning of Bayesian networks (BNs) is the exponential number of parameters needed for conditional probability tables. Recent research reduces this complexity by modeling local structure in the probability tables. We examine the use of log-linear local models. While log-linear models in this con…
Improves classifier performance in multi-stage selection processes.
New particle algorithms optimize latent variable models.
On compact surfaces with or without boundary, Osgood, Phillips and Sarnak proved that the maximum of the determinant of the Laplacian within a conformal class of metrics with fixed area occurs at a metric of constant curvature and, for negative Euler characteristic, exhibited a flow from a given metric to a constant cu…
Whilst deep neural networks have shown great empirical success, there is still much work to be done to understand their theoretical properties. In this paper, we study the relationship between random, wide, fully connected, feedforward networks with more than one hidden layer and Gaussian processes with a recursive ker…
We prove exact BNN posterior convergence to GP limit and provide sampling methods.
Study projective deformations of hyperbolic 3-orbifolds with turnover ends.
We define the beta diffusion tree, a random tree structure with a set of leaves that defines a collection of overlapping subsets of objects, known as a feature allocation. A generative process for the tree structure is defined in terms of particles (representing the objects) diffusing in some continuous space, analogou…
We propose a dynamical theory of market liquidity that predicts that the average supply/demand profile is V-shaped and {\it vanishes} around the current price. This result is generic, and only relies on mild assumptions about the order flow and on the fact that prices are (to a first approximation) diffusive. This natu…
The EM algorithm is one of the most popular algorithm for inference in latent data models. The original formulation of the EM algorithm does not scale to large data set, because the whole data set is required at each iteration of the algorithm. To alleviate this problem, Neal and Hinton have proposed an incremental ver…
In the context of science, the well-known adage "a picture is worth a thousand words" might well be "a model is worth a thousand datasets." In this manuscript we introduce the SciML software ecosystem as a tool for mixing the information of physical laws and scientific models with data-driven machine learning approache…
This paper removes the finite variance assumption for deep convolutional neural networks.
The automorphisms of a two-generator free group acting on the space of orientation-preserving isometric actions of on hyperbolic 3-space defines a dynamical system. Those actions which preserve a hyperbolic plane but not an orientation on that plane is an invariant subsystem, which reduces to an action on R^3 by polyno…
We introduce a differential refinement of Cohomotopy cohomology theory, defined on Penrose diagram spacetimes, whose cocycle spaces are unordered configuration spaces of points. First we prove that brane charge quantization in this differential 4-Cohomotopy theory implies intersecting p/(p+2)-brane moduli given by orde…
We propose and document the evidence for an analogy between the dynamics of granular counter-flows in the presence of bottlenecks or restrictions and financial price formation processes. Using extensive simulations, we find that the counter-flows of simulated pedestrians through a door display many stylized facts obser…
In the first part of this work we explore the geometry of infinite type surfaces and the relationship between its convex core and space of ends. In particular, we show that a geodesically complete hyperbolic surface is made up of its convex core with funnels attached along the simple closed geodesic components and half…
Study improves cryptocurrency price prediction using unlabeled text data.
Enhances random forests by smoothing predictions for better performance.
The paper compares Dirichlet and Neumann eigenvalues on various curved surfaces.
The Expectation-Maximization (EM) algorithm for mixture models often results in slow or invalid convergence. The popular convergence proof affirms that the likelihood increases with Q; Q is increasing in the M -step and non-decreasing in the E-step. The author found that (1) Q may and should decrease in some E-steps; (…
Maximizing product use is a central goal of many businesses, which makes retention and monetization two central analytics metrics in games. Player retention may refer to various duration variables quantifying product use: total playtime or session playtime are popular research targets, and active playtime is well-suite…
Develops a method for non-equilibrium importance sampling to estimate expectations and constants.
Improves classifier performance in multi-stage processes with adversarial autoencoders and multi-task learning.
A new method reduces complexity of normalizing flows for MCMC preconditioning.
Motivation: Ab initio protein docking represents a major challenge for optimizing a noisy and costly "black box"-like function in a high-dimensional space. Despite progress in this field, there is no docking method available for rigorous uncertainty quantification (UQ) of its solution quality (e.g. interface RMSD or iR…
Gauge theory connects hyperbolic metrics to Virasoro orbits, revealing their geometric and topological properties.
Bayesian optimization has become a fundamental global optimization algorithm in many problems where sample efficiency is of paramount importance. Recently, there has been proposed a large number of new applications in fields such as robotics, machine learning, experimental design, simulation, etc. In this paper, we foc…
Bayesian deep neural networks converge to processes with α-stable marginals under infinite variance weights.
Hyperelastic bodies in Riemannian manifolds can levitate due to curvature-induced forces.