Random features are improved by variance-reducing couplings, enhancing machine learning models.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
U-Net trained to recover acoustic interference striations from distorted data.
NetOTC compares and aligns directed or undirected networks via random walk transitions.
The aim here is to study the concept of pairing multifractality between time series possessing non-Gaussian distributions. The increasing number of rare events creates "criticality". We show how the pairing between two series is affected by rare events, which we call "coupled criticality". A method is proposed for stud…
A new method for approximating softmax and Gaussian kernels with reduced error.
Unified analytic account of correlation emergence and Epps effect in coupled limit order books
A coupling by reflection of a time-inhomogeneous diffusion process on a manifold are studied. The condition we assume is a natural time-inhomogeneous extension of lower Ricci curvature bounds. In particular, it includes the case of backward Ricci flow. As in time-homogeneous cases, our coupling provides a gradient esti…
We present a general framework, the coupled compound Poisson factorization (CCPF), to capture the missing-data mechanism in extremely sparse data sets by coupling a hierarchical Poisson factorization with an arbitrary data-generating model. We derive a stochastic variational inference algorithm for the resulting model …
This paper presents an introduction to the stochastic concepts of \emph{coupling} and \emph{copula}. Coupling means the construction of a joint distribution of two or more random variables that need not be defined on one and the same probability space, whereas a copula is a function that joins a multivariate distributi…
We investigate robustness of deep feed-forward neural networks when input data are subject to random uncertainties. More specifically, we consider regularization of the network by its Lipschitz constant and emphasize its role. We highlight the fact that this regularization is not only a way to control the magnitude of …
Linear-cost unbiased estimates for complex models via couplings.
We develop randomized (block) coordinate descent (CD) methods for linearly constrained convex optimization. Unlike most CD methods, we do not assume the constraints to be separable, but let them be coupled linearly. To our knowledge, ours is the first CD method that allows linear coupling constraints, without making th…
We construct a cut-off version of nonpertubative closed Bosonic string field theory in the light-cone gauge with imaginary string coupling constant. We show that the partition function is a continuous function of the string coupling constant, and conjecture a relation between the formal power series expansion of this p…
Using methods of statistical physics, we analyse the error of learning couplings in large Ising models from independent data (the inverse Ising problem). We concentrate on learning based on local cost functions, such as the pseudo-likelihood method for which the couplings are inferred independently for each spin. Assum…
Optimal coupling among random vectors with known statistics and correlation structure found using minimum spanning tree over measure-valued vertices.
Study optimal consumption and investment strategies with constraints in a market with random coefficients.
Continuous time random walks (CTRWs) are used in physics to model anomalous diffusion, by incorporating a random waiting time between particle jumps. In finance, the particle jumps are log-returns and the waiting times measure delay between transactions. These two random variables (log-return and waiting time) are typi…
The paper introduces a new method for tail bounds of random vectors and matrices.
We provide a verification and characterization result of optimal maximal sub-solutions of BSDEs in terms of fully coupled forward backward stochastic differential equations. We illustrate the application thereof in utility optimization with random endowment under probability and discounting uncertainty. We show with ex…
New MCMC method tackles label-switching problem for clustering.
Coupled entropy corrects flaws in Tsallis entropy for complex systems.
We describe and analyze some novel approaches for studying the dynamics of Ising spin glass models. We first briefly consider the variational approach based on minimizing the Kullback-Leibler divergence between independent trajectories and the real ones and note that this approach only coincides with the mean field equ…
New couplings improve understanding of molecular dynamics convergence.
New method uncovers zero entropy in dependent observations after finite samples.
ARK improves knockoffs robustness to feature distribution misspecification.
PURE-CD algorithm proves complexity bounds for convex-concave problems.
Deep learning solves non-Markovian FBSDEs for utility maximization.
SIMPLE-RC method tests group membership profiles in large networks with weak signals.
Effects of randomness on non-integer power law tails in multiplicatively interacting stochastic processes are investigated theoretically. Generally, randomness causes decrease of the exponent of tails and the growth rate of processes. Explicit calculations are performed for two examples: uniformly distributed and two p…
Recent theoretical work has established connections between over-parametrized neural networks and linearized models governed by he Neural Tangent Kernels (NTKs). NTK theory leads to concrete convergence and generalization results, yet the empirical performance of neural networks are observed to exceed their linearized …
We study the problem of identifying the causal relationship between two discrete random variables from observational data. We recently proposed a novel framework called entropic causality that works in a very general functional model but makes the assumption that the unobserved exogenous variable has small entropy in t…
Chimera state refers to coexistence of coherent and non-coherent phases in identically coupled dynamical units found in various complex dynamical systems. Identification of Chimera, on one hand is essential due to its applicability in various areas including neuroscience, and on other hand is challenging due to its wid…
MUSIC learns coupled systems with sparse data and incomplete physics.
We study partition functions of random Bergman metrics, with the actions defined by a class of geometric functionals known as `stability functions'. We introduce a new stability invariant - the critical value of the coupling constant - defined as the minimal coupling constant for which the partition function converges.…
Paper proposes BTuD for unsupervised feature selection.
Paper proposes diagnostics for error and variance estimation in randomized matrix computations.
Model simulates correlation emergence in two coupled limit order books.
New gradient estimators for discrete variables improve model training.
DGP learns speech recognition by modeling complex relationships between utterances.
We consider the problem of rational decision making in the presence of nonlinear constraints. By using tools borrowed from spin glass and random matrix theory, we focus on the portfolio optimisation problem. We show that the number of ``optimal'' solutions is generically exponentially large: rationality is thus de fact…
We establish convergence to an invariant measure as time tends to infinity, for a large class of (possibly non-Markovian) stochastic volatility models. Our arguments are based on a novel coupling idea for Markov chains which also extends to Markov chains in random environments in an efficient way.
In this paper we relate the partition function to the max-statistics of random variables. In particular, we provide a novel framework for approximating and bounding the partition function using MAP inference on randomly perturbed models. As a result, we can use efficient MAP solvers such as graph-cuts to evaluate the c…
Introduces a probabilistic framework for dimension reduction methods.
New methods link Calabi-Yau metrics to random matrices.
We consider the inverse Ising problem, i.e. the inference of network couplings from observed spin trajectories for a model with continuous time Glauber dynamics. By introducing two sets of auxiliary latent random variables we render the likelihood into a form, which allows for simple iterative inference algorithms with…
Gaussian processes have been successful in both supervised and unsupervised machine learning tasks, but their computational complexity has constrained practical applications. We introduce a new approximation for large-scale Gaussian processes, the Gaussian Process Random Field (GPRF), in which local GPs are coupled via…
We investigate the learning performance of the pseudolikelihood maximization method for inverse Ising problems. In the teacher-student scenario under the assumption that the teacher's couplings are sparse and the student does not know the graphical structure, the learning curve and order parameters are assessed in the …
We examine several aspects of explicability of a classification system built from neural networks. The first aspect is the pairwise explicability, which is the ability to provide the most accurate prediction when the range of possibilities is narrowed to just two. Next we consider explicability in development, which me…