CMRFs extend PGMs for topological data, capturing both conditional and marginal dependencies.
problem Limited expressiveness of PGMs for topological data.
method Introducing Colored Markov Random Fields (CMRFs) that model Gaussian edge variables on topological spaces.
result CMRFs improve distributed estimation over physical networks compared to baselines.
Develops a new framework for conditional independence.
problem Generalizing previous notions of conditional independence.
method Introduces transition probability spaces and transitional random variables.
result Satisfies all desired relevance relations except symmetry.
Sharp concentration results for sums of heavy-tailed random variables.
problem Analyzing sums of independent heavy-tailed random variables.
method Using concentration inequalities and large deviation principles for distributions satisfying specific tail bounds.
result Sharp concentration inequalities and large deviation results for sums of heavy-tailed random variables.
Generalizes data thinning for various distributions.
problem Thinning random variables without losing information.
method Relaxes summation requirement to sufficiency.
result Generalizes thinning to more distributions.
A concentration graph associated with a random vector is an undirected graph where each vertex corresponds to one random variable in the vector. The absence of an edge between any pair of vertices (or variables) is equivalent to full conditional independence between these two variables given all the other variables. In…
DIET tests conditional independence using marginal dependence measures of residual information.
problem Computational intractability of conditional randomization tests (CRTs).
method DIET avoids fitting large models by leveraging marginal independence statistics of information residuals.
result DIET achieves higher power than other tractable CRTs on synthetic and real benchmarks.
New AI-block models for clustering high-dimensional variables based on maxima of random processes.
problem Clustering high-dimensional variables with weakly dependent maxima of random processes.
method Asymptotic Independent block (AI-block) models and an algorithm for variable clustering.
result The proposed AI-block models and algorithm can effectively identify clusters in high-dimensional data.
We describe a method for unmixing mixtures of freely independent random variables in a manner analogous to the independent component analysis (ICA) based method for unmixing independent random variables from their additive mixtures. Random matrices play the role of free random variables in this context so the method we…
New class of heavy-tailed distributions shows weighted averages dominate individual variables.
problem Understanding and comparing risks in heavy-tailed distributions.
method Introducing a new class of heavy-tailed distributions and proving stochastic dominance relations.
result Weighted averages of random variables in this class are stochastically larger than individual variables.
Modeling financial returns as conditionally independent random variables explains power-law tails.
problem Understanding the distribution of financial returns and their relation to volatility.
method Assuming returns are conditionally independent given volatility, which varies randomly over time.
result Returns distribution can be described by the sum of conditionally independent random variables, showing scaling and power-law tails.
Paper extends stochastic dominance for compound binomial distributions.
problem Stochastic dominance for infinite-mean random variables.
method Investigates properties and inclusion relationships of distribution classes, extends results to compound binomial distributions.
result Establishes necessary and sufficient conditions for first-order stochastic dominance preservation.
We consider N Bernoulli random variables, which are independent conditional on a common random factor determining their probability distribution. We show that certain expected functionals of the proportion LN of variables in a given state converge at rate 1/N as N→∞. Based on these results, we …
The paper deals with distribution of singular values of product of random matrices arising in the analysis of deep neural networks. The matrices resemble the product analogs of the sample covariance matrices, however, an important difference is that the population covariance matrices, which are assumed to be non-random…
In this work, we consider an extension of graphical models to random graphs, trees, and other objects. To do this, many fundamental concepts for multivariate random variables (e.g., marginal variables, Gibbs distribution, Markov properties) must be extended to other mathematical objects; it turns out that this extensio…
Diversification improves profits for heavy-tailed investments.
problem Investment portfolios of Pareto-distributed returns.
method Stochastic dominance and majorization order.
result Diversification increases first-order stochastic dominance for heavy-tailed returns.
The Lugannani-Rice formula is a saddlepoint approximation method for estimating the tail probability distribution function, which was originally studied for the sum of independent identically distributed random variables. Because of its tractability, the formula is now widely used in practical financial engineering as …
Proves new concentration inequalities for sub-gaussian and sub-exponential variables.
problem Understanding functions of independent random variables better.
method Sub-gaussian and sub-exponential conditions, Rademacher complexities, Lipschitz function classes.
result Extension of Rademacher complexities to unbounded sub-exponential distributions.
This note displays an interesting phenomenon for percentiles of independent but non-identical random variables. Let X1,⋯,Xn be independent random variables obeying non-identical continuous distributions and X(1)≥⋯≥X(n) be the corresponding order statistics. For any p∈(0,1), we investig…
Forré introduces a new conditional independence notion for mixed variables.
problem Unified framework for random and non-stochastic variables.
method Unified framework of transitional conditional independence and causal calculus for iDMGs.
result Unified framework connects conditional independencies to graphical separation criteria.
LMMVAE improves VAE for correlated data by separating latent variables into fixed and random parts.
problem Correlated data in tabular and image datasets.
method Integrates random effects into VAE architecture, separating latent variables into fixed and random parts.
result Significant improvement in reconstruction error and likelihood loss on unseen data.
New method allows generating independent data matrices from summary statistics.
problem Generating independent data matrices from summary statistics like mean and covariance.
method Thinning a Wishart random matrix based on sample mean and covariance.
result It is possible to generate two independent data matrices from summary statistics.
The independence clustering problem is considered in the following formulation: given a set S of random variables, it is required to find the finest partitioning {U1,…,Uk} of S into clusters such that the clusters U1,…,Uk are mutually independent. Since mutual independence is the target, pairwise …
Recently, the binary expansion testing framework was introduced to test the independence of two continuous random variables by utilizing symmetry statistics that are complete sufficient statistics for dependence. We develop a new test based on an ensemble approach that uses the sum of squared symmetry statistics and di…
A new non parametric approach to the problem of testing the independence of two random process is developed. The test statistic is the Hilbert Schmidt Independence Criterion (HSIC), which was used previously in testing independence for i.i.d pairs of variables. The asymptotic behaviour of HSIC is established when compu…
We develop a new framework of uncertainty variables to model uncertainty. An uncertainty variable is characterized by an uncertainty set, in which its realization is bound to lie, while the conditional uncertainty is characterized by a set map, from a given realization of a variable to a set of possible realizations of…
Note improves confidence bounds for random variables.
problem Improving confidence bounds for random variables with unbounded ranges and different distributions.
method PAC-Bayes-ification of a derived confidence bound.
result Streamlined proofs for existing results.
Optimal transport is #P-hard when components are independent, even with approximate solutions.
problem Computational complexity of optimal transport with independent marginals.
method Proved #P-hardness and developed a pseudo-polynomial time approximation algorithm.
result Optimal transport is #P-hard even with independent components and approximate solutions.
Unexpectedly, weighted Pareto variables are stochastically dominant.
problem Understanding stochastic dominance in Pareto distributions.
method Analyzing weighted averages of Pareto random variables with infinite mean.
result The weighted average of Pareto variables is stochastically dominant.
Researchers study the conformal geometry of bivariate Gaussian manifolds.
problem Exploring the conformal structure of Fisher-Rao metric on statistical manifolds.
method Determined invariants of the conformal structure of the Fisher-Rao metric on the bivariate Gaussian manifold.
result The conformal holonomy group is SO0(1,6) for generic random variables, but SO0(1,4) for independent ones. A new algorithm FastGM speeds up generating Gumbel-Max variables.
problem Efficiently generating multiple Gumbel-Max variables from high-dimensional vectors.
method FastGM reduces time complexity from O(kn+) to O(klnk+n+) by generating variables in descending order. result Significantly reduces computation time for generating k Gumbel-Max variables. We prove non-asymptotic lower bounds on the expectation of the maximum of d independent Gaussian variables and the expectation of the maximum of d independent symmetric random walks. Both lower bounds recover the optimal leading constant in the limit. A simple application of the lower bound for random walks is an (…
Simple conditions for comonotonic additive risk measures from acceptance sets.
problem Conditions for comonotonic additive risk measures from acceptance sets.
method Conditions on acceptance sets for induced comonotonic additive risk measures.
result Acceptance sets induce comonotonic additive risk measures if and only if the acceptance sets and their complements are stable under convex combinations of comonotonic random variables.
BEGIN network models binary data without parametric assumptions.
problem Conditional independence in non-parametric families of binary data.
method BEGIN network models binary data using sparse linear representations and block factorizations.
result BEGIN network captures conditional independence for arbitrary binary and multinomial variables.
Let Xλ1,…,Xλn be dependent non-negative random variables and Yi=IpiXλi, i=1,…,n, where Ip1,…,Ipn are independent Bernoulli random variables independent of Xλi's, with E[Ipi]=pi, i=1,…,n. In actuarial sciences, Yi corresponds to the claim amo…
New method detects causal relationships from noisy measurements.
problem Discover causal relationships from noisy, imperfect measurements.
method Transformed Independent Noise (TIN) condition and ordered group decomposition.
result Identifies causal graph structure without over-complete ICA.
New sampling method for Heston model reduces complexity.
problem Efficient sampling for Heston model's time integrated variance.
method Series expansion, change of measure, Chebyshev polynomial approximations.
result Strong, efficient sampling scheme established for Heston model.
Bayesian networks, and especially their structures, are powerful tools for representing conditional independencies and dependencies between random variables. In applications where related variables form a priori known groups, chosen to represent different "views" to or aspects of the same entities, one may be more inte…
Sharp concentration bounds for i.i.d. variables.
problem Controlling the tail probabilities of independent variables.
method Extension of Sanov's theorem using large deviations and information theory.
result Matching concentration and anti-concentration bounds for i.i.d. samples of any size.
RaSE screens variables via random subspaces, identifying joint effects.
problem Missing joint effects of predictors in ultra-high dimensional data.
method Random Subspace Ensemble (RaSE) framework combining subspace evaluation criteria.
result RaSE identifies signals with no marginal effect or high-order interactions.
New method speeds up HSIC for multiple variables.
problem Quadratic computational complexity of HSIC for multiple variables.
method Nyström approximation to HSIC for M≥2. result Consistent Nyström HSIC estimator for M≥2. We propose the Sobolev Independence Criterion (SIC), an interpretable dependency measure between a high dimensional random variable X and a response variable Y . SIC decomposes to the sum of feature importance scores and hence can be used for nonlinear feature selection. SIC can be seen as a gradient regularized Integr…
New algorithms test independence with fewer samples by using predictive information.
problem Testing independence of distributions with limited samples.
method Augmented distribution testing framework that incorporates predictive information.
result Optimal sample complexity achieved, matching lower bounds.
A new efficient test addresses limitations of knockoffs for conditional independence testing.
problem Testing conditional independence under model-X assumptions.
method Leave-One-Covariate-Out Conditional Randomization Test (LOCO-CRT)
result LOCO-CRT produces valid p-values for familywise error rate control with minimal variability. We prove semi-empirical concentration inequalities for random variables which are given as possibly nonlinear functions of independent random variables. These inequalities describe concentration of random variable in terms of the data/distribution-dependent Efron-Stein (ES) estimate of its variance and they do not requ…
Bayesian networks are simplified for categorical variables using staged trees and asymmetry-labeled DAGs.
problem Representing non-symmetric conditional independences in Bayesian networks.
method Formalized relationship between Bayesian networks and staged trees, introduced asymmetry-labeled DAGs, and developed an algorithm to learn staged trees.
result A novel algorithm for learning staged trees that captures non-symmetric independences.
While records and order statistics of independent and identically distributed (i.i.d.) random variables X_1, ..., X_N are fully understood, much less is known for strongly correlated random variables, which is often the situation encountered in statistical physics. Recently, it was shown, in a series of works, that one…
Diagonal transformations preserve independence structures in non-Gaussian distributions.
problem Preserving independence structures in non-Gaussian distributions.
method Diagonal nonlinear transformations of multivariate normal variables.
result Independence structures are preserved in non-Gaussian distributions under diagonal transformations.
We provide a theoretical foundation for non-parametric estimation of functions of random variables using kernel mean embeddings. We show that for any continuous function f, consistent estimators of the mean embedding of a random variable X lead to consistent estimators of the mean embedding of f(X). For Matérn ke…