New method combines domain changes and sparse mixing for better latent variable learning.
problem Challenges in identifying latent variables due to insufficient domain changes and violated sparsity constraints.
method Combines sufficient changes and sparse mixing constraints, using domain encoding networks and variational autoencoders.
result Identifiability of latent variables achieved with less restrictive constraints.
The literature on statistical learning for time series assumes the asymptotic independence or ``mixing' of the data-generating process. These mixing assumptions are never tested, nor are there methods for estimating mixing rates from data. We give an estimator for the β-mixing rate based on a single stationary sample…
The paper connects Chern-Simons invariants to mixed Tate motives in hyperbolic 3-manifolds.
problem Understanding the relationship between Chern-Simons invariants and mixed Tate motives in hyperbolic 3-manifolds.
method Constructing a mixed Tate motive over the invariant trace field whose image equals the Chern-Simons invariant and complex volume.
result The mixed Hodge realization of the motive is a quotient of the path torsor of the augmented character variety.
New proof shows rapid mixing for random walks on nilmanifolds.
problem Proving rapid mixing for random walks on nilmanifolds.
method Proved rapid mixing for almost all random walks generated by m translations on nilmanifolds under mild assumptions.
result For several classical classes of nilmanifolds, m=2 suffices for rapid mixing.
Study shows DQN's performance degrades with temporal dependence in data.
problem Temporal dependence in replayed data affects DQN's performance.
method Modelled τ-mixing data, derived risk bounds, and empirical validation. result Temporal dependence leads to a degradation in DQN's performance rate.
Study on gradient descent in Hilbert spaces with Markov chains, focusing on mixing coefficients.
problem Analyzing convergence of gradient descent in Hilbert spaces with stationary Markov chains.
method Examined strictly stationary Markov chains with φ- and β-mixing coefficients, derived probabilistic upper bounds. result Probabilistic upper bounds on convergence behavior of gradient descent algorithm based on mixing coefficients.
New framework relaxes independence assumption for graph-mixing dependencies.
problem Tackles limitations of existing generalization results for graph-mixing dependencies.
method Proposes a framework where dependencies decay with graph distance, derives generalization bounds leveraging online-to-PAC framework.
result Derives high-probability generalization guarantees that depend on mixing rate and graph's chromatic number.
We develop algorithms to learn non-linear dynamical systems without mixing assumptions.
problem Learning non-linear dynamical systems from dependent data.
method We introduce an offline algorithm and a one-pass streaming method with SGD-RER.
result Our methods achieve optimal or near-optimal performance for learning non-linear systems.
Study geodesic equation on mixed-volume forms on balanced manifolds, proving existence of solutions.
problem Existence of solutions to the Calabi-Yau equation for balanced metrics.
method Introduced a L2 metric space of mixed-volume forms and derived a geodesic equation. result Existence of solutions to the Calabi-Yau equation on all balanced manifolds.
No-regret learning fails to converge to Nash equilibria in mixed strategies.
problem Limiting behavior of mixed strategies in repeated games.
method Study of optimal no-regret learning algorithms for 2x2 competitive games.
result Limiting mixed strategies cannot converge to Nash equilibria under mean-based and monotonic updates.
Study online learning in RKHS with dependent processes, focusing on \(β\)- and \(φ\)-mixing.
problem Online learning in RKHS with dependent data.
method Online regularized learning algorithm in RKHS, analyzing \(β\)- and \(φ\)-mixing sequences.
result Probabilistic upper bounds and convergence rates for mixing coefficients.
Method upgrades limit theorems to mixing limit theorems for dynamical systems.
problem Improving limit theorems for dynamical systems.
method General method for upgrading limit theorems to mixing limit theorems.
result Mixing limit theorems for specific subbundles of the Kontsevich-Zorich cocycle.
Combines boosting with Gaussian process and mixed effects models.
problem Model misspecifications and independence assumptions in boosting.
method Relaxes zero or linearity assumption in Gaussian process and mixed effects models, and independence assumption in boosting.
result Increased prediction accuracy compared to existing approaches.
Study on singularities of specific polynomial functions.
problem Characterizing the topology of singularities of mixed functions.
method Introduced inner non-degenerate mixed functions and used Newton boundary to characterize links.
result Links of singularities can be completely characterized under certain conditions.
We show how to control the generalization error of time series models wherein past values of the outcome are used to predict future values. The results are based on a generalization of standard i.i.d. concentration inequalities to dependent data without the mixing assumptions common in the time series setting. Our proo…
MALA mixes efficiently under smoothness and isoperimetry assumptions.
problem Sampling from target densities efficiently.
method Metropolis-Adjusted Langevin algorithm (MALA) with smoothness and isoperimetry assumptions.
result MALA mixes in $O\left(\frac{(LΥ)^{\frac12}}{ψ_μ^2} \log\left(\frac{1}ε
ight)
ight)$ iterations.
We present a novel algorithm for overcomplete independent components analysis (ICA), where the number of latent sources k exceeds the dimension p of observed variables. Previous algorithms either suffer from high computational complexity or make strong assumptions about the form of the mixing matrix. Our algorithm does…
Under certain assumptions on CAT(0) spaces, we show that the geodesic flow is topologically mixing. In particular, the Bowen-Margulis' measure finiteness assumption used in recent work of Ricks is removed. We also construct examples of CAT(0) spaces which do not admit finite Bowen-Margulis measure.
In this paper we introduce a new parametric distribution, the Mixed Tempered Stable. It has the same structure of the Normal Variance Mean Mixtures but the normality assumption leaves place to a semi-heavy tailed distribution. We show that, by choosing appropriately the parameters of the distribution and under the conc…
New method recovers causal DAGs from general environments without strict assumptions.
problem Recovering causal DAGs from real-world data with varying distributions.
method Formalizes desiderata for causal representation learning in general environments, leveraging sufficient change conditions up to third-order derivatives.
result Fully recovers latent DAG and identifies latent variables up to minor indeterminacies under nonparametric mixing.
The mixed scalar curvature is one of the simplest curvature invariants of a foliated Riemannian manifold. We explore the problem of prescribing the mixed scalar curvature of a foliated Riemann-Cartan manifold by conformal change of the structure in tangent and normal to the leaves directions. Under certain geometrical …
Study proves projective Anosov subgroups lead to mixing flows in specific spaces.
problem Understanding mixing properties of flows on specific geometric spaces.
method Constructing non-empty domain of discontinuity in homogeneous space, using spectral estimates for transfer operators.
result Exponential mixing, spectral gap, and meromorphic continuation of zeta functions established.
Improved density estimation for mixed discrete-continuous data.
problem Inconsistent density estimation for mixtures of continuous and discrete data.
method Modification of existing nonparametric density estimation methods to handle mixed discrete-continuous data.
result Improved consistency and empirical performance for mixed discrete-continuous data.
New bound for neural nets on non-iid data.
problem Generalization of deep nets for dependent data.
method Establishes a generalization bound for feed-forward neural networks on φ-mixing data. result Proves neural nets can generalize well on non-iid data.
We study a special case of the problem of statistical learning without the i.i.d. assumption. Specifically, we suppose a learning method is presented with a sequence of data points, and required to make a prediction (e.g., a classification) for each one, and can then observe the loss incurred by this prediction. We go …
Theoretical analysis of deep neural networks for time series data.
problem Theoretical development for deep neural networks on temporally dependent observations is lacking.
method Established non-asymptotic bounds for prediction error of deep neural networks under mixing-type assumptions.
result Deep neural networks can model non-linear time series data with additional logarithmic factors due to dependence.
Observations consisting of measurements on relationships for pairs of objects arise in many settings, such as protein interaction and gene regulatory networks, collections of author-recipient email, and social networks. Analyzing such data with probabilisic models can be delicate because the simple exchangeability assu…
We introduce a convex approach for mixed linear regression over d features. This approach is a second-order cone program, based on L1 minimization, which assigns an estimate regression coefficient in Rd for each data point. These estimates can then be clustered using, for example, k-means. For problem…
PVI improves SIVI by directly optimizing ELBO without parametric assumptions.
problem Intractable variational densities in SIVI methods.
method Particle Variational Inference (PVI) using empirical measures to approximate optimal mixing distributions.
result PVI directly optimizes the ELBO and performs favorably compared to other SIVI methods.
New method improves uncertainty estimation in complex statistical models.
problem Challenges in estimating high-dimensional mixed models due to computational complexity.
method Partially factorized variational inference to relax mean-field assumption.
result Relaxed variational inference provides accurate uncertainty quantification without high computational cost.
The paper analyzes convergence rates of Langevin dynamics and Proximal Sampler using Φ-divergence.
problem Analyzing convergence rates of Langevin dynamics and Proximal Sampler.
method Extending mixing time analyses to Φ-divergence, using strong data processing inequalities. result Convergence of Φ-divergence to 0 exponentially fast along Unadjusted Langevin Algorithm and Proximal Sampler. We tackle causal discovery in linear systems with measurement error and unobserved causes.
problem Causal discovery in linear systems with measurement error and unobserved causes.
method Characterization of identifiability based on the mixing matrix, proposing causal structure learning methods.
result The structure of causal models can be identified under certain faithfulness assumptions.
Study of Anosov flows using microlocal analysis for ergodicity and mixing properties.
problem Ergodicity and mixing properties of Anosov flows and their isometric extensions.
method Microlocal analysis of Pollicott-Ruelle resonances to study isometric extensions of Anosov flows.
result Ergodicity of frame flow on negatively-curved Riemannian manifolds under specific curvature assumptions.
DDICA separates nonlinear mixed signals robustly.
problem Blind source separation of nonlinear mixed signals.
method Deep deterministic neural network with matrix-based entropy function.
result DDICA effectively separates independent components with high accuracy.
Paper addresses online identification and clustering for mixed linear regression models.
problem Online identification and clustering of mixed linear regression models.
method Introduces two online identification algorithms based on the EM principle, proving global convergence without i.i.d. data assumptions.
result Global convergence of the proposed algorithms for mixed linear regression models.
CLOUD method detects causal relationships in various data types without latent variable assumptions.
problem Detecting causal relationships in the presence of unobserved common causes.
method CLOUD method using Normalized Maximum Likelihood (NML) Code for various data types (discrete, mixed, continuous).
result CLOUD method is more effective than existing methods in inferring causal relationships.
Study bounds noise level in linear regression with dependent data.
problem Analyzing noise level in linear regression with dependent data.
method Derive upper bounds for random design linear regression with β-mixing data, without realizability assumptions. result Correctly recovers the noise level of the problem, exhibiting graceful degradation with misspecification.
A new method clusters qualitative data with mixed variables, improving interpretability.
problem Clustering qualitative data with context and high-dimensional mixed datasets.
method Hierarchical Qualitative Clustering (HQC) using Maximum Mean Discrepancy.
result HQC maintains interpretability of qualitative information and clusters effectively.
We consider the mixed regression problem with two components, under adversarial and stochastic noise. We give a convex optimization formulation that provably recovers the true solution, and provide upper bounds on the recovery errors for both arbitrary noise and stochastic noise settings. We also give matching minimax …
We analyze mixing times of three DA algorithms for regression models.
problem Analyzing mixing times of data augmentation algorithms for regression models.
method Modified conductance-based method to study mixing times of Gibbs samplers.
result Prove non-asymptotic polynomial upper bounds on mixing times for DA algorithms.
New RL method MAC improves performance in sparse reward settings.
problem Slow mixing in large state spaces or sparse rewards.
method Multi-level Monte Carlo Actor-Critic (MAC) algorithm.
result Achieves convergence rate comparable to state-of-the-art AC algorithms.
Reweighted ALPS improves sampling from multimodal distributions using warm start points.
problem Sampling from multimodal distributions is hard due to exponential mixing times.
method Introduces Reweighted ALPS, a modified Annealed Leap-Point Sampler that uses warm start points.
result First polynomial-time bound for Re-ALPS in a general setting, under a natural assumption.
Gradient Boosted Mixed Models estimate mean and variance components for clustered data.
problem Limited flexibility in linear mixed models for complex settings.
method Gradient Boosting extended to mixed models with likelihood-based gradients and flexible base learners.
result Accurate recovery of variance components and improved predictive accuracy.
This work analyzes Gibbs samplers for Bayesian hierarchical models without dimensionality constraints.
problem Analyzing convergence properties of Gibbs samplers for Bayesian hierarchical models.
method Using Bayesian asymptotics and total variation mixing times, the study provides dimension-free convergence results.
result Dimension-free convergence results for Gibbs samplers targeting hierarchical models under random data-generating assumptions.
Many theoretical results on estimation of high dimensional time series require specifying an underlying data generating model (DGM). Instead, along the footsteps of~\cite{wong2017lasso}, this paper relies only on (strict) stationarity and β-mixing condition to establish consistency of lasso when data comes from a $β…
We study the problem of separating a mixture of distributions, all of which come from interventions on a known causal bayesian network. Given oracle access to marginals of all distributions resulting from interventions on the network, and estimates of marginals from the mixture distribution, we want to recover the mixi…
Clustering is an essential technique for discovering patterns in data. The steady increase in amount and complexity of data over the years led to improvements and development of new clustering algorithms. However, algorithms that can cluster data with mixed variable types (continuous and categorical) remain limited, de…
We consider the problem of learning parameters of latent variable models from mixed (continuous and ordinal) data with missing values. We propose a novel Bayesian Gaussian copula factor (BGCF) approach that is consistent under certain conditions and that is quite robust to the violations of these conditions. In simulat…