Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

3907811,1711,561 · Jun 202019922001200920172026
48 results for complex data distributions

We consider the problems of robust PAC learning from distributed and streaming data, which may contain malicious errors and outliers, and analyze their fundamental complexity questions. In particular, we establish lower bounds on the communication complexity for distributed robust learning performed on multiple machine…

2017-03-30abs ↗pdf ↗

VAEs and GANs use simple distributions and neural networks to implicitly approximate complex data distributions.

problem Approximating high-dimensional complex distributions explicitly is often intractable.
method VAEs and GANs use simple base distributions and neural networks to implicitly approximate complex distributions.
result Implicit approximation of complex distributions is crucial but introduces limitations, especially in VAEs with fixed Gaussian priors.

MEP-Net uses MEP to generate solutions from limited data.

problem Generating solutions to scientific problems with incomplete information.
method Combines MEP with neural networks to learn complex distributions from moment constraints.
result Demonstrates MEP-Net's effectiveness in modeling biochemical reaction networks and generating complex distributions.

This paper improves diffusion models for low-dimensional data.

problem Theoretical foundations of diffusion models are lacking for low-dimensional data.
method Score approximation, estimation, and distribution recovery of diffusion models on low-dimensional data.
result Sample complexity bounds for distribution estimation using diffusion models are provided.

We obtain a tight distribution-specific characterization of the sample complexity of large-margin classification with L2 regularization: We introduce the margin-adapted dimension, which is a simple function of the second order statistics of the data distribution, and show distribution-specific upper and lower bounds on…

2012-04-05abs ↗pdf ↗

New algorithm reduces distributed optimization time with stochastic delays.

problem Optimizing distributed data with stochastic delays.
method Developed ADSAGA, a variant of SAGA for distributed-data settings with stochastic delays.
result ADSAGA converges in $ ilde{O}\left(\left(n + \sqrt{m}κ ight)\log(1/ε) ight)$ iterations under mean delay mm.

Improved privacy-preserving methods for estimating multiple samples from distributions.

problem Estimating multiple samples from distributions while maintaining privacy.
method Developed new multi-sampling techniques for differentially private data estimation.
result Achieved significant reduction in sample complexity for multi-sampling from finite domains and Gaussian distributions.

We examine the influence of input data representations on learning complexity. For learning, we posit that each model implicitly uses a candidate model distribution for unexplained variations in the data, its noise model. If the model distribution is not well aligned to the true distribution, then even relevant variati…

2019-12-19abs ↗pdf ↗

Rectified flows achieve optimal sample complexity for generating data.

problem Generating high-quality data samples efficiently.
method Rectified flows constrain transport trajectories to be linear, enabling efficient sampling.
result Achieve sample complexity of ildeO(ε2) ilde{O}(\varepsilon^{-2}), matching optimal rate for mean estimation.

Improved sampling for diffusion models and log-concave distributions.

problem Efficient sampling for diffusion models and log-concave distributions.
method Algorithms for sampling with δδ-error in polylog(1/δ)\mathrm{polylog}(1/δ) steps using accurate score estimates.
result Exponential improvement in complexity over previous results.

Generative models can approximate high-dimensional data from lower dimensions without needing a latent dimension equal to or greater than the data's intrinsic dimension.

problem Theoretical limitations on the latent dimension required for generative models to approximate high-dimensional data distributions.
method Inspired by space-filling curves, the work demonstrates that generative networks can approximate distributions on dd-dimensional manifolds from inputs of any arbitrary dimension, even lower than dd.
result Generative models can approximate high-dimensional data distributions from lower-dimensional inputs without needing a latent dimension equal to or greater than the data's intrinsic dimension.

Graph Neural Networks struggle with generalization, especially OOD data; GRATIN solves this with Gaussian Mixture Model-based augmentation.

problem Graph Neural Networks struggle with generalization, particularly to unseen or out-of-distribution data.
method Theoretical framework using Rademacher complexity to compute a regret bound on generalization error. GRATIN algorithm leveraging Gaussian Mixture Models for efficient data augmentation.
result GRATIN outperforms existing augmentation techniques in terms of generalization and offers improved time complexity.

Paper proposes a new generative model for discrete distributions using flows on submanifolds.

problem Discretization issues and complex statistical dependencies in discrete data.
method Continuous normalizing flows on factorizing discrete measures, geodesic flow matching.
result Efficient training and broad applicability demonstrated through experiments.

Neural networks use their hidden layers to transform input data into linearly separable data clusters, with a linear or a perceptron type output layer making the final projection on the line perpendicular to the discriminating hyperplane. For complex data with multimodal distributions this transformation is difficult t…

2018-07-08abs ↗pdf ↗

New bounds on learning from multiple distributions for VC classes.

problem Understanding the sample complexity of learning from multiple data distributions.
method Analyzing the gap between known upper and lower bounds for PAC-learnable classes.
result Recent progress on sample complexity for VC dimension d classes on k distributions.

A new method reduces complexity of normalizing flows for MCMC preconditioning.

problem Improving sampling efficiency in MCMC algorithms for complex target distributions.
method Factorized preconditioning architecture combining a linear component and a conditional NF.
result Significantly better tail samples and higher effective sample sizes on various distributions.

This paper introduces a spline-based method for nonparametric ADVI that handles complex posterior distributions.

problem Learning complex posterior distributions with skewness, multimodality, and bounded support.
method Develops a spline-based nonparametric approximation approach for ADVI.
result Establishes the asymptotic consistency of the derived lower bound for importance weighted autoencoder.

Generative models learn complex data from low-dimensional manifolds.

problem Theoretical justification for generative models on manifold structures.
method Prove statistical guarantees of generative networks under Wasserstein-1 loss, considering intrinsic dimensionality.
result Generative networks converge to zero at a fast rate depending on intrinsic dimensionality, not ambient data dimension.

Low complexity decentralized neural net with centralized performance.

problem Training large neural networks in distributed nodes without data sharing.
method Layer-wise learning using ADMM for low complexity and centralized performance.
result Equivalent learning performance to centralized training in distributed nodes.

Public pretraining improves private model training even in extreme distribution shift scenarios.

problem Improving private model training accuracy in settings with large distribution shift.
method Empirical evaluation and theoretical explanation of public representations improving private training accuracy.
result Public representations can improve private training accuracy by up to 67% over private training from scratch in settings with large distribution shift.

Metric learning seeks a transformation of the feature space that enhances prediction quality for the given task at hand. In this work we provide PAC-style sample complexity rates for supervised metric learning. We give matching lower- and upper-bounds showing that the sample complexity scales with the representation di…

2015-05-11abs ↗pdf ↗

New insights show coverage conditions are crucial for efficient online reinforcement learning.

problem The role of coverage conditions in determining sample complexity of offline reinforcement learning.
method Established a connection between coverage conditions and sample efficiency in online reinforcement learning.
result Coverability, a structural property of MDPs, enables sample-efficient exploration in online reinforcement learning.

Paper optimizes privacy-preserving distribution estimation for sparse data.

problem Sparse distribution estimation under local differential privacy constraints.
method Compressive sensing approaches for privacy-preserving estimation.
result Significant reduction in sample complexity for approximately sparse distributions.

DCMA uses generative models to analyze complex treatment effects on outcome distributions.

problem Analyzing complex and nonlinear causal mechanisms through outcome-level summary contrasts.
method Generative learning framework for identifying and estimating treatment effects on entire outcome distributions.
result Reconstructs interventional outcome distributions via Monte Carlo forward simulation, capturing both summary and distributional contrasts.

Improved multimodal variational models capture more complex joint distributions.

problem Limited expressiveness of multimodal variational models.
method Used normalizing flows to approximate and transform a simple parametric joint posterior into a more complex one.
result The model improves on state-of-the-art multimodal variational methods on various tasks.

A new base distribution for normalizing flows allows modeling complex distributions without sacrificing invertibility.

problem Normalizing flows struggle with complex, non-trivial distributions.
method Learned rejection sampling for base distribution, combined with optimization of log-likelihood and Kullback-Leibler divergence.
result The method effectively models complicated distributions without sacrificing invertibility.

New MMD estimators detect differences in missing paired data.

problem Handling missing data in matched pairs with complex distributions.
method Maximum mean discrepancy (MMD) estimators for complex data with missing values.
result Valid and consistent estimators detect differences in data distributions.

Improved eigenvalue distribution method for financial data.

problem Noise and complexity in financial markets.
method Matrix H theory, hierarchical structure, informational cascade.
result Captures a larger fraction of data variance in financial markets.

A new framework enhances generative modeling by learning local flows over complex manifolds.

problem Limited expressivity of current normalizing flows for low-dimensional manifolds.
method Vector quantized local normalizing flows (VQ-Flows) using a VQ-AE atlas and conditional flows.
result Enhanced modeling of complex data distributions over manifolds.

This work improves SGMs' convergence guarantees for semiconvex distributions with discontinuous gradients.

problem Establishing convergence guarantees for SGMs under weak regularity conditions.
method Developed non-asymptotic Wasserstein-2 convergence analysis for SGMs targeting semiconvex distributions with discontinuous gradients.
result Achieved optimal dependence of O(d)O(\sqrt{d}) on data dimension dd and convergence rate of order one.