DRMMs enable flexible conditional sampling for interactive machine learning.
problem Limited flexibility in conditional sampling for deep generative models.
method Proposes Deep Residual Mixture Models (DRMMs) that allow flexible conditional sampling.
result DRMMs enable sampling with arbitrary combinations of conditioning variables and priors.
A new method uses Schrödinger bridges for deep conditional generative learning.
problem Learning conditional distributions with additional information.
method Schrödinger bridge approach with discretized SDE and deep neural network.
result Generated samples have higher quality and can estimate conditional density.
In this paper, we address the problem of conditional modality learning, whereby one is interested in generating one modality given the other. While it is straightforward to learn a joint distribution over multiple modalities using a deep multimodal architecture, we observe that such models aren't very effective at cond…
We study likelihood-based methods for distribution regression with deep generative models.
problem Distribution regression with high-dimensional responses concentrated on a low-dimensional manifold.
method Likelihood-based approach using conditional deep generative models.
result Convergence rates for estimating conditional distributions in Hellinger and Wasserstein metrics.
Framework generates personalized insulin treatment strategies using deep models.
problem Developing optimal personalized treatment strategies for diabetes patients.
method Combines deep generative time series models with decision theory.
result Demonstrated improved personalized insulin treatment strategies for diabetes patients.
Proposes model-based robust deep learning to handle natural variation in data.
problem Deep learning's fragility to natural variation in data.
method Develops model-based robust training algorithms using deep generative models to learn natural variation.
result Deep neural networks trained with model-based algorithms outperform standard and norm-bounded robust algorithms.
Proposes a new framework for deep learning conditional mean estimation with confidence regions.
problem Lack of asymptotic properties in deep nonparametric regression models.
method Transforms deep estimation into conditional diffusion model for conditional mean estimation.
result Developed end-to-end convergence rate and asymptotic normality for conditional diffusion model.
There is a rising interest in studying the robustness of deep neural network classifiers against adversaries, with both advanced attack and defence techniques being actively developed. However, most recent work focuses on discriminative classifiers, which only model the conditional distribution of the labels given the …
Conditional domain generation is a good way to interactively control sample generation process of deep generative models. However, once a conditional generative model has been created, it is often expensive to allow it to adapt to new conditional controls, especially the network structure is relatively deep. We propose…
Paper introduces GDR-learners for estimating potential outcomes from observational data.
problem Lack of theoretical property of general Neyman-orthogonality in deep generative models.
method Develops flexible GDR-learners based on various deep generative models.
result GDR-learners possess quasi-oracle efficiency and rate double robustness, asymptotically optimal.
New approach uses deep generative models for inventory and pricing decisions.
problem Data-driven inventory and pricing decisions in feature-based newsvendor problems.
method Conditional deep generative models (cDGMs) to learn demand distribution and generate probabilistic forecasts.
result Effective in optimizing inventory and pricing decisions, with theoretical guarantees and real-world applications.
SIGMA prior enables federated learning for non-factorizable models.
problem Current FL methods assume conditional independence, limiting applicability to non-factorizable models.
method SIGMA prior approximates deep generative model to induce conditional independence structure.
result SIGMA prior expands FL applicability to fields requiring modeling dependencies.
Deep neural operators learn complex probabilistic models efficiently.
problem Learning complex probabilistic models with global Lipschitz conditions.
method Deep neural-operator framework under global Lipschitz conditions.
result Explicit network-size bounds for universal approximation of probabilistic models.
New model generates unseen attribute combinations from limited data.
problem Lack of generalization in deep generative models for unseen attribute combinations.
method Introduces multilinear latent conditioning to capture multiplicative interactions.
result Demonstrates effectiveness on MNIST, Fashion-MNIST, and CelebA datasets.
CoFinDiff generates synthetic financial data capturing stylized facts and meeting specified conditions.
problem Limited data availability and difficulty in controlling synthetic financial data generation.
method Conditional diffusion model with cross-attention to incorporate conditions derived from price data.
result Synthetic data generated by CoFinDiff accurately meets specified conditions for trends and volatility.
A novel deep bootstrap framework for nonparametric regression using conditional diffusion models.
problem Nonparametric regression with efficient sampling and accurate estimation.
method Conditional diffusion model for learning conditional distributions, integrating sampling and regression into a unified generative framework.
result Established optimal convergence rates in the Wasserstein distance and convergence guarantees for the bootstrap procedure.
The article proposes a deep learning method to test and infer the Markov property in time series data.
problem Testing and inferring the Markov property in high-dimensional time series data.
method Deep conditional generative learning to estimate conditional density functions and derive a doubly robust test statistic.
result The test controls the type-I error asymptotically and has power approaching one.
Probabilistic graphical models are a central tool in AI; however, they are generally not as expressive as deep neural models, and inference is notoriously hard and slow. In contrast, deep probabilistic models such as sum-product networks (SPNs) capture joint distributions in a tractable fashion, but still lack the expr…
SONA improves conditional generation by balancing authenticity and alignment.
problem Challenges in balancing authenticity and conditional alignment in conditional generative models.
method SONA integrates unconditional discrimination, matching-aware supervision, and adaptive weighting to balance authenticity and alignment.
result SONA achieves superior sample quality and conditional alignment compared to state-of-the-art methods.
This paper reviews and compares deep generative models for financial time series and VaR.
problem Forecasting risk factor distribution in financial markets.
method Apply multiple deep generative models (CGAN, CWGAN, Diffusion, Signature WGAN) and propose new methods for conditional time series generation.
result Top performing models are Historical Simulation, GARCH, and CWGAN.
Proposes a deep learning method to ensure non-crossing quantiles in conditional distributions.
problem Non-crossing quantiles issue in deep learning QR models.
method Generic deep learning algorithm enforcing quantile monotonicity.
result Ensures non-crossing quantiles up to machine precision.
Generative neural nets learn deep policies conditioned on goals.
problem Learning optimal policies for specific goals in reinforcement learning.
method Goal-conditioned neural nets that generate deep neural policies.
result Single learned policy generator can achieve any desired return.
We identify causal models with unobserved confounding using bijective generation mechanisms.
problem Identifying causal relationships with unobserved confounders.
method Establish counterfactual identifiability for BGMs and propose a learning method.
result Learned BGMs enable efficient counterfactual estimation.
We present a novel model architecture which leverages deep learning tools to perform exact Bayesian inference on sets of high dimensional, complex observations. Our model is provably exchangeable, meaning that the joint distribution over observations is invariant under permutation: this property lies at the heart of Ba…
Deep Neural Networks (DNNs), with its promising performance, are being increasingly used in safety critical applications such as autonomous driving, cancer detection, and secure authentication. With growing importance in deep learning, there is a requirement for a more standardized framework to evaluate and test deep l…
Proposes a new framework for open set recognition using conditional probabilistic generative models.
problem Unknown samples can mislead traditional deep neural networks during testing.
method Conditional Probabilistic Generative Models (CPGM) that combine generative models with discriminative information.
result Significantly outperforms baselines on multiple benchmark datasets.
Unified approach for nonparametric regression and conditional distribution learning.
problem Nonparametric regression and conditional distribution learning problems.
method Generative learning framework with deep neural networks to estimate a conditional generator.
result The approach estimates a regression function and a conditional generator simultaneously, providing good prediction intervals.
Method generates resource-optimized ML models for different platforms.
problem Deployment of deep learning models on edge platforms requires model reduction and retraining.
method Conditional Neural Architecture Search using Generative Adversarial Networks (GAN)
result Successfully generates resource-optimized ML models for different platforms.
There has been much recent, exciting work on combining the complementary strengths of latent variable models and deep learning. Latent variable modeling makes it easy to explicitly specify model constraints through conditional independence properties, while deep learning makes it possible to parameterize these conditio…
Proposes a method to forecast non-stationary time series.
problem Challenges of non-stationary conditional distributions in deep learning.
method Bayesian dynamic model + deep conditional distribution model.
result Adapts to non-stationary time series better than state-of-the-art solutions.
Generative model for inferring graph from time series data.
problem Generating graphs conditioned on multivariate time series data.
method Time Series Conditioned Graph Generation-Generative Adversarial Networks (TSGG-GAN).
result Demonstrates effectiveness and generalizability of TSGG-GAN on synthetic and real-world datasets.
MDMA provides closed-form marginals and conditionals for deep networks.
problem Lack of closed-form marginals and conditionals in deep neural models.
method MDMA architecture combining deep scalar representations and hierarchical tensor decompositions.
result MDMA outperforms state-of-the-art models in tasks requiring marginalization and conditional inference.
This article reviews and compares various methods for estimating conditional distributions.
problem Inference of conditional distributions in statistics.
method Classical nonparametric methods and modern generative models.
result A systematic numerical comparison of methods using performance metrics.
A new deep learning model improves asset pricing predictions.
problem Improving asset pricing models for better predictions.
method Pseudo-Siamese Network (SNAP) for conditional asset pricing.
result The SNAP model outperforms benchmarks in out-of-sample prediction and Sharpe ratio.
A nonparametric family of conditional distributions is introduced, which generalizes conditional exponential families using functional parameters in a suitable RKHS. An algorithm is provided for learning the generalized natural parameter, and consistency of the estimator is established in the well specified case. In ex…
Study on deep neural networks for reward modeling with pairwise comparison data.
problem Reward modeling with deep neural networks in non-parametric settings.
method Established a non-asymptotic regret bound for deep reward estimators, introduced a margin-type condition.
result Improved regret bound for deep reward estimators, highlighting the importance of clear human beliefs.
Survey on deep models for graph generation.
problem Improving fidelity of generated graphs.
method Taxonomy and comparison of deep generative models.
result Advances in deep generative models for graph generation.
Deep conditional transformation models unify interpretable and complex predictors.
problem Challenging to learn conditional CDFs in high-dimensional settings.
method Unified deep learning framework for interpretable and complex predictors.
result Efficacy demonstrated through numerical experiments and applications.
In recent years, intelligent condition-based monitor-ing of rotary machinery systems has become a major researchfocus of machine fault diagnosis. In condition-based monitoring,it is challenging to form a large-scale well-annotated datasetdue to the expense of data acquisition and costly annotation.The generated data ha…
Deep generative models for graphs have shown great promise in the area of drug design, but have so far found little application beyond generating graph-structured molecules. In this work, we demonstrate a proof of concept for the challenging task of road network extraction from image data. This task can be framed as im…
Sum Product Networks (SPNs) are a recently developed class of deep generative models which compute their associated unnormalized density functions using a special type of arithmetic circuit. When certain sufficient conditions, called the decomposability and completeness conditions (or "D&C" conditions), are imposed on …
Deep generative models are rapidly becoming a common tool for researchers and developers. However, as exhaustively shown for the family of discriminative models, the test-time inference of deep neural networks cannot be fully controlled and erroneous behaviors can be induced by an attacker. In the present work, we show…
Roundtrip uses deep generative models for flexible density estimation.
problem Density estimation in statistics and machine learning.
method Roundtrip is a deep generative neural density estimator that uses flexible mappings.
result Roundtrip achieves state-of-the-art performance in density estimation tasks.
Kernel density matrices simplify probabilistic deep learning.
problem Representing joint probability distributions of continuous and discrete variables.
method Extending density matrices to a reproducing kernel Hilbert space.
result Versatile representation for marginal and joint probability distributions.
Modeling the probability distribution of rows in tabular data and generating realistic synthetic data is a non-trivial task. Tabular data usually contains a mix of discrete and continuous columns. Continuous columns may have multiple modes whereas discrete columns are sometimes imbalanced making the modeling difficult.…
We introduce a new category of multivariate conditional generative models and demonstrate its performance and versatility in probabilistic time series forecasting and simulation. Specifically, the output of quantile regression networks is expanded from a set of fixed quantiles to the whole Quantile Function by a univar…
Generative models improve commodity hedging using deep learning.
problem Improving risk management in commodity markets.
method Four state-of-the-art generative models adapted for commodity time series.
result Deep hedging of commodity options trained on generated time series shows promising results.
New method for generating images with conditional probability models.
problem Generating images with specific conditions.
method Score-based diffusion models with theoretical analysis and new estimator.
result New estimator for conditional score performs similarly to state-of-the-art.