Deep generative models have shown promising results in generating realistic images, but it is still non-trivial to generate images with complicated structures. The main reason is that most of the current generative models fail to explore the structures in the images including spatial layout and semantic relations betwe…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “structured generative models”
Proposes a new model to handle latent structure methods.
problem Lack of model inference, generative form, and unidentifiable parameters in latent structure methods.
method Generative Flexible Latent Structure Regression (GFLSR) model structure.
result Proposed model allows for model inference and leads to potential probabilistic model.
A new method generates graphs with hierarchical structures.
problem Generating graphs with natural hierarchical structures.
method Recursively generates community structures at multiple resolutions, parallel generation of all sub-structures.
result Improves generative performance on multiple graph datasets.
In this article we give an equivariant version for the construction of generic models on presheaves of structures. We deal with first order structures endowed with a suitable action of some fixed group, say ; we call them -structures. We show that every exact presheaf of -structures has a generic…
Paper presents a framework for learning generative models with structured latent factors.
problem Learning controllable and generalizable representations of multivariate data with desired structural properties.
method The paper introduces a novel generative model framework that uses mask variables to model dependency structure and extends the multivariate information bottleneck theory.
result The framework learns semantically meaningful latent factors that reflect various desired structures and can automatically estimate dependency structure from data.
Model criticism tool evaluates text coherence and structure in generated long-form text.
problem Evaluate the high-level structure of generated text for coherence, coreference, and topicality.
method Apply model criticism in latent space to compare real and generated data distributions.
result Transformer-based models struggle with maintaining structural coherence and coreference.
New insights on how weight structure affects generalization in deep Gaussian feature models.
problem Understanding how weight structure impacts generalization in deep learning models.
method Using the replica trick from statistical physics to derive learning curves for models with structured Gaussian features.
result Allowing correlations between the rows of the first layer of features can aid generalization, while structure in later layers is generally detrimental.
Generalizes Hamiltonian structures to Dirac structures for new mechanics models.
problem Extending Hamiltonian structures to non-symplectic manifolds.
method Introduces Hamiltonian Lie algebroids and momentum sections over Dirac structures.
result Constructs new sigma models based on these structures.
We propose a new topological field theory on generalized complex geometry in two dimension using AKSZ formulation. Zucchini's model is model in the case that the generalized complex structuredepends on only a symplectic structure. Our new model is model in the case that the generalized complex structure depends…
We study the problem of building generative models of natural source code (NSC); that is, source code written and understood by humans. Our primary contribution is to describe a family of generative models for NSC that have three key properties: First, they incorporate both sequential and hierarchical structure. Second…
Generative models improve digital twins for structures with uncertainties.
problem Uncertainty in structural modelling limits deterministic models.
method Two types of generative models: physics-based SFE and data-driven cGANs.
result Data-driven cGANs outperform physics-based models in nonlinear structures.
This paper proposes a new method to generate protein structures using deep learning.
problem Weak correlation between current scoring functions and protein molecular activity.
method Graph-generative models to sample novel tertiary protein structures.
result Generative models can reveal latent space and highlight structural factors.
A general model for geometric structures on differentiable manifolds is obtained by deforming infinitesimal symmetries. Specifically, this model consists of a Lie algebroid, equipped with an affine connection compatible with the Lie algebroid structure. The curvature of this connection vanishes precisely when the struc…
Language models exhibit low-rank structure, which can be used for generation.
problem Understanding the low-dimensional structure of large language models.
method Empirical demonstration and theoretical analysis of the approximate rank of language models' logits.
result Language models can generate responses using linear combinations of unrelated prompts.
Generative model predicts remaining life of damaged structures.
problem Prognosis of damage and remaining useful life of structures.
method Generative adversarial networks (GANs) in a population-based SHM framework.
result Algorithm provides confident predictions about structures' remaining useful life.
We construct a three-dimensional topological sigma model which is induced from a generalized complex structure on a target generalized complex manifold. This model is constructed from maps from a three-dimensional manifold to an arbitrary generalized complex manifold . The theory is invariant under the diffeomor…
Proposes GNAN model for detecting various network structures.
problem Detecting traditional communities in networks.
method GNAN model combining topology and node-attribute information.
result GNAN detects a broader range of network structures.
We propose Graphical Generative Adversarial Networks (Graphical-GAN) to model structured data. Graphical-GAN conjoins the power of Bayesian networks on compactly representing the dependency structures among random variables and that of generative adversarial networks on learning expressive dependency functions. We intr…
Paper introduces structured sparsity estimators for Generalized Linear Models.
problem Estimating structured sparsity in GLMs with debiased estimators.
method Extends Stucky and van de Geer's results to GLMs with structured sparsity.
result Proves oracle inequalities for structured sparsity estimators in GLMs.
Generating graph structures is a challenging problem due to the diverse representations and complex dependencies among nodes. In this paper, we introduce Graph Variational Recurrent Neural Network (GraphVRNN), a probabilistic autoregressive model for graph generation. Through modeling the latent variables of graph data…
SNS-GAN integrates class labels into generative models for images and time series.
problem Effective integration of class labels in generative models without network modifications.
method Embeds class conditions within the generator's noise space.
result Superior performance in time series generation compared to baseline models.
Novel risk bound for structured prediction tackles non-i.i.d. data.
problem Structured prediction challenges due to non-factorizable target objects.
method PAC-Bayesian risk bound with explicit structure distillation.
result Generalization rate scales with data size and structure.
CANs improve GANs by enforcing structured constraints during training.
problem Generating valid structured objects like molecules and game maps from examples alone.
method Constrained Adversarial Networks (CANs) embed constraints into the model during training, penalizing invalid structures.
result CANs efficiently generate high-quality and novel valid structures.
Proposes a new model for testing causal structural priors and synthesizing data.
problem Testing and synthesizing causal structural priors using nonparametric knowledge and neural networks.
method Causal Structural Hypothesis Testing (C-SHT) and Causal Structural Variational Hypothesis Testing (C-SVHT) using deep neural networks.
result Demonstrates out-of-distribution generalization error as a proxy for causal structural prior hypothesis testing.
Paper formalizes a reinforcement learning model for complex information structures.
problem Complex interdependence in sequential decision-making problems.
method Formalizes a novel reinforcement learning model with explicit information structure representation.
result Upper bound on sample complexity of learning general sequential decision-making problems.
Deep generative models (DGMs) have shown promise in image generation. However, most of the existing work learn the model by simply optimizing a divergence between the marginal distributions of the model and the data, and often fail to capture the rich structures and relations in multi-object images. Human knowledge is …
IH-GAN models cellular structures accurately and improves structural performance.
problem Optimizing variable-density cellular structures with multiscale design challenges.
method Conditional deep generative model (IH-GAN) for property-to-geometry mapping using implicit function parameterization.
result Generates unit cells with high accuracy and improves structural performance.
Paper reviews deep structural causal models for answering counterfactual queries.
problem Answering counterfactual queries using observational data with known causal structures.
method Deep generative models integrated with structural causal models.
result Provides insights into the capabilities and limitations of DSCMs.
Generative Modeling of Approximately Periodic Time Series by a Posterior-Weighted Gaussian Processstat.ML
Generative model captures repetitive industrial processes with varying durations and dynamics.
problem Capturing repetitive industrial processes with varying durations and dynamics using Gaussian Processes.
method Posterior-weighted Gaussian Process with a novel kernel to decouple intra-repetition and inter-repetition variability.
result Generative model produces realistic synthetic trajectories from toy datasets.
Paper tackles goal-directed generation of discrete structures using conditional generative models.
problem Challenges in generating structured discrete data, especially for problems like program synthesis and materials design.
method Investigates conditional generative models to directly model the distribution of discrete structures given properties of interest. Introduces a novel approach to optimize a reinforcement learning objective.
result Improvements over maximum likelihood estimation and other baselines in generating molecules and identifying short python expressions.
We present a conditional generative model to learn variation in cell and nuclear morphology and the location of subcellular structures from microscopy images. Our model generalizes to a wide range of subcellular localization and allows for a probabilistic interpretation of cell and nuclear morphology and structure loca…
FOCUS improves offline RL by incorporating causal structure into world-models.
problem Learning effective policies from historical data without interaction.
method FOCUS proposes a practical algorithm that learns and leverages causal structure in offline RL.
result FOCUS outperforms plain model-based offline RL algorithms and other causal model-based RL algorithms.
NeRF-VAE generates 3D scenes with geometric structure from few images.
problem Generating 3D scenes from few images with geometric consistency.
method Combines NeRF and VAE, incorporating shared geometric structure.
result NeRF-VAE can infer and render geometrically-consistent scenes from unseen environments.
In this contribution we review some of the interplay between sigma models in theoretical physics and novel geometrical structures such as Lie (n-)algebroids. The first part of the article contains the mathematical background, the definition of various algebroids as well as of Dirac structures, a joint generalization of…
A new method learns causal structure from data using amortized inference.
problem Causal structure learning is a combinatorial search problem that is costly and difficult to design suitable scores or tests.
method Train a variational inference model to predict causal structure from data.
result Our inference model generalizes well to larger problem instances and outperforms existing algorithms, especially in genomics.
Generative models of graph structure have applications in biology and social sciences. The state of the art is GraphRNN, which decomposes the graph generation process into a series of sequential steps. While effective for modest sizes, it loses its permutation invariance for larger graphs. Instead, we present a permuta…
Existing automatic music generation approaches that feature deep learning can be broadly classified into two types: raw audio models and symbolic models. Symbolic models, which train and generate at the note level, are currently the more prevalent approach; these models can capture long-range dependencies of melodic st…
Generative modelling of financial time series with structured noise and MMD-based signature learningq-fin.MF
Generative model for financial time series using structured noise and signature learning.
problem Creating synthetic financial data to reflect real-world market dynamics.
method Structured noise, moving average model, signature transform, reinforcement learning.
result Model effectively captures key financial characteristics and outperforms existing methods.
As a new approach to train generative models, \emph{generative adversarial networks} (GANs) have achieved considerable success in image generation. This framework has also recently been applied to data with graph structures. We propose labeled-graph generative adversarial networks (LGGAN) to train deep generative model…
Surveying joint Gaussian graphical models to identify shared structures across domains.
problem Estimating shared structures across different data sources.
method Statistical inference of joint Gaussian graphical models.
result Improved estimation power for high-dimensional data.
New approach learns causally disentangled latent structures in generative models.
problem Fundamental tension between expressivity and structure in latent structure learning.
method Added a context module to an arbitrarily complex model to learn causally disentangled concepts.
result Causally disentangled representations can be composed for out-of-distribution generation.
A new model synthesizes population with fewer structural and sampling zeros.
problem Synthesizing a feasible and diverse synthetic population from limited data.
method A deep generative model with two regularizations to minimize structural zeros and preserve sampling zeros.
result The model significantly improves feasibility and diversity of synthetic populations.
Proposes a differentiable structure learning framework for general binary data.
problem Limitations of existing methods in discrete data structure learning.
method Formulates a differentiable optimization task for arbitrary dependencies in general discrete models.
result Establishes identifiability of complete set of compatible parameters and structures under mild assumptions.
Generative models often fail to preserve joint structure despite matching marginals.
problem Generative models fail to capture complex dependencies beyond univariate marginals.
method Introduced D_Sigma(P,Q) = ||Sigma_P - Sigma_Q||_F to measure covariance-level dependence fidelity.
result Covariance-level divergence can lead to structural instability in downstream inference.
Significant strides have been made toward designing better generative models in recent years. Despite this progress, however, state-of-the-art approaches are still largely unable to capture complex global structure in data. For example, images of buildings typically contain spatial patterns such as windows repeating at…
A new diffusion model improves cryo-EM structure sampling.
problem Gaussian prior in VAE fails to match approximate posterior in cryo-EM data.
method Train a diffusion model as an expressive, learnable prior in cryoDRGN framework.
result Samples accurately follow the data distribution, not the VAE prior.
Graphs are fundamental data structures which concisely capture the relational structure in many important real-world domains, such as knowledge graphs, physical and social interactions, language, and chemistry. Here we introduce a powerful new approach for learning generative models over graphs, which can capture both …
FlowMM models stable crystal structures efficiently.
problem Predicting and proposing stable crystalline structures.
method Riemannian Flow Matching generalized to crystal symmetries.
result 3x more efficient at finding stable materials.