A new method for image translation using disentangled style and content preservation.
problem Difficulty in maintaining original content during reverse diffusion in diffusion-based image translation.
method Disentangled style and content representation using intermediate keys from ViT model, CLIP loss, semantic divergence loss, and resampling strategy.
result Outperforms state-of-the-art models in text-guided and image-guided translation tasks.
Study shows how heat leaks from material sets in low diffusivity scenarios.
problem Understanding heat leakage from material sets in low diffusivity limits.
method Generalized leading-order asymptotics for time-dependent diffusion processes.
result Diffusive transport out of a material set is proportional to the surface area of the set boundary.
Zero-shot contrastive loss improves text-guided image style transfer without extra training.
problem Stochastic nature of diffusion models leads to trade-offs between style transformation and content preservation.
method Proposes a zero-shot contrastive loss for diffusion models that doesn't require additional fine-tuning or auxiliary networks.
result Method outperforms existing methods while preserving content and requiring no additional training.
FasterVoiceGrad speeds up VC by 6-7x with novel distillation.
problem Slow iterative sampling in diffusion-based VC models.
method Adversarial diffusion conversion distillation (ADCD) to create a faster one-step model.
result 6.6-6.9 and 1.8x faster on GPU and CPU, respectively.
A new model captures diffusion dynamics in networks using hidden states.
problem Capturing temporal relationships and hidden content trajectories in network diffusion.
method A topological recurrent neural model that embeds diffusion history as hidden states.
result Good experimental performances for diffusion modeling and prediction.
RB-Modulation trains free diffusion models without external adapters.
problem Training-free personalization of diffusion models with style and content control.
method Stochastic optimal control with a style descriptor and cross-attention aggregation.
result Precise content and style extraction and control without external adapters.
Improved image translation using asymmetric gradient guidance.
problem Trade-off between style transformation and content preservation in diffusion models.
method Asymmetric gradient guidance to guide reverse diffusion sampling.
result Our method outperforms state-of-the-art models in image translation tasks.
A new model for content diffusion over social media networks.
problem Modeling content diffusion with complex longitudinal dependency.
method Hierarchical Nonparametric Point Process (HNP3) with a mixture intensity function and a hierarchical dependent nonparametric approach.
result The proposed model effectively models content diffusion over networks.
Proposes D2D-LSTM for predicting mobile social network content diffusion paths.
problem Lack of accurate content popularity prediction considering time and location in mobile social networks.
method D2D-LSTM, a deep neural network combining user social features and files features.
result Significantly improved prediction accuracy (up to 85.858%) and faster convergence (less than 100 steps).
Efficiently selects seed nodes to maximize content influence in unknown social networks.
problem Maximizing content spread in social networks with unknown network model.
method Formulated as an infinite-horizon discounted MDP, uses model-based reinforcement learning to select seed users adaptively.
result Established a regret bound of O ~ ( T ) \widetilde O(\sqrt{T}) O ( T ) for the algorithm. Paper introduces Latent-CLIP for efficient text-image comparison in latent space.
problem Efficiently compare text and images in latent space without costly decoding.
method Trains CLIP model in latent space, uses Latent-CLIP rewards for noise optimization, and guides generation away from harmful content.
result Latent-CLIP matches CLIP performance on text-image classification and harmful content detection.
Boost-and-Skip generates minority samples without guidance, faster and more effectively.
problem Generating minority samples in low-density regions of a data manifold.
method Boost-and-Skip approach with variance-boosted initialization and timestep skipping.
result Boost-and-Skip effectively promotes the emergence of underrepresented minority features.
A new approach uses deep learning to manage vehicular content efficiently.
problem Managing content replication and caching in vehicular networks efficiently.
method Data-driven, centralized approach using a Convolutional Neural Network (CNN).
result Effective strategies derived to modulate FC operation in space and adapt to mobility changes.
PaGoDA reduces diffusion model training costs by 64x.
problem Diffusion models are computationally expensive during training.
method Three-stage pipeline: downsampled training, distillation, progressive super-resolution.
result PaGoDA achieves state-of-the-art performance with reduced training costs.
Modeling true and false news diffusion in social networks using homogeneity.
problem Difficulties in distinguishing true from false news in social networks.
method Proposes a Bayesian nonparametric model that incorporates homogeneity of news stories to predict their genuineness.
result Homogeneity values of news stories strongly correlate with their genuineness and content.
Method optimizes diffusion model generation to meet user preferences.
problem Optimizing diffusion model generation with only black-box target scores.
method Covariance-adaptive sequential optimization algorithm for black-box optimization.
result Proves superior performance in achieving better target scores.
Paper establishes a density formula for diffusion models, linking target density to score function.
problem Lack of theoretical foundation for optimizing DDPMs using ELBO.
method Developed a density formula for continuous-time diffusion processes, revealing the connection between target density and score function.
result The minimizer of the ELBO objective for DDPMs nearly coincides with the true objective, providing a theoretical foundation.
NCT simplifies one-step generator adaptation to new controls.
problem Adapting one-step generators to new control conditions.
method Noise Consistency Training (NCT) integrates new controls without retraining.
result NCT achieves state-of-the-art controllable generation in a single pass.
Proves bounds on copyright risk for generative models.
problem Generative models risk producing similar content to copyrighted data.
method Defines NAF, proves bounds, and provides learning algorithms.
result Generative models can be made less likely to produce copyrighted content.
CoTj improves diffusion model quality and stability via graph planning.
problem Rigidity in diffusion models due to high-dimensional state space.
method Chain-of-Trajectories (CoTj) framework using Diffusion DNA for graph planning.
result CoTj discovers context-aware trajectories improving output quality and stability.
In online social media systems users are not only posting, consuming, and resharing content, but also creating new and destroying existing connections in the underlying social network. While each of these two types of dynamics has individually been studied in the past, much less is known about the connection between th…
Kernel analysis reveals rumor truth from diffusion patterns alone.
problem Detecting unverified rumors on Twitter using text and user identities.
method Graph kernels to extract diffusion patterns from Twitter cascade structures.
result Diffusion patterns are highly informative of rumor truth or falsehood.
This paper uses diffusion models for lossy image compression, improving perceptual metrics and practicality.
problem Lossy image compression with improved perceptual metrics and practicality.
method End-to-end optimized lossy image compression using conditional diffusion models.
result The model yields stronger FID scores and competitive performance in distortion metrics.
Diffusion models' sampling paths lie in a low-dimensional subspace, resembling boomerangs.
problem Understanding the geometric structure of diffusion-based generative models.
method Characterization of deterministic sampling trajectories using low-dimensional subspace and kernel-estimated data modeling.
result Sampling trajectories in diffusion models are confined to a low-dimensional subspace and exhibit a boomerang shape.
Unified derivation of diffusion models using PDEs for inverse problems.
problem Solving inverse problems in physics-based applications.
method Deriving diffusion models using PDEs for a unified approach.
result Unified derivation and new class of variance preserving models.
Proposes a framework for energy-efficient AIGC workload scheduling in cloud data centers.
problem Challenges of scheduling AIGC workloads for energy efficiency and quality control.
method Joint energy management and coordinated AIGC workload scheduling framework with diffusion model-aided reward shaping.
result Effective learning of scheduling policies under sparse environmental feedback.
A new method optimizes diffusion models with recursive likelihood ratios.
problem Efficiently aligning pre-trained diffusion models for specific applications.
method Recursive Likelihood Ratio (RLR) optimizer for Half-Order (HO) fine-tuning.
result The RLR method achieves unbiased and lower-variance gradients, improving model performance.
AutoAnchor uses cross-attention to improve text-to-image model unlearning.
problem Mitigating harmful or copyrighted content in text-to-image models.
method Two-stage framework that automatically synthesizes manifold-proximal anchors using cross-attention consistency loss.
result Effective robust and unbiased unlearning across various baselines.
Efficiently generates high-resolution images with reduced sampling time using LEGO bricks.
problem Efficiently generating high-resolution images with reduced sampling time.
method Introduces LEGO bricks that integrate Local-feature Enrichment and Global-content Orchestration to create a test-time reconfigurable diffusion backbone.
result Significantly reduces sampling time compared to other methods.
Estimates latent topic structure from information diffusion events.
problem Estimating latent structure of social networks from cascade data.
method Proposes a node-topic model with influence and receptivity vectors.
result Consistent estimator of latent topic structure from cascades.
We analyze DMs using spectral methods to design effective noise schedules.
problem Lack of theoretical foundation for synthesis process decisions in DMs.
method Introduced a frequency response perspective based on Gaussianity assumption.
result Proposed a spectral transfer function to understand DM inference process.
Generative models tackle incompressible fluid flows by enforcing divergence-free constraints.
problem Simulating incompressible fluid flows with generative models.
method Score-based diffusion models with divergence-free constraint.
result Models can reproduce Kolmogorov turbulence characteristics.
Efficiently estimates Hawkes process kernels using non-parametric Bayesian methods.
problem Estimating flexible Hawkes process kernels with uncertainty quantification.
method Cluster representation of Hawkes processes, Gibbs sampling, expectation maximization.
result Linear time complexity in both theoretical and empirical settings.
Two semi-supervised manifold alignment methods improve cross-domain classification.
problem Aligning data from multiple sources for better analysis.
method SPUD and MASH methods using graph integration and diffusion.
result SPUD and MASH methods outperform existing methods in cross-domain classification.
The paper explores how information theory aids in statistical learning models.
problem Characterizing fundamental performance limits in statistical learning models.
method Introduces divergence measures and evidence lower bound (ELBO) in model training.
result Provides a systematic derivation for generative diffusion models.
New model learns content and transformation separately from data.
problem Learning disentangled representations from data without explicit labels.
method Group-based variational autoencoders, assuming content and transformation groups.
result Model learns generalizable content representations from unseen data.
Study shows online learning algorithms incentivize low-quality content, proposing new algorithms to improve quality.
problem Online learning algorithms in content recommender systems incentivize producers to create low-quality content.
method Analyzed the game between producers and content quality, designed new learning algorithms to incentivize high effort and quality.
result New algorithms incentivize producers to invest high effort and achieve high user welfare, improving content quality.
Unified model for audio control and style transfer.
problem Explicit control and style transfer in music generation.
method Diffusion autoencoders for semantic feature extraction, disentanglement using adversarial criterion.
result Model generates audio matching timbre targets with specified structure.
Proposes a model to optimize feedback for content creators on social media.
problem Nurturing content creation on social media platforms.
method Modeling feedback distribution to incentivize creators and optimize newsfeed experience.
result Optimized newsfeed for content creators without compromising user experience.
Proposes a VAE variant for ordinal content factors.
problem Isolating ordinal-valued content factors in deep latent variable models.
method Introduces a partially ordered set (poset) structure and a conditional Gaussian spacing prior model.
result Significant improvements in content-style separation over previous non-ordinal approaches.
Generative model learns to create coherent slates from prompts.
problem Generating coherent slates from natural language prompts.
method DMSG, a generative framework based on diffusion models.
result DMSG outperforms baselines in relevance and diversity.
This research predicts the popularity of new video contents using a hybrid machine learning approach.
problem Predicting the popularity of new video contents before they are published.
method Hybrid machine learning approach combining XGBoosting and deep neural nets, using metadata and categorical embedding techniques.
result Achieved better performance than standalone methods, validated on a dataset from a top streaming service.
Method recombines image content and style from different images.
problem Recombining image content and style from different images.
method Constructs content embedding, uses VAE with leakage filtering to ensure separation of style and content.
result Synthesizes novel images with state-of-the-art performance on few-shot learning tasks.
Preserves content while changing style in text.
problem Text style transfer often fails to preserve content.
method Leverages linguistic information in structured supervisions.
result Significant improvement in content preservation and style transfer.
A mixture of CNNs improves adult content recognition.
problem Recognizing and restricting inappropriate images like pornography.
method A weighted sum of multiple CNN models trained using OLS.
result The proposed model outperforms single and average models.
Many businesses are using recommender systems for marketing outreach. Recommendation algorithms can be either based on content or driven by collaborative filtering. We study different ways to incorporate content information directly into the matrix factorization approach of collaborative filtering. These content-booste…
Spotify improves content mix using contextual bandits.
problem Skewed historical data and varying user preferences across contexts.
method Contextual bandits to dynamically learn optimal content type distribution.
result Improved precision and user engagement with under-represented content types.
A new model considers fatigue in online content recommendation systems.
problem Fatigue in users due to overexposure and boredom from similar recommendations.
method Proposed a fatigue-aware Dependent Click Model (DCM) and two learning algorithms.
result Developed algorithms with regret bounds for learning content relevance and fatigue effects.