DLM-One speeds up language generation by 500x with continuous models.
problem Efficiently generating text sequences in natural language processing.
method Score-distillation of continuous diffusion language models.
result Achieves up to 500x speedup in inference time with competitive performance.
Warped DLMs improve forecasting for count time series.
problem Limited options for modeling count time series data.
method Introduces a semiparametric methodology using warping of Gaussian DLMs.
result Demonstrates improved forecasting capabilities for count time series.
The paper improves sparse Gaussian processes by optimizing predictive loss.
problem Optimizing predictive loss in sparse Gaussian processes.
method Direct loss minimization (DLM) for log-loss and square loss, with product sampling (uPS) and biased Monte Carlo (bMC) for non-conjugate cases.
result DLM shows significant performance improvement in both log-loss and square loss cases.
Unified continuous diffusion model outperforms discrete alternatives in scalability and quality.
problem Continuous diffusion models were perceived as less scalable than discrete models.
method Reconstructed Plaid model and compared it with modern discrete DLMs, optimizing noise schedule and embeddings via likelihood.
result Unified continuous diffusion model (RePlaid) outperforms discrete models in compute efficiency and quality.
DLM for BNNs fails to improve over ELBO optimization.
problem Performance of DLM for Bayesian Neural Networks (BNNs).
method Direct Loss Minimization (DLM) compared to ELBO optimization.
result DLM does not significantly improve over ELBO optimization for BNNs.
Dynamic linear models improve travel time prediction for congested freeways.
problem Accurate travel time prediction for congested freeways.
method Dynamic linear models (DLMs) with time-varying parameters.
result Significant improvements in travel time prediction accuracy, especially for short-term predictions.
Learning new representations of input observations in machine learning is often tackled using a factorization of the data. For many such problems, including sparse coding and matrix completion, learning these factorizations can be difficult, in terms of efficiency and to guarantee that the solution is a global minimum.…
New RL algorithm GDPO improves DLM reasoning efficiency.
problem Adapting RL to DLMs for efficient, unbiased likelihood estimation.
method Group Diffusion Policy Optimization (GDPO) using semi-deterministic Monte Carlo.
result GDPO outperforms existing methods on math, reasoning, and coding benchmarks.
Entropy-based decoding improves DLM sampling efficiency.
problem Decoding strategy challenges in flexible DLMs.
method Entropy sum-based confidence-based decoding.
result Entropy sum-based decoding achieves ε \varepsilon ε -accuracy with O ~ ( H ( X 0 ) / ε ) \widetilde O(H(X_0)/\varepsilon) O ( H ( X 0 ) / ε ) iterations. New method adapts DLMs to intrinsic data dependence without prior knowledge.
problem Understanding how unmasking schedules affect DLM generation quality.
method Adapts unmasking schedule to target data distribution's dependence structure.
result Sampling convergence guarantees improve for low-complexity distributions.
Fenrir efficiently estimates Bayesian MLN-DLMs for scalable inference.
problem Computational challenges in Bayesian MLN-DLMs for longitudinal count compositional data.
method Novel algorithm for MAP estimation and accurate posterior marginal approximation.
result Fenrir can be three orders of magnitude more efficient than Stan.
Bayesian model improves asset price forecasting using realized volatility.
problem Improving asset price forecasting accuracy.
method Integrates dynamic gamma process with DLMs for price and realized volatility.
result Significant improvements in asset price forecasting compared to standard models.
Study forecasts stock returns on JSE using SGDLMs capturing cross-series dependencies.
problem Accurate forecasting of multivariate time series data.
method Simultaneous Graphical Dynamic Linear Models (SGDLMs) with customised DLMs and importance sampling/mean-field variational Bayes.
result SGDLMs accurately forecast stock data on JSE and respond to market changes.
Clustering in high-dimensional spaces is nowadays a recurrent problem in many scientific domains but remains a difficult task from both the clustering accuracy and the result understanding points of view. This paper presents a discriminative latent mixture (DLM) model which fits the data in a latent orthonormal discrim…
Improved text-to-image and multimodal understanding through adaptive generation order optimization.
problem Determining optimal generation sequences in text-to-image synthesis and multimodal understanding.
method Introduced a learnable control module trained via Group Relative Policy Optimization (GRPO) to determine the generation order.
result Learning the control block substantially improves text-to-image alignment and multimodal understanding in DLMs.
Bayesian method tests Granger causality in functional time series.
problem Testing Granger causality between functional time series.
method Bayesian dynamic linear models (DLM) and Bayes Factor.
result Captures Granger causality between yield curves and weather conditions.
We develop VAE-DLM for dynamics with geometric flows in latent space.
problem Learning latent geometric properties for dynamics in high-dimensional data.
method Riemannian approaches to VAEs with a geometric flow in latent space, reformulating ELBO loss.
result Improved performance and robust learning for external dynamics, reducing OOD error.
Bayesian framework improves financial risk management and compliance.
problem Uncertainty in financial risk forecasting and compliance.
method Integrated Bayesian analytics framework for precise uncertainty quantification.
result Proposed DLM model produces more accurate VaR estimates compared to baseline models.