Paper introduces a method to generate physically feasible dynamics with physical priors.
problem Challenges in generating physically feasible dynamics under physical priors.
method Seamlessly incorporates physical priors into diffusion-based generative models.
result Efficient generation of physically realistic dynamics across various physical phenomena.
A novel Bayesian method for dynamic sparsity in Gaussian dynamic linear regression.
problem Variable selection and shrinkage in time-varying regression models.
method Time-varying sparsity via Markov switching priors for coefficients' variances, extending spike-and-slab priors.
result Induces smoothness or shrinkage towards zero at each time point, leading to improved model performance.
Proposes learning task-agnostic dynamics priors for faster RL.
problem Challenges in learning accurate dynamics models for RL.
method Pre-training a frame predictor on physics videos to initialize and fine-tune dynamics models.
result Improves policy learning and convergence, outperforming competitors.
Framework expands particle filtering to estimate states beyond prior boundaries.
problem Limitations of traditional particle filtering in estimating states outside prior support.
method Diffusion-Enhanced Particle Filtering Framework with adaptive diffusion, entropy-driven regularisation, and kernel-based perturbations.
result Framework significantly improves state estimation accuracy and success rates for out-of-boundary targets.
NDS learns dynamical models with prior knowledge, improving accuracy and efficiency.
problem Learning accurate dynamical models with limited data and varying dynamics.
method Neural Dynamical Systems (NDS) integrates prior knowledge in ODEs with neural networks to estimate parameters and predict states.
result NDS achieves higher accuracy and uses fewer samples compared to other methods.
Study finds physical priors don't significantly improve ML models for learning latent dynamics.
problem Learning latent dynamics from visual observations without access to the underlying state.
method Benchmarked 17 datasets with visual observations of physical systems using various physically inspired methods alongside baselines.
result Physical priors do not significantly improve standard techniques for learning latent dynamics.
We study the problem of learning shared structure \emph{across} a sequence of dynamic pricing experiments for related products. We consider a practical formulation where the unknown demand parameters for each product come from an unknown distribution (prior) that is shared across products. We then propose a meta dynami…
Cohesion uses deep Koopman operators to generate long-range forecasts of chaotic dynamics.
problem Challenges in data-driven emulation of chaotic dynamics, especially long-range skill decay.
method Generative modeling with coherent priors estimated using reduced-order models.
result Superior long-range forecasting skill on chaotic systems, including climate dynamics.
Bayesian framework integrates prior and data knowledge for nonlinear dynamical systems.
problem Fusing diverse prior knowledge with data for accurate model learning.
method General-purpose Bayesian inference and learning framework combining explicit and implicit prior knowledge.
result Efficient parameter marginalization and closed-form densities for online and offline inference.
PRISM-VQ combines financial priors with vector quantization for better stock prediction.
problem Predicting cross-sectional stock returns is hard due to low signal-to-noise ratios and changing market conditions.
method Integrates expert priors, vector-quantized latent factors, and dynamic factor loadings.
result Consistent improvements in cross-sectional return prediction and portfolio performance.
DAFT models attention as a dynamical system to make neural networks more interpretable.
problem Uninterpretable features learned by neural networks without human priors.
method DAFT models attention as a continuous dynamical system using neural ODEs.
result DAFT reduces the number of reasoning steps while maintaining similar performance.
Dynamic skewness models improve financial time series analysis.
problem Modeling financial time series with skewness and heavy tails.
method Dynamic skewness stochastic volatility models with penalized priors and HMC estimation.
result Penalized priors outperform classical choices in model performance.
Paper uses SGLD to recover signals from generative models, proving convergence under mild conditions.
problem Signal recovery from generative priors in compressed sensing.
method Stochastic Gradient Langevin Dynamics (SGLD) for signal recovery.
result SGLD converges to the true signal under mild assumptions on the generative model.
Estimation of response functions is an important task in dynamic medical imaging. This task arises for example in dynamic renal scintigraphy, where impulse response or retention functions are estimated, or in functional magnetic resonance imaging where hemodynamic response functions are required. These functions can no…
The paper proposes a framework to reason about object dynamics for faster reinforcement learning.
problem Current reinforcement learning approaches lack prior knowledge about the environment, limiting efficiency.
method Integrates object dynamics and behavior into reinforcement learning to improve efficiency.
result Demonstrates the need for reasoning about object behavior and dynamics, leading to faster learning.
Posterior sampling estimator achieves near-optimal recovery guarantees for signals from any prior distribution.
problem Characterizing measurement complexity for signals from any prior distribution, including the entire space.
method Characterization of measurement complexity using posterior sampling estimator for Gaussian measurements and any prior distribution.
result Posterior sampling estimator achieves near-optimal recovery guarantees for signals from any prior distribution, robust to model mismatch.
New framework uses dynamics to justify Gaussian process for turbulent flows.
problem Lack of rigorous justification for Gaussian process priors in turbulent flows.
method Introduces a dynamics-informed Gaussian process framework based on quasi-Gaussianity.
result Provides a principled, long-time dynamical justified GP prior for turbulent flows.
One of the challenges in model-based control of stochastic dynamical systems is that the state transition dynamics are involved, and it is not easy or efficient to make good-quality predictions of the states. Moreover, there are not many representational models for the majority of autonomous systems, as it is not easy …
DIVA clusters dynamic data without needing cluster count, outperforming baselines.
problem Clustering complex, dynamic data without prior knowledge of cluster count.
method Nonparametric Dirichlet Process Mixtures with memoized online variational inference.
result DIVA outperforms state-of-the-art in classifying complex data with changing features.
Advanced and effective collaborative filtering methods based on explicit feedback assume that unknown ratings do not follow the same model as the observed ones (\emph{not missing at random}). In this work, we build on this assumption, and introduce a novel dynamic matrix factorization framework that allows to set an ex…
Proposes a graph dynamics prior for more accurate relational inference.
problem Identifying interactions in dynamical systems from observed dynamics.
method Graph Dynamics Prior (GDP) that uses error amplification in non-local polynomial filters.
result Reconstructs graphs more accurately than previous methods, robust to under-sampling.
Dynamic paired comparison models, such as Elo and Glicko, are frequently used for sports prediction and ranking players or teams. We present an alternative dynamic paired comparison model which uses a Gaussian Process (GP) as a prior for the time dynamics rather than the Markovian dynamics usually assumed. In addition,…
New priors can update posteriors without re-estimating likelihoods.
problem Degradation of classification approaches when class priors change.
method Recompute posteriors using recovered likelihoods from original posteriors and new priors.
result Dynamic update of original posteriors is possible without re-estimating likelihoods.
Alternative sampling method for autoregressive models using Langevin dynamics.
problem Efficiently sampling from autoregressive models.
method Initialize sequences with white noise and follow Langevin dynamics on global log-likelihood.
result Parallelizes and generalizes sampling process for autoregressive models.
Model approximates market prices and returns without prior market dynamics.
problem Simultaneously approximate market prices and log returns.
method GDN model of Kratsios and Papon (2022) for generalized Ornstein-Uhlenbeck process.
result Universal approximation guarantees for conditional distributions and contingent claims.
Improves model accuracy for neural nets in stochastic dynamics with partial prior knowledge.
problem Stability and accuracy in neural nets modeling stochastic dynamics with many parameters.
method Three steps: probabilistic weights, partial knowledge incorporation, and PAC-Bayesian training.
result Improved model fit with partial and noisy prior knowledge.
Algorithm adapts to non-stationary rewards without prior knowledge.
problem Optimizing decisions in non-stationary environments without prior knowledge of changes.
method Optimization-based algorithm that restarts when non-stationarity is detected.
result Achieves tighter dynamic regret bound and is nearly minimax optimal.
Framework incorporates prior knowledge into Bayesian models for data streams.
problem Effective use of prior knowledge in learning Bayesian models from streaming data.
method Proposes a novel framework that subsumes existing models for time-series data.
result Framework outperforms existing methods with a large margin.
Proposes a flexible MGP model for dynamic, sparse correlations.
problem Handling dynamic and sparse correlations in multivariate data.
method Non-stationary MGP with dynamic spike-and-slab prior and EM algorithm.
result Captures dynamic and sparse correlations effectively.
Soft geometric bias improves physical dynamics predictions.
problem Learning physical dynamics with exact group equivariance can degrade performance.
method Object-centric world models using geometric algebra neural networks.
result Soft geometric inductive bias leads to better physical fidelity predictions.
We propose the factorized action variational autoencoder (FAVAE), a state-of-the-art generative model for learning disentangled and interpretable representations from sequential data via the information bottleneck without supervision. The purpose of disentangled representation learning is to obtain interpretable and tr…
This work introduces a new regularization method that improves sparsity and generalization.
problem Improving sparsity and generalization in machine learning models.
method Formulates a dynamic regularizer with an informative prior to improve sparsity.
result The proposed regularizer shows better results in inducing sparsity and improving generalization compared to existing methods.
Blade uses diffusion priors to accurately and calibratedly infer complex systems.
problem Derivative-free Bayesian inversion for high-dimensional, nonlinear problems with costly forward models.
method Blade employs an ensemble of interacting particles and diffusion models as priors, querying forward models only through evaluations.
result Blade produces well-calibrated posterior samples that existing methods cannot, improving with more iterations and particles.
Bayesian framework estimates label shift for improved classifier performance.
problem Label shift in supervised learning leading to degraded classifier performance.
method Bayesian framework with dynamic Dirichlet priors and online EM algorithms.
result Significant improvements in classifier accuracy over state-of-the-art methods.
CSGM framework applied to clinical MRI data for robust reconstructions.
problem Applying deep generative priors to clinical MRI data for high-quality reconstructions.
method Training a generative prior on brain scans from the fastMRI dataset and using Langevin dynamics for posterior sampling.
result Posterior sampling via Langevin dynamics achieves high quality reconstructions in clinical MRI data.
Recent advances in Bayesian reinforcement learning (BRL) have shown that Bayes-optimality is theoretically achievable by modeling the environment's latent dynamics using Flat-Dirichlet-Multinomial (FDM) prior. In self-interested multi-agent environments, the transition dynamics are mainly controlled by the other agent'…
Bayesian method clusters time series with varying dynamics.
problem Modeling and clustering time series with unknown number of clusters and dynamics.
method Hierarchical Dirichlet process and Gaussian process for modeling time series patterns and variations.
result Efficiently clusters time series with varying dynamics without unnecessary proliferation of clusters.
Introduces PELP for graph-enhanced word embeddings.
problem Combining graph side-information into static word embeddings.
method Probabilistic embeddings using Laplacian priors.
result Unified and flexible approach to various embedding methods.
New algorithm reduces dynamic regret without prior function change knowledge.
problem Non-stationary stochastic optimization with bandit feedback.
method Fixed step sizes combined with multi-scale sampling framework.
result Achieves optimal dynamic regret without prior function change knowledge.
Bayesian method for dynamic correlation matrices improves accuracy and responsiveness.
problem Challenges in estimating time-varying correlation matrices, including slow adaptation, insufficient regularization, and diffuse uncertainty.
method Low-rank factor representation with dynamic shrinkage prior and multivariate factor stochastic volatility model.
result Improved accuracy and responsiveness compared to competing methods in various challenging scenarios.
Dynamic topic models (DTMs) model the evolution of prevalent themes in literature, online media, and other forms of text over time. DTMs assume that word co-occurrence statistics change continuously and therefore impose continuous stochastic process priors on their model parameters. These dynamical priors make inferenc…
Paper develops a framework to identify latent dynamics from high-dimensional data.
problem Identifying latent dynamics from high-dimensional time-series data.
method Combines physics inductive bias and learn-to-identify strategy.
result Meta-HyLaD framework effectively identifies hybrid latent dynamics.
Bayesian approach uses generative models as priors for better source separation.
problem Artifacts in source separation for richly structured data.
method Bayesian approach with generative models as priors and noise-annealed Langevin dynamics.
result Achieves state-of-the-art performance for MNIST digit separation.
New methods combine MALA and mGRAD for scalable Bayesian inference in high-dimensional state-space models.
problem Bayesian inference in high-dimensional state-space models with limited scalability.
method Combines gradient-based MALA and prior-informed mGRAD for scalable inference.
result Extends classical MCMC methods to handle multiple time steps and particles.
Proposes a method to learn system dynamics and region of attraction from trajectories.
problem Learning accurate dynamics and region of attraction from system trajectories.
method Uses local stability information as a prior to learn vector field and region of attraction.
result Efficient sampling and accurate estimate of dynamics in inner approximation of region of attraction.
This paper analyzes how diffusion models learn and generalize concepts.
problem Learning and generalizing concepts in compositional data-generating processes.
method Introduced a structured identity mapping (SIM) task to analyze neural network learning dynamics.
result SIM task captures key empirical observations on compositional generalization.
Develops VAEs for learning complex physical systems from data.
problem Learning low-dimensional representations of nonlinear physical systems.
method Variational Autoencoders with manifold latent spaces.
result Effective in learning nonlinear Burgers equation and constrained mechanical systems.
Recently there has been substantial interest in spectral methods for learning dynamical systems. These methods are popular since they often offer a good tradeoff between computational and statistical efficiency. Unfortunately, they can be difficult to use and extend in practice: e.g., they can make it difficult to inco…