Proposes LDIDPs for efficient sequential data generation from latent dynamical models.
problem Challenges in generating high-fidelity sequential samples from latent dynamical models.
method Utilizes implicit diffusion processes to sample from latent dynamical processes.
result Demonstrates accurate learning of dynamics and efficient generation of high-quality sequential data.
New method reduces sample complexity for learning Ising model dynamics exponentially.
problem Learning binary graphical models from correlated samples produced by a dynamical process.
method Two estimators based on interaction screening objective and conditional likelihood loss.
result Sample complexity reduces exponentially for samples from a dynamical process far from equilibrium.
Alternative sampling method for autoregressive models using Langevin dynamics.
problem Efficiently sampling from autoregressive models.
method Initialize sequences with white noise and follow Langevin dynamics on global log-likelihood.
result Parallelizes and generalizes sampling process for autoregressive models.
HySRL improves RL sample efficiency with shifted-dynamics data.
problem Leveraging historical data with shifted dynamics to improve sample efficiency in RL.
method HySRL, a hybrid transfer RL algorithm that uses prior information on dynamics shift to achieve better sample complexity.
result HySRL achieves problem-dependent sample complexity and outperforms pure online RL.
Paper proposes learning system dynamics from irregularly-sampled partial observations.
problem Capturing dynamics of multi-agent systems with irregular and partial observations.
method LG-ODE, a latent ordinary differential equation model using graph neural networks and neuralODE.
result Demonstrates effectiveness on motion capture, spring system, and charged particle datasets.
We propose a new Stein self-repulsive dynamics for obtaining diversified samples from intractable un-normalized distributions. Our idea is to introduce Stein variational gradient as a repulsive force to push the samples of Langevin dynamics away from the past trajectories. This simple idea allows us to significantly de…
Quantum dynamics algorithm learns manifold from data.
problem Learning manifolds from high-dimensional datasets.
method Simulation of quantum dynamics on a graph embedding of data.
result Algorithm reveals connections between data sampling and quantization.
Dynamic Influence Tracker measures changing sample importance during model training.
problem Static influence measurements during training overlook how sample importance varies over time.
method Dynamic Influence Tracker (DIT) captures time-varying sample influence across arbitrary time windows.
result DIT reveals distinct learning phases with shifting priorities and detects corrupted samples more efficiently.
Adaptive sampling for multimodal distributions converges faster than classical methods.
problem Sampling from multimodal distributions efficiently.
method Adaptive linear dynamics with adaptive diffusion coefficients and vector fields, interpreted as weighted Wasserstein gradient flows.
result Derivative-free dynamics can achieve significantly faster convergence for nonconvex potentials.
Novel data acquisition schemes have been an emerging need for scanning microscopy based imaging techniques to reduce the time in data acquisition and to minimize probing radiation in sample exposure. Varies sparse sampling schemes have been studied and are ideally suited for such applications where the images can be re…
Combining diffusion models with Langevin dynamics improves posterior sampling efficiency.
problem Sampling from noisy posterior distributions efficiently.
method Annealed Langevin dynamics combined with diffusion models.
result Achieves posterior sampling in polynomial time with a weaker score error bound.
We present a novel technique for learning the mass matrices in samplers obtained from discretized dynamics that preserve some energy function. Existing adaptive samplers use Riemannian preconditioning techniques, where the mass matrices are functions of the parameters being sampled. This leads to significant complexiti…
DICE learns population dynamics from discrete samples.
problem Learning smooth population dynamics from discrete data.
method Discrete Inverse Continuity Equation (DICE) method.
result DICE models are stable and generate representative samples.
Dynamic sample pruning speeds up spatio-temporal forecasting models.
problem Training deep learning models on large, redundant datasets is computationally expensive.
method Dynamic sample pruning based on real-time learning state.
result Significant acceleration of training speed with improved performance.
Optimal sample complexity for learning DDAGs from noisy data.
problem Learning interactions in linear dynamical systems over DAGs.
method Proposed a metric and algorithm based on PSD matrix for reconstruction.
result Optimal sample complexity n=Θ(qlog(p/q)) for learning DDAGs. Langevin Dynamics fails to sample from mixture distributions efficiently.
problem Analyzing Langevin Dynamics for sampling from mixture distributions.
method Theoretical analysis of Langevin Dynamics and proposing Chained-Langevin Dynamics.
result Langevin Dynamics fails to sample from mixture distributions efficiently.
The aim of multi-task reinforcement learning is two-fold: (1) efficiently learn by training against multiple tasks and (2) quickly adapt, using limited samples, to a variety of new tasks. In this work, the tasks correspond to reward functions for environments with the same (or similar) dynamical models. We propose to l…
Improved sample efficiency in reinforcement learning with deep Gaussian processes.
problem Efficiently learn to control actions with limited interaction data.
method Deep Gaussian processes that simulate dynamics with depth and prior knowledge.
result Significantly improved early sample efficiency across various tasks, including half-cheetah control.
Efficiently samples posterior distributions using Langevin dynamics.
problem Challenges in generating diverse posterior samples in high-dimensional spaces.
method Simulates Langevin dynamics in the noise space of a pre-trained generative model.
result Noise-space Langevin dynamics approximates the posterior without restarting the full sampling chain.
Blend-ASC improves self-consistency efficiency by dynamically allocating samples, reducing costs.
problem Efficiently applying self-consistency to large datasets is computationally expensive.
method Blend-ASC dynamically allocates samples during inference, improving efficiency.
result Blend-ASC reduces sample usage by 6.8x on average compared to vanilla self-consistency.
Kernel test evaluates dynamical system data streams.
problem Evaluate if data streams from dynamical systems are from the same distribution.
method Proposes a novel kernel two-sample test for dynamical systems, addressing independence and autocorrelation challenges.
result Data-driven method with theoretical guarantees for anomaly detection.
Diffusion models' sampling paths lie in a low-dimensional subspace, resembling boomerangs.
problem Understanding the geometric structure of diffusion-based generative models.
method Characterization of deterministic sampling trajectories using low-dimensional subspace and kernel-estimated data modeling.
result Sampling trajectories in diffusion models are confined to a low-dimensional subspace and exhibit a boomerang shape.
This paper improves volatility forecasting using dynamic subset selection in genetic programming.
problem Improving accuracy of implied volatility forecasting.
method Dynamic training-subset selection methods applied to genetic programming.
result Dynamic subset selection improves predictive accuracy of genetic programming models.
Infrastructure monitoring is critical for safe operations and sustainability. Water distribution networks (WDNs) are large-scale networked critical systems with complex cascade dynamics which are difficult to predict. Ubiquitous monitoring is expensive and a key challenge is to infer the contaminant dynamics from parti…
In this paper, we study the problem of sampling from a graphical model when the model itself is changing dynamically with time. This problem derives its interest from a variety of inference, learning, and sampling settings in machine learning, computer vision, statistical physics, and theoretical computer science. Whil…
Avare improves optimization and sampling with adaptive importance sampling.
problem Improving convergence rate of stochastic gradient-based algorithms.
method Adaptive importance sampling with decreasing step-sizes.
result Achieves dynamic regret bounds of O(T2/3) and O(T5/6). Study birth-death dynamics for sampling Gibbs measures with nonconvex potentials.
problem Sampling Gibbs measures with nonconvex potentials.
method Birth-death dynamics, Kullback-Leibler divergence, χ2 divergence, kernel-based approximations, Γ-convergence of gradient flows. result Probability density converges exponentially fast to Gibbs equilibrium measure with a universal rate.
This paper improves system identification by reducing sample complexity for high-dimensional linear dynamical systems.
problem High sample complexity for learning partially observed linear dynamical systems in high dimensions.
method Introduces an ℓ1-regularized estimation method that reduces sample complexity from linear to logarithmic with system dimension. result Markov parameters can be learned with logarithmic number of samples relative to system dimension, improving sample complexity.
Despite the availability of ever more data enabled through modern sensor and computer technology, it still remains an open problem to learn dynamical systems in a sample-efficient way. We propose active learning strategies that leverage information-theoretical properties arising naturally during Gaussian process regres…
Optimizes network sampling for efficient community detection.
problem Prohibitive cost of observing entire network for community detection.
method Chernoff-optimal dynamic sampling scheme for stochastic blockmodel.
result Significant resource savings while maintaining block structure recovery.
Latent MoS learns multiple symmetries for efficient dynamic learning.
problem Efficiently learning dynamics from limited system measurements.
method Latent Mixture of Symmetries (Latent MoS) with hierarchical architecture.
result Latent MoS outperforms baselines in interpolation and extrapolation tasks.
Efficiently selects top-m designs for various contexts using sequential sampling.
problem Optimizing selection of top-m designs across different contexts.
method Formulated as a stochastic dynamic programming problem, developed sequential sampling policy.
result Asymptotically optimal sampling ratios for efficient selection.
WiGS improves active learning for regression by dynamically selecting informative samples.
problem Reducing labeling costs in regression tasks.
method Formulated as a reinforcement learning problem, WiGS adapts the exploration-investigation balance.
result WiGS outperforms static methods in accuracy and labeling efficiency, especially in irregular data density.
New study on guidance in masked diffusion models, showing how it shapes sampling dynamics.
problem Understanding how guidance influences the sampling behavior of masked diffusion models.
method Derived explicit solution to guided reverse dynamics, analyzing effects in 1D and 2D.
result Guidance amplifies class-specific regions and suppresses shared regions, affecting covariance structures.
Algorithm identifies bilinear dynamical systems from noisy data.
problem Learning a realization of a partially observed bilinear dynamical system.
method Regression of outputs to highly correlated covariates for Markov-like parameters.
result High probability error bounds on identification algorithm under uniform stability assumption.
The paper analyzes a neural network two-sample test using kernel analysis.
problem Determining if two datasets come from the same distribution.
method Time-analysis on a neural tangent kernel (NTK) two-sample test, extending to realistic neural network dynamics.
result Training times needed to detect deviations are well-separated in null and alternative hypothesis scenarios.
ICSGLD improves efficiency in posterior sampling for big data.
problem Efficient posterior sampling for large datasets.
method Embarrassingly parallel multiple-chain CSGLD with efficient interactions.
result ICSGLD is more efficient than a single-chain CSGLD.
ES improves training efficiency by dynamically selecting data samples.
problem Efficiently selecting informative data samples for faster learning.
method Evolved Sampling (ES) dynamically selects data samples based on loss dynamics and differences.
result ES achieves significant training acceleration without compromising model performance.
New algorithm reduces sample complexity for online reinforcement learning.
problem Reducing sample complexity for online reinforcement learning in nonlinear systems.
method Generalized algorithm for various dynamical systems, including neural networks.
result Achieves policy regret of O(Nε^2 + d_u ln(m(ε))/ε^2) in general settings.
NCDSSM models irregularly sampled time series with improved imputation and forecasting.
problem Accurate modeling of irregularly sampled time series with missing observations.
method Neural Continuous-Discrete State Space Model (NCDSSM) with amortized inference for auxiliary variables and flexible dynamic state parameterizations.
result Improved imputation and forecasting performance on multiple benchmark datasets.
Generative models map simple samples to complex target samples.
problem Improving Monte-Carlo sampling techniques.
method Variational learning of dynamical maps between base and target measures.
result Improved sampling efficiency through feedback loops.
Improved forecasting for irregularly-sampled time series using kernel flows.
problem Forecasting dynamical systems from irregularly-sampled time series data.
method Directly approximating the vector field using time differences in data-adapted kernels.
result Significant improvement in forecasting accuracy compared to classical methods.
New method for long-term sampling of complex dynamics on curved spaces.
problem Sampling ergodic dynamics on Riemannian manifolds efficiently over long periods.
method Intrinsic geometric operations for sampling invariant measure without embeddings.
result Outperforms previous methods in long-term sampling efficiency.
We present an adversarial active exploration for inverse dynamics model learning, a simple yet effective learning scheme that incentivizes exploration in an environment without any human intervention. Our framework consists of a deep reinforcement learning (DRL) agent and an inverse dynamics model contesting with each …
New methods improve sampling from complex dynamical models.
problem Sampling from high-dimensional, non-linear latent dynamical models is computationally challenging.
method Introduce auxiliary MCMC and Particle Gibbs samplers with improved performance and parallelisation.
result Enhanced samplers maintain performance in high-dimensional latent spaces and support parallelisation.
A new sampling method estimates scores without training or nested MCMC.
problem Efficient sampling from complex, unnormalised distributions.
method Multiscale averaging in SDEs for score estimation.
result Empirical results show competitive accuracy and efficiency.
New algorithm samples Bayesian neural networks for improved calibration.
problem Improving calibration of Bayesian neural networks.
method Symmetric Minibatch Splitting-UBU (SMS-UBU) algorithm.
result SMS-UBU provides better calibration performance than standard methods.
Lower bounds and upper bounds on sample complexity for identifying linear dynamical systems.
problem Identifying an unknown linear dynamical system with limited data.
method Sample complexity lower and upper bounds, persistent excitation condition, active learning algorithm.
result Lower and upper bounds share the same dependency on key problem parameters.