Improves neural relational inference for dynamic multi-agent trajectories.
problem Limited accuracy of NRI in short output sequences for relational inference in multi-agent trajectories.
method Proposes DYnamic multi-AgentRelational Inference (DYARI) model to handle changing interactions over time.
result DYARI model outperforms NRI in dynamic relational inference tasks.
VTIRT speeds up IRT inference for dynamic learner proficiency.
problem Expensive and slow inference algorithms for dynamic IRT models.
method Variational Temporal IRT (VTIRT) for fast, accurate inference.
result Orders of magnitude speedup in inference runtime with accurate results.
Framework infers Langevin dynamics from stochastic observations of latent systems.
problem Inferring non-stationary Langevin dynamics from indirect stochastic observations.
method Non-parametric framework explicitly modeling stochastic observation process and non-stationary latent dynamics.
result Correct inference of non-stationary dynamics requires accounting for non-equilibrium states and observation duration.
Proposes exact inference for continuous-time Gaussian process dynamics.
problem Inexact inference methods for continuous-time Gaussian process dynamics are impractical for irregularly-sampled data.
method Uses higher-order numerical integrators to discretize dynamics with arbitrary accuracy and proposes multistep and Taylor integrators for exact inference.
result Demonstrates accurate representation of continuous-time systems through exact GP inference.
New method for state inference in state-space models with unknown dynamics.
problem State inference in state-space models with computationally expensive and undefined dynamics.
method Estimate state transition dynamics using a multi-output Gaussian process and Bayesian Neural Network as a surrogate model.
result Significant improvement in accuracy for state inference and prediction in non-stationary user models.
New method infers dynamical systems from population data.
problem Inferring dynamical systems from population data.
method Deducing and estimating Fokker-Planck equation, projecting to test functions, sparse inference.
result Induces driving forces of dynamical systems.
Researchers develop a new SMC sampler for Wishart processes to improve dynamic covariance inference.
problem Challenging inference of dynamic covariance in various scientific fields.
method Introduce Sequential Monte Carlo (SMC) sampler for the Wishart process.
result SMC sampling provides more robust estimates and out-of-sample predictions of dynamic covariance.
We study the inference of a model of dynamic networks in which both communities and links keep memory of previous network states. By considering maximum likelihood inference from single snapshot observations of the network, we show that link persistence makes the inference of communities harder, decreasing the detectab…
New couplings improve understanding of molecular dynamics convergence.
problem Understanding convergence of Andersen dynamics in high dimensions.
method Presented couplings to obtain sharp convergence bounds in the Wasserstein sense.
result Sharp convergence bounds in the Wasserstein sense without global convexity.
Proposes DCNAR for dynamic causal inference from neural time series.
problem Uncertainty and evolution of causal structure in real-world domains.
method Two-stage neural causal modeling integrating discovery and inference.
result Dynamic causal inferences are more stable and meaningful than alternatives.
Physics-informed methods infer spatial dynamics from static snapshots, but limits exist.
problem Inferring spatial dynamics from static molecular patterns.
method Combining flexible representations with mechanistic constraints, analyzing structural identifiability, and adapting physics-informed schemes.
result Static spatial patterns can identify spatially varying dynamics, but limits exist due to modeling choices.
Adaptive Langevin dynamics reduces bias in Bayesian inference with mini-batching.
problem Bias in posterior sampling due to mini-batching in Bayesian inference.
method Adaptive Langevin dynamics with dynamical friction to correct noise.
result Quantified bias in posterior distribution due to mini-batching.
Model infers latent variables in sparse coding models using Langevin dynamics.
problem Sampling posterior distribution in sparse coding models.
method Langevin dynamics for inference and simultaneous learning of parameters.
result Langevin dynamics efficiently sample from 'L0 sparse' posterior distribution.
Optimizes variational inference for dynamic network models.
problem Estimating pairwise inner products and intercepts in dynamic latent space models.
method Structured mean-field variational inference with block coordinate ascent algorithm.
result Variational risk attains minimax optimal rate with logarithmic factor under certain conditions.
Deep generative models are reported to be useful in broad applications including image generation. Repeated inference between data space and latent space in these models can denoise cluttered images and improve the quality of inferred results. However, previous studies only qualitatively evaluated image outputs in data…
The roundworm C. elegans exhibits robust escape behavior in response to rapidly rising temperature. The behavior lasts for a few seconds, shows history dependence, involves both sensory and motor systems, and is too complicated to model mechanistically using currently available knowledge. Instead we model the process p…
SING improves state inference in latent SDE models for better drift function estimation.
problem Intractable posterior inference in latent SDE models.
method Natural gradient variational inference.
result SING provides faster and more reliable inference in latent SDE models.
This paper addresses metaconsistency in Bayesian inference for metastable systems.
problem Inference for metastable systems may not be consistent, but can be metaconsistent over large but finite time intervals.
method Introduces metaconsistency in a Bayesian framework, discusses its relation to spectral properties of model dynamics.
result Metaconsistency can be exploited to infer sub-systems efficiently from larger systems.
Neural EKF improves structural dynamics prediction.
problem Accurately predicting structural response for health monitoring.
method Neural Extended Kalman Filter (Neural EKF) for learning dynamics.
result Significant predictive capabilities demonstrated on simulated and real-world data.
We present a representation learning algorithm that learns a low-dimensional latent dynamical system from high-dimensional \textit{sequential} raw data, e.g., video. The framework builds upon recent advances in amortized inference methods that use both an inference network and a refinement procedure to output samples f…
Proposes a graph dynamics prior for more accurate relational inference.
problem Identifying interactions in dynamical systems from observed dynamics.
method Graph Dynamics Prior (GDP) that uses error amplification in non-local polynomial filters.
result Reconstructs graphs more accurately than previous methods, robust to under-sampling.
New method learns cell trajectories and network interactions from single-cell data.
problem Network inference in systems biology from steady-state data.
method Min-entropy estimation for stochastic dynamics, leveraging both temporal and perturbational data.
result Jointly learns cellular trajectories and network interactions.
Optimally explores dynamical systems with varying properties using context inference.
problem Learning dynamics models for systems with varying properties.
method Formulates dynamics models as stochastic processes conditioned on a latent context variable inferred from system transitions. Uses probabilistic formulation to compute optimal action sequences for exploration.
result Demonstrates effectiveness of the method on non-linear toy-problems and reinforcement learning environments.
Neuroscience is experiencing a data revolution in which many hundreds or thousands of neurons are recorded simultaneously. Currently, there is little consensus on how such data should be analyzed. Here we introduce LFADS (Latent Factor Analysis via Dynamical Systems), a method to infer latent dynamics from simultaneous…
DISTANA improves weather prediction by inferring hidden factors from temperature data.
problem Inferring hidden factors in spatiotemporal processes without supervision.
method Enhanced DISTANA architecture for spatiotemporal data, active tuning for latent state inference.
result DISTANA achieves more accurate predictions than other methods, inferring hidden factors from temperature data.
Valid inference method for DTW distance for abnormal time-series detection.
problem Statistical inference on DTW distance under uncertain conditions.
method Conditional selective inference framework to derive valid p-values.
result First method to provide valid p-values for DTW distance.
Efficient EP algorithm improves smoothing distribution inference in financial models.
problem Computational intractability of smoothing distribution in high dimensions.
method Adapted expectation propagation (EP) algorithms for the unified skew-normal family.
result Accuracy gains in financial illustrations over existing approximate algorithms.
TSCI improves causal inference in dynamical systems using vector fields.
problem Challenges in causal discovery with time series data in dynamical systems.
method TSCI method using vector fields to check for synchronization between learned dynamics.
result TSCI outperforms traditional methods like CCM and its generalizations.
Model-based reinforcement learning algorithms make decisions by building and utilizing a model of the environment. However, none of the existing algorithms attempts to infer the dynamics of any state-action pair from known state-action pairs before meeting it for sufficient times. We propose a new model-based method ca…
Proposes a new model for better speech segmentation.
problem Improving speech segmentation accuracy.
method Integrates recurrent explicit duration variables into rSLDS and uses Pólya-gamma augmentation for inference.
result Demonstrates improved segmentation on various datasets.
We propose an efficient inference method for switching nonlinear dynamical systems. The key idea is to learn an inference network which can be used as a proposal distribution for the continuous latent variables, while performing exact marginalization of the discrete latent variables. This allows us to use the reparamet…
State-space models are successfully used in many areas of science, engineering and economics to model time series and dynamical systems. We present a fully Bayesian approach to inference \emph{and learning} (i.e. state estimation and system identification) in nonlinear nonparametric state-space models. We place a Gauss…
Paper introduces TSSDMN for modeling dynamic multilayer networks.
problem Capturing temporal and cross-layer dynamics in multilayer networks.
method Tensor State Space Model (TSSDMN) using symmetric Tucker decomposition.
result TSSDMN uniquely captures temporal dynamics within and across layers.
Paper defends diffusion models from membership inference attacks using Langevin dynamics.
problem Defending diffusion models against membership inference attacks.
method Uses critically-damped higher-order Langevin dynamics with auxiliary variables.
result Demonstrates improved resistance to membership inference attacks through theoretical investigation and validation.
New model tackles complex spatio-temporal causal inference with dynamic confounders and functional data.
problem Complex spatio-temporal dynamics and unmeasured confounders hinder causal inference.
method PFD-BDCM, a unified generative framework for spatio-temporal dependencies, functional data, and dynamic confounding.
result PFD-BDCM outperforms existing methods across observational, interventional, and counterfactual queries.
New method infers population dynamics from snapshots using path space optimization.
problem Recover dynamics of a population from its temporal marginals.
method Grid-free algorithm using Schrödinger bridges coupled via noisy gradient descent in mean-field limit.
result Global convergence to min-entropy estimator with end-to-end theoretical guarantees.
ACSSM models irregular time series with continuous dynamics.
problem Modeling irregular time series data.
method ACSSM uses a multi-marginal Doob's h-transform and variational inference with stochastic optimal control.
result ACSSM outperforms in tasks like classification, regression, interpolation, and extrapolation.
NCDSSM models irregularly sampled time series with improved imputation and forecasting.
problem Accurate modeling of irregularly sampled time series with missing observations.
method Neural Continuous-Discrete State Space Model (NCDSSM) with amortized inference for auxiliary variables and flexible dynamic state parameterizations.
result Improved imputation and forecasting performance on multiple benchmark datasets.
Graph Neural Network improves causal inference in dynamic systems.
problem Identifying causal relations among multi-variate time series.
method Graph Neural Network approach with score-based method.
result Graph Neural Network significantly outperformed other methods in dynamic Bayesian network inference.
New algorithm infers trajectories from partial observations using optimal transport.
problem Inferring trajectories from partial observations of coupled systems.
method Extends MFL algorithm to latent SDEs using observable state space models and partial observations.
result Experiments show significant outperformance over latent-free baseline.
Predicts solar dynamics with diffusion models, improving long-range dependencies.
problem Predicting solar dynamics with limited observable data.
method Multiscale inference scheme for diffusion models.
result Improved long-range predictions with reduced bias.
This work uses variational inference to estimate parameters of opinion dynamics models.
problem Challenges in parameter estimation for ABMs of social phenomena.
method Transformed ABM parameter estimation into an optimization problem using variational inference.
result Estimates parameters more accurately than simulation-based and MCMC methods.
Machine learning infers time-reversible dynamics from data.
problem Learn time-reversible dynamics constrained by initial and final conditions.
method Machine learning algorithms solve boundary value problems for deterministic and stochastic dynamics.
result Inferred time-reversible dynamics for various types of systems.
New method accelerates energetic variational inference using particle dynamics.
problem Efficiently solving variational inference problems with reduced computational cost.
method Particle-based variational inference with implicit scheme, inspired by energy quadratization and operator splitting.
result Significantly reduces computational cost compared to existing methods.
Improved robust latent variable estimation for neural dynamics.
problem Inconsistent results due to noise and nonlinearity in existing models.
method Probabilistic approach to latent variable estimation in decomposed models.
result More accurate latent variable inference in nonlinear systems with diverse noise conditions.
Koopman theory asserts that a nonlinear dynamical system can be mapped to a linear system, where the Koopman operator advances observations of the state forward in time. However, the observable functions that map states to observations are generally unknown. We introduce the Deep Variational Koopman (DVK) model, a meth…
A method for inferring motility models and heterogeneity from particle trajectories.
problem Understanding motility patterns from discrete trajectory data of biological agents.
method Maximum likelihood approach for second-order Langevin models with population heterogeneity.
result The proposed method outperforms alternative approaches for short trajectories.
A novel model uses ODE-based random features to model nonlinear dynamical systems.
problem Modeling highly nonlinear dynamical systems with uncertainty quantification.
method Compositions of physics-informed random features derived from ODEs, combined with deep Gaussian processes and approximate Bayesian inference.
result The model effectively captures nonlinear behavior in real-world multivariate time series data and achieves comparable performance to other models on benchmark tasks.