ODE trajectories become abnormal curves in Carnot groups.
problem Understanding abnormal curves in Carnot groups.
method Explicit construction of covectors for abnormal curves.
result Polynomial ODE trajectories lift to abnormal curves in Carnot groups.
MoNODEs improve neural ODEs by separating dynamic states from static factors.
problem Learning non-linear dynamics with variations across trajectories.
method Introduces time-invariant modulator variables to separate dynamic states from static factors.
result Consistently improves model generalization and far-horizon forecasting.
Efficiently trains forward processes to minimize generative trajectories curvature.
problem High curvature of generative trajectories slows down sampling speed.
method Trains forward process to minimize curvature without ODE/SDE simulation.
result Lower curvature than previous models, decreased sampling costs.
Bayesian Neural ODEs improve vessel trajectory prediction with better uncertainty estimates.
problem Challenges in predicting vessel trajectories from irregular AIS data.
method Adopted a Gaussian process (GP) kernel-based prior on the vector field evaluated at measurement points, combined with probabilistic multiple shooting for long trajectories.
result Improved accuracy and uncertainty quantification in vessel trajectory predictions.
The paper examines the sampling dynamics of diffusion models using ODEs.
problem Understanding the sampling dynamics of diffusion models.
method Careful inspection of ODE-based sampling of SDEs, revealing structures and relationships.
result Established a theoretical relationship between optimal ODE-based sampling and mean-shift algorithm.
Statistical approach uses ODEs for modeling individual health trajectories.
problem Challenges in applying ODEs to longitudinal cohort data, especially noise and parameter sensitivity.
method Combines ODEs with neural networks to model individual health trajectories using each observation as initial value.
result Demonstrates improved modeling of individual health trajectories compared to global regression.
CTM improves diffusion model sampling quality with efficient ODE traversal.
problem Lack of natural trade-off between sample quality and speed in consistency models.
method CTM trains a neural network to output scores and traverse ODE trajectories efficiently.
result CTM achieves state-of-the-art FIDs and improves sample quality with increased computational budget.
EFiGP uses Fourier and eigen-decomposition for efficient ODE parameter estimation.
problem Parameter estimation and trajectory reconstruction for noisy, sparse, nonlinear ODE systems.
method EFiGP integrates Fourier transformation and eigen-decomposition into a physics-informed Gaussian Process framework.
result EFiGP efficiently estimates ODE parameters and recovers trajectories from noisy data.
We accelerate CNF by reducing ODE truncation errors with polynomial regularization.
problem High computation cost of CNF due to large truncation errors in solving ODEs.
method Add polynomial regularization to approximate ODE trajectories with polynomial functions.
result 42.3% to 71.3% reduction of NFE on density estimation, 19.3% to 32.1% on variational auto-encoder.
Signature tensors uniquely identify ODE solutions.
problem Identifying ODE solutions from signature tensors.
method Geometric theory of nonlinear systems of ODEs.
result Necessary and sufficient algebraic conditions for signature tensors to represent ODE solutions.
ACA method improves gradient estimation for neural ODEs, reducing error and training time.
problem Inaccurate gradient estimation methods hinder the performance of neural ODEs on benchmark tasks.
method Adaptive Checkpoint Adjoint (ACA) method that applies trajectory checkpointing, deletes redundant components, and supports adaptive solvers.
result ACA reduces error rate by half and training time by half compared to adjoint and naive methods on image classification tasks.
A new method combines ANN and Laplace for fast Bayesian inference in ODE models.
problem Bayesian inference for ODE systems with non-analytical solutions is computationally expensive.
method Hybrid approach using ANN for tractable likelihood and Laplace approximation.
result Effective posterior inference with improved computational cost compared to traditional methods.
We present Ordinary Differential Equation Variational Auto-Encoder (ODE2VAE), a latent second order ODE model for high-dimensional sequential data. Leveraging the advances in deep generative models, ODE2VAE can simultaneously learn the embedding of high dimensional trajectories and infer arbitrarily complex conti…
Enhanced Neural ODEs outperform traditional models in image classification and video prediction.
problem Efficiently modeling time-varying dynamics in neural networks.
method Proposed a novel family of non-autonomous Neural ODEs with time-varying weights.
result Outperformed previous Neural ODE variants in speed and representational capacity.
Bayesian ODEs with Gaussian processes infer unknown dynamics from data.
problem Estimating unknown continuous-time system dynamics from data.
method Bayesian nonparametric model using Gaussian processes, sparse variational inference, probabilistic shooting.
result Posterior predictive uncertainty scores outperform alternative methods on multiple ODE learning tasks.
Novel methods improve Bayesian analysis of chaotic dynamical systems.
problem Bayesian parameter inference and trajectory reconstruction of chaotic systems with sparse and noisy data.
method Pilot MAGI (pMAGI) and Pilot MAGI Sequential Prediction (PMSP) methods.
result pMAGI and PMSP significantly outperform existing methods in accuracy and computational efficiency.
Faster training of neural ODEs using Gauß-Legendre quadrature.
problem Training neural ODEs is slow due to solving ODEs numerically.
method Use Gauß-Legendre quadrature to solve integrals faster than ODE-based methods.
result Faster training of neural ODEs, especially for large models.
TRS-ODENs learn dynamics with time-reversal symmetry for more efficient learning.
problem Learning dynamics with time-reversal symmetry for more efficient learning.
method Proposed a loss function and a new framework (TRS-ODENs) to learn dynamics efficiently.
result TRS-ODENs can learn dynamics from noisy and complex trajectories efficiently.
Study optimal paths in Zermelo's navigation problem using geometric equations.
problem Optimal control paths in Zermelo's navigation problem.
method Geometric and differential equations approach to obtain precise ODE system.
result Obtained precise equations for optimal trajectories.
JKO-iFlow uses neural ODEs to improve generative models with reduced memory and training complexity.
problem Efficiently training deep generative models in high dimensions with reduced memory and training complexity.
method JKO scheme inspired neural ODE flow network with adaptive time reparameterization.
result JKO-iFlow achieves competitive performance compared to existing models at reduced computational and memory cost.
Statistical methods remain relevant for ODE inverse problems, especially with sparse data.
problem The relevance of statistical methods in the era of deep learning for ODE inverse problems.
method Employed physics-informed neural networks (PINN) and manifold-constrained Gaussian process inference (MAGI) to compare statistical and deep learning approaches.
result Statistically principled methods outperform deep learning models in tasks like parameter inference and trajectory reconstruction.
The paper uses neural networks to learn system dynamics from data with Lipschitz regularization.
problem Learning governing equations from time-sampled data.
method Lipschitz regularized deep neural networks for ODE system identification.
result Lipschitz regularization improves the smoothness and generalization of the learned function.
Adam's hyperparameters implicitly regularize solutions, penalizing or impeding loss gradients' norms.
problem Implicit regularization in Adam's hyperparameters and training stage.
method Backward error analysis and ODE approximations to study Adam's behavior.
result Adam's implicit regularization depends on hyperparameters and training stage, involving different norms.
New concept of regular separation for ODEs leads to improved Hardy field results.
problem Understanding solutions of definable ODEs with specific properties.
method Introducing regular separation and proving its implications for ODEs and vector fields.
result The regular separation property leads to improved Hardy field results and non-empty sets of trajectories.
Neural ODEs control graph dynamics with low energy feedback.
problem Controlling complex dynamical systems on graphs.
method Neural Ordinary Differential Equation Control (NODEC) framework.
result NODEC learns low-energy control signals for graph dynamical systems.
A new method for estimating uncertainties in neural ODEs without numerical integration.
problem Accurate estimation of predictive uncertainties in neural ODEs.
method Distributional Gradient Matching (DGM) algorithm that jointly trains a smoother and a dynamics model.
result Significantly more accurate predictions compared to traditional methods.
New analysis shows FM learns underlying dynamical structure, not just trajectory replay.
problem Understanding whether flow matching models learn transferable dynamical structure or merely replay trajectories.
method Derived velocity field implied by FM objective, characterized as a continuous-time dynamical system.
result FM models can be seen as parametric surrogates of nonparametric solutions, providing strong probabilistic forecasts.
Paper proves higher-order flow matching preserves optimality in generative modeling.
problem Theoretical guarantees for higher-order flow matching in generative modeling.
method Neural network approximations with controlled depth, width, and sparsity.
result Proves worst case optimality for second-order flow matching.
Study of ants' movement rules on a 6D space, revealing distribution structures and singular trajectories.
problem Understanding the movement patterns of ants in a 6D space.
method Analyzing mechanical system rules to derive distribution structures and singular trajectories.
result Distributions and singular trajectories of ants' movement rules in a 6D space.
New method identifies physical constants from video data alone.
problem Identifying physical constants from video data.
method Proves level-set slope-coverage condition ensures local affine mapping to true physical state, enabling exact parameter recovery.
result Underdamped systems identifiable from a single video clip, other regimes require three diverse trajectories.
Paper addresses identifiability and asymptotics of ODE systems from noisy data.
problem Identifying parameters and causal structure of linear ODE systems from discrete observations.
method Developed sufficient conditions for identifiability, proved consistency and asymptotic normality of NLS estimator, constructed confidence sets, and inferred causal structure.
result Consistent and asymptotically normal parameter estimator for linear ODE systems under mild conditions.
We aim to identify the generating, ordinary differential equation (ODE) from a set of trajectories of a partially observed system. Our approach does not need prescribed basis functions to learn the ODE model, but only a rich set of Neural Arithmetic Units. For maximal explainability of the learnt model, we minimise the…
Generative models need per-sample confidence scores to improve quality and stability.
problem Generative models produce unreliable outputs and lack confidence measures.
method Flow Matching with Confidence (FMwC) injects noise and integrates it through the network, providing per-sample confidence scores.
result The confidence score correlates with the velocity field's divergence, offering insights into generative processes.
Deep learning models can infer individual trajectories from sparse data.
problem Learning individual dynamics from limited data points.
method Combining variational autoencoders (VAEs) with ordinary differential equations (ODEs) for dynamic modeling.
result Deep learning can recover individual trajectories from sparse data, but requires careful adaptation.
Neural Laplace models diverse DEs in the Laplace domain for better dynamics.
problem Inadequate ODEs for long-range dependencies and discontinuities.
method Unified framework in Laplace domain, using stereographic map for smoothness.
result Superior performance in diverse DEs, including complex history dependency and abrupt changes.
The paper analyzes identifiability in ODE systems with hidden confounders.
problem Identifiability of ODE systems with hidden confounders.
method Systematic analysis of identifiability in linear ODE systems with hidden confounders, considering both no causal relationships and causal dependencies.
result Comprehensive identifiability analysis of ODE systems with hidden confounders, including causal dependencies.
In this paper, we introduce Symplectic ODE-Net (SymODEN), a deep learning framework which can infer the dynamics of a physical system, given by an ordinary differential equation (ODE), from observed state trajectories. To achieve better generalization with fewer training samples, SymODEN incorporates appropriate induct…
The Eisenhart lift connects Hamiltonian systems to geodesics in pp-wave spacetimes.
problem Studying the stability and dynamics of Hamiltonian systems.
method Eisenhart lift to pp-wave spacetimes and conformal classes of ODEs.
result Existence of a constant of the motion generalizing conservation of energy.
SeqRF straightens generative model flows to speed up sampling.
problem High global truncation error in ODE-based solvers for generative models.
method SeqRF, a learning technique that straightens the probability flow.
result Significantly improved sampling speed and synthesis quality.
VT-DIS improves sampling from Boltzmann distributions with minimal overhead.
problem Bias in Monte Carlo estimates from score-based diffusion models.
method Variance-Tuned Diffusion Importance Sampling (VT-DIS) adapts noise covariance to correct bias.
result VT-DIS achieves effective sample sizes of 80%, 35%, and 3.5% on benchmarks, using less computational budget.
CT-OT Flow estimates continuous-time dynamics from discrete snapshots.
problem Estimating continuous-time dynamics from temporally aggregated snapshots with noisy or uncertain timestamps.
method Two-stage framework: aligning neighboring intervals via partial optimal transport (POT) and reconstructing a continuous-time distribution through temporal kernel smoothing.
result Reduces distributional and trajectory errors compared with existing methods across synthetic and real datasets.
Diffusion models' sampling paths lie in a low-dimensional subspace, resembling boomerangs.
problem Understanding the geometric structure of diffusion-based generative models.
method Characterization of deterministic sampling trajectories using low-dimensional subspace and kernel-estimated data modeling.
result Sampling trajectories in diffusion models are confined to a low-dimensional subspace and exhibit a boomerang shape.
New method models complex dynamics using a base variable.
problem Modeling complex high-frequency dynamics from time series.
method Constructing a joint model with a base variable and a target variable.
result Successfully models chaotic behavior and reconstructs statistical properties.
Investigates the relationship between ResNets and Neural ODEs, quantifying their closeness and providing training methods.
problem Quantifying the distance between ResNet dynamics and Neural ODE solutions.
method Bounding the distance between hidden state trajectories and Neural ODE solutions, using gradient descent and Heun's method.
result Gradient descent and Heun's method can implicitly regularize ResNets towards Neural ODEs, especially for smooth residual functions.
NOs can learn any finite collection of classes in functional data.
problem Learning finite collections of classes in infinite-dimensional spaces.
method Proved sample-based neural operators can learn any finite collection of classes in an infinite-dimensional reproducing kernel Hilbert space.
result NOs can learn any finite collection of classes in an infinite-dimensional reproducing kernel Hilbert space, even when the classes are not convex or connected.
Myriad offers a testbed for integrating machine learning and trajectory optimization.
problem Real-world trajectory optimization challenges.
method JAX-based testbed with machine learning and trajectory optimization integration.
result End-to-end learning and planning with neural ODEs.
This paper proposes a new method to learn integration schemes for complex ODEs.
problem Learning efficient integration schemes for non-linear ODEs and their identification.
method A novel framework to learn integration schemes that minimize an integration-related cost function.
result The proposed learning-based approach provides integration schemes close to analytical solutions.
Proposes a new tensor decomposition method for functional temporal data with adaptive complexity.
problem Challenges in temporal tensor decomposition for general tensor data with continuous indexes.
method Encodes continuous spatial indexes as learnable Fourier features and uses neural ODEs for temporal trajectories. Introduces a sparsity-inducing prior for complexity adaptation.
result Significantly outperforms existing methods in prediction performance and robustness against noise.