DGFS improves sampling from complex densities by optimizing partial trajectories.
problem Sampling from intractable high-dimensional density functions.
method DGFS uses a flow function to break down the training process into short partial trajectory segments, leveraging intermediate learning signals.
result DGFS achieves more accurate estimates of the normalization constant.
Proposes DGCN with trajectory sampling for data-efficient policy search in MBRL.
problem Improving data efficiency in model-based reinforcement learning.
method Combines trajectory sampling and DGCN for uncertainty propagation in probabilistic world models.
result Improves sample-efficiency over other uncertainty propagation methods and probabilistic models.
Framework learns continuous dynamics from sparse trajectories.
problem Learning dynamics from sparsely sampled and high-dimensional trajectories.
method Interpolative Multi-Marginal Flow Matching (IMMFM) framework.
result IMMFM outperforms existing methods in forecasting and downstream tasks.
TGD improves conditional sampling by concentrating computation on promising trajectories.
problem Efficiently training-free conditional sampling with diffusion priors.
method Tempered Guided Diffusion (TGD) using annealed sequential Monte Carlo.
result TGD yields a consistent particle approximation to the posterior as the number of particles grows.
CEM-GD combines CEM and gradient descent for efficient model-based RL.
problem Efficient planning in continuous control settings with large prediction horizons.
method Combines CEM for exploration and gradient descent for exploitation.
result Achieves better performance with fewer samples and less computation time.
Diffusion models' sampling paths lie in a low-dimensional subspace, resembling boomerangs.
problem Understanding the geometric structure of diffusion-based generative models.
method Characterization of deterministic sampling trajectories using low-dimensional subspace and kernel-estimated data modeling.
result Sampling trajectories in diffusion models are confined to a low-dimensional subspace and exhibit a boomerang shape.
Algorithm recovers graph from Glauber dynamics trajectory without mixing.
problem Learning Gaussian graphical models from a single Glauber dynamics trajectory.
method Three components: conditional variance estimation, pairwise influence test, robust median aggregation.
result Polynomial-time recovery of conditional independence graph from a single trajectory.
New method detects metastable basins in high dimensions using trajectory sampling.
problem Identifying distinct basins in high-dimensional Markov processes.
method Discriminative approach based on marginal trajectory distribution comparison.
result Bayes-optimal classifier achieves high accuracy distinguishing between basins.
The paper examines the sampling dynamics of diffusion models using ODEs.
problem Understanding the sampling dynamics of diffusion models.
method Careful inspection of ODE-based sampling of SDEs, revealing structures and relationships.
result Established a theoretical relationship between optimal ODE-based sampling and mean-shift algorithm.
Study learns dynamics of linear systems from multiple short trajectories.
problem Learning dynamics of autonomous linear systems from multiple short trajectories.
method Finite sample analysis for stable and unstable systems, adjusting trajectory length for marginally stable systems.
result Learning rate of O ( 1 N ) \mathcal{O}(\frac{1}{\sqrt{N}}) O ( N 1 ) for both stable and unstable systems. We learn linear models from nonlinear systems using multiple trajectories and regularization.
problem Identifying linear models from data when the underlying dynamics are nonlinear.
method Multiple trajectories data acquisition followed by regularized least squares.
result Learn linearized dynamics with arbitrarily small error given enough samples.
Efficiently trains forward processes to minimize generative trajectories curvature.
problem High curvature of generative trajectories slows down sampling speed.
method Trains forward process to minimize curvature without ODE/SDE simulation.
result Lower curvature than previous models, decreased sampling costs.
Reinforcement learning with trajectory feedback instead of state-action rewards.
problem Frequent feedback not available in practice.
method Extended reinforcement learning algorithms using trajectory feedback for known and unknown transition models.
result Hybrid optimistic-Thompson Sampling algorithm for unknown transition models.
Develops a method to infer cell trajectories from RNA sequencing data.
problem Inferring cell trajectories from single cell RNA-sequencing data.
method Entropy-regularized optimal transport for global optimization.
result Proves and implements a method to recover ground truth trajectories from limited samples.
Map matching of the GPS trajectory serves the purpose of recovering the original route on a road network from a sequence of noisy GPS observations. It is a fundamental technique to many Location Based Services. However, map matching of a low sampling rate on urban road network is still a challenging task. In this paper…
The problem of continuous inverse optimal control (over finite time horizon) is to learn the unknown cost function over the sequence of continuous control variables from expert demonstrations. In this article, we study this fundamental problem in the framework of energy-based model, where the observed expert trajectori…
Improved GFlowNets learn more efficiently with trajectory balance.
problem Inefficient credit assignment in GFlowNets leads to suboptimal learning.
method Proposed trajectory balance as a new learning objective.
result Trajectory balance leads to more efficient and robust GFlowNet learning.
Trajectory-level supervision allows efficient offline reinforcement learning.
problem Offline reinforcement learning
method Developing a statistical theory for offline policy optimization from trajectory-level labels
result Proving a high-probability guarantee of order O ~ ( H 2 C s a ( π ⋆ ) / n ) \widetilde O(H^2\sqrt{C_{sa}(\pi^\star)/n}) O ( H 2 C s a ( π ⋆ ) / n ) New algorithm improves RL performance across different environments.
problem Improving reinforcement learning performance across various environments.
method Designing a fully model-free DRRL algorithm that learns from a single trajectory.
result Demonstrates superior robustness and sample efficiency compared to existing methods.
Pattern ensembling fills in missing or inaccurate trajectory data.
problem Incompleteness, missing information, and inaccuracies in geolocation data.
method Probabilistically ensemble similar trajectory patterns from the vicinity.
result Reconstructs missing or unreliable trajectory segments effectively.
Variational inference improves training of generative flow networks.
problem Training generative flow networks efficiently and accurately.
method Define variational objectives in terms of KL divergences and optimize convex combinations.
result Variational inference methods can reduce the variance of gradients in training generative flow networks.
EviTrack improves sequential prediction in delayed disambiguation scenarios.
problem Challenges in sequential prediction with delayed disambiguation where early observations are ambiguous.
method EviTrack operates over latent trajectories, applying evidence- and likelihood-ratio-based selection to delay commitment until supported by data.
result EviTrack outperforms sampling-based baselines in a controlled synthetic benchmark, achieving faster post-disambiguation recovery.
CTM improves diffusion model sampling quality with efficient ODE traversal.
problem Lack of natural trade-off between sample quality and speed in consistency models.
method CTM trains a neural network to output scores and traverse ODE trajectories efficiently.
result CTM achieves state-of-the-art FIDs and improves sample quality with increased computational budget.
Enhanced decision-making through Dreamer's anticipatory trajectories and Online Decision Transformer.
problem Efficiently integrating world models with decision transformers.
method Combining Dreamer's trajectory forecasting with Online Decision Transformer's adaptive learning.
result Notable improvements in sample efficiency and reward maximization.
New method improves meta-reinforcement learning efficiency.
problem Sample inefficiency in meta-reinforcement learning.
method Hindsight Foresight Relabeling (HFR) method.
result HFR improves performance on various meta-reinforcement learning tasks.
Trajectory optimization using a learned model of the environment is one of the core elements of model-based reinforcement learning. This procedure often suffers from exploiting inaccuracies of the learned model. We propose to regularize trajectory optimization by means of a denoising autoencoder that is trained on the …
Improved Gaussian Process model for predicting trajectories without independence assumption errors.
problem Incorrect independence assumption in previous work on Gaussian Process uncertainty propagation.
method Proposed a novel piecewise linear approximation to correct the independence assumption in continuous models.
result Corrected the independence assumption in Gaussian Process models for predicting trajectories.
Deep Reinforcement Learning has shown tremendous success in solving several games and tasks in robotics. However, unlike humans, it generally requires a lot of training instances. Trajectories imitating to solve the task at hand can help to increase sample-efficiency of deep RL methods. In this paper, we present a simp…
Adaptive stopping in MCMC using classifier-based dynamics
problem Sampling from complex, unnormalized probability densities
method Training state-dependent neural classifiers
result Significant reduction in average trajectory lengths
Established techniques for simulation and prediction with Gaussian process (GP) dynamics often implicitly make use of an independence assumption on successive function evaluations of the dynamics model. This can result in significant error and underestimation of the prediction uncertainty, potentially leading to failur…
Fractured Sampling improves LLM reasoning efficiency by truncating CoT trajectories.
problem Efficiently scaling reasoning in large language models with limited tokens.
method Integrating truncated Chain-of-Thought (CoT) with Fractured Sampling across multiple dimensions.
result Fractured Sampling achieves superior accuracy-cost trade-offs compared to full CoT.
Paper reduces sample complexity for bilinear systems identification to nearly constant.
problem Identifying discrete-time bilinear systems under bounded disturbances.
method Uses trajectory-dependent regressors and polynomial mean-square state growth analysis.
result Proves sample complexity of O ~ ( 1 / ε ) \widetilde{\mathcal O}(1/ε) O ( 1/ ε ) for estimation error ε ε ε . Algorithm finds safe zones in policy Markov Decision Processes to limit trajectory escape.
problem Finding safe zones in policy Markov Decision Processes to limit trajectory escape.
method Bi-criteria approximation learning algorithm with polynomial sample complexity.
result Achieves almost 2 approximation for both escape probability and safe zone size.
Algorithm learns multiple LDS models from unlabeled short trajectories.
problem Learning from unlabeled short sample trajectories of multiple LDS models.
method Two-stage meta-algorithm with end-to-end performance guarantees.
result Efficiently recovers each ground-truth LDS model up to error i l d e O ( d / T ) ilde{O}(\sqrt{d/T}) i l d e O ( d / T ) . WMPG reduces policy gradient variance using world models.
problem Reducing variance in policy gradient estimates.
method Trains a world model online to estimate policy gradients and uses imagined trajectories as a baseline.
result WMPG achieves better sample efficiency compared to AC and MAC.
Map matching of GPS trajectories from a sequence of noisy observations serves the purpose of recovering the original routes in a road network. In this work in progress, we attempt to share our experience of feature construction in a spatial database by reporting our ongoing experiment of feature extrac-tion in Conditio…
Estimates MLDS using tensor decomposition, improving upon existing methods.
problem Learning mixtures of linear dynamical systems from input-output data.
method Proposes a moment-based estimator using tensor decomposition.
result Improves sample complexity bounds for estimating MLDS.
Analyzing the urban trajectory in cities has become an important topic in data mining. How can we model the human mobility consisting of stay and travel from the raw trajectory data? How can we infer such a mobility model from the single trajectory information? How can we further generalize the mobility inference to ac…
OSIRIS reduces variance in off-policy evaluation by omitting irrelevant states.
problem High variance in importance sampling-based OPE estimators.
method OSIRIS reduces variance by omitting likelihood ratios associated with states irrelevant to return.
result OSIRIS is unbiased and has lower variance than ordinary importance sampling.
Identifies bilinear systems from a single trajectory with optimal sample complexity.
problem Learning bilinear systems from a single trajectory of states and inputs.
method Uses a mild marginal mean-square stability assumption and martingale small-ball condition.
result Sample complexity and statistical error rates are optimal.
New method improves learning from multiple correlated data trajectories.
problem Learning from multiple correlated data trajectories without mixing assumptions.
method Hellinger localization framework for maximum likelihood estimation.
result Instance-optimal bounds that scale with full data budget under broad conditions.
Physics-informed diffusion model detects anomalous trajectories in GPS data.
problem Detecting fake GPS trajectories in international waters.
method Physics-informed diffusion model integrating kinematic constraints.
result Higher prediction accuracy and lower error rate for anomaly detection.
Generative models need per-sample confidence scores to improve quality and stability.
problem Generative models produce unreliable outputs and lack confidence measures.
method Flow Matching with Confidence (FMwC) injects noise and integrates it through the network, providing per-sample confidence scores.
result The confidence score correlates with the velocity field's divergence, offering insights into generative processes.
New insights on offline RL with state aggregation and trajectory data.
problem Understanding sample complexity in offline policy evaluation.
method Analyzing concentrability coefficient in aggregated Markov Transition Model.
result Sample complexity depends on concentrability coefficient in aggregated model.
New method detects OOD samples using neural network trajectories.
problem Lack of comprehensive layer exploration in OOD detection.
method Functional data perspective, analyzing sample trajectories through multi-layer classifier.
result Empirically validated as effective compared to state-of-the-art methods.
CoTj improves diffusion model quality and stability via graph planning.
problem Rigidity in diffusion models due to high-dimensional state space.
method Chain-of-Trajectories (CoTj) framework using Diffusion DNA for graph planning.
result CoTj discovers context-aware trajectories improving output quality and stability.
Effective understanding of the environment and accurate trajectory prediction of surrounding dynamic obstacles are critical for intelligent systems such as autonomous vehicles and wheeled mobile robotics navigating in complex scenarios to achieve safe and high-quality decision making, motion planning and control. Due t…
Bayesian inference models failure distributions in autonomous systems.
problem Estimating the distribution of failures in complex systems.
method Bayesian inference using system dynamics rollouts and gradient computation.
result Improves sample efficiency and parameter space coverage in autonomous systems.