The paper develops no arbitrage results for trajectory based models by imposing general constraints on the trading portfolios. The main condition imposed, in order to avoid arbitrage opportunities, is a local continuity requirement on the final portfolio value considered as a functional on the trajectory space. The pap…
Deep Reinforcement Learning has shown tremendous success in solving several games and tasks in robotics. However, unlike humans, it generally requires a lot of training instances. Trajectories imitating to solve the task at hand can help to increase sample-efficiency of deep RL methods. In this paper, we present a simp…
We address the problem of abnormal event detection from trajectory data. In this paper, a new adversarial approach is proposed for building a deep neural network binary classifier, trained in an unsupervised fashion, that can distinguish normal from abnormal trajectory-based events without the need for setting manual d…
Study compares RL and DT-based control for hedging European call options.
problem Optimizing hedging strategies for European call options with transaction costs.
method Reinforcement Learning vs. Deep Trajectory-based Stochastic Control.
result RL and DT-based methods perform differently under stepwise mean-variance hedging.
Extended flatness approach for discrete-time systems considers forward and backward shifts.
problem Defining flatness for discrete-time systems with forward-shifts.
method Introducing backward-shifts to extend flatness definition.
result Extended flat systems maintain key properties like reachability and controllability.
The paper develops general, discrete, non-probabilistic market models and minmax price bounds leading to price intervals for European options. The approach provides the trajectory based analogue of martingale-like properties as well as a generalization that allows a limited notion of arbitrage in the market while still…
The paper studies sub and super-replication price bounds for contingent claims defined on general trajectory based market models. No prior probabilistic or topological assumptions are placed on the trajectory space, trading is assumed to take place at a finite number of occasions but not bounded in number nor necessari…
Enhances reinforcement learning from sparse data.
problem Limited data for offline reinforcement learning.
method Trajectory-based data augmentation.
result Improves reinforcement learning performance.
Persistent neurons improve neural network optimization by leveraging previous solutions.
problem Improving neural network optimization under different initialization and data distributions.
method Persistent neurons use information from previous converged solutions to explore new landscapes and avoid local minima.
result Persistent neurons converge to more optimal solutions and improve model performance under various initializations.
This paper presents a new approach for training artificial neural networks using techniques for solving the constraint satisfaction problem (CSP). The quotient gradient system (QGS) is a trajectory-based method for solving the CSP. This study converts the training set of a neural network into a CSP and uses the QGS to …
Podcast recommendations improved by analyzing user listening paths.
problem Challenges in recommending podcasts effectively.
method Analyzes user listening paths as sequential trajectories for recommendations.
result 450% increase in effectiveness over baseline.
Extends RL to random stopping times, improving optimization.
problem Real-world applications with random stopping times.
method Extended RL framework to random stopping times, derived new formulas.
result Improves optimization convergence with new formulas.
We introduce a novel class of rotation invariants of two dimensional curves based on iterated integrals. The invariants we present are in some sense complete and we describe an algorithm to calculate them, giving explicit computations up to order six. We present an application to online (stroke-trajectory based) charac…
Policy gradient methods are powerful reinforcement learning algorithms and have been demonstrated to solve many complex tasks. However, these methods are also data-inefficient, afflicted with high variance gradient estimates, and frequently get stuck in local optima. This work addresses these weaknesses by combining re…
Neural nets predict user attention from mouse movements.
problem Predicting user attention from mouse cursor movements.
method Investigated different mouse movement representations and trained neural networks.
result Neural networks outperform handcrafted features for predicting user attention.
Mathematical method based on a direct or indirect analysis of growth rates is described. It is shown how simple assumptions and a relatively easy analysis can be used to describe mathematically complicated trends and to predict growth. Only rudimentary knowledge of calculus is required. Projected trajectories based on …
Detecting inaccurate smart meters and targeting them for replacement can save significant resources. For this purpose, a novel deep-learning method was developed based on long short-term memory (LSTM) and a modified convolutional neural network (CNN) to predict electricity usage trajectories based on historical data. F…
Method detects trajectory outliers using Hodge Laplacian embeddings.
problem Detecting outliers in trajectory data on simplicial complexes.
method Flow-embeddings using Hodge 1-Laplacian of simplicial complexes.
result Classifies trajectories based on topological behavior.
RL and DTSOC for final quadratic hedging performance studied.
problem Optimal hedging of European call options with and without transaction costs.
method Reinforcement Learning and Deep Trajectory-based Stochastic Optimal Control.
result RL and DTSOC perform similarly to variance-optimal hedging in various market models.
New algorithm learns Koopman operator online, with complexity control and convergence guarantees.
problem Online learning of Koopman operator for general nonlinear systems.
method Sparse online learning via stochastic approximation, RKHS action, CME operator.
result Provably convergent algorithm with finite-time guarantees in mis-specified setting.
Efficiently samples complex distributions using tensor train format.
problem Sampling from high-dimensional complex probability densities efficiently.
method Integrates tensor train format with backward stochastic differential equations (BSDEs) for fast, robust, and accurate sampling.
result Improved efficiency in sampling from challenging target distributions.
Paper combines RL with policy regularization for inventory policies.
problem Optimizing inventory policies using RL and dynamic programming.
method Hybrid approach combining RL with policy regularization.
result Generalization guarantees for inventory policies using VC theory.
New algorithm reduces sample complexity for planning in MDPs.
problem Planning in MDPs with unknown transitions.
method MDP-GapE, a trajectory-based MCTS algorithm.
result Proves upper bound on sample complexity in terms of sub-optimality gaps.
Unified framework for sampling from complex densities using PDEs and neural networks.
problem Sampling from complicated probability densities.
method Dynamical measure transport via PDEs and physics-informed neural networks (PINNs).
result Significantly better mode coverage and high accuracy in sampling.
Learning from demonstration has been widely studied in machine learning but becomes challenging when the demonstrated trajectories are unstructured and follow different objectives. This short-paper proposes PODNet, Plannable Option Discovery Network, addressing how to segment an unstructured set of demonstrated traject…
New method for data assimilation using score-based models.
problem Bayesian inverse problem of identifying plausible state trajectories.
method Score-based data assimilation, learning a score-based generative model of state trajectories.
result Effective method for zero-shot observation scenarios.
VectorNet predicts car behavior using vectorized HD maps and agent dynamics.
problem Predicting behavior in multi-agent systems with self-driving cars.
method VectorNet uses hierarchical graph neural networks on vectorized representations of HD maps and agent trajectories.
result VectorNet achieves comparable or better performance than state-of-the-art methods while using fewer parameters and less computational power.
Gaussian processes for dynamical systems with Koopman equivariance.
problem Forecasting and learning representations of nonlinear dynamical systems.
method Koopman-equivariant Gaussian processes with linear time-invariant responses and trajectory-based equivariance.
result Enhanced forecasting performance compared to kernel-based methods.
Reinforcement learning is explored as a candidate machine learning technique to enhance existing analytical solutions for optimal trade execution with elements from the market microstructure. Given a volume-to-trade, fixed time horizon and discrete trading periods, the aim is to adapt a given volume trajectory such tha…
The excited states of polyatomic systems are rather complex, and often exhibit meta-stable dynamical behaviors. Static analysis of reaction pathway often fails to sufficiently characterize excited state motions due to their highly non-equilibrium nature. Here, we proposed a time series guided clustering algorithm to ge…
Neural controlled DEs model irregular time series by adjusting based on observations.
problem Modeling irregularly sampled multivariate time series with memory-efficient adjoint-based backpropagation.
method Neural controlled differential equations (CDEs) that adjust based on subsequent observations.
result Achieves state-of-the-art performance on various datasets.
Paper proposes TC3 algorithm to predict crowdfunding funding progress.
problem Predicting the funding progress in crowdfunding dynamics.
method Trajectory-based Continuous Control for Crowdfunding (TC3) algorithm using actor-critic frameworks.
result TC3-Options model effectively predicts U-shaped funding patterns.
In this paper we propose a new method to predict the final destination of vehicle trips based on their initial partial trajectories. We first review how we obtained clustering of trajectories that describes user behaviour. Then, we explain how we model main traffic flow patterns by a mixture of 2d Gaussian distribution…
Paper learns Koopman operator from sparse data, escaping function space constraints.
problem Learning Koopman operator from non-closed function spaces.
method Operator stochastic approximation algorithm using conditional mean embeddings (CME).
result Online sparse learning algorithm with trajectory-based sampling guarantees.
Eikonal-Constrained QRL improves goal-reaching in reinforcement learning.
problem Reward design and out-of-distribution generalization in reinforcement learning.
method Eikonal-Constrained Quasimetric Reinforcement Learning (Eik-QRL) using the Eikonal PDE.
result Eik-QRL achieves state-of-the-art performance in offline goal-conditioned navigation and manipulation tasks.
This thesis enhances ML reliability by selectively abstaining from predictions when uncertain.
problem Improving reliability in machine learning systems, especially in high-stakes domains.
method Exploiting uncertainty signals from training trajectories to develop lightweight, post-hoc abstention methods compatible with differential privacy.
result A robust trajectory-based approach to selective prediction that maintains high accuracy under privacy noise.
The paper develops a neural network-based classifier for diffusion process drifts.
problem Classifying diffusion processes with distinct drift functions from discrete observations.
method Derives a Bayes rule and constructs a plug-in classifier using neural networks to estimate drifts.
result Establishes convergence rates for misclassification risk, highlighting benefits of diffusion structure.
A framework learns multiscale dynamics from single trajectories using normalizing flows.
problem Learning effective stochastic dynamics from single observed paths of slow variables.
method Data-driven approach based on coupled multiscale SDEs, stochastic averaging, and normalizing flows for density modeling.
result Scalable approach to capturing epistemic uncertainty in multiscale systems.
Recently, researchers proposed various low-precision gradient compression, for efficient communication in large-scale distributed optimization. Based on these work, we try to reduce the communication complexity from a new direction. We pursue an ideal bijective mapping between two spaces of gradient distribution, so th…
We learn linear models from nonlinear systems using multiple trajectories and regularization.
problem Identifying linear models from data when the underlying dynamics are nonlinear.
method Multiple trajectories data acquisition followed by regularized least squares.
result Learn linearized dynamics with arbitrarily small error given enough samples.
Paper introduces DTAE to optimize RL algorithms, balancing exploration and exploitation.
problem Balancing exploration and exploitation in reinforcement learning.
method Soft policy optimization with entropy and dual-track advantage estimator (DTAE).
result DTAE accelerates RL algorithm convergence and improves performance.
A framework clusters vehicle motion trajectories efficiently.
problem Costly manual annotation of vehicle motion data.
method Five-stage framework: align, embed, extract, embed, cluster.
result Framework achieves promising results on real-world dataset.
Extends diffusion-based Schrödinger bridge models to handle time-dependent potentials.
problem Approximating optimal transport dynamics between two boundary distributions with a twisted Brownian motion reference.
method Introduces Twisted Schrödinger Bridge Matching (TSBM) using the Iterative Markovian Fitting (IMF) paradigm, incorporating a gradient-dependent bridge-matching loss.
result Improves trajectory inference across high-dimensional settings, including crowd navigation and single-cell data.
Develops MENT for interpreting and detecting changes in network trajectories.
problem Distortion of network geometry and invalidation of temporal comparisons in dynamic network analysis.
method Develops Multiscale Euclidean Network Trajectories (MENT) framework based on second-moment geometry.
result Validates and interprets network trajectories through isotropic normalization and orthogonal transformations.
We identify linear models from nonlinear systems with initialization constraints.
problem Identifying linear models from nonlinear systems with initialization constraints.
method Multiple trajectories-based deterministic data acquisition algorithm followed by regularized least squares.
result We provide a finite sample error bound on the learned linearized dynamics.
Develops new methods to evaluate data influence in SAM for improved model training.
problem Challenges in mislabeled noisy data and privacy concerns in SAM.
method Two innovative data valuation methods based on influence functions (IF) for SAM.
result Demonstrates effectiveness in identifying mislabeled data and enhancing interpretability.
Estimates roughness of volatility from discrete variance data.
problem Estimating roughness exponent of stochastic volatility from discrete observations of integrated variance.
method Pathwise estimator based on fractional Brownian motion with drift.
result Strong consistency theorems for rough volatility models.
Paper analyzes EM algorithm's trajectory in 2MLR, revealing cycloid behavior.
problem Understanding the convergence and trajectory of EM algorithm in 2MLR.
method Explicit closed-form expressions for EM updates, recurrence relation derivation at population level.
result EM iterations lie on a cycloid trajectory, leading to theoretical estimate of convergence exponent.