Optimal estimator derived for partially observable LTI systems.
problem Optimal estimator for partially observable LTI systems.
method State-space representation for derivation of optimal estimator.
result Derivation of minimum error variance estimator for partially observable LTI systems.
PAC-Bayesian bounds for stochastic LTI systems derived.
problem Error bounds for stochastic LTI systems.
method PAC-Bayesian theory applied to autonomous stochastic LTI models.
result Error bounds for stochastic LTI systems derived.
Paper derives PAC-Bayesian bounds for LTI systems learning from empirical data.
problem Characterizing predictive power of LTI systems learned from data.
method PAC-Bayesian bounds for LTI stochastic dynamical systems with inputs.
result Finite-sample error bounds for learning algorithms of LTI systems.
A distributed system identification method for LTI systems using reverse experience replay.
problem Online system identification of LTI systems over multi-agent networks.
method DSGD-RER, a distributed variant of SGD-RER with backward updates.
result The estimation error decreases as the network size grows.
Paper derives an error bound for stochastic LTI systems.
problem Stochastic LTI systems with inputs in control engineering and econometrics.
method PAC-Bayesian-Like error bound derivation.
result Derived an error bound for stochastic LTI systems.
New model stabilizes asynchronous LTI systems, independent of synchronous stability.
problem Stability of asynchronous LTI systems under randomization and asynchrony.
method Introduced a new model for random asynchronous LTI systems and developed a method for system identification.
result Stability of random asynchronous LTI systems is independent of synchronous stability.
The paper sets sample complexity bounds for identifying LTI systems from a finite set.
problem Identifying an LTI system from a finite set of possible systems using trajectory data.
method Maximum likelihood estimator and information theory tools.
result Upper and lower bounds for sample complexity are derived, independent of stability assumption.
Study non-asymptotic estimation bounds for LTI models with Gaussian noise.
problem Estimating parameters of LTI models with non-asymptotic error bounds.
method Sharp non-asymptotic lower bounds using Cramér-Rao and van Trees inequalities, concentration results, and differential geometric constructions.
result Sharp and rate-optimal lower bounds for mean square estimation risk.
Polynomial-time reachability for LTI systems with TLL NN controllers is achieved.
problem Bounding the reachable set of LTI systems controlled by TLL NN controllers.
method Polynomial-time computation of exact one-step reachable set and tight bounding box via two methods.
result Exact reachability computation in polynomial time for TLL NN controllers.
Solves parameter non-identifiability in Bayesian LTI system identification.
problem Parameter non-identifiability in standard Bayesian approaches for LTI system identification.
method Embedding canonical forms of LTI systems within the Bayesian framework.
result Unlocking the use of meaningful priors and robust uncertainty estimates.
We consider the problem of learning a realization for a linear time-invariant (LTI) dynamical system from input/output data. Given a single input/output trajectory, we provide finite time analysis for learning the system's Markov parameters, from which a balanced realization is obtained using the classical Ho-Kalman al…
The paper tackles estimation of hidden state LTI systems of unknown order.
problem Estimation of Markov parameters and minimal realization of unknown order LTI systems.
method Hankel penalized least square estimator, Ho-Kalman algorithm, and a combined algorithm.
result Statistical guarantees for estimation error, rank recovery, and sample complexity.
Complex frequency generalizes eigenvalues in LTI systems.
problem Characterizing dynamics of signals with complex values.
method Geometric frequency interpretation and transformation analysis.
result Complex frequencies in LTI systems match eigenvalues.
HOPE improves SSMs for long-memory tasks with robust initialization and training.
problem Improving state-space models for long-memory tasks with robust initialization and training.
method Developed a new parameterization scheme called HOPE using Hankel operators and Markov parameters.
result HOPE improves SSMs' performance on Long-Range Arena tasks and demonstrates non-decaying memory.
Paper identifies sparse LTI systems from a single trajectory.
problem Identifying sparse linear time-invariant systems from a single sample trajectory.
method Lasso-like estimator for sparse parameters, considering stability or stabilizing controller.
result Sharp finite-time guarantees on accurate recovery of sparsity and parameter values.
New scheme detects anomalies in time series data quickly and accurately.
problem Detecting anomalies in time series data with multi-seasonality and unlabeled data.
method Prediction-driven, unsupervised anomaly detection scheme combining decomposition and inference.
result Our scheme outperforms existing algorithms in AUC metric while maintaining efficiency.
New algorithm optimizes linear system estimation from single trajectory.
problem Estimating LTI systems from a single trajectory.
method SGD with Reverse Experience Replay (SGD−RER) result Optimal guarantees for parameter and prediction errors.
KKR uses Koopman theory to improve forecasting in complex systems.
problem Forecasting complex, nonlinear dynamical systems in decision-making.
method Derives a universal Koopman-invariant RKHS for LTI dynamical systems.
result KKR framework provides convergence results and generalization error bounds.
SSMs have a built-in bias towards low-frequency components, which can be adjusted.
problem Frequency bias in SSMs affects their performance on long-range sequences.
method Proposed two mechanisms to tune frequency bias: scaling initialization or applying a Sobolev-norm-based filter.
result Tuning frequency bias improves SSMs' performance on long-range sequence learning tasks.
The focal point of this paper is the issue of "drawdown" which arises in recursive betting scenarios and related applications in the stock market. Roughly speaking, drawdown is understood to mean drops in wealth over time from peaks to subsequent lows. Motivated by the fact that this issue is of paramount concern to co…
Modeling financial networks to predict systemic crises.
problem Predicting systemic financial crises in complex networks.
method Developed inhomogeneous random financial networks (IRFNs) to model bank interactions.
result Found a condition for a locally tree-like independence (LTI) property, leading to fixed point equations for system equilibrium.
Unified analysis of TD learning using MJLS theory for linear function approximators.
problem Characterizing the exact behaviors of TD learning algorithms with linear function approximators.
method Exploiting connections to Markov jump linear systems (MJLS) theory to analyze TD learning algorithms.
result Closed-form expressions for mean and covariance matrix of TD estimation error at any time step.
Physics-based framework improves building energy forecasting.
problem Lack of physical correspondence in machine learning models for building energy systems.
method Combines LTI SSMs with subspace-based domain adaptation (SDA).
result Physics-derived subspaces align with data-derived subspaces for better forecasting.
The Expectation-Maximization (EM) algorithm is one of the most popular methods used to solve the problem of parametric distribution-based clustering in unsupervised learning. In this paper, we propose to analyze a generalized EM (GEM) algorithm in the context of Gaussian mixture models, where the maximization step in t…
Transformers can approximate Kalman Filtering in linear systems with small error.
problem Approximating Kalman Filtering using Transformers for linear dynamical systems.
method Two-step reduction: 1) Softmax self-attention block approximates Nadaraya-Watson kernel smoothing, 2) This estimator approximates Kalman Filter.
result Constructs a Transformer that implements the Kalman Filter with small additive error, uniformly bounded in time.
Unified Bayesian framework for LTV system identification using neural networks and Gaussian Processes.
problem Identifying Linear Time-Varying systems from input-output data.
method Bayesian modeling of impulse response as a stochastic process, using neural networks and Gaussian Processes for inference.
result Framework can infer LTI system properties from a single noisy input-output pair, achieving lower error than classical methods.
Study online control of unknown time-varying systems with negative and positive results.
problem Online control of time-varying systems with unknown dynamics.
method Algorithmic upper bounds and lower bounds for different policy classes.
result Sublinear adaptive regret bounds for Disturbance Response policies.
A new FFT-based method simplifies causal structure recovery for linear dynamical systems.
problem Efficiently identifying dynamic causal effects from time-series data.
method FFT-based approach to reduce computational complexity to O(Tn3logN). result Significant computational advantage for graph reconstruction.
New insights into spectral statistics of sample covariance matrix for stable linear systems.
problem Estimating high-dimensional stable state transition matrices from noisy data.
method Combining spectral theorem for non-Hermitian operators, concentration of measure, and perturbation theory.
result The spectral radius of the sample covariance matrix exhibits phase transitions in high dimensions.