This paper tackles Bayesian system identification with probabilistic numerical methods.
problem Accurately modeling nonlinear dynamic systems from noisy data.
method Probabilistic Sequential Monte Carlo (SMC) combined with probabilistic numerical integration.
result Efficient identification of latent states and system parameters from noisy measurements.
New method improves parameter identification for complex systems.
problem Parameter identification and comparison of nonlinear ODE systems.
method Gaussian process regression over time-series data.
result Better accuracy in state-of-the-art performance for nonlinear systems.
Review of automatic de-identification systems for EHR, highlighting challenges beyond accuracy.
problem Challenges in surrogate generation and patient privacy in de-identification of EHR.
method Comprehensive review of 18 recently published systems, focusing on accuracy and challenges.
result Despite accuracy improvements, challenges remain in surrogate generation and patient privacy.
Modeling dynamical systems is important in many disciplines, e.g., control, robotics, or neurotechnology. Commonly the state of these systems is not directly observed, but only available through noisy and potentially high-dimensional observations. In these cases, system identification, i.e., finding the measurement map…
One of the key challenges in identifying nonlinear and possibly non-Gaussian state space models (SSMs) is the intractability of estimating the system state. Sequential Monte Carlo (SMC) methods, such as the particle filter (introduced more than two decades ago), provide numerical solutions to the nonlinear state estima…
Algorithm identifies bilinear dynamical systems from noisy data.
problem Learning a realization of a partially observed bilinear dynamical system.
method Regression of outputs to highly correlated covariates for Markov-like parameters.
result High probability error bounds on identification algorithm under uniform stability assumption.
Bayesian filtering approach identifies nonlinear restoring forces in dynamic systems.
problem Identification of nonlinear dynamic systems in engineering.
method Modeling the nonlinear restoring force as a Gaussian process, converting it to a state-space model, and inferring internal states and the nonlinear restoring force through filtering and smoothing.
result The approach effectively identifies nonlinear restoring forces in both simulated and experimental datasets.
ANNs improve de-identification of patient notes, outperforming existing systems.
problem De-identification of patient notes to protect patient confidentiality.
method Artificial Neural Networks (ANNs) without handcrafted features or rules.
result ANN model outperforms state-of-the-art systems, achieving high F1-scores.
Proposes neural delay differential equations for stable system identification with partially observed states.
problem Learning stable models for systems with partial or delayed observations.
method Augments states with history, uses neural delay differential equations, and ensures stability through time delay analysis.
result The approach ensures stability of learned models for partially observed systems.
The paper explores past and present uses of regularization and Bayesian methods in system identification.
problem System identification challenges and classical parametric approaches limitations.
method Evolution of regularization and Bayesian methods in system identification, focusing on historical and foundational issues.
result Illustrates the evolution of regularization and Bayesian methods in system identification over the years.
This paper tackles adaptive control of unknown Markov jump systems with sample complexity and regret bounds.
problem Adaptive control of unknown Markov jump systems with changing dynamics.
method Identification-based adaptive control using a system identification algorithm and certainty equivalent control.
result The proposed adaptive control scheme achieves O ( T ) \mathcal{O}(\sqrt{T}) O ( T ) regret, improving to O ( p o l y l o g ( T ) ) \mathcal{O}(polylog(T)) O ( p o l y l o g ( T )) with partial knowledge. New CNN architecture separates 'what' and 'where' in neural data.
problem Estimating individual receptive field locations in neural data.
method Sparse readout layer factorizing spatial and feature dimensions.
result Our network outperforms current models in system identification.
A new method for identifying Gaussian process state space models.
problem Challenges in learning the model of Gaussian process state space models.
method Structured Gaussian variational posterior distribution over latent states parameterized by a recognition model.
result The method allows for efficient computation of a lower bound on the marginal likelihood and generation of plausible future trajectories.
Improved SINDy autoencoder for identifying noisy dynamical systems.
problem Robust identification of noisy dynamical systems from data.
method Incorporates noise-separating neural network structures into SINDy autoencoder architecture.
result Accurately recovers latent dynamics and estimates measurement noise from noisy observations.
A method for identifying NPWARX models with arbitrary domains using probabilistic mixture models.
problem Identifying hybrid system models with discontinuous maps.
method Probabilistic mixture model with a neural network for nonlinear partitioning and Expectation Maximization for parameter estimation.
result Demonstrated on a nonlinear piece-wise problem with discontinuous maps.
Unified framework identifies nonlinear systems using characteristic curves and neural networks.
problem Balancing interpretability and flexibility in nonlinear system identification.
method Combines differential equation structure with neural networks, using characteristic curves as modular components.
result NN-CC approach outperforms other methods in complex nonlinear systems.
Deep learning scheme identifies and reconstructs chaotic and stochastic systems from noisy data.
problem Challenging identification of governing equations from noisy and partial observations.
method Jointly learns inference model and governing laws using variational deep learning.
result Framework generalizes state-of-the-art methods and accounts for stochastic variabilities.
NSIBF detects anomalies in CPS using neural system identification and Bayesian filtering.
problem Detecting anomalies in CPS with complex dynamics and sensor noise.
method Neural System Identification and Bayesian Filtering (NSIBF).
result NSIBF outperforms state-of-the-art methods in anomaly detection for CPS.
New nonconvex methods improve SysID efficiency and accuracy.
problem Efficiently identify low-order linear systems from limited data.
method Proposes two nonconvex reformulations of Hankel-rank minimization for SysID.
result Nonconvex methods achieve lower statistical error rates and sample complexities.
New framework for 3D spatial topology enumeration and identification.
problem Efficient navigation through complex engineering system topologies.
method Mathematical spatial graph theory to represent, enumerate, and identify unique topological classes.
result Identification of distinctive 3D topological classes for engineering systems.
Automatically constructs models from time series data in seconds.
problem Creating models of complex systems from small time series data.
method Automated construction of dynamic prime models from experimental data.
result Models can be constructed in less than a minute.
Tensor completion method identifies nonlinear systems from input-output data.
problem Identifying nonlinear functions from input-output data pairs.
method Formulated as tensor completion problem with smoothness regularization and solved using block coordinate descent.
result Provable correct nonlinear system identification under certain conditions.
In the present paper we study interval identification systems of order three. We prove that the Rauzy induction preserves symmetry: for any symmetric interval identification system of order three after finitely many iterations of the Rauzy induction we always obtain a symmetric system. We also provide an example of sym…
A new method reduces Volterra kernel complexity and uncertainty quantification.
problem Challenges in modeling nonlinear systems with Volterra series due to high model order.
method Bayesian Tensor Network Volterra kernel machines (BTN-V) using canonical polyadic decomposition.
result Competitive accuracy, enhanced uncertainty quantification, and reduced computational cost.
Paper explores using EEG for better speaker identification, even in noisy environments.
problem Speaker identification performance degrades in background noise.
method Uses EEG signals to enhance speaker identification systems, comparing with acoustic features.
result Speaker identification system using only EEG features outperforms one using only acoustic features in high background noise.
AdaptOn achieves logarithmic regret in adaptive control of unknown partially observable linear systems.
problem Adaptive control in partially observable linear dynamical systems.
method AdaptOn algorithm that estimates system dynamics through online learning and gradient descent.
result AdaptOn achieves a logarithmic regret bound of polylog(T) after T steps.
Physics-informed GP regression solves eigenvalue problems by identifying non-trivial eigenspaces.
problem Solving eigenvalue problems of linear operators with trivial solutions.
method Constructing a transfer function-type indicator using physics-informed Gaussian Process posterior.
result The posterior covariance is non-trivial only for eigenvalues of the operator, indicating non-trivial eigenspaces.
Paper uses sparse learning to estimate quasi-potential and drift components in stochastic systems.
problem Estimating quasi-potential and drift components in stochastic systems.
method Sparse identification of non-linear dynamics (SINDy) combined with action minimization methods.
result Evaluation of quasi-potential landscape from a single trajectory.
This paper improves system identification by reducing sample complexity for high-dimensional linear dynamical systems.
problem High sample complexity for learning partially observed linear dynamical systems in high dimensions.
method Introduces an ℓ 1 \ell_1 ℓ 1 -regularized estimation method that reduces sample complexity from linear to logarithmic with system dimension. result Markov parameters can be learned with logarithmic number of samples relative to system dimension, improving sample complexity.
Unified Bayesian framework for LTV system identification using neural networks and Gaussian Processes.
problem Identifying Linear Time-Varying systems from input-output data.
method Bayesian modeling of impulse response as a stochastic process, using neural networks and Gaussian Processes for inference.
result Framework can infer LTI system properties from a single noisy input-output pair, achieving lower error than classical methods.
Paper proposes i-vector approach for NLI with improved accuracy.
problem Identifying a speaker's native language from speech in a second language.
method i-vector approach using MFCC and GFCC features.
result Improved accuracy in NLI system, especially with GFCC features.
A framework learns agent policies from interaction data.
problem Modeling complex multiagent behavior.
method Representation learning approach using imitation and agent identification.
result Demonstrated utility in diverse multiagent tasks.
A distributed system identification method for LTI systems using reverse experience replay.
problem Online system identification of LTI systems over multi-agent networks.
method DSGD-RER, a distributed variant of SGD-RER with backward updates.
result The estimation error decreases as the network size grows.
dynoGP uses deep Gaussian processes for dynamic system identification.
problem System identification for complex dynamical systems.
method Interconnecting linear dynamic GPs and static GPs to model dynamic and static nonlinearities.
result Demonstrates effectiveness of the approach using both simulated and real-world data.
Tutorial on using concentration inequalities for linear system identification.
problem Learning state-space parameters of linear systems.
method Large-deviations and self-normalized martingales.
result Data-dependent and independent bounds on learning rate.
Deep learning's convolutional networks improve system identification.
problem Nonlinear system identification problems.
method Exploration of relationships between TCN and Volterra series/block-oriented models.
result TCN outperforms traditional models in sequence modeling tasks.
Bayesian neural networks with nonparametric noise models for system identification.
problem Estimating parameters and noise processes in stochastic dynamic systems.
method Bayesian nonparametric approach using neural networks and Gibbs sampler.
result The method converges to full nonparametric Bayesian regression model.
Study on risk networks to improve risk identification and classification.
problem Biases in risk network generation limit risk management models.
method Alternative methodology for generating weighted risk networks.
result Observed modular topology as a robust risk classification framework.
Paper connects system identification and machine learning using RKHSs.
problem Combining system identification and machine learning for dynamic systems.
method Introducing RKHSs of dynamic systems and deriving stability conditions.
result RKHSs of dynamic systems facilitate the design of new kernels for system identification.
Equation discovery method reconstructs model structure and parameters from data.
problem Nonlinear system identification challenges.
method Two interlaced parts: model structure identification and parameter estimation.
result Equation discovery method successfully reconstructs model structure and parameters from data.
GEnBP combines EnKF and GaBP for efficient high-dimensional inference.
problem Efficient inference in high-dimensional models.
method Gaussian Ensemble Belief Propagation algorithm combining EnKF and GaBP.
result GEnBP outperforms existing methods in accuracy and efficiency.
The paper explores when linear system identification is hard or easy, especially for under-actuated systems.
problem Statistical hardness of learning linear systems, especially under-actuated or under-excited systems.
method Using tools from minimax theory and recent statistical tools for finite sample analysis of system identification.
result The controllability index of linear systems affects the sample complexity of identification, making some systems hard to learn.
Study identifies and validates a method for system identification of Markov jump linear systems.
problem System identification for autonomous Markov jump linear systems with complete state observations.
method Proposes switched least squares method for identification and derives rates of convergence.
result Data-independent rate of convergence is O ( log ( T ) / T ) \mathcal{O}\big(\sqrt{\log(T)/T} \big) O ( log ( T ) / T ) , showing strong consistency. Optimism-based methods improve adaptive regulation of linear-quadratic systems.
problem Trade-off between identifying unknown dynamics and regulating the system.
method Optimism-based adaptive policies that favor optimistic approximations of true parameters.
result Established high probability upper bounds for worst-case regret of optimism-based adaptive policies.
New method uses neural networks to identify sources from limited data in complex systems.
problem Identifying sources from noisy and limited data in high-dimensional systems.
method Calibrating deep neural network surrogates to ensemble simulations and using Bayesian optimization for source identification.
result Reliable source identification with uncertainty quantification using limited data and auxiliary processes.
A new Bayesian system identification method for real-time data.
problem Real-time system identification with new data arriving at fixed time steps.
method Proposes a 1-step Bayesian system identification procedure using iterative optimization.
result The 1-step procedure is more efficient than the standard optimization method.
Deep SSMs use neural networks to identify complex systems.
problem Identifying nonlinear systems with high uncertainty.
method Deep state space models with neural networks.
result Deep SSMs outperform traditional methods on benchmarks.
Automated system identifies and counts insects from images.
problem Manual sorting and identification of insect samples is time-consuming and limits biodiversity mapping.
method Robot-enabled image-based identification machine using CNNs.
result Classification accuracy of 0.980 0.980 0.980 for initial dataset.