Study non-parametric frequency-domain system identification from finite samples.
problem Frequency-domain system identification from limited data.
method Empirical Transfer Function Estimate (ETFE) under sub-Gaussian colored noise and stability assumptions.
result ETFE estimates are concentrated around true values with a finite-sample rate of N t o t − 1 / 3 N_{\mathrm{tot}}^{-1/3} N tot − 1/3 for all frequencies in the H ∞ \mathcal{H}_{\infty} H ∞ norm. New method identifies parameters of wider shallow neural networks with biases.
problem Identifying parameters of wide shallow neural networks with biases from finite samples.
method Two-step pipeline: direction of weights via second order information, signs via algebraic evaluations, biases via gradient descent.
result Constructive methods and theoretical guarantees of finite sample identification for wider shallow networks with biases.
The paper sets sample complexity bounds for identifying LTI systems from a finite set.
problem Identifying an LTI system from a finite set of possible systems using trajectory data.
method Maximum likelihood estimator and information theory tools.
result Upper and lower bounds for sample complexity are derived, independent of stability assumption.
The paper explores when linear system identification is hard or easy, especially for under-actuated systems.
problem Statistical hardness of learning linear systems, especially under-actuated or under-excited systems.
method Using tools from minimax theory and recent statistical tools for finite sample analysis of system identification.
result The controllability index of linear systems affects the sample complexity of identification, making some systems hard to learn.
Efficiently identifies best policies in tabular MDPs with reduced computational cost.
problem Identifying the best policy in tabular MDPs with high computational cost.
method Combines posterior sampling with online learning to achieve asymptotic optimality.
result Achieves optimal sample complexity and posterior contraction rate with O ( S 2 A H ) O(S^2AH) O ( S 2 A H ) per episode. End-to-end algorithm for controlling bilinear systems with probabilistic noise.
problem Controlling bilinear systems with noisy data.
method Proposes an end-to-end algorithm using statistical learning theory and robust controller design.
result Derived finite sample identification error bounds and structurally suitable for control.
In this paper, we analyze the finite sample complexity of stochastic system identification using modern tools from machine learning and statistics. An unknown discrete-time linear system evolves over time under Gaussian noise without external inputs. The objective is to recover the system parameters as well as the Kalm…
We identify linear models from nonlinear systems with initialization constraints.
problem Identifying linear models from nonlinear systems with initialization constraints.
method Multiple trajectories-based deterministic data acquisition algorithm followed by regularized least squares.
result We provide a finite sample error bound on the learned linearized dynamics.
Paper reduces sample complexity for bilinear systems identification to nearly constant.
problem Identifying discrete-time bilinear systems under bounded disturbances.
method Uses trajectory-dependent regressors and polynomial mean-square state growth analysis.
result Proves sample complexity of O ~ ( 1 / ε ) \widetilde{\mathcal O}(1/ε) O ( 1/ ε ) for estimation error ε ε ε . We learn linear models from nonlinear systems using multiple trajectories and regularization.
problem Identifying linear models from data when the underlying dynamics are nonlinear.
method Multiple trajectories data acquisition followed by regularized least squares.
result Learn linearized dynamics with arbitrarily small error given enough samples.
The OLS estimator optimally identifies stable linear systems with a finite number of samples.
problem Identifying stable linear systems with a finite number of samples.
method Finite-time analysis of the Ordinary Least Squares (OLS) estimator for stable linear systems.
result The OLS estimator achieves optimal sample complexity for stable systems, matching existing lower bounds up to universal factors.
Study on generating and identifying languages privately, showing privacy imposes costs and creates barriers.
problem Generating and identifying languages privately in the limit model.
method Introduced a continual release model under differential privacy constraints, proving both positive and negative results.
result Privacy imposes quantitative and qualitative costs, and creates fundamental barriers for identification.
Algorithm identifies bilinear dynamical systems from noisy data.
problem Learning a realization of a partially observed bilinear dynamical system.
method Regression of outputs to highly correlated covariates for Markov-like parameters.
result High probability error bounds on identification algorithm under uniform stability assumption.
New bounds show current methods overestimate system parameter errors.
problem Current bounds overestimate parameter errors in system identification.
method Utilized asymptotic normality and second-order decomposition.
result Obtained finite-sample bounds matching optimal rates up to constants.
Study quantile multi-armed bandits for identifying the best arm with a specified quantile level.
problem Identifying the arm with the highest quantile in multi-armed bandits with private rewards.
method Proposed a (non-private) and differentially private successive elimination algorithms for best-arm identification.
result The proposed algorithms are essentially optimal for quantile bandit problems, with finite sample complexity even for distributions with infinite support-size.
Computational identifiability is a new framework for identifying causal effects.
problem Identifying causal effects in complex scenarios.
method A computational search procedure for empirical estimators.
result Fine-grained identification questions can be answered.
Formalizes identifying information to answer key questions about machine learning from uncertain and novel observations.
problem Understanding and quantifying information from uncertain and novel observations in machine learning.
method Formalizes identifying information, defines hypothesis identification and sample complexity, and proves sample complexity properties for various data-generating processes.
result Proves the information theoretic characteristics of hypothesis identification and sample complexity, and shows how to compute identifying information and novel information.
Unified algorithm for efficient pure exploration using dual variables.
problem Efficiently achieving a specific goal through adaptive experimentation.
method Introducing dual variables to derive optimal allocation conditions, leading to Information-Directed Selection.
result Top-two Thompson sampling attains asymptotic optimality for Gaussian best-arm identification.
Opt-BBAI identifies the best arm with minimal batches and pulls, optimizing both sample and batch complexity.
problem Batched best arm identification (BBAI) problem, aiming to minimize policy switches and resource usage.
method Proposed Opt-BBAI algorithm, achieving near-optimal sample and batch complexity in non-asymptotic settings.
result First algorithm to achieve near-optimal sample and batch complexity in non-asymptotic settings.
Cyclic coordinate descent identifies models in finite time and converges linearly.
problem Model identification in composite nonsmooth optimization problems.
method Cyclic coordinate descent for a wide class of functions.
result Explicit local linear convergence rates for coordinate descent.
New bounds derived for KG algorithm's performance in finite time.
problem Best arm identification problem in multi-armed bandit.
method Theoretical analysis of finite-time performance, deriving bounds for sample allocation, error probability, and regret.
result Upper and lower bounds for the probability of error and simple regret of the KG algorithm.
This paper analyzes the sample complexity of SPS method for scalar linear regression.
problem Analyzing the sample complexity of the Sign-Perturbed Sums (SPS) identification method.
method The paper provides high probability upper bounds for the sizes of SPS confidence intervals under different sets of assumptions.
result The sizes of SPS confidence intervals shrink at a geometric rate around the true parameter, if observation noises are subgaussian.
Develops a framework for distributional Granger causality
problem Identifying predictive dependence in time series beyond Gaussian settings
method Using finite collection of channel-specific restrictions
result Identifies distributional Granger non-causality through testable hypotheses
Algorithm identifies best arm in piecewise stationary linear bandits with minimal samples.
problem Identifying the best arm in a piecewise stationary linear bandit model with unknown contexts and changepoints.
method Design of PS ε \varepsilon ε BAI + ^+ + algorithm, consisting of PS ε \varepsilon ε BAI and N ε \varepsilon ε BAI subroutines. result PS ε \varepsilon ε BAI + ^+ + achieves optimal sample complexity up to a logarithmic factor. The paper introduces a frequency-domain estimator for low-order systems from noisy data.
problem Estimating frequency responses of low-order systems from noisy measurements.
method Uses a quadratic data-fitting term regularized by the nuclear norm of a Loewner matrix, subject to a convex stability constraint.
result Proves a finite-sample error bound and extends it to all frequencies through rational interpolation.
Improved sample complexity for identifying best policies in risk-sensitive reinforcement learning.
problem Identifying approximately optimal policies in risk-sensitive reinforcement learning with exponential horizon dependence.
method Forward-model based algorithm with KL-based exploration bonuses adapted for entropic criterion, leveraging smoothness properties of exponential utility and a new stopping rule.
result Achieved sample complexity matching the lower bound, closing the gap between upper and lower bounds.
Demonstration-regularized RL reduces sample complexity for policy identification.
problem Improving reinforcement learning's sample efficiency with expert demonstrations.
method KL-regularization of behavior cloning using expert demonstrations.
result Demonstration-regularized RL achieves optimal policy identification with reduced sample complexity.
Modern data analysis depends increasingly on estimating models via flexible high-dimensional or nonparametric machine learning methods, where the identification of structural parameters is often challenging and untestable. In linear settings, this identification hinges on the completeness condition, which requires the …
Learn dynamics of a system using auxiliary data from similar systems.
problem Learning dynamics of a linear system with limited data.
method Weighted least squares approach, incorporating auxiliary data.
result Auxiliary data can help reduce intrinsic error due to noise.
Optimal top-2 method improves best arm identification with reduced error.
problem Identifying the arm with the highest mean in a set of arms.
method A novel top-2 algorithm that pulls the empirical best arm with probability β and the challenger arm otherwise.
result The proposed algorithm matches the information theoretic lower bound on sample complexity as δ approaches 0.
New method identifies latent components in PNL mixtures without strong assumptions.
problem Identifying latent components in PNL mixtures under unknown nonlinear functions.
method Carefully designed UML criterion to identify a null space associated with the mixing system.
result Identification/removal of unknown nonlinearity under minimal conditions.
Optimal best-arm identification in linear bandits reduces sampling budget.
problem Identifying the best arm with fixed confidence in stochastic linear bandits.
method A simple algorithm that tracks an optimal proportion of arm draws, updated as rarely as desired.
result The algorithm's sampling complexity matches known lower bounds, asymptotically almost surely and in expectation.
In the present paper we study interval identification systems of order three. We prove that the Rauzy induction preserves symmetry: for any symmetric interval identification system of order three after finitely many iterations of the Rauzy induction we always obtain a symmetric system. We also provide an example of sym…
A new method, Residual-Permuted Sums, improves confidence region construction for linear regression models.
problem Constructing reliable confidence regions for linear regression models with non-symmetric noise.
method Residual-Permuted Sums (RPS) method, which permutes residuals instead of perturbing their signs.
result RPS provides exact finite sample coverage probabilities and is uniformly strongly consistent.
The paper provides guarantees for high-dimensional DML estimators in observational studies.
problem Estimating treatment effects in observational settings with many covariates.
method Debiased machine learning (DML) with finite-sample guarantees.
result Bounding the deviation of finite-sample distribution from asymptotic Gaussian approximation.
New findings on complexity limits in fixed budget bandit identification.
problem Determining the best possible error rate for fixed budget bandit identification.
method Analyzing the best non-adaptive sampling procedures and showing the existence of complexities.
result No fixed complexity for certain bandit identification tasks.
Active learning method estimates nonlinear systems efficiently.
problem Identifying nonlinear dynamical systems with continuous states and actions.
method Repeating three steps: trajectory planning, tracking, and re-estimation.
result Estimates nonlinear dynamical systems at a parametric rate.
Study best arm identification in restless bandits with unknown TPMs.
problem Identify the best arm with fixed confidence in restless bandits with unknown TPMs.
method Proposed a policy for best arm identification and proved its expected stopping time matches the lower bound.
result The state-action visitation proportions match the optimal proportions under any asymptotically optimal policy.
New method improves IV estimation with many weak and invalid instruments.
problem Identification in linear IV models with unknown validity.
method Non-convex penalized approaches, surrogate sparsest penalty.
result Advantages over other IV estimators in selection consistency and weak IV strength conditions.
New nonconvex methods improve SysID efficiency and accuracy.
problem Efficiently identify low-order linear systems from limited data.
method Proposes two nonconvex reformulations of Hankel-rank minimization for SysID.
result Nonconvex methods achieve lower statistical error rates and sample complexities.
Improved elimination strategies for adaptive bandit identification reduce sample complexity and computational burden.
problem Inefficient elimination strategies in bandit identification.
method Adaptive elimination methods that update sampling rules frequently and reduce problem size.
result Adaptive elimination methods achieve better sample complexity and computational efficiency.
Optimal noise excitation for linear system identification reduces sample complexity.
problem Efficiently identifying linear systems with minimal data.
method Active learning algorithm using ordinary least squares and semidefinite programming.
result The proposed algorithm matches lower bounds on sample complexity for any active learning method.
Learning from examples is one of the key problems in science and engineering. It deals with function reconstruction from a finite set of direct and noisy samples. Regularization in reproducing kernel Hilbert spaces (RKHSs) is widely used to solve this task and includes powerful estimators such as regularization network…
We identify linear dynamical systems under convex constraints with fewer samples.
problem Identifying linear dynamical systems with prior structural information.
method Constrained least squares estimator with error bounds dependent on convex set size.
result Linear dynamical systems can be reliably estimated with fewer samples than unconstrained settings.
Clustering, or unsupervised classification, is a task often plagued by outliers. Yet there is a paucity of work on handling outliers in clustering. Outlier identification algorithms tend to fall into three broad categories: outlier inclusion, outlier trimming, and post hoc outlier identification methods, with the forme…
We address the structure identification and the uniform approximation of two fully nonlinear layer neural networks of the type f ( x ) = 1 T h ( B T g ( A T x ) ) f(x)=1^T h(B^T g(A^T x)) f ( x ) = 1 T h ( B T g ( A T x )) on R d \mathbb R^d R d from a small number of query samples. We approach the problem by sampling actively finite difference approximations to Hessians of the network. Gathe…
Paper tackles good arm identification in stochastic bandits.
problem Identifying good arms with minimal samples.
method Proposes DGAI, a differentiable algorithm to improve sample complexity.
result DGAI outperforms baseline algorithms in synthetic and real-world datasets.
PAC best arm identification with a deadline, improving efficiency over sequential methods.
problem Identifying an optimal arm under a fixed time constraint.
method Elastic Batch Racing (EBR) algorithm for ( ε , δ ) (ε, δ) ( ε , δ ) -PAC best arm identification under a deadline. result EBR is optimal with respect to two hardness results and outperforms sequential methods.