Simplified identification methods for causal inference with arbitrary interventional distributions.
problem Estimating cause-effect relationships from data with experimental interventions.
method Using Single World Intervention Graphs and nested model factorization, we provide algorithms for identifying causal parameters from mixed observational and interventional distributions.
result Our algorithms are complete for certain types of interventional marginal distributions.
A distributed system identification method for LTI systems using reverse experience replay.
problem Online system identification of LTI systems over multi-agent networks.
method DSGD-RER, a distributed variant of SGD-RER with backward updates.
result The estimation error decreases as the network size grows.
Paper identifies unobserved variables from observable data.
problem Missing variables in empirical studies.
method Function mapping from observables to unobservables based on joint distribution.
result Uniqueness of latent values in each observation.
Algorithm identifies sources in product distributions with improved complexity.
problem Identifying sources in mixtures of product distributions.
method Approximate multilinear moments input, 2^{O(k^2)} n^{O(k)} operations.
result First explicit bound on computational complexity of source identification.
Study measures uncertainty in MST identification across different correlation networks.
problem Uncertainty in MST identification across various correlation-based market networks.
method Developed a framework using random variable networks (RVN) to measure uncertainty of MST identification.
result FDR is the most appropriate measure for MST identification reliability.
New findings on complexity limits in fixed budget bandit identification.
problem Determining the best possible error rate for fixed budget bandit identification.
method Analyzing the best non-adaptive sampling procedures and showing the existence of complexities.
result No fixed complexity for certain bandit identification tasks.
Proposes a method to identify elements in a skewness matrix for multivariate skew-elliptical distributions.
problem Label switching issue in Bayesian estimation of skewness matrix.
method Imposes a positive lower-triangular constraint and uses Bayesian sparse estimation with horseshoe prior.
result Successfully estimates the true structure of skewness dependency.
Emputation learns imputation models guided by missingness assumptions.
problem Learning imputation models for missing data given observed data.
method Guided by specific missingness assumptions, Emputation trains a deep generative model to learn the extrapolation distribution of missing variables.
result The population minimizer of the emputation risk recovers the target extrapolation distribution under various identification assumptions.
New method identifies distribution grid outages using smart meter data.
problem Outages in urban distribution grids due to DERs and smart meters' last gasp signals.
method Data-driven approach based on stochastic time series analysis and maximum likelihood estimation.
result Proves optimal performance in identifying distribution grid outages using smart meter data.
New method improves neural network robustness by identifying functions rather than parameters.
problem Neural networks' lack of robustness to distribution shifts.
method Identify the function represented by quadratic networks, not their parameters.
result Obtain robust generalization bounds for neural networks.
Missing data is a pervasive problem in data analyses, resulting in datasets that contain censored realizations of a target distribution. Many approaches to inference on the target distribution using censored observed data, rely on missing data models represented as a factorization with respect to a directed acyclic gra…
New insights into identifying mixtures of product distributions using Hadamard extensions.
problem Identifying mixtures of product distributions on binary variables.
method Analysis of Hadamard extensions of matrix products.
result Conditions for full column rank of Hadamard extensions.
Bayesian method improves online NARMAX model identification.
problem Online identification of nonlinear systems with small sample sizes and low noise.
method Variational Bayesian inference using message passing algorithm for polynomial NARMAX models.
result Variational Bayesian estimator outperforms recursive and offline least-squares methods.
Improved theoretical guarantees for Top Two algorithms.
problem Theoretical support for best arm identification with bounded distributions.
method General analysis of Top Two methods, identifying desirable properties and replacing sampling step.
result Theoretical support for Top Two algorithms with bounded distributions.
This paper considers the problem of Phase Identification in power distribution systems. In particular, it focuses on improving supervised learning accuracies by focusing on exploiting some of the problem's information theoretic properties. This focus, along with recent advances in Information Theoretic Machine Learning…
dynoGP uses deep Gaussian processes for dynamic system identification.
problem System identification for complex dynamical systems.
method Interconnecting linear dynamic GPs and static GPs to model dynamic and static nonlinearities.
result Demonstrates effectiveness of the approach using both simulated and real-world data.
Investigation of the market graph attracts a growing attention in market network analysis. One of the important problem connected with market graph is to identify it from observations. Traditional way for the market graph identification is to use a simple procedure based on statistical estimations of Pearson correlatio…
Improved sample and time complexity for identifying mixtures of product distributions.
problem Identifying a mixture of k product distributions from statistics. method Combining robust tensor decomposition and Hadamard extensions to bound the condition number of key matrices.
result Achieved sample complexity and run-time complexity of (1/ζ)O(k) for n≥2k−1. Develops a framework for distributional Granger causality
problem Identifying predictive dependence in time series beyond Gaussian settings
method Using finite collection of channel-specific restrictions
result Identifies distributional Granger non-causality through testable hypotheses
SIG model identifies invariant variables for MSDA with fewer domain constraints.
problem Challenges in enforcing minimal changes across domains for MSDA.
method Subspace identification theory and variational inference.
result SIG model outperforms existing techniques on various benchmark datasets.
This paper studies active learning in the context of robust statistics. Specifically, we propose a variant of the Best Arm Identification problem for \emph{contaminated bandits}, where each arm pull has probability ε of generating a sample from an arbitrary contamination distribution instead of the true und…
Unified method for learning from selectively labeled data.
problem Classification with selectively labeled data from multiple decision-makers.
method Unified cost-sensitive learning (UCL) approach.
result Unified method for robust classification in selective labeling.
Algorithm identifies missing data distributions in graphical models.
problem Identifying missing data distributions in graphical models with interventionist perspective.
method Tree-based identification algorithm that tracks selection bias and admissible intervention strategies.
result Valid estimating equations for missingness mechanism and complete data distribution.
New method verifies formulas for causal interventional distributions.
problem Deciding if a given formula correctly identifies an interventional distribution.
method Proposed a falsifier to check if a formula is identifying.
result Falsifier can induce an almost-surely correct verifier for certain models.
The growing integration of distributed energy resources (DERs) in urban distribution grids raises various reliability issues due to DER's uncertain and complex behaviors. With a large-scale DER penetration, traditional outage detection methods, which rely on customers making phone calls and smart meters' "last gasp" si…
Data augmentation is usually used by supervised learning approaches for offline writer identification, but such approaches require extra training data and potentially lead to overfitting errors. In this study, a semi-supervised feature learning pipeline was proposed to improve the performance of writer identification b…
In this paper we introduce a novel method for linear system identification with quantized output data. We model the impulse response as a zero-mean Gaussian process whose covariance (kernel) is given by the recently proposed stable spline kernel, which encodes information on regularity and exponential stability. This s…
New algorithms for best arm identification in bandits robust to misspecified parameters.
problem Inconsistent learning performance of traditional MAB algorithms when parameters are misspecified.
method Proposes two classes of asymptotically near-optimal algorithms for statistically robust MAB under fixed-budget pure exploration.
result Establishes fundamental performance limits and proposes algorithms that are asymptotically near-optimal.
The paper develops a theory for identifying the best arm in non-parametric multi-armed bandits with a fixed budget.
problem Identifying the best arm in non-parametric multi-armed bandits with a limited number of trials.
method The paper proposes upper and lower bounds on the average log-probability of misidentification using information-theoretic quantities and a refined analysis of the successive-rejects strategy.
result The paper provides new upper and lower bounds on the average log-probability of misidentification, which generalize existing bounds.
Paper identifies latent factors from noisy measurements using tensor decomposition.
problem Identification of latent factors from noisy, correlated measurements.
method Tensor decomposition of third order cross moments, Kruskal theorem, Kotlarski identity, generalized Kruskal rank.
result Full distribution of latent factors and measurement errors identified without injective measurements.
We establish a foundation for multivariate counterfactual identification using dynamic optimal transport.
problem Addressing the open question of counterfactual identification for high-dimensional multivariate outcomes from observational data.
method Establish a foundation for multivariate counterfactual identification using continuous-time flows, including non-Markovian settings, with tools from dynamic optimal transport.
result Characterise the conditions under which flow matching yields a unique, monotone, and rank-preserving counterfactual transport map, ensuring consistent inference.
Bayesian neural networks with nonparametric noise models for system identification.
problem Estimating parameters and noise processes in stochastic dynamic systems.
method Bayesian nonparametric approach using neural networks and Gibbs sampler.
result The method converges to full nonparametric Bayesian regression model.
The paper explores how to extrapolate from limited data points using causal mechanisms.
problem Handling distribution shifts with limited target samples.
method Formulates the extrapolation problem with a latent-variable model embodying the minimal change principle in causal mechanisms, and identifies conditions for identification.
result Theoretical understanding and practical methods for extrapolation without requiring an on-support target distribution.
Study improves MMD estimation for two distributions with mismeasured data.
problem Estimating MMD under contaminated data.
method Partial identification of MMD bounds with a fast convergence rate.
result Proposes a method to estimate MMD bounds that converge faster than alternatives.
This paper tackles Bayesian system identification with probabilistic numerical methods.
problem Accurately modeling nonlinear dynamic systems from noisy data.
method Probabilistic Sequential Monte Carlo (SMC) combined with probabilistic numerical integration.
result Efficient identification of latent states and system parameters from noisy measurements.
Algorithm learns new tasks efficiently from past experience.
problem Lack of robustness to distributional shift in meta-reinforcement learning.
method Model Identification and Experience Relabeling (MIER) using dynamics models.
result Efficient extrapolation to out-of-distribution tasks.
This paper addresses the identification of insurance models with multidimensional screening where insurees have private information about their risk and risk aversion. The model includes a random damage and the possibility of several claims. Screening of insurees relies on their certainty equivalence. The paper then in…
Paper proposes online learning for estimating AC network admittance matrix.
problem Missing or outdated information on power grid topology and parameters.
method Recursive identification algorithm using phasor measurements, enhanced with DOE for optimal data excitation.
result Improves on existing techniques and substantiated by numerical studies.
Proposes methods to identify and estimate counterfactual distributions with confounding.
problem Estimating counterfactual distributions in the presence of confounding.
method Nonparametric identification and semiparametric estimation using conditional copulas and machine learning.
result Valid inference for individual-level effects and nonparametric identifiability of latent confounding subspace.
The paper identifies the best treatment to maximize NDPO, a key outcome in causal mediation analysis.
problem Identifying the treatment that maximizes the expected natural direct potential outcome (NDPO) in causal mediation analysis.
method Developed a fixed-confidence best-arm identification (BAI) algorithm based on the Track-and-Stop (TaS) framework, using a cutting-set method to solve a semi-infinite optimization problem.
result The proposed algorithm achieves sample-efficient identification with a high-probability correctness guarantee and asymptotic optimality.
New algorithms identify best arm with less pulls, adapting to arm covariances.
problem Best arm identification under dependent and correlated arm distributions.
method Adaptive algorithms estimating arm covariances to minimize pulls.
result Substantial improvement in best arm identification over standard setting.
Optimal algorithm for identifying best-arm with minimal regret.
problem Identifying the best arm in two treatments with limited budget.
method Neyman allocation based on outcome standard deviations.
result Neyman allocation is minimax optimal for simple regret.
Beta-SOD detects and corrects noisy object re-identification using cosine similarity and Beta mixtures.
problem Noisy object re-identification in image datasets.
method Reframed Re-ID as a similarity task, using Siamese networks and Beta mixture models.
result Superior performance in noisy conditions compared to state-of-the-art methods.
Paper uses genome Markov structure for outlier detection and read classification.
problem Identifying outliers and classifying reads in genome databases.
method Applying second-order Markov models to triplet base distributions.
result Improved accuracy in outlier identification and read classification.
There are many advantages to use probability method for nonlinear system identification, such as the noises and outliers in the data set do not affect the probability models significantly; the input features can be extracted in probability forms. The biggest obstacle of the probability model is the probability distribu…
The paper explores how missing data problems are related to causal inference.
problem Missing data in experiments makes causal inference difficult.
method The paper reinterprets missing data as a form of causal inference by considering counterfactual variables.
result Identification assumptions in missing data can be encoded using graphical models of counterfactual and observed variables.
Contextual information helps identify the best arm more efficiently.
problem Best arm identification with contextual covariate information.
method Proposed a context-aware version of the 'Track-and-Stop' strategy.
result Expected number of arm draws matches lower bound asymptotically.
Recent developments in system identification have brought attention to regularized kernel-based methods. This type of approach has been proven to compare favorably with classic parametric methods. However, current formulations are not robust with respect to outliers. In this paper, we introduce a novel method to robust…