Method selects valid IVs from a large set using clustering and test of overidentifying restrictions.
problem Selecting valid instrumental variables from a large set of candidates.
method Agglomerative hierarchical clustering combined with a test of overidentifying restrictions.
result Achieves oracle properties when the largest group of IVs is valid.
New method improves IV estimation with many weak and invalid instruments.
problem Identification in linear IV models with unknown validity.
method Non-convex penalized approaches, surrogate sparsest penalty.
result Advantages over other IV estimators in selection consistency and weak IV strength conditions.
Paper discovers valid IVs from data without domain knowledge.
problem Inferring causal effects from observational data with latent confounders.
method Data-driven algorithm based on partial ancestral graphs (PAGs).
result Discovering valid IVs leads to accurate causal effect estimation.
Estimates price elasticity from autocorrelated time series using causal graphs.
problem Inconsistent IV estimators in autocorrelated time series data.
method Model equilibrium with unobserved confounders, derive DAG, and use graphical inference for valid IV estimators.
result Valid IV estimators improve understanding of economic dynamics.
Develops a statistical test for IV, improving feature selection reliability.
problem Lack of statistical justification in conventional IV-based feature selection.
method Establishes connection with Jeffreys divergence and proposes a nonparametric hypothesis test.
result The J-Divergence test provides rigorous guarantees and is more reliable than traditional IV thresholds.
Ivy combines weak IV candidates to estimate causal effects robustly.
problem Estimating causal effects from observational data using weak or invalid IV candidates.
method Ivy synthesizes multiple weak IV candidates into a robust summary.
result Ivy produces more reliable causal effect estimates compared to allele scores.
Unified method for learning from selectively labeled data.
problem Classification with selectively labeled data from multiple decision-makers.
method Unified cost-sensitive learning (UCL) approach.
result Unified method for robust classification in selective labeling.
Proposes RDIV for IV estimation avoiding limitations of existing methods.
problem Nonparametric estimation of IV regressions with practical limitations.
method Tikhonov-regularized DeepIV regression with model selection.
result Matches state-of-the-art convergence rate and provides rigorous guarantees.
New method identifies valid IVs for bi-directional MR with invalid instruments.
problem Estimating causal effects from observational data with invalid instruments and unmeasured confounding.
method Theoretical investigation and cluster fusion-like method to discover valid IV sets.
result Theoretical demonstration and experimental validation of the method's effectiveness.
Novel quasi-Bayesian method for IV regression using machine learning models.
problem Uncertainty quantification in IV regression with machine learning models.
method Quasi-Bayesian procedure based on kernelized IV models and dual formulation.
result Established minimax optimal contraction rates and scalable inference algorithm.
AI uses language models to find instrumental variables quickly.
problem Finding valid instrumental variables is a challenging and heuristic process.
method Uses large language models to search for new instrumental variables through narratives and counterfactual reasoning.
result Demonstrates the effectiveness of multi-step and role-playing prompting strategies for LLMs.
ZNet learns instrumental representations from covariates for causal inference.
problem Lack of valid instruments in observational studies.
method Representation learning approach that constructs instrumental representations from observed covariates.
result ZNet enables IV-based estimation without explicit instruments.
This paper presents the asymptotic behavior of a linear instrumental variables (IV) estimator that uses a ridge regression penalty. The regularization tuning parameter is selected empirically by splitting the observed data into training and test samples. Conditional on the tuning parameter, the training sample creates …
Empirical researchers are increasingly faced with rich data sets containing many controls or instrumental variables, making it essential to choose an appropriate approach to variable selection. In this paper, we provide results for valid inference after post- or orthogonal L2-Boosting is used for variable selection.…
CgNN uses network structure as IVs to estimate causal effects in networks.
problem Hidden confounders complicate causal effect estimation in network data.
method CgNN combines GNNs and attention mechanisms to leverage network structure as IVs.
result CgNN effectively mitigates hidden confounder bias and improves causal effect estimation.
Paper develops a new estimator for panel data with endogenous treatments, improving causal inference.
problem Challenges in causal inference for static panel data with endogenous treatments and confounding variables.
method Develops Double Machine Learning (DML) estimator for static panel models with endogenous treatments (panel IV DML). Introduces weak-identification diagnostics.
result Panel IV DML estimator improves estimation accuracy and delivers more reliable inference under weak identification.
The implied volatility surface (IVS) is a fundamental building block in computational finance. We provide a survey of methodologies for constructing such surfaces. We also discuss various topics which can influence the successful construction of IVS in practice: arbitrage-free conditions in both strike and time, how to…
BRACE addresses noncompliance in bandits, offering methods for recommendation and treatment policies.
problem Noncompliance in bandit problems complicates learning objectives and treatment effects.
method BRACE formalizes objective-choice, identifies direct-control regimes, and proposes a phase-doubling algorithm for IV inversion.
result BRACE delivers valid policy values and structural uncertainty, even under weak identification and homogeneity failure.
Simplifies IV regression for high-dimensional instruments.
problem Nonlinear instrumental variable regression with high-dimensional instruments.
method Combines kernelized IV methods with an adaptive regression algorithm.
result Faster convergence and adaptability to feature dimensionality.
Improved IV estimates by weighting on compliance reduces noise in treatment effect estimation.
problem Noisy IV estimates in settings with non-random treatment receipt.
method Weighting observations by estimated compliance, leveraging machine learning for compliance estimation.
result Compliance weighting reduces IV variance, improving precision of treatment effect estimates.
Combines IV and observational data to estimate CATEs with low compliance and unobserved confounding.
problem Estimating CATEs in personalized medicine and analytics with observational data and weak IVs.
method Two-stage framework: first learns biased CATEs from observational data, then corrects using IV data.
result Effective in estimating CATEs with low compliance and unobserved confounding.
This paper presents a light-weight and accurate deep neural model for audiovisual emotion recognition. To design this model, the authors followed a philosophy of simplicity, drastically limiting the number of parameters to learn from the target datasets, always choosing the simplest earning methods: i) transfer learnin…
New method predicts model performance under selection bias in healthcare.
problem Selection bias limits model generalizability in healthcare.
method Proposes a novel upper bound method for estimating model performance.
result Validates and demonstrates the practical utility of the method.
A new algorithm uses IVs to learn optimal policies from observational data.
problem Learning optimal policies from unobserved variable confounded data.
method IV-aided Value Iteration (IVVI) algorithm based on conditional moment restrictions.
result First provably efficient algorithm for instrument-aided offline RL.
New method avoids IV limitations for flexible estimation.
problem Nonparametric estimation of IV regressions with multiple solutions.
method Minimax penalized estimator avoiding identification and closedness conditions.
result Strong L2 convergence rate without closedness condition. Paper uses VAEs to control IVS features for financial modeling.
problem Generating realistic IVSs with desired characteristics.
method Variational autoencoder architecture with controllable latent variables.
result Controlled generation of IVSs with specified features.
DRIVE improves IV estimation by accounting for distributional uncertainties.
problem Challenges in IV estimation due to untestable model assumptions and poor finite sample properties.
method DRIVE is a distributionally robust IV estimation method that minimizes a square root TSLS objective with a Wasserstein ambiguity set.
result DRIVE achieves consistency without requiring regularization parameter to vanish, ensuring robustness to distributional uncertainties.
Motivation: Radiomics refers to the high-throughput mining of quantitative features from radiographic images. It is a promising field in that it may provide a non-invasive solution for screening and classification. Standard machine learning classification and feature selection techniques, however, tend to display infer…
BGM-IV uses AI to estimate causal effects in complex data.
problem Estimating causal effects in high-dimensional, nonlinear settings with endogeneity.
method Structured latent generative modeling for posterior inference in a causally structured latent space.
result BGM-IV outperforms existing methods in high-dimensional covariate regimes.
Stochastic approximation is one of the effective approach to deal with the large-scale machine learning problems and the recent research has focused on reduction of variance, caused by the noisy approximations of the gradients. In this paper, we have proposed novel variants of SAAG-I and II (Stochastic Average Adjusted…
Novel method recovers market regime changes from option prices.
problem Recovering market regime changes from option prices.
method Assumed Markov regime switching, computed implied volatility, validated recovery of regime changes.
result Implied volatility time series can recover market regime changes.
A new method learns IV representation from data to estimate causal effects.
problem Inferring causal effects from observational data with latent confounders.
method Disentangled representation learning using Variational AutoEncoder (VAE).
result The proposed method outperforms existing IV-based estimators and VAE-based estimators.
DML-IV improves IV regression for learning decision policies by reducing bias.
problem Spurious correlations in offline datasets caused by hidden confounders.
method Double/debiased machine learning (DML) framework to reduce bias in two-stage IV regression.
result DML-IV outperforms state-of-the-art methods and learns high-performing policies.
Flow IV uses IVs to infer counterfactuals in complex models.
problem Identifying causal effects and counterfactual reasoning in nonseparable outcome models.
method Utilizes instrumental variables and normalizing flows to estimate and infer counterfactual outcomes.
result Identifies a method to make causal inferences from observed data in nonseparable models.
Transformers can handle endogeneity in linear regression using IV methods.
problem Endogeneity in in-context linear regression models.
method Transformer architecture with gradient-based bi-level optimization and in-context pretraining.
result Transformers provide more robust predictions and estimates than 2SLS in endogenous scenarios.
Aggregation challenges causal interpretation of IV estimators.
problem Aggregation of fine-grained components into an aggregate treatment variable.
method Characterization of conditions for identifying aggregate causal effects.
result Standard IV estimators cannot identify aggregate causal effects due to ambiguous dependencies.
Develops framework for estimating and improving DTRs with time-varying IV in the presence of unmeasured confounding.
problem Estimating DTRs from observational data with unmeasured confounding.
method Time-varying instrumental variable (IV) framework for estimating and improving DTRs.
result IV-optimal and IV-improved DTRs perform better than DTRs assuming no unmeasured confounding.
We propose a direction of arrival (DOA) estimation method that combines sound-intensity vector (IV)-based DOA estimation and DNN-based denoising and dereverberation. Since the accuracy of IV-based DOA estimation degrades due to environmental noise and reverberation, two DNNs are used to remove such effects from the obs…
Study compares mutation validation and cross-validation for model selection.
problem Comparing model selection methods for generalization performance and computational efficiency.
method Empirical comparison using benchmark and real-world datasets with Bayesian tests.
result Both methods select models with equivalent generalization performance but MV selects simpler models and is computationally cheaper.
When selecting a classification algorithm to be applied to a particular problem, one has to simultaneously select the best algorithm for that dataset \emph{and} the best set of hyperparameters for the chosen model. The usual approach is to apply a nested cross-validation procedure; hyperparameter selection is performed…
New method uses few instruments to estimate complex causal effects.
problem Estimating causal effects with limited instruments in high-dimensional settings.
method Sequentially selects and combines instruments to estimate the treatment effect.
result Can reliably recover the treatment effect's projection onto the instrumented subspace.
This paper presents details of our winning solutions to the task IV of NIPS 2017 Competition Track entitled Classifying Clinically Actionable Genetic Mutations. The machine learning task aims to classify genetic mutations based on text evidence from clinical literature with promising performance. We develop a novel mul…
Proposes MRIV framework for unbiased CATE estimation using binary IVs.
problem Bias in estimating CATEs due to unobserved confounders.
method Multiply robust machine learning framework (MRIV) for binary IVs.
result MRIV yields multiple robust convergence rates and outperforms existing methods.
For this special issue, the article aims at discussing a few econophysics problems studied so far rather successfully. The following "applications" in micro-econo-physics are considered : (i) financial crashes; it is emphasized that one can distinguish between endogenous and exogenous causes; (ii) portofolio control, s…
Study integrates implied Hurst exponent into IV models for better market efficiency.
problem Capturing market efficiency in IV models based on moneyness.
method Developed an IV model integrating implied Hurst exponent H, optimizing across multiple indexes.
result Model outperforms SABR and fSABR in accuracy, capturing IV-H dynamics.
Scientific and business practices are increasingly resulting in large collections of randomized experiments. Analyzed together, these collections can tell us things that individual experiments in the collection cannot. We study how to learn causal relationships between variables from the kinds of collections faced by m…
This paper theoretically explains and validates a deep neural network approach to IV estimation.
problem Endogeneity issues in empirical applications, especially in the presence of omitted variables, measurement error, or simultaneous causality.
method A two-stage estimator using deep neural networks in a linear instrumental variables model, with a latent structural assumption on the reduced form equation.
result The second-stage estimator achieves the semiparametric efficiency bound, with a smaller estimation error and requiring weaker conditions on the smoothness of optimal instruments.
The study finds a liquidity premium in stock returns, but only after correcting for microstructure noise.
problem The positive association between expected idiosyncratic volatility and expected stock returns.
method Developed a novel method to eliminate microstructure influences from stock returns and estimate idiosyncratic volatility.
result The liquidity premium in value-weighted portfolios is driven by liquidity in the prior month after correcting for microstructure noise.