A fast method estimates stability of ensemble feature selectors.
problem Improving stability of ensemble feature selectors for better prediction.
method Simulator of a feature selector to estimate stability.
result Reduces computation time for estimating stability.
Improves estimation under model misspecification with fake features.
problem Model misspecification with fake features.
method Proposes a framework to decompose output error into underlying, fake, and missing features.
result Fake features can significantly improve estimation performance, even when not correlated with underlying features.
SANs estimate feature importance in neural models, identifying interactions and high-ranked features.
problem Understanding and interpreting black-box neural network models.
method Self-Attention Network (SAN) architecture for feature importance estimation.
result SANs identify similar high-ranked features and feature interactions as other methods, improving predictive performance.
Paper proposes a framework to identify and obfuscate sensitive features via information density estimation.
problem Identifying and protecting sensitive attributes from leakage in obfuscation mechanisms.
method Information density estimation to identify leaking features, followed by a targeted obfuscation mechanism.
result Proven leakage guarantee in terms of Eγ-divergence for the obfuscation mechanism. CXPlain provides accurate, fast feature importance estimates and uncertainty quantification for machine learning models.
problem Accurate and fast feature importance estimates for high-dimensional data with uncertainty quantification.
method CXPlain models learn to estimate feature importance as a causal learning task, using bootstrap ensembling to quantify uncertainty.
result CXPlain is significantly more accurate and faster than existing methods for estimating feature importance.
Featurization improves density ratio estimation for complex data.
problem Difficulty in estimating density ratios for high-dimensional, different distributions.
method Invertible generative model to map distributions into a common feature space.
result Improved accuracy in density ratio estimation through feature space.
New method for private learning with public features improves convergence rates.
problem Private estimation with public features under local differential privacy.
method Semi-feature LDP, HistOfTree estimator.
result HistOfTree reaches mini-max optimal convergence rate.
New methods prioritize acquiring confounding features for efficient treatment effect estimation.
problem Efficient treatment effect estimation from observational data with missing confounding information.
method Proposes two acquisition strategies: covariate balancing and reducing factual outcome error.
result Our proposed methods, especially reducing factual outcome error, improve sample efficiency for treatment effect estimation.
A framework infers feature importance with uncertainties for high-dimensional data.
problem Estimating feature importance in high-dimensional data with uncertainty.
method Shapley value based framework, sub-SAGE, bootstrapping.
result Uncertainties in feature importance can be estimated from bootstrapping.
Aligns databases with Gaussian features using MAP estimation and thresholding.
problem Aligning databases with jointly Gaussian features.
method Two algorithms: MAP estimation and thresholding of log likelihood ratios.
result Conditions on mutual information for reliable performance of algorithms.
Analyzes error sources in global feature effect estimation methods.
problem Unexplored error sources in global feature effect estimation methods.
method Systematic, estimator-level analysis of bias and variance.
result Holdout data is theoretically cleanest, but estimation variance depends on sample size and model characteristics.
Paper introduces MCRP for estimating feature relevance uncertainty in neural networks.
problem Lack of uncertainty in feature relevance for neural network decisions.
method Monte Carlo Relevance Propagation (MCRP) method.
result Allows deeper understanding of neural networks' perception and reasoning.
Estimates MoE models with feature selection for high-dimensional data.
problem Estimation and feature selection in Mixtures-of-Experts models with high-dimensional predictors.
method Regularized maximum likelihood estimation with proximal-Newton EM algorithm.
result Good performance in recovering sparse solutions, parameter estimation, and clustering of heterogeneous data.
ALIEN detects multiple small objects and estimates their pixel locations and features.
problem Detecting and localizing multiple small objects in a scene.
method Deep-learning network (ALIEN) that performs simultaneous x,y pixel estimation and feature extraction in a single forward pass.
result Efficient detection and localization of hundreds to thousands of small objects.
Paper tackles non-identifiability in latent feature models, proposing a novel method.
problem Non-identifiability in latent feature models.
method A novel method for parameter estimation that solves non-identifiability.
result The method can find an appropriate solution by hopping efficiently through equivalent solutions.
DPERC efficiently estimates covariance matrices for mixed data with missing values.
problem Estimating covariance matrices for datasets with missing values and mixed features.
method Direct Parameter Estimation for Randomly Missing Data with Categorical Features (DPERC).
result DPERC outperforms other methods in estimating covariance matrices for mixed data with missing values.
A new method learns outcome-aware spectral features for causal effect estimation.
problem Estimation of causal effects in the presence of hidden confounders.
method Augmented Spectral Feature Learning framework that minimizes a contrastive loss derived from an augmented operator incorporating outcome information.
result Our method remains effective even under spectral misalignment.
New tree and forest methods use oblique splits for better risk bounds.
problem Improving risk bounds for regression algorithms.
method Randomized decision trees and forests with oblique splits.
result Oblique splits lead to better risk bounds for multi-index models.
Popular interpretability methods often produce inaccurate feature importance estimates.
problem Inaccurate feature importance estimates in deep neural networks.
method Empirical measure of feature importance accuracy across large-scale image classification datasets.
result Only certain ensemble-based methods (VarGrad and SmoothGrad-Squared) outperform random assignment of feature importance.
RoSHAP stabilizes feature attribution in machine learning models.
problem Stochastic variation in feature attribution measures.
method Modeling feature attribution score distribution and estimating it through bootstrap resampling and kernel density estimation.
result RoSHAP provides stable feature rankings and improves model performance.
Sparse feature selection has been demonstrated to be effective in handling high-dimensional data. While promising, most of the existing works use convex methods, which may be suboptimal in terms of the accuracy of feature selection and parameter estimation. In this paper, we expand a nonconvex paradigm to sparse group …
For massive data sets, efficient computation commonly relies on distributed algorithms that store and process subsets of the data on different machines, minimizing communication costs. Our focus is on regression and classification problems involving many features. A variety of distributed algorithms have been proposed …
A neural network approach for feature selection using mutual information.
problem Feature ranking and selection leading to sub-optimal solutions for class separability.
method Stochastic mutual information gradient estimation for dimensionality reduction.
result The network projects features onto an output space maximizing mutual information with class labels.
Modeling preference rankings with salient features to explain irrational choices.
problem Estimating rankings from noisy pairwise comparisons with irrational choices.
method Salient feature preference model with maximum likelihood estimation.
result Strong performance of maximum likelihood estimation on synthetic and real data.
FICM uses motion features to encourage exploration in DRL environments.
problem Exploiting novelty in environments with moving objects.
method Flow-based intrinsic curiosity module (FICM) leveraging motion features between consecutive frames.
result FICM encourages exploration in environments featuring moving objects.
Aerial robot estimates human pose and path using dynamic classifier selection.
problem Estimating human pose and trajectory from aerial video.
method Dynamic classifier selection architecture; perspective correction; HOG and CNN features; 64 pose-viewpoint classes.
result Dynamic classifier selection improves efficiency and accuracy.
PRoFILE accurately estimates feature importance under distribution shifts.
problem Challenges in estimating feature importance under distribution shifts.
method PRoFILE uses a loss estimator trained with a causal objective to estimate feature importance.
result PRoFILE accurately estimates feature importance under complex distribution shifts.
A common strategy for sparse linear regression is to introduce regularization, which eliminates irrelevant features by letting the corresponding weights be zeros. However, regularization often shrinks the estimator for relevant features, which leads to incorrect feature selection. Motivated by the above-mentioned issue…
Enhanced framework selects features for unbiased causal inference.
problem Unbiased estimation of causal quantities in causal inference.
method Three-stage computational framework balancing treatment and non-treatment variables.
result Significantly reduces bias and variance in estimating causal quantities.
Study shows how feature weighting affects neural network regularization.
problem Understanding how feature weighting influences neural network regularization.
method Derived equivalence paths connecting different weighting matrices and ridge regularization levels.
result Ridge estimators trained on weighted features are asymptotically equivalent when evaluated against test vectors.
Paper uses VAEAC to estimate Shapley values for complex models with mixed features.
problem Estimating Shapley values for models with dependent mixed features.
method Uses variational autoencoder with arbitrary conditioning (VAEAC) to model feature dependencies.
result VAEAC approach outperforms state-of-the-art methods for various settings.
A new tree-based estimator, FastPD, efficiently estimates PD functions for machine learning models.
problem Efficiently estimating Partial Dependence functions for machine learning models.
method Proposes a new tree-based estimator, FastPD, to estimate PD functions.
result FastPD consistently estimates the desired population quantity and improves complexity from quadratic to linear.
Study improves feature acquisition for static settings in AFAPE.
problem Evaluate AFAPE performance in static feature settings.
method Derive and adapt IPW, DM, and DRL estimators for MAR and MNAR missingness.
result Improved data efficiency in synthetic and real-world experiments.
Deconfounding scores improve causal effect estimation with weak overlap.
problem Poor overlap in treatment and control groups makes causal effect estimators brittle.
method Introduces feature representations that improve overlap without introducing bias.
result Deconfounding scores satisfy a zero-covariance condition that is identifiable in observed data.
Pruning method removes less important features in linear models.
problem Removing less important features in linear models trained by gradient flow.
method Iterative Magnitude Pruning (IMP) applied to linear models trained by gradient flow.
result IMP prunes features with smallest projection onto the data.
The study sets lower bounds on MMSE for inferring sensitive features from noisy data.
problem Estimating sensitive features from noisy observations of correlated features.
method Adversarial evaluation framework based on MMSE estimation with theoretical lower bounds.
result Derives closed-form bounds for linear models, showing optimality in noise variance.
Transformers handle infinite dimensional inputs effectively by feature extraction and dynamic feature selection.
problem Understanding the approximation and estimation ability of Transformers with infinite dimensional inputs.
method Anisotropic smoothness analysis and feature extraction properties of Transformers.
result Transformers avoid the curse of dimensionality and dynamically select important features.
A new model improves uncertainty estimation in deep learning.
problem Deep Kernel Learning (DKL) produces unreliable uncertainty estimates.
method Proposed a bi-Lipschitz constraint to preserve distances in feature space.
result DUE model outperforms previous DKL and other methods in uncertainty quality.
A new weighted dissimilarity measure reduces positioning errors in feature-based systems.
problem Reducing errors in feature-based positioning systems, especially in areas with high variability.
method Iterative scheme using location-dependent standard deviations as weights.
result Maximum radial positioning error reduced by 40% using the weighted dissimilarity measure.
Novel approach uses neural networks to enhance CI testing for feature selection.
problem Challenges in implementing Markov blanket feature selection due to CI testing limitations.
method Two-step approach: feature mapping followed by CI testing using k-NN. result The method boosts CI testing performance, leading to improved feature selection.
A new method uses Gaussian Processes for feature-based nonrigid image registration.
problem Estimating dense displacement fields for nonrigid image registration.
method Using Gaussian Processes to estimate both dense displacement field and uncertainty map.
result GP-based interpolation performs similarly to state-of-the-art B-spline interpolation.
The paper proposes a new algorithm to estimate personalized treatment effects.
problem Estimating personalized heterogeneous treatment effects.
method Concatenation and augmentation of feature vectors, outcome regression function construction.
result The proposed algorithm outperforms T-learner and X-learner in various simulation experiments.
New method quantifies feature interactions in machine learning models.
problem Capturing high-order interactions and feature contributions in predictive models.
method Information-theoretic approach using Conditional Mutual Information (CMI) via k-NN.
result Accurately recovers feature interactions in synthetic and real-world datasets.
Efficiently estimates SAGE values using causal structure learning.
problem Computational infeasibility of exact SAGE calculations.
method Uses causal structure learning to identify conditional independencies and accelerate SAGE approximation.
result Empirically demonstrates efficient and accurate estimation of SAGE values.
A new method corrects weight values to improve treatment effect estimation.
problem Estimating heterogeneous treatment effects in high-dimensional data with sample selection bias.
method Differentiable Pareto-Smoothed Weighting (DPSW) framework.
result Our method outperforms existing methods in treatment effect estimation.
Study identifies and estimates causal LSNM models, proving feature maps are consistent.
problem Identifying causal direction in LSNM models.
method Proposed two estimators: feature maps and neural networks.
result Feature maps estimator is consistent and concave.
PML-LFC improves PML by estimating label confidence from both feature and label spaces.
problem PML challenges in real-world scenarios where only some labels are relevant.
method PML-LFC estimates label confidence using feature and label space similarities, training a predictor with these values.
result PML-LFC achieves superior performance on synthetic and real-world datasets.
Proposes CCME framework for estimating heterogeneous treatment effects.
problem Estimating heterogeneous treatment effects in complex distributions.
method Embeds conditional distributions into RKHS, develops meta-estimators for CCME.
result Establishes finite-sample convergence rates and double robustness for CCME estimators.