Online selection of dynamic features has attracted intensive interest in recent years. However, existing online feature selection methods evaluate features individually and ignore the underlying structure of feature stream. For instance, in image analysis, features are generated in groups which represent color, texture…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,291 papers · 148 categories
Trend · papers per month
48 results for “grouped features”
New methods for assessing and visualizing feature groups in machine learning models.
problem Lack of methods for interpreting feature groups in machine learning models.
method Permutation-based, refitting, and Shapley-based techniques for grouped feature importance. Introduced a sequential procedure for identifying stable feature combinations. Developed a combined features effect plot.
result Effective methods for assessing and visualizing the importance and effect of feature groups in machine learning models.
Deep-gKnock uses DNNs to select groups of features with improved interpretability.
problem Feature selection in high-dimensional data with grouping structure.
method Combines deep neural networks with Knockoffs technique for group-feature selection.
result Improves interpretability and accurate gFDR control compared to state-of-the-art methods.
Exclusive Group Lasso improves feature selection in correlated biological data.
problem Correlated features hinder Lasso performance in biological classification problems.
method Proposes and solves the exclusive group Lasso, combining stability selection and random group allocation.
result Exclusive Group Lasso outperforms Lasso in comprehensive selection of informative features.
Feature noise causes loss discrepancies across groups even with equal data.
problem Loss discrepancies observed in learning procedures across different groups.
method Characterized the effect of feature noise on loss discrepancy in linear regression.
result Feature noise leads to loss discrepancy even when groups have equal data.
A new feature coding method for invariant features using tensor products.
problem Learning invariant features for transformations represented by orthogonal matrices.
method Group-invariant feature vector using tensor-product representations of basic representations.
result Group-invariant feature vector contains sufficient discriminative information for linear classifiers.
New method proves neural networks can select features consistently.
problem Feature selection for deep neural networks is challenging.
method Adaptive Group Lasso selection procedure with Group Lasso as the base estimator.
result Adaptive Group Lasso is selection-consistent for a wide class of neural networks.
New framework controls FDR for grouped features in sequential models.
problem FDR control for grouped features in sequential models.
method Grouped-feature FDR control framework for sequential and grouped models using mirror statistics and Permutation SHAP.
result FDR control for low- and high-dimensional grouped linear models and improved power under correlated signals.
Removing spurious features can hurt model accuracy and disproportionately affect different groups.
problem Interference from spurious features in robust model performance across different groups.
method Characterization and analysis of spurious feature removal in noiseless overparameterized linear regression.
result Removal of spurious features can decrease accuracy and disproportionately affect different groups, even in balanced datasets.
GMLP learns feature groups for tabular data without known structure.
problem Deep learning for tabular data with unknown feature interactions.
method Group-wise operations and sparse feature grouping matrix learned through temperature annealing softmax.
result GMLP achieves state-of-the-art classification performance on various datasets.
Classification with a sparsity constraint on the solution plays a central role in many high dimensional machine learning applications. In some cases, the features can be grouped together so that entire subsets of features can be selected or not selected. In many applications, however, this can be too restrictive. In th…
Improves AUC for disadvantaged groups by adding features.
problem Reducing cross-group differences in AUC for classification models.
method Feature augmentation to improve AUC for disadvantaged groups.
result Significantly improves AUC for disadvantaged groups.
Sparse feature selection has been demonstrated to be effective in handling high-dimensional data. While promising, most of the existing works use convex methods, which may be suboptimal in terms of the accuracy of feature selection and parameter estimation. In this paper, we expand a nonconvex paradigm to sparse group …
DFR reduces the computational cost of sparse-group lasso and adaptive sparse-group lasso.
problem Sparse-group lasso's computational expense and need for tuning.
method Dual Feature Reduction (DFR) using strong screening rules and dual norms.
result DFR drastically reduces computational cost without affecting solution optimality.
A distributed feature selection framework identifies genetic risk factors for Alzheimer's disease.
problem High dimensionality of GWAS data makes it hard to detect genetic risk factors for Alzheimer's disease.
method Distributed Feature Selection Framework (DFSF) with distributed group Lasso screening rules and stability selection.
result The method efficiently identifies relevant genetic risk factors for Alzheimer's disease across multiple institutions.
Cost-efficient feature selection for multi-label classification in medicine.
problem Feature selection in multi-label classification with cost constraints.
method Sequential feature selection maximizing conditional mutual information, followed by cost-free feature selection using shadow features.
result The method effectively reduces prediction costs in medical applications.
Safe screening rule reduces computational costs for Group OWL models.
problem High computational costs and memory usage in solving Group OWL models.
method Safe screening rule for Group OWL models that identifies and removes inactive features.
result Significant computational gain and memory savings achieved without loss of accuracy.
A new method simplifies feature explanation for complex models.
problem Explain predictions from complex models efficiently with many features.
method groupShapley: groups features for Shapley value computation.
result Equivalent to summing feature-wise Shapley values within groups.
Sparse group matrix completion reduces complexity and improves performance.
problem Matrix completion with non-informative side features.
method Group-Lasso regularization for feature selection in matrix factorization.
result Theoretical sample complexity is significantly lower than competitors.
Bayesian method for feature selection with grouping info using expectation propagation.
problem Feature selection with grouping info and sparsity constraints.
method Sparse-group Bayesian feature selection using expectation propagation.
result Our method outperforms existing methods in terms of feature selection accuracy and computational efficiency.
This paper considers the multi-task learning problem and in the setting where some relevant features could be shared across few related tasks. Most of the existing methods assume the extent to which the given tasks are related or share a common feature space to be known apriori. In real-world applications however, it i…
We analyze in this paper a random feature map based on a theory of invariance I-theory introduced recently. More specifically, a group invariant signal signature is obtained through cumulative distributions of group transformed random projections. Our analysis bridges invariant feature learning with kernel methods, as …
New FGSPCA method captures grouping and sparse structures in PCA without prior info.
problem Capture grouping and sparse structures in PCA without prior info.
method Truncated regularization with alternating algorithm.
result FGSPCA method reduces model complexity and increases interpretability.
Adaptive Group Lasso selects important features in neural networks.
problem Lack of interpretability in neural networks.
method Adaptive Group Lasso for feature selection.
result Consistent feature selection for neural networks with theoretical guarantee.
New method uses feature grouping to improve model generalization in high-dimensional data.
problem Overfitting in high-dimensional, expensive data.
method Feature grouping with stochastic regularizer applied to complex models.
result Improves model generalization and convergence speed.
Group Shapley with Robust Significance Testing and Its Application to Bond Recovery Rate Predictionstat.ML
Group Shapley evaluates feature groups in business data, improving explainability in AI.
problem Evaluating the importance of feature groups in business and economic data.
method Developed Group Shapley and a significance testing procedure based on chi-square approximation.
result Market-related variables are identified as the most influential feature group.
Identifies important features and their resolution for complex models.
problem Characterizing complex learned models' decision-making across instance distributions.
method Model-agnostic approach using hypothesis testing and feature groups.
result Determines important features and their resolution levels for model accuracy.
Algorithm improves binary classification of biased grouped data.
problem Improving binary classification for biased, grouped data.
method Assumes partition-projected class-conditional invariance across groups and derives a semi-supervised algorithm to learn a group-aware classifier.
result Demonstrates improved area under the ROC curve compared to baselines.
The paper tackles fair classification with multiple sensitive features.
problem Existing fair classification methods often consider a single sensitive feature, but in practice, individuals are defined by multiple sensitive features.
method Characterizes Bayes-optimal fair classifiers for multiple sensitive features under various fairness measures, proposing in-processing and post-processing algorithms.
result Bayes-optimal fair classifiers for multiple sensitive features are instance-dependent thresholding rules that rely on a weighted sum of group membership probabilities.
We develop the Latent Multi-group Membership Graph (LMMG) model, a model of networks with rich node feature structure. In the LMMG model, each node belongs to multiple groups and each latent group models the occurrence of links as well as the node feature structure. The LMMG can be used to summarize the network structu…
Proposes a method for deriving local group invariant representations using kernel methods.
problem Invariance to nuisance transformations in group settings.
method Kernel methods and probability distributions over the group to induce distributions in the input feature space.
result Uniform convergence bounds and excess risk bounds for learning with local invariant random feature maps.
Sparse Neural Additive Model: Interpretable Deep Learning with Feature Selection via Group Sparsitystat.ML
SNAM improves NAM's accuracy and feature selection via group sparsity.
problem Improving interpretability and accuracy in deep learning models.
method Employing group sparsity regularization in neural additive models (SNAM).
result SNAM provably converges to zero training loss and achieves exact support recovery.
Deep models learn spurious features correlated with target, but can still perform well.
problem Spurious correlations in feature learning.
method Empirical risk minimization and specialized group robustness training.
result Feature representations learned by ERM are competitive with specialized methods.
A new method for sparse regression using principal components.
problem Wide data with many features and few observations.
method Combines lasso () sparsity with quadratic penalty towards principal components.
result Powerful feature selection and group-wise shrinkage.
AEFS selects features from high-dimensional data using autoencoders.
problem Feature selection for high-dimensional data in computer vision and machine learning.
method Combines autoencoder regression and group lasso for unsupervised feature selection.
result AEFS selects more important features than traditional methods, including linear and nonlinear information.
AFR simplifies reducing reliance on spurious features, improving model performance.
problem Reducing reliance on spurious features for out-of-distribution generalization.
method Automatic Feature Reweighting (AFR) updates the model with a weighted loss.
result AFR improves model performance on benchmarks with minimal compute.
New method handles correlated genes for better genomic prediction.
problem Technical issues with highly correlated genes in prediction models.
method Grouping algorithm that treats correlated genes as a group and uses their common patterns.
result Significantly outperforms standard models in prediction and feature selection.
Steerable neural ODEs on homogeneous spaces for equivariant feature dynamics.
problem Learning continuous-time equivariant dynamics of vector-valued features on homogeneous spaces.
method Introduces steerable neural ordinary differential equations on homogeneous spaces, interpreting features as sections of associated vector bundles over .
result Steerable NODEs are -equivariant when the flow and connection are -invariant, and they incorporate existing models.
Nonnegative matrix factorization (NMF) with group sparsity constraints is formulated as a probabilistic graphical model and, assuming some observed data have been generated by the model, a feasible variational Bayesian algorithm is derived for learning model parameters. When used in a supervised learning scenario, NMF …
Algorithm computes JSJ decompositions of hyperbolic groups.
problem Computing JSJ decompositions of hyperbolic groups.
method Uses geometry of large balls in Cayley graph, avoids Makanin's algorithm.
result Computes JSJ decomposition over virtually cyclic subgroups.
In this paper, a novel learning paradigm is presented to automatically identify groups of informative and correlated features from very high dimensions. Specifically, we explicitly incorporate correlation measures as constraints and then propose an efficient embedded feature selection method using recently developed cu…
Neural network feature extraction is compared to statistical physics renormalization group flow.
problem Understanding how deep neural networks extract hierarchical features from input images.
method Used RBM to model Ising model and analyze weight matrices of trained RBM.
result RBM trained on spin configurations flows towards critical temperature instead of typical RG flow.
Path signatures adapted for Lie groups improve action recognition in computer vision.
problem Improving action recognition in computer vision with geometric constraints.
method Lifting path signatures to Lie groups and proving universality and characteristic property.
result Path signatures on Lie groups provide comparable performance to shallow learning approaches in action recognition.
Method evaluates classification uncertainty with adaptively chosen features.
problem Finding a balance between model efficiency and fairness.
method Adaptively selects features for equalized coverage in classification.
result Valid and effective method demonstrated on simulated and real data.
Random Forest proximity distances reveal feature contributions in black-box models.
problem Understanding feature contributions in complex, opaque machine learning models.
method Observing changes in input affecting proximity distances and instance movement in decision space.
result Each feature's independent contribution to model decisions can be calculated and analyzed.
Geometric models improve feature extraction and equivariance in image generation.
problem Improving feature extraction at multiscale levels and reducing network complexity.
method Proposes a geometric generative model based on morphological PDEs and GANs, incorporating equivariance for geometric interpretability.
result Preliminary results show GM-GAN outperforms classical GANs on MNIST data.
The paper proposes a method to improve fairness in classification without using sensitive features directly.
problem Balancing accuracy and fairness in automated decision-making systems.
method Combining Multitask Learning with fairness constraints to train group-specific classifiers.
result The method achieves substantial improvements in both accuracy and fairness on real datasets.
A wearable device-based sleep stage classifier using feature learning and RNNs.
problem Automatic sleep stage classification using wearable devices.
method Multi-level feature learning framework and RNN classifier with BLSTM.
result The algorithm achieves high precision, recall, and F1 scores in both resting and comprehensive groups.