Two binary Sine Cosine Algorithms improve feature selection in medical datasets.
problem Optimizing feature selection from medical datasets to enhance model accuracy.
method Proposed SBSCA and VBSCA algorithms using S-shaped and V-shaped transfer functions.
result SBSCA and VBSCA outperform four other binary optimization algorithms in medical datasets.
Quantum circuits represent binary classification trees with binary features.
problem Classifying data using binary classification trees with binary features.
method Quantum circuits and probabilistic approach for traversing decision trees.
result First realization of a decision tree classifier on a quantum device.
We consider analysis of relational data (a matrix), in which the rows correspond to subjects (e.g., people) and the columns correspond to attributes. The elements of the matrix may be a mix of real and categorical. Each subject and attribute is characterized by a latent binary feature vector, and an inferred matrix map…
MeliusNet improves binary neural networks to match MobileNet-v1 accuracy.
problem Achieving high accuracy with binary neural networks on mobile devices.
method Alternating DenseBlocks and ImprovementBlocks to increase feature capacity and quality.
result MeliusNet matches MobileNet-v1 accuracy on ImageNet, improving binary network performance.
A method extracts binary features directly from CS measurements for compressive image classification.
problem Efficiently classify images using compressive sensing without reconstruction.
method DCT-based approach for binary feature extraction from CS measurements, feature fusion with CNN features.
result Fused features outperform state-of-the-art methods in image classification.
Active learning improves EDFA model accuracy with binary features.
problem Lack of labeled training data for EDFA devices.
method Active learning strategy for binary features using sparse linear models.
result Improved prediction and accelerated query generation.
Study shows squared loss is robust for binary classification with noisy features.
problem Learning binary classifiers with noisy features.
method Sy-De and Asy-In attribute noise models, analyzing l0−1 and lsq losses. result Squared loss is robust in Sy-De model but not in Asy-In model.
This paper introduces a novel real-time Fuzzy Supervised Learning with Binary Meta-Feature (FSL-BM) for big data classification task. The study of real-time algorithms addresses several major concerns, which are namely: accuracy, memory consumption, and ability to stretch assumptions and time complexity. Attaining a fa…
Proposes an L1-regularized functional SVM for binary classification with functional covariates.
problem Binary classification with multivariate functional covariates.
method L1-regularized functional support vector machine (SVM) with an accompanying algorithm.
result The proposed classifier performs well in prediction and feature selection.
AFS-BM improves model accuracy by dynamically selecting features.
problem Feature selection challenges in ML, especially scalability and adaptability.
method Joint optimization for feature selection and model training with binary masking.
result AFS-BM achieves significant improvements in model accuracy and computational efficiency.
A novel method for feature selection using a reparameterized logitNormal distribution.
problem Feature selection for reconstruction in high-dimensional data.
method Introducing a reparameterization of the logitNormal distribution to address differentiability and covariance issues.
result The method provides an effective exploration scheme and efficient feature selection for reconstruction.
Binary and multiclass epilepsy detection methods using EEG features.
problem Epilepsy diagnosis from EEG data.
method Feature extraction from power spectrum, spectrogram, and bispectrogram; eight machine learning algorithms used.
result Random forest and backpropagation algorithms achieved highest accuracy for binary and multiclass classification.
The choice of normalization affects the coefficients in regularized regression models.
problem The impact of normalization on the coefficients of regularized regression models.
method Investigated lasso, ridge, and elastic net regression with different normalization methods for binary and mixed features.
result Normalization affects the coefficients of regularized regression models, and specific scaling methods can mitigate this effect.
Paper introduces Laplace-HDC for better binary hyperdimensional computing.
problem Improving binary hyperdimensional computing for spatial information.
method Develops Laplace-HDC using the Laplace kernel and Haar convolutional features.
result Laplace-HDC outperforms previous methods in encoding spatial information.
We compare in this paper several feature selection methods for the Naive Bayes Classifier (NBC) when the data under study are described by a large number of redundant binary indicators. Wrapper approaches guided by the NBC estimation of the classification error probability out-perform filter approaches while retaining …
Scaling feature values is an important step in numerous machine learning tasks. Different features can have different value ranges and some form of a feature scaling is often required in order to learn an accurate classifier. However, feature scaling is conducted as a preprocessing task prior to learning. This is probl…
Continuous dropout mimics brain neuron firing rates to prevent feature detector co-adaptation.
problem Preventing overfitting in deep neural networks.
method Extending binary dropout to continuous dropout, inspired by brain neuron firing rates.
result Continuous dropout improves test performance by preventing feature detector co-adaptation.
Feature selection (FS) has become an indispensable task in dealing with today's highly complex pattern recognition problems with massive number of features. In this study, we propose a new wrapper approach for FS based on binary simultaneous perturbation stochastic approximation (BSPSA). This pseudo-gradient descent st…
For the problem of binary linear classification and feature selection, we propose algorithmic approaches to classifier design based on the generalized approximate message passing (GAMP) algorithm, recently proposed in the context of compressive sensing. We are particularly motivated by problems where the number of feat…
Paper finds Dutch Draw optimal baseline for binary classification.
problem Need a proper baseline for binary classification validation.
method Examined all input-independent baseline methods.
result Dutch Draw is optimal baseline under given conditions.
The paper analyzes features learned by deep neural networks from malware binaries.
problem Costly feature engineering in malware classification.
method Examined byte-level activations and their connection to original features through parsing and disassembly.
result Identified interesting features learned by deep neural networks and their relation to traditional features.
Proposes an efficient algorithm for identifying important features in binary classification.
problem Understanding explainability of deep neural networks in binary classification.
method Variable-importance framework combined with lazy training.
result Achieves well-controlled error rates with minimal assumptions.
gOMP algorithm selects features for various types of data.
problem Feature selection for scalable molecular data.
method Generalized Orthogonal Matching Pursuit algorithm for multiple types of data.
result gOMP performs similarly or better than LASSO on various datasets.
Dasgupta and Shulman showed that a two-round variant of the EM algorithm can learn mixture of Gaussian distributions with near optimal precision with high probability if the Gaussian distributions are well separated and if the dimension is sufficiently high. In this paper, we generalize their theory to learning mixture…
In many real life problems, objects are described by large number of binary features. For instance, documents are characterized by presence or absence of certain keywords; cancer patients are characterized by presence or absence of certain mutations etc. In such cases, grouping together similar objects/profiles based o…
BSF algorithm reduces neural network size and selects features efficiently.
problem Neural network size and feature selection optimization.
method Binary Stochastic Filtering (BSF) layer that penalizes information, stochastically passes or drops features.
result Multifold decrease in neural network size and optimal feature selection.
This paper detects function-level obfuscation in binary code using graph-based methods.
problem Detecting and characterizing function-level obfuscation in binary code.
method Graph-based approaches, including GNNs, are compared on various datasets.
result GNNs outperform baselines in function-level obfuscation detection, especially in a 11-class classification task.
We introduce the hierarchical compositional network (HCN), a directed generative model able to discover and disentangle, without supervision, the building blocks of a set of binary images. The building blocks are binary features defined hierarchically as a composition of some of the features in the layer immediately be…
Study compares Android malware and benign apps using permissions.
problem Classify Android malware from benign apps.
method Used machine learning techniques like decision trees, random forests, SVM, etc.
result Permissions are a strong feature for malware detection.
Paper introduces r-DEP classifier for binary classification tasks.
problem No natural ordering for feature patterns in practical situations.
method Introduces reduced dilation-erosion (r-DEP) classifier using multi-valued mathematical morphology.
result r-DEP classifiers outperform traditional SVCs in balanced accuracy.
Paper proposes a robust deep graph-based classifier for noisy labels.
problem Difficulty in feature learning with noisy training labels.
method Convolutional neural networks with graph Laplacian regularization (GLR).
result Proposed method outperforms state-of-the-art classifiers on noisy datasets.
Analyzes double descent in binary classification models with different losses.
problem Understanding the double descent phenomenon in binary classification models.
method Analytic study of gradient descent with logistic and square losses on binary linear classification models.
result The double descent phenomenon persists but with differences compared to logistic loss.
Sharp bounds on binary model inference performance.
problem High-dimensional inference in binary models.
method Convex empirical risk minimization, sharp asymptotics, optimal performance bounds.
result Sharp predictions and optimal performance bounds for binary models.
Binary Hashing is widely used for effective approximate nearest neighbors search. Even though various binary hashing methods have been proposed, very few methods are feasible for extremely high-dimensional features often used in visual tasks today. We propose a novel highly sparse linear hashing method based on pairwis…
The paper analyzes how overparameterized models can generalize well in multiclass classification.
problem Generalization in multiclass classification with overparameterized models.
method Survival/contamination analysis framework adapted for multiclass classification.
result Multiclass classification can generalize well even with many classes, unlike regression tasks.
The paper uses machine learning to detect malicious executable files.
problem Detecting malicious executable files using static analysis.
method Pre-processing, cleaning, encoding, feature selection, and ensemble training of classifiers.
result An ensemble of classifiers effectively detects malicious executable files.
CSVAE learns interpretable latent subspaces for binary labels.
problem Learning interpretable latent representations correlated to specific labels.
method Conditional Subspace VAE (CSVAE) using mutual information minimization.
result CSVAE extracts interpretable latent subspaces for binary labels.
Paper proposes a method to generate synthetic anomalies for robust anomaly detection.
problem Anomaly detection struggles with unbalanced data and rare anomalies.
method Two-level hierarchical latent space representation for feature distillation and synthesis.
result The method creates robust synthetic anomalies for training robust binary classifiers.
Approach for modeling EHR data with rare features, improving prediction and interpretation.
problem Challenges in modeling rare binary features in EHR data.
method Tree-guided feature selection and logic aggregation for large-scale regression.
result Improved prediction and model interpretation of suicide risk in EHR data.
diproperm tests differences in HDLSS data with binary classifiers.
problem Testing differences in HDLSS data with binary classifiers.
method DiProPerm test for binary linear classifiers.
result Validates the DiProPerm test on real-world data.
Algorithm improves binary classification of biased grouped data.
problem Improving binary classification for biased, grouped data.
method Assumes partition-projected class-conditional invariance across groups and derives a semi-supervised algorithm to learn a group-aware classifier.
result Demonstrates improved area under the ROC curve compared to baselines.
Memory capacity of DAM scales exponentially with feature separation, unaffected by correlations.
problem Understanding how feature correlations impact DAM's capacity.
method Developed an empirical framework to analyze DAM's capacity under varying feature correlations and pattern separations.
result Memory capacity scales exponentially with feature separation, unaffected by correlations.
RENT selects stable features for robust model interpretation.
problem Stability in feature selection for robust model interpretation.
method RENT uses an ensemble of elastic net models trained on distinct subsets of data.
result RENT selects features with high stability improving model robustness.
Cryptocurrencies are ranked for efficiency using a new Complexity-Entropy Plane.
problem Evaluating the efficiency of cryptocurrencies using traditional financial metrics.
method Developed a Binary Complexity-Entropy Plane (BiCEP) to analyze daily price fluctuations of major cryptocurrencies.
result Only Shiba Inu (SHIB) is significantly inefficient, while most cryptocurrencies operate in close-to-efficient conditions.
Feature selection and attribute reduction are crucial problems, and widely used techniques in the field of machine learning, data mining and pattern recognition to overcome the well-known phenomenon of the Curse of Dimensionality, by either selecting a subset of features or removing unrelated ones. This paper presents …
Paper optimizes sparse feature selection for cancer detection using GSVP and SVM.
problem Sparse feature selection for cancer detection.
method Regularized GSVP with proximal gradient descent, feature selection via SVM.
result Near-perfect balanced accuracy with few selected features.
A nearly tight convex relaxation for sparse Naive Bayes features.
problem Feature selection in large-scale Naive Bayes classification.
method Proposes a convex relaxation for the combinatorial maximum-likelihood problem of feature selection in Naive Bayes.
result The convex relaxation bounds become tight as marginal feature contributions decrease, providing a nearly optimal solution.
Selective classification improves trading strategies by abstaining from predictions.
problem Designing effective trading strategies using selective classification.
method Extends binary or multi-class classifiers to allow abstaining from predictions, evaluates across different feature sets and classifiers.
result Selective classifiers can improve trading performance by avoiding poor predictions.