New algorithm extracts features from superpositions in machine learning models.
problem Challenges in extracting interpretable features from complex models in superposition.
method An efficient query algorithm that identifies non-degenerate feature directions and reconstructs the function.
result Identifies all feature directions whose responses are non-degenerate and reconstructs the function \( f \) in a general superposition setting.
Mamba efficiently learns low-dimensional targets in-context via feature extraction.
problem Learning low-dimensional targets in context for computational efficiency.
method Test-time feature learning of a single-index model using Mamba's pretrained linear-time sequence model.
result Mamba achieves efficient in-context learning of low-dimensional targets via feature extraction.
CRBM extracts speech features from complex spectra directly.
problem Speech coding ignores phase information in complex spectra.
method CRBM learns relationships between visible and hidden units from complex-valued spectra.
result CRBM outperforms conventional methods in speech coding.
The paper proposes methods to extract and analyze individual variable information from complex dependencies.
problem Analyzing and understanding complex dependencies between multiple variables.
method Reversible normalization and iterative dependency reduction to extract individual information, and use it for direct mutual information and multi-feature Granger causality analysis.
result Decoupling of variables to analyze their individual information and direct mutual information transfers.
AA extracts archetypes from data for clear feature extraction.
problem Non-convex optimization problem in AA.
method Computational procedure extracting archetypes as convex combinations of data.
result AA offers interpretable representations for high-dimensional data.
CNNPred uses CNNs to predict stock market movements across multiple markets.
problem Feature extraction and prediction in financial markets.
method CNN-based framework for multiple markets, using various data sources.
result Significant improvement in prediction performance compared to baseline algorithms.
Study uses machine learning to detect early COVID-19 from CT images.
problem Early detection of COVID-19 from CT images.
method Machine learning methods applied to patches of CT images, feature extraction (GLCM, LDP, GLRLM, GLSZM, DWT), SVM classification.
result Best classification accuracy of 99.68% with 10-fold cross-validation and GLSZM feature extraction.
U-CNNpred improves stock market prediction by extracting general market patterns.
problem Improving financial market prediction through better feature extraction.
method A CNN-based framework trained on diverse historical data to identify common market patterns.
result U-CNNpred outperforms baseline algorithms in predicting market directional movements.
The study extracts market direction from transaction data.
problem Extracting market direction from transaction data.
method Dynamic equation with time scale selection from past transactions.
result Automatic determination of time scale for price calculation.
Kernel-based methods enjoy powerful generalization capabilities in handling a variety of learning tasks. When such methods are provided with sufficient training data, broadly-applicable classes of nonlinear functions can be approximated with desired accuracy. Nevertheless, inherent to the nonparametric nature of kernel…
DeepUnHide uses deep learning to reveal hidden demographic features in recommender systems.
problem Extracting hidden demographic features from recommender systems factors.
method Gradient-based localization in deep learning for feature extraction.
result DeepUnHide outperforms state-of-the-art feature selection methods.
Neural networks learn faster with correlated latent variables.
problem Efficiently learning from higher-order correlations in neural networks.
method Analytical derivation and simulations of two-layer neural networks.
result Correlations between latent variables speed up learning from higher-order correlations.
We propose a spatial diffuseness feature for deep neural network (DNN)-based automatic speech recognition to improve recognition accuracy in reverberant and noisy environments. The feature is computed in real-time from multiple microphone signals without requiring knowledge or estimation of the direction of arrival, an…
Discriminators can be good feature extractors despite their task focus.
problem Discriminators' features are often considered useless for downstream tasks.
method Theoretical analysis and feature space examination to understand discriminator's role.
result Discriminator features are robust and can prevent mode collapse, making them useful for transfer learning.
This paper reviews methods for feature selection and extraction in pattern analysis.
problem Complex raw data require feature selection or extraction for better discrimination or representation.
method Reviews different methods of feature selection and extraction.
result Compares various methods of feature selection and extraction.
Paper introduces a framework for diagnosing Alzheimer's disease using higher-order topological features from fMRI.
problem Diagnosing Alzheimer's disease using brain network topology.
method Persistent homology to extract higher-order features (cycles, cavities) from fMRI data.
result Framework significantly outperforms existing methods in AD classification.
Improved spectral-based GCN for directed graphs.
problem Cannot directly work on directed graphs.
method Redefined Laplacians to improve propagation model.
result Outperforms state-of-the-art methods on directed graph datasets.
Proposes LM3FE for multi-modal feature extraction in image classification.
problem High-dimensional features and multi-modal data challenges.
method Large margin multi-modal multi-task feature extraction (LM3FE) framework.
result LM3FE outperforms single-task feature extraction and multi-modal feature extraction.
New theory explains how equivariant self-supervised learning improves feature extraction.
problem Contrastive learning sacrifices useful features due to invariance to data augmentations.
method Information-theoretic perspective to understand E-SSL's generalization ability.
result Equivariant self-supervised learning creates synergy between equivariant and classification tasks.
Paper proposes a method to extract style features from unlabeled data.
problem Extracting fine-grained features like styles from unlabeled data.
method Contrastive conditioned variational autoencoders with mutual information constraints.
result The method efficiently extracts style features from real-world natural image datasets.
Deep neural networks are representation learning techniques. During training, a deep net is capable of generating a descriptive language of unprecedented size and detail in machine learning. Extracting the descriptive language coded within a trained CNN model (in the case of image data), and reusing it for other purpos…
Deep neural networks are a powerful tool for feature learning and extraction given their ability to model high-level abstractions in highly complex data. One area worth exploring in feature learning and extraction using deep neural networks is efficient neural connectivity formation for faster feature learning and extr…
Automatically extracts features from time series data for improved forecasting.
problem Manual feature selection for time series forecasting is inefficient and prone to errors.
method Extracts features from time series using recurrence plots and computer vision algorithms.
result Automatically extracted features lead to highly comparable and sometimes superior forecasting performance.
New method extracts biological concepts from cell microscopy images.
problem Extracting meaningful concepts from vision foundation models trained on cell microscopy images.
method Sparse dictionary learning (DL) combined with PCA whitening pre-processing.
result Successfully retrieved biologically meaningful concepts like cell types and genetic perturbations.
Study shows DNNs often extract redundant features, influenced by network size and activation function.
problem Redundancy in deep neural network features.
method Hierarchical clustering of features based on cosine distances, varying network sizes and activation functions.
result Network size and activation function are key factors in DNN redundancy.
Deep learning detects atrial fibrillation with high accuracy.
problem Detecting atrial fibrillation in ECG signals.
method Extracted deep features from spectrograms using convolutional networks.
result Convolutional network achieved 93.16% classification accuracy.
We use machine learning for designing a medium frequency trading strategy for a portfolio of 5 year and 10 year US Treasury note futures. We formulate this as a classification problem where we predict the weekly direction of movement of the portfolio using features extracted from a deep belief network trained on techni…
Study examines neural networks for feature extraction and their impact on machine learning models.
problem Improving feature extraction for better machine learning model performance.
method Used neural networks to extract features from images and numeric data, then compared these features with SVMs and KNNs.
result Neural network-extracted features significantly enhance SVM and KNN performance in many cases.
Efficiently extracts local features from whole images using CNNs with pooling layers.
problem Efficiently extracting local features from whole images for various tasks.
method A method to compute patch-based local feature descriptors efficiently in presence of pooling and striding layers for whole images at once, applicable to nearly all existing network architectures.
result Our approach significantly speeds up feature extraction from whole images compared to existing methods.
Relational Autoencoder improves feature extraction by considering data relationships.
problem Feature extraction from high-dimensional data fails to consider data relationships.
method Proposes a Relation Autoencoder model that considers both features and relationships.
result Considering data relationships generates more robust features with lower error rates.
Enhancing malware detection with icon features.
problem Improving accuracy in detecting malware.
method Extract icon features using summary statistics, HOG, and a convolutional autoencoder. Cluster icons and integrate these clusters into machine learning models.
result Significant increase in malware prediction model accuracy (10%) when icon clusters are used.
End-to-end model extracts nested terms without extra features.
problem Automatic term extraction for nested terms.
method Deep learning model that predicts conceptual terms within fixed sentence lengths.
result High recall and comparable precision on term extraction task.
Dilated CNN improves multivariate time series classification.
problem Multivariate time series classification.
method Transformed multivariate time series into image-like style, applied dilated and strided convolutions.
result Automatic features extracted by dilated CNN are as effective as hand-crafted features.
Extends feature selection to GNNs, improving accuracy and feature ranking.
problem Improving feature selection in Graph Neural Networks (GNNs).
method Implemented a feature selection algorithm using Gumbel Softmax for ranking and selecting features in GNNs.
result Selected 225 features out of 1433 for the Cora dataset, improving classification accuracy.
Proposes Haar Scattering Networks for better feature extraction.
problem Improving feature extraction in various signal processing and system identification tasks.
method Building function approximators on top of Haar Scattering Networks.
result Demonstrates the architecture's effectiveness in multiple fields.
Feature extraction is a very crucial task in image and pixel (voxel) classification and regression in biomedical image modeling. In this work we present a machine learning based feature extraction scheme based on inception models for pixel classification tasks. We extract features under multi-scale and multi-layer sche…
A new method extracts features from time series data using iterated sums and improves classification accuracy.
problem Time series classification challenges.
method Feature extraction using iterated-sums signature (ISS) followed by a linear classifier.
result Competitive with state-of-the-art methods on UCR archive.
Supervised linear feature extraction can be achieved by fitting a reduced rank multivariate model. This paper studies rank penalized and rank constrained vector generalized linear models. From the perspective of thresholding rules, we build a framework for fitting singular value penalized models and use it for feature …
Adaptive template systems improve feature extraction from persistence diagrams for machine learning.
problem Feature extraction from persistence diagrams for machine learning.
method Adaptive template systems using CDER, GMM, and HDBSCAN algorithms.
result Adaptive template systems yield competitive and often superior results in classification tasks.
Gradient-based method extracts slow features from high-dimensional data.
problem Extracting meaningful low-dimensional features from high-dimensional, temporally varying data.
method Power Slow Feature Analysis (PowerSFA) using gradient-based training of differentiable architectures.
result PowerSFA effectively extracts meaningful low-dimensional features in various data types.
RTFN extracts robust temporal features for time series analysis.
problem Challenges in extracting sufficient shapelets from time series data.
method Combines temporal feature networks and attentional LSTM networks.
result RTFN outperforms in supervised and unsupervised time series analysis.
The study uses music chords to predict Brazilian music genres.
problem Classifying popular Brazilian music genres based on harmonic structures.
method Extracted and engineered harmonically related features from chords data, used random forest model for classification.
result Features from harmonic elements can predict Brazilian music genres.
Paper proposes CNN with SIFT for rotation invariant feature extraction.
problem Max-pooling layer discards rotational information, leading to rotation invariance issues.
method Uses SIFT descriptor to capture orientation and spatial relationships.
result Improves feature extraction on MNIST and fashionMNIST datasets.
Improved stock prediction using news features and RNN.
problem Predicting stock prices with high accuracy.
method Extracted news features, optimized seed words, calculated positive polar, constructed news features, proposed RNN model.
result Our method improves stock prediction accuracy by over 5%.
Proposes a method to extract robust features that improve classifier robustness.
problem Improving classifier robustness to small perturbations in input space.
method Introduces an additional penalty term in the information bottleneck framework to minimize Fisher information, optimizing a variational bound using stochastic gradient descent.
result Optimally robust features are jointly Gaussian, and the method produces classifiers with increased robustness to perturbations.
New algorithms select and rank features from MTS without feature extraction.
problem Feature extraction step for MTS classification.
method Directly computes similarity between time series and assesses cluster structure matching labels.
result Techniques match labels well without feature extraction.
Combines multiple data types to predict emotions in images.
problem Predicting emotions in images using various data types.
method Combines facial features, scene extraction, audio tonality, human pose, text-based tagging, and CNN predictions.
result Improves accuracy in emotion prediction compared to baseline methods.
Identifies influential neurons in deep networks for better explanations.
problem Explaining complex behaviors of deep neural networks.
method Identifies neurons with high influence using an influence measure and provides interpretations.
result Identifies influential concepts that generalize across instances and isolates individual features used by the network.