Gaussian processes classify graphs using vertex and edge features.
problem Graph classification in machine learning.
method Transform graph features into spectral Euclidean features, apply Hodge decomposition.
result Gaussian processes can classify graphs using vertex and edge features.
CIBP models feature abundance in latent feature models.
problem Modeling feature abundance in latent feature models.
method Proposes a new Bayesian nonparametric prior, the CIBP, for latent feature models.
result The expected number of features is bounded even as the number of objects increases.
Study shows topological features improve time series classification.
problem Classifying stochastic processes with varying noise and sampling.
method Topological data analysis features compared to statistical and raw features.
result Topological features lead to better classification performance.
Graph classification improved using spectral features and wavelet filters.
problem Categorizing graphs based on their structure and node attributes.
method Derived spectral features from graph signal processing, designed two Gaussian process models: one simple and one sophisticated.
result Simple and sophisticated Gaussian process models yield competitive performance, including well-calibrated uncertainty estimates.
Improved Gaussian Process regression using TQFF over RFF and Gaussian QFF.
problem Limited performance of Quadrature Fourier Features (QFF) in approximating highly oscillatory functions.
method Developed Trigonometric Quadrature Fourier Features (TQFF) using a novel non-Gaussian quadrature rule.
result TQFF provides better approximation accuracy and fewer features compared to RFF and Gaussian QFF.
We develop a theory of higher-order feature attribution for complex models.
problem Interpreting feature contributions in models with interactions is challenging.
method We extend Integrated Gradients (IG) to higher-order feature attributions.
result We establish natural connections to statistics and topological signal processing.
Enhances DGPs with adaptive RKHS Fourier features for better non-stationary pattern modeling.
problem Capturing complex non-stationary patterns in non-linear dynamical systems.
method Integrates ODE-based RKHS Fourier features into DGPs using convolution operations for adaptive amplitude and phase modulation. Uses a doubly stochastic variational inference framework.
result Improved predictive performance across various regression tasks.
A single pre-trained agent guides feature selection using knockoffs.
problem Feature selection challenges in AI-readiness of data.
method Generates knockoff features and uses reinforcement learning.
result Optimal feature subset identified with reduced dependency on target variable.
Optimizes real-time data processing in HFT algorithms using machine learning.
problem Optimizing data processing speed in high-frequency trading.
method Adaptive feature selection mechanism, clustering, feature weight analysis, lightweight neural networks.
result The model maintains consistent performance across varying market conditions.
A new Gaussian process framework uses neural feature maps for scalable, accurate inference.
problem Efficient and accurate Gaussian process inference for diverse data types.
method Neural feature maps to construct expressive kernels, with theoretical guarantees and practical scalability.
result The approach outperforms existing methods in accuracy and efficiency across various data modalities.
Integrates Fourier features for faster Gaussian process regression.
problem Efficiently scaling Gaussian process regression to large datasets.
method Integrated Fourier features for Gaussian processes.
result Improves Gaussian process regression speed to O(M3) for a broad class of kernels. Deep learning uses alphabet frequencies to accurately classify fake news.
problem Classifying fake news from trustworthy news.
method Used deep learning algorithms on alphabet frequencies of text without sequence information.
result Achieved high accuracy (85%) in classifying fake news.
Indian Buffet Process based models are an elegant way for discovering underlying features within a data set, but inference in such models can be slow. Inferring underlying features using Markov chain Monte Carlo either relies on an uncollapsed representation, which leads to poor mixing, or on a collapsed representation…
This study evaluates data pre-processing techniques for class imbalance in biomedical data.
problem Class imbalance in biomedical datasets affects model performance.
method Resampling and feature selection techniques evaluated using SVM, C4.5, LDA, and KNN classifiers.
result Feature Selection outperforms other methods in most cases, especially with SVM.
Paper proposes an ensemble approach to improve fairness in classifier decisions.
problem Improving fairness in classifier decisions to prevent bias.
method Inspired by dropout techniques, feature drop-out is used to reduce classifier dependence on sensitive features while maintaining accuracy.
result An ensemble of classifiers with reduced sensitivity to sensitive features and improved accuracy.
In Random Forests, proximity distances are a metric representation of data into decision space. By observing how changes in input map to the movement of instances in this space we are able to determine the independent contribution of each feature to the decision-making process. For binary feature vectors, this process …
A new neural network framework ADNN improves financial feature construction.
problem Constructing highly informative financial features.
method Neural network (ADNN) with domain knowledge, pre-training, and data augmentation.
result ADNN produces more diversified and informative features than genetic programming.
Graph convolutional network (GCN) is an emerging neural network approach. It learns new representation of a node by aggregating feature vectors of all neighbors in the aggregation process without considering whether the neighbors or features are useful or not. Recent methods have improved solutions by sampling a fixed …
tsflex speeds up time series processing and feature extraction.
problem Inefficient and inflexible time series processing tools.
method Flexible Python toolkit exttttsflex for multivariate, asynchronous time series. result Significantly faster and more memory-efficient than existing packages.
Feature engineering is a crucial step in the process of predictive modeling. It involves the transformation of given feature space, typically using mathematical functions, with the objective of reducing the modeling error for a given target. However, there is no well-defined basis for performing effective feature engin…
Pattern analysis often requires a pre-processing stage for extracting or selecting features in order to help the classification, prediction, or clustering stage discriminate or represent the data in a better way. The reason for this requirement is that the raw data are complex and difficult to process without extractin…
Condition monitoring is one of the routine tasks in all major process industries. The mechanical parts such as a motor, gear, bearings are the major components of a process industry and any fault in them may cause a total shutdown of the whole process, which may result in serious losses. Therefore, it is very crucial t…
Theory captures feature learning effects in finite CNNs.
problem Feature learning in finite deep neural networks.
method Derive a self-consistent Gaussian Process theory.
result Good agreement with experiments and sharp transition between regimes.
A new method for efficient nonlinear process monitoring using random Bernoulli features.
problem High computational demands and real-time responsiveness in online monitoring systems.
method Random Bernoulli principal component analysis to capture nonlinear patterns efficiently.
result The proposed methods offer excellent scalability and reduced computational complexity.
A new method for nonstationary Gaussian processes using Fourier features.
problem Efficient simulation of nonstationary Gaussian processes with high-dimensional distributions.
method Discretizes the spectral representation of nonstationary processes, avoiding probability measure assumptions.
result An efficient low-rank approximation of nonstationary spectral densities, consistent and positive semi-definite.
Scientific explanation often requires inferring maximally predictive features from a given data set. Unfortunately, the collection of minimal maximally predictive features for most stochastic processes is uncountably infinite. In such cases, one compromises and instead seeks nearly maximally predictive features. Here, …
Conventional mutual information (MI) based feature selection (FS) methods are unable to handle heterogeneous feature subset selection properly because of data format differences or estimation methods of MI between feature subset and class label. A way to solve this problem is feature transformation (FT). In this study,…
We investigate a class of feature allocation models that generalize the Indian buffet process and are parameterized by Gibbs-type random measures. Two existing classes are contained as special cases: the original two-parameter Indian buffet process, corresponding to the Dirichlet process, and the stable (or three-param…
Deep learning techniques are rapidly advanced recently, and becoming a necessity component for widespread systems. However, the inference process of deep learning is black-box, and not very suitable to safety-critical systems which must exhibit high transparency. In this paper, to address this black-box limitation, we …
FABLE incorporates instance features into PWS label models for improved performance.
problem Lack of instance features in existing label models limits their performance.
method FABLE uses a mixture of Bayesian label models and a Gaussian Process classifier to incorporate instance features.
result FABLE achieves the highest averaged performance across nine baselines on benchmark datasets.
A RL framework selects features to balance bias and accuracy dynamically.
problem Bias in automated feature selection when predictors are correlated.
method Multi-component reward function with policy gradient for dynamic regularization and bias mitigation.
result Model balances fairness and accuracy during training.
Enhances Gaussian processes with spherical features for better scalability and flexibility.
problem Lack of representation learning in Gaussian processes compared to deep neural networks.
method Introduces spherical inter-domain features to improve GP approximation and scalability.
result The method alleviates limitations and improves scalability compared to alternative strategies.
Feature selection is frequently used as a pre-processing step to machine learning. It is a process of choosing a subset of original features so that the feature space is optimally reduced according to a certain evaluation criterion. The central objective of this paper is to reduce the dimension of the data by finding a…
Kernel improves Gaussian process scalability for wide datasets.
problem Under-performance of Gaussian processes on wide data.
method Introduces Bézier Gaussian Process kernel with exponential summarising variables growth and linear cost.
result Empirically demonstrates scalability to both tall and wide datasets.
SLEIPNIR improves Gaussian process regression with derivatives, scaling up efficiently and accurately.
problem Scaling Gaussian process regression with derivatives for large datasets.
method Quadrature Fourier features for feature expansion, proving error bounds.
result Deterministic, non-asymptotic, exponentially fast decaying error bounds for approximated kernel and posterior.
A new method uses Gaussian Processes for feature-based nonrigid image registration.
problem Estimating dense displacement fields for nonrigid image registration.
method Using Gaussian Processes to estimate both dense displacement field and uncertainty map.
result GP-based interpolation performs similarly to state-of-the-art B-spline interpolation.
ML predicts alloy properties considering chemistry, processing, and data transformations.
problem Designing and predicting alloy properties in high-dimensional design space.
method Physics-informed machine learning with engineered features from chemistry and heat treatment.
result ML models accurately predict alloy properties, including hysteresis in shape memory alloys.
Researchers calculate Shannon entropy rates of hidden Markov processes efficiently.
problem No finite expression exists for Shannon entropy rates of hidden Markov processes.
method Developed an efficient method to calculate entropy rates and identify minimal predictive features.
result Entropy rates can be accurately calculated for hidden Markov processes.
This work studies how contrastive learning extracts features from unlabeled data.
problem How neural networks trained by contrastive learning can extract features from unlabeled data.
method Formal analysis of contrastive learning's feature learning process, considering two types of features: sparse and dense.
result Contrastive learning using ReLU networks can learn sparse features if proper augmentations are adopted.
Deep kernel processes unify various models using Gram matrices and kernel functions.
problem Unified representation of various deep learning models.
method Defining deep kernel processes with progressively transformed Gram matrices and sampling from inverse Wishart distributions.
result Deep Gaussian processes, BNNs, infinite BNNs, and infinite BNNs with bottlenecks can all be written as deep kernel processes.
Improved kernel ridge regression for large datasets using weighted random binning.
problem Efficiently approximating kernel matrices for large-scale datasets.
method Introduced weighted random binning features for locality sensitive hashing.
result Weighted random binning features generate Gaussian processes of any desired smoothness.
Paper introduces a hybrid GPR model for more interpretable RUL prediction in aeroengine.
problem Challenges in interpreting and modeling uncertainty in RUL prediction models.
method Modified Gaussian Process Regression (GPR) with temporal feature extraction.
result Effective prediction of RUL intervals with transparent feature significance.
A new method guides neural networks to focus on specific features of input data.
problem Training neural networks to consider specific features of input data.
method Focus-and-Expand ( ax) method: Gradual manipulation of input features.
result Achieves state-of-the-art results in bias removal and image classification tasks.
Investors seek to attribute performance to various features using Shapley value method.
problem Attributing performance to different features in an investment process.
method Use Shapley value method for attribution, either exactly or approximately.
result Shapley value method provides a preferred attribution approach.
Paper extracts features from time series to improve forecasting accuracy.
problem Forecasting time series generated by Itô-type processes with unknown coefficients.
method Statistical adjustment of mixture-type models to extract features from time series data.
result Additional statistical features enhance time series prediction accuracy.
Simplified feature selection using a single agent with restructured choice strategy.
problem Efficiency and cost issues in multi-agent reinforced feature selection.
method Single-agent approach with restructured choice strategy, including scanning method, feature prioritization, state representation, and reward scheme.
result Improved efficiency and effectiveness of feature selection.
Quantum-assisted Gaussian process speeds up data regression.
problem High computational complexity of Gaussian process regression for large datasets.
method Quantum-assisted sparse Gaussian process regression using random Fourier features.
result Achieves polynomial-order computational speedup compared to classical methods.
The beta-Bernoulli process provides a Bayesian nonparametric prior for models involving collections of binary-valued features. A draw from the beta process yields an infinite collection of probabilities in the unit interval, and a draw from the Bernoulli process turns these into binary-valued features. Recent work has …