Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

147294441588 · Jun 202019922001200920172026
48 results for feature construction

Enhances machine learning for high-energy physics data by embedding feature construction.

problem Improving machine learning performance in high-energy physics data analysis.
method Integrates feature construction directly into tree-based model training, adapting to physics constraints.
result Significant improvement in classification scores with fewer interpretable features.

Motivated by an abstract notion of low-level edge detector filters, we propose a simple method of unsupervised feature construction based on pairwise statistics of features. In the first step, we construct neighborhoods of features by regrouping features that correlate. Then we use these subsets as filters to produce n…

2013-12-20abs ↗pdf ↗

Paper proposes a new method to optimize feature coordinates for better image classification.

problem Improving feature extraction for better machine learning classification.
method Mutual-energy inner product optimization method.
result The method enhances low-frequency features and suppresses high-frequency noise, leading to better classification results.

Study analyzes feedback complexity for sparse feature retrieval in deep networks.

problem Learning sparse superposed features with feedback.
method Analysis of feedback complexity in sparse settings, including triplet comparisons.
result Establishes tight bounds and strong upper bounds for feature recovery.

Framework predicts implied volatility surface without arbitrage.

problem Predicting implied volatility surface without static arbitrage.
method Two-step framework: feature selection and deep neural network (DNN) construction.
result DNN model for surface construction removes static arbitrage and reduces prediction error.

The modeling of atomistic biomolecular simulations using kinetic models such as Markov state models (MSMs) has had many notable algorithmic advances in recent years. The variational principle has opened the door for a nearly fully automated toolkit for selecting models that predict the long-time kinetics from molecular…

2018-11-28abs ↗pdf ↗

Proposes a method for clearer counterfactual explanations of deep networks.

problem Unclear explanations from current counterfactual methods.
method Gradual construction of explanations through masking and composition steps.
result Produces human-friendly, interpretable explanations with fewer modifications.

No-trick kernel adaptive filtering uses deterministic features for scalability and robustness.

problem Scalability issues in kernel methods for large datasets.
method Deterministic feature-map construction using polynomial-exact solutions.
result Deterministic features outperform random Fourier features in performance and scalability.

The paper classifies market states to predict trading strategies, outperforming traditional methods.

problem Directly predicting prices or returns is unreliable; classifying market states is a better approach.
method Classify market states using various labels and features, then combine probabilities from neural networks.
result Trading strategy ensembles outperform traditional methods in returns and risk-adjusted returns.

Study improves mortality prediction in ICU patients using feature engineering and 1D CNN.

problem Improving mortality prediction in ICU patients with high-dimensional, imbalanced, and missing data.
method Feature engineering, 1D Convolutional Neural Network (1D CNN), traditional machine learning algorithms.
result Best AUC of 0.848 achieved with 1D CNN model.

Principal components analysis (PCA) is the optimal linear auto-encoder of data, and it is often used to construct features. Enforcing sparsity on the principal components can promote better generalization, while improving the interpretability of the features. We study the problem of constructing optimal sparse linear a…

2015-02-23abs ↗pdf ↗

Graph neural networks (GNNs) are a powerful tool to learn representations on graphs by iteratively aggregating features from node neighbourhoods. Many variant models have been proposed, but there is limited understanding on both how to compare different architectures and how to construct GNNs systematically. Here, we p…

2019-11-13abs ↗pdf ↗

New model selects uncorrelated and discriminative features for unsupervised feature selection.

problem Selecting uncorrelated and discriminative features in high-dimensional data.
method Adaptive graph-based generalized regression model with uncorrelated constraint and 2,1\ell_{2,1}-norm regularization.
result The model effectively selects uncorrelated and discriminative features, improving clustering performance.

Enhances functional classifier performance with new tree-based methods and unbiased feature importance assessment.

problem Challenges of high-dimensional functional data and biased feature importance assessment.
method Augmented functional classification trees and random forests with ad-hoc conditional permutations for unbiased feature importance.
result Significant enhancement in predictive power of functional classifiers through new feature importance assessment.

We present the Wright-Fisher Indian buffet process (WF-IBP), a probabilistic model for time-dependent data assumed to have been generated by an unknown number of latent features. This model is suitable as a prior in Bayesian nonparametric feature allocation models in which the features underlying the observed data exhi…

2016-11-22abs ↗pdf ↗

Cross-balancing improves causal inference by balancing features with outcome data.

problem Balancing features for valid causal inference when outcome data is available.
method Cross-balancing using sample splitting to separate feature construction and weight estimation errors.
result Cross-balancing produces consistent, asymptotically normal, and efficient estimators under mild conditions.

Enhances LDL by integrating distance and directional information for more robust label feature representation.

problem Lack of robust label feature representation in LDL tasks, especially with label ambiguity.
method Introduces Structural Anchor Points (SAPs) to capture inter-cluster interactions and a novel LSFs construction strategy, LIFT-SAP.
result Improves LDL performance by 15% on average across 15 real-world datasets.

The goal of machine learning is to provide solutions which are trained by data or by experience coming from the environment. Many training algorithms exist and some brilliant successes were achieved. But even in structured environments for machine learning (e.g. data mining or board games), most applications beyond the…

2011-05-10abs ↗pdf ↗

Efficiently applies NTK to large-scale datasets using random features.

problem Computational limitations of kernel methods for large-scale datasets.
method Proposes a sketching-based algorithm combining random features of arc-cosine kernels to construct an efficient feature map of the NTK.
result Achieves comparable error bounds to exact kernel methods but with significantly reduced feature dimensionality.

A new method for feature selection in high-dimensional data.

problem Dealing with noise and high-dimensional data in unsupervised feature selection.
method Sparse PCA via l2,pl_{2,p}-norm regularization, combined with an efficient optimization algorithm.
result The proposed method effectively selects features from real-world data sets.

In this study, a novel feature coding method that exploits invariance for transformations represented by a finite group of orthogonal matrices is proposed. We prove that the group-invariant feature vector contains sufficient discriminative information when learning a linear classifier using convex loss minimization. Ba…

2019-06-05abs ↗pdf ↗

Matching pursuit (MP) methods are a promising class of feature construction algorithms for value function approximation. Yet existing MP methods require creating a pool of potential features, mandating expert knowledge or enumeration of a large feature pool, both of which hinder scalability. This paper introduces batch…

2013-09-26abs ↗pdf ↗

Feature extraction becomes increasingly important as data grows high dimensional. Autoencoder as a neural network based feature extraction method achieves great success in generating abstract features of high dimensional data. However, it fails to consider the relationships of data samples which may affect experimental…

2018-02-09abs ↗pdf ↗

Develops a new feature theory for robust machine learning.

problem Creating robust machine learning features from training data.
method Stochastic tensor space feature theory with Karhunen-Loeve expansion and hierarchical subspaces.
result Dramatic increases in accuracy for predicting Alzheimer's disease stages.

Improves machine learning models by incorporating physical laws into feature maps.

problem Lack of model interpretability in classical machine learning approaches.
method Physics-informed feature maps constructed from physical laws and dimensional analysis.
result Enhanced model interpretability and potential discovery of new physical equations.

Kernel methods linked to feature subspaces and maximal correlation kernels.

problem Understanding kernel methods and their relationship to feature extraction.
method Established a correspondence between feature subspaces and kernels, introduced maximal correlation kernels, and demonstrated their optimality.
result Kernel SVM on maximal correlation kernel achieves minimum prediction error.

A machine learning approach to record fusion with high accuracy.

problem Aggregating multiple records corresponding to the same entity.
method Constructing feature vectors from attribute-level, record-level, and database-level signals; using a stagewise additive model to learn a classifier.
result Average precision of ~98% with source information and ~94% without source information across diverse datasets.

Quantum kernels can be efficiently embedded into classical feature spaces.

problem Can all quantum kernels be efficiently embedded into classical feature spaces?
method Invoking computational universality and using techniques like random Fourier features, the authors show that certain classes of quantum kernels can be efficiently embedded.
result For shift-invariant and composition kernels, embedding quantum kernels are universal and efficient.