Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,051 papers · 148 categories

Trend · papers per month

115231346461 · Jun 202019922001200920172026
48 results for Feature amounts

New insights suggest larger early layers improve CNN performance.

problem Common assumption of monotonously increasing feature counts in CNNs is challenged.
method Used a skew normal distribution to investigate feature amounts in CNN layers.
result Architectures favoring larger early layers yield better accuracy.

Study of local optima in neural networks for feature interactions.

problem NNs struggle with local optima in feature interactions for small datasets.
method Proposed a node pruning and feature selection algorithm to improve NN performance.
result NNs have many non-equivalent local optima in XOR-like data with irrelevant variables.

Network Lasso classifies partially labeled data with high-dimensional features.

problem Classifying data points with limited labeled data and high-dimensional features.
method Logistic Network Lasso using total variation regularization and primal-dual splitting.
result Accurate classification achieved from limited labeled data via network structure.

A new method selects features efficiently for high-dimensional data.

problem High computational costs and memory requirements in high-dimensional data.
method QuickSelection uses the strength of neurons in sparse autoencoders to select features.
result QuickSelection achieves the best trade-off of accuracy, speed, and memory usage.

The amount of information in the form of features and variables avail- able to machine learning algorithms is ever increasing. This can lead to classifiers that are prone to overfitting in high dimensions, high di- mensional models do not lend themselves to interpretable results, and the CPU and memory resources necess…

2014-02-10abs ↗pdf ↗

Deep linear networks exhibit collapsing features and classifiers across datasets.

problem Understanding the collapse of features and classifiers in deep linear networks.
method Theoretical and empirical analysis of deep linear networks with MSE and CE losses.
result Deep linear networks exhibit NC properties, collapsing features and classifiers to orthogonal vectors.

Many methods have been proposed for community detection in networks, but most of them do not take into account additional information on the nodes that is often available in practice. In this paper, we propose a new joint community detection criterion that uses both the network edge information and the node features to…

2015-09-03abs ↗pdf ↗

BSF algorithm reduces neural network size and selects features efficiently.

problem Neural network size and feature selection optimization.
method Binary Stochastic Filtering (BSF) layer that penalizes information, stochastically passes or drops features.
result Multifold decrease in neural network size and optimal feature selection.

Many efforts have been made to use various forms of domain knowledge in malware detection. Currently there exist two common approaches to malware detection without domain knowledge, namely byte n-grams and strings. In this work we explore the feasibility of applying neural networks to malware detection and feature lear…

2017-09-05abs ↗pdf ↗

This work proves convergence of adaptive resampling for random Fourier features.

problem Sampling Fourier frequencies well for high-dimensional data.
method Data adaptive resampling of Fourier frequencies, asymptotically optimal.
result Proves convergence of adaptive resampling method for regression and classification problems.

In recent years, a large amount of model-agnostic methods to improve the transparency, trustability and interpretability of machine learning models have been developed. We introduce local feature importance as a local version of a recent model-agnostic global feature importance method. Based on local feature importance…

2018-04-18abs ↗pdf ↗

In the domain of technology startups, biotechnology has often been considered as specific. Their unique technology content, the type of founders and managers they have, the amount of venture capital they raise, the time it takes them to reach an exit as well as the technology clusters they belong to are seen as such un…

2018-04-13abs ↗pdf ↗

During the last decade, a considerable amount of effort has been made to classify variable stars using different machine learning techniques. Typically, light curves are represented as vectors of statistical descriptors or features that are used to train various algorithms. These features demand big computational power…

2018-10-21abs ↗pdf ↗

Novel graph-based framework for hyperspectral image classification using superpixels.

problem High classification accuracy with limited labelled data in hyperspectral images.
method Superpixel method for defining local regions, spectral and spatial features extraction, contracted graph representation, semi-supervised classifier.
result Our approach produces accurate classifications with minimal labelled data, outperforming state-of-the-art techniques.

We consider the problem of object recognition with a large number of classes. In order to overcome the low amount of labeled examples available in this setting, we introduce a new feature learning and extraction procedure based on a factor model we call spike-and-slab sparse coding (S3C). Prior work on S3C has not prio…

2012-06-27abs ↗pdf ↗

Convolutional neural networks provide visual features that perform remarkably well in many computer vision applications. However, training these networks requires significant amounts of supervision. This paper introduces a generic framework to train deep networks, end-to-end, with no supervision. We propose to fix a se…

2017-04-18abs ↗pdf ↗

Proposes ACLAE-DT for unsupervised anomaly detection in multivariate time series.

problem Challenges in building anomaly detection frameworks for multivariate time series data.
method Attention-based ConvLSTM Autoencoder with Dynamic Thresholding.
result Demonstrates superior performance over state-of-the-art methods.

Deep neural networks, trained with large amount of labeled data, can fail to generalize well when tested with examples from a \emph{target domain} whose distribution differs from the training data distribution, referred as the \emph{source domain}. It can be expensive or even infeasible to obtain required amount of lab…

2018-11-13abs ↗pdf ↗

SLEIPNIR improves Gaussian process regression with derivatives, scaling up efficiently and accurately.

problem Scaling Gaussian process regression with derivatives for large datasets.
method Quadrature Fourier features for feature expansion, proving error bounds.
result Deterministic, non-asymptotic, exponentially fast decaying error bounds for approximated kernel and posterior.

In this paper we present a technique for using the bootstrap to estimate the operating characteristics and their variability for certain types of ensemble methods. Bootstrapping a model can require a huge amount of work if the training data set is large. Fortunately in many cases the technique lets us determine the eff…

2017-10-24abs ↗pdf ↗

We consider the problem of classifying business process instances based on structural features derived from event logs. The main motivation is to provide machine learning based techniques with quick response times for interactive computer assisted root cause analysis. In particular, we create structural features from p…

2017-10-08abs ↗pdf ↗

Sparse GEMINI selects relevant features for clustering without assumptions.

problem Feature selection in clustering with relevant clusters and variables.
method Discriminative clustering model maximizing GEMINI with l1 penalty.
result Sparse GEMINI selects relevant subsets of variables without prior hypotheses.

A federated model predicts failures using multi-stream incomplete data.

problem Insufficient data for reliable prognostic models in multi-stream applications.
method Federated data fusion, multivariate functional principal component analysis, (log)-location-scale regression model, federated algorithm.
result Performance is as good as classic non-federated models and better than individual models.

Deep learning models misclassify malware with added benign features.

problem Detecting malware with deep learning when it's mixed with benign code.
method Trained a deep neural network classifier using benign and malware features. Demonstrated the impact of adding benign features to malware. Used data augmentation to improve classifier robustness.
result Adding benign features to malware significantly increases false negatives.

We introduce and study a simple model of a limit order-driven market. Traders in this model can either trade at the market price or place a limit order, i.e. an instruction to buy (sell) a certain amount of the stock if its price falls below (raises above) a predefined level. The choice between these two options is pur…

1999-10-30abs ↗pdf ↗