Adaptive feature normalization improves model robustness to extraneous variables.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
The choice of normalization affects the coefficients in regularized regression models.
Neural collapse occurs in normalized features over a Riemannian manifold.
Feature normalization prevents collapse in non-contrastive learning dynamics.
Layer normalization improves federated learning with skewed labels.
New method normalizes matrix features for robust low-rank approximation.
Computer-Aided-Diagnosis (CADx) systems assist radiologists with identifying and classifying potentially malignant pulmonary nodules on chest CT scans using morphology and texture-based (radiomic) features. However, radiomic features are sensitive to differences in acquisitions due to variations in dose levels and slic…
FlowSelect uses normalizing flows to control FDR in feature selection.
Proposes Moment Exchange to use moments in image recognition models, improving generalization.
Batch normalization shifts models to rely more on non-robust features.
BN helps learn fragile features, which can improve adversarial robustness.
In a binary classification problem the feature vector (predictor) is the input to a scoring function that produces a decision value (score), which is compared to a particular chosen threshold to provide a final class prediction (output). Although the normal assumption of the scoring function is important in many applic…
This paper aims to classify a single PCG recording as normal or abnormal for computer-aided diagnosis. The proposed framework for this challenge has four steps: preprocessing, feature extraction, training and validation. In the preprocessing step, a recording is segmented into four states, i.e., the first heart sound, …
The paper proves asymptotic normality for multinomial logistic regression on null covariates.
This paper proposes a novel generic one-class feature learning method based on intra-class splitting. In one-class classification, feature learning is challenging, because only samples of one class are available during training. Hence, state-of-the-art methods require reference multi-class datasets to pretrain feature …
Two-dimensional case in the theory of dynamical systems admitting the normal shift differs crucially from multidimensional case. Features of two-dimensional case are gathered and studied in this thesis.
The cost of wind energy can be reduced by using SCADA data to detect faults in wind turbine components. Normal behavior models are one of the main fault detection approaches, but there is a lack of consensus in how different input features affect the results. In this work, a new taxonomy based on the causal relations b…
This paper presents a normalization mechanism called Instance-Level Meta Normalization (ILM~Norm) to address a learning-to-normalize problem. ILM~Norm learns to predict the normalization parameters via both the feature feed-forward and the gradient back-propagation paths. ILM~Norm provides a meta normalization mechanis…
Normalization methods are a central building block in the deep learning toolbox. They accelerate and stabilize training, while decreasing the dependence on manually tuned learning rate schedules. When learning from multi-modal distributions, the effectiveness of batch normalization (BN), arguably the most prominent nor…
Person Re-identification (re-id) faces two major challenges: the lack of cross-view paired training data and learning discriminative identity-sensitive and view-invariant features in the presence of large pose variations. In this work, we address both problems by proposing a novel deep person image generation model for…
Proposes PSCs for UQ in deep nets without retraining.
Study links neural network inductive bias, feature learning, and generalization on Boolean functions.
System classifies lung CT scans into normal or COVID-19 using machine learning.
New method improves feature importance assessment in random forests.
We developed a new approach for the analysis of physiological time series. An iterative convolution filter is used to decompose the time series into various components. Statistics of these components are extracted as features to characterize the mechanisms underlying the time series. Motivated by the studies that show …
We introduce online learning algorithms which are independent of feature scales, proving regret bounds dependent on the ratio of scales existent in the data rather than the absolute scale. This has several useful effects: there is no need to pre-normalize data, the test-time and test-space complexity are reduced, and t…
We introduce online learning algorithms which are independent of feature scales, proving regret bounds dependent on the ratio of scales existent in the data rather than the absolute scale. This has several useful effects: there is no need to pre-normalize data, the test-time and test-space complexity are reduced, and t…
A new classification method using disjoint centroids and normalized distance.
Fine-tuning normalization layers can reconstruct smaller networks.
In this paper, we propose a new pooling method called spatial pyramid encoding (SPE) to generate speaker embeddings for text-independent speaker verification. We first partition the output feature maps from a deep residual network (ResNet) into increasingly fine sub-regions and extract speaker embeddings from each sub-…
Deep Neural Networks (DNNs) thrive in recent years in which Batch Normalization (BN) plays an indispensable role. However, it has been observed that BN is costly due to the reduction operations. In this paper, we propose alleviating this problem through sampling only a small fraction of data for normalization at each i…
Nearest Neighbors Algorithm is a Lazy Learning Algorithm, in which the algorithm tries to approximate the predictions with the help of similar existing vectors in the training dataset. The predictions made by the K-Nearest Neighbors algorithm is based on averaging the target values of the spatial neighbors. The selecti…
PSMM method optimizes matrix sufficient dimension reduction.
Paper predicts EEG features from acoustic features using RNN and GAN.
This paper is devoted to the specific class of pseudoconformal mappings of quaternion and octonion variables. Normal families of functions are defined and investigated. Four criteria of a family being normal are proven. Then groups of pseudoconformal diffeomorphisms of quaternion and octonion manifolds are investigated…
Deep networks have achieved huge successes in application domains like object and face recognition. The performance gain is attributed to different facets of the network architecture such as: depth of the convolutional layers, activation function, pooling, batch normalization, forward and back propagation and many more…
Defense against adversarial attacks by manipulating feature thickness.
Study on the geometric Dyson Brownian motion of non-square matrix products.
Improves data normality with robust transformations.
Improved road segmentation on low-res LIDAR data for autonomous vehicles.
Edge features contain important information about graphs. However, current state-of-the-art neural network models designed for graph learning, e.g. graph convolutional networks (GCN) and graph attention networks (GAT), adequately utilize edge features, especially multi-dimensional edge features. In this paper, we build…
Real analytic functions can be extended on manifolds with normal crossings.
DeepSeekMoE improves language model efficiency with shared experts and normalized gating.
Training only BatchNorm parameters achieves surprisingly high performance in deep networks.
ReVol normalizes stock price features to mitigate distribution shifts, improving prediction accuracy.
A fall is an abnormal activity that occurs rarely, so it is hard to collect real data for falls. It is, therefore, difficult to use supervised learning methods to automatically detect falls. Another challenge in using machine learning methods to automatically detect falls is the choice of engineered features. In this p…
simpcomp is an extension to GAP, the well known system for computational discrete algebra. It allows the user to work with simplicial complexes. In the latest version, support for simplicial blowups and discrete normal surfaces was added, both features unique to simpcomp. Furthermore, new functions for constructing cer…
Hybrid pipeline detects spike-and-wave discharges in long-term EEG recordings.