Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,291 papers · 148 categories

Trend · papers per month

3817621,1431,524 · Jun 202019922001200920182026
48 results for imbalanced data sets

A new algorithm improves credit scoring accuracy for imbalanced data.

problem Poor classification of minority class in credit scoring data sets.
method Weighted-Hybrid-Sampling-Boost (WHSBoost) algorithm with balanced data sampling.
result WHSBoost outperforms other methods in credit scoring accuracy.

Classifiers trained on data sets possessing an imbalanced class distribution are known to exhibit poor generalisation performance. This is known as the imbalanced learning problem. The problem becomes particularly acute when we consider incremental classifiers operating on imbalanced data streams, especially when the l…

2014-05-09abs ↗pdf ↗

Instance selection improves geometric mean accuracy in imbalanced data classification.

problem Improving classification success on imbalanced data using geometric mean.
method Instance selection to maximize geometric mean.
result GM is non-monotonic with instance selection, and balancing frequencies is inferior.

Spectral clustering is sensitive to how graphs are constructed from data particularly when proximal and imbalanced clusters are present. We show that Ratio-Cut (RCut) or normalized cut (NCut) objectives are not tailored to imbalanced data since they tend to emphasize cut sizes over cut values. We propose a graph partit…

2013-09-09abs ↗pdf ↗

New framework for learning from imbalanced data with theoretical guarantees.

problem Class imbalance in machine learning, especially in multi-class problems.
method Theoretical framework and new margin loss function for imbalanced classification.
result Proves strong HH-consistency of the proposed margin loss function.

SkewPNN uses probabilistic neural networks with skew-normal kernels to improve classification of imbalanced data.

problem Imbalanced data distribution leading to biased predictions for minority classes.
method Probabilistic neural networks with skew-normal kernel function and Bat optimization algorithm for hyperparameter tuning.
result SkewPNN and BA-SkewPNN outperform other methods in both balanced and imbalanced datasets.

Paper develops a new method for open-set and imbalanced classification with valid prediction sets.

problem Tackles open-set and imbalanced classification with new prediction methods.
method Develops a new family of conformal p-values and a selective sample splitting algorithm.
result Valid prediction sets with valid coverage in open-set scenarios and informative predictions under extreme class imbalance.

Study tackles imbalanced data in car insurance claims prediction.

problem Predicting rare events (claims) in car insurance with imbalanced data.
method Various machine learning techniques (logistic-regression, decision tree, random forest, xgBoost, feed-forward network) applied to imbalanced dataset.
result Comparison of machine learning algorithms' performance in claim occurrence prediction.

The paper proposes a SeqGAN model to generate balanced log messages for anomaly detection.

problem Imbalanced log data makes anomaly detection difficult.
method SeqGAN for generating balanced log messages, Autoencoder for feature extraction, GRU for anomaly detection.
result Oversampling and balancing data improves anomaly detection accuracy.

Imbalanced data sets containing much more background than signal instances are very common in particle physics, and will also be characteristic for the upcoming analyses of LHC data. Following up the work presented at ACAT 2008, we use the multivariate technique presented there (a rule growing algorithm with the meta-m…

2010-11-29abs ↗pdf ↗

Proposes GMOTE for better handling imbalanced data.

problem Classification of imbalanced data.
method Generates minority class instances using Gaussian Mixture Model, considering outliers through Mahalanobis distance.
result Shows better accuracy and F1-Score when combined with CART or SVM.

LDAO addresses imbalanced regression by learning local distribution structures.

problem Imbalanced regression with sparse target regions difficult for models.
method LDAO learns local distribution structures, models and samples from each, then merges.
result LDAO outperforms state-of-the-art methods on 45 imbalanced datasets.

An adjusted NN algorithm reduces false negatives in imbalanced data.

problem Learning from imbalanced data, focusing on reducing false negatives.
method Introduces a reweighted distance scheme to modify Voronoi regions and decision boundaries.
result The method yields the best performance, especially when combined with sampling methods.

The paper develops a statistical theory explaining overfitting in imbalanced classification.

problem Overfitting in high-dimensional imbalanced classification.
method Developed a statistical theory for support vector machines and logistic regression.
result Overfitting is more severe for the minority class due to truncation or skewing effects in high-dimensional data.

PSC classifier improves HDLSS classification on class-imbalanced data.

problem Classification on high-dimension low-sample-size data with class imbalance.
method Population Structure-learned Classifier (PSC) maximizing inter-class and intra-class scatter matrices.
result PSC outperforms state-of-the-art methods on IHDLSS.

Superensemble classifier improves predictions in imbalanced datasets.

problem Imbalanced datasets lead to poor performance in minority class examples.
method Maps Hellinger distance decision trees into RBFN framework for universal consistency and parameter optimization.
result The proposed model outperforms state-of-the-art models in various real-life data sets.

Improves PU learning for imbalanced data with practical AUL estimation and new training method.

problem Training binary classifiers on datasets with only positive and unlabeled samples.
method Asymptotic unbiased AUL estimation and ProbTagging for imbalanced data.
result ProbTagging increases AUC by up to 10% on industrial and artificial data sets.

BERT improved for propaganda detection with imbalanced, dissimilar data.

problem BERT struggles with dissimilar imbalanced datasets in propaganda detection.
method Cost-sensitive BERT with dissimilarity measure for imbalanced, dissimilar datasets.
result Achieved second-highest score on sentence-level propaganda classification.

VIR model improves regression accuracy and uncertainty estimation for imbalanced data.

problem Imbalanced regression datasets lead to poor model accuracy and uncertainty estimation.
method VIR model uses probabilistic smoothing and reweighting to estimate latent representations and uncertainty.
result VIR model outperforms state-of-the-art models in accuracy and uncertainty estimation.

New bounds for balanced classification improve understanding of imbalanced datasets.

problem Negligible size of the minority class in imbalanced datasets.
method Developed non-asymptotic and consistent bounds for balanced empirical risk minimization and balanced nearest neighbors estimates.
result Improved understanding of class-weighting benefits in real-world imbalanced classification settings.

Spectral clustering methods which are frequently used in clustering and community detection applications are sensitive to the specific graph constructions particularly when imbalanced clusters are present. We show that ratio cut (RCut) or normalized cut (NCut) objectives are not tailored to imbalanced cluster sizes sin…

2016-08-26abs ↗pdf ↗

Model for detecting rare labels in imbalanced crowdsourcing data.

problem Detecting rare labels in imbalanced crowdsourcing data.
method Generative aggregation model combining item difficulty and class-dependent annotator competence.
result Our model achieves the highest minority recall while maintaining competitive balanced accuracy.

NPC tackles class imbalance in datasets by progressively considering more neighbors.

problem Class imbalance in datasets causes poor performance in classification tasks.
method Inspired by k-NN, NPC progressively considers more neighbors and uses local-global grading.
result NPC outperforms five representative algorithms on fifteen imbalanced datasets.

Deep reinforcement learning improves classification accuracy for imbalanced datasets.

problem Imbalanced datasets challenge conventional classification algorithms.
method Formulated as a sequential decision-making process, solved using deep Q-learning network.
result Proposed model outperforms other imbalanced classification algorithms.

New method improves classification accuracy in imbalanced high-dimensional data.

problem Imbalanced classification in high-dimensional data.
method Data splitting and hard-thresholding rules for LDA.
result Proposed method reduces misclassification rates in minority class.

Study shows imbalanced labels can be beneficial but not always in class-imbalanced learning.

problem Challenges in class-imbalanced learning with heavy label bias.
method Systematic investigation of semi-supervised and self-supervised approaches to leverage imbalanced labels.
result Imbalanced labels are valuable in semi-supervised learning but not always in self-supervised learning.

Adaptive regularization tackles heteroskedastic and imbalanced datasets in deep learning.

problem Heteroskedastic and imbalanced datasets challenge deep learning due to varying label uncertainty and long-tailed label distributions.
method Data-dependent adaptive regularization that applies stronger regularization to higher-uncertainty, lower-density regions.
result Significant improvement in noise-robust deep learning over other methods on benchmark tasks.

A new BN method corrects size mismatch in WLF for imbalanced data.

problem Learning from imbalanced datasets in neural networks.
method Proposes weighted batch normalization (WBN) to correct size mismatch between BN and WLF.
result WBN corrects size mismatch and improves classification performance in imbalanced datasets.

A new graph-based sampling method improves classification of imbalanced COVID-19 datasets.

problem Classification of imbalanced COVID-19 datasets.
method Modified Random Walk Under-sampling based on graphs.
result The method increases the boundary of the minority class without raising outliers.