Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

155309464618 · Jun 202019922001200920172026
48 results for balanced datasets

Study constructs balanced datasets for seismic failure prediction.

problem Imbalanced datasets limit machine learning performance in seismic failure prediction.
method Framework with three steps: GMF identification, probability density estimation, and sample transformation.
result Framework improves machine learning performance in seismic failure mode prediction.

Study examines how balancing methods affect model behavior in imbalanced classification problems.

problem Impact of balancing methods on model behavior in imbalanced classification problems.
method Used Explainable Artificial Intelligence tools (variable importance method, partial dependence profile, accumulated local effects) to compare model behavior before and after balancing.
result Significant changes in model behavior due to balancing methods, leading to biased models.

Paper proposes a new autoencoder metric for balanced learning in imbalanced tabular datasets.

problem Challenges of imbalanced self-supervised learning in tabular data.
method Developed a Multi-Supervised Balanced MSE metric to balance learning.
result The new metric outperforms standard MSE in imbalanced datasets.

Paper proposes ARB-Loss to improve classification precision in imbalanced datasets.

problem Improving classification precision on minor classes in imbalanced datasets.
method Introduces Attraction-Repulsion-Balanced Loss (ARB-Loss) to balance gradients across different classes.
result ARB-Loss achieves state-of-the-art performance with one-stage training.

This study improves electricity price forecasting in the Irish balancing market.

problem Limited and inconsistent research on short-term price forecasting in volatile balancing markets.
method Compared statistical, machine learning, and deep learning models using a public dataset and framework.
result LEAR, a statistical approach, outperforms complex models in the balancing market.

New approach tackles class imbalance in long-tailed datasets using domain adaptation techniques.

problem Class imbalance in long-tailed datasets leading to poor model performance.
method Proposes a meta-learning approach to estimate differences between class-conditioned distributions.
result Validated approach on six benchmark datasets and three loss functions.

New scalable method balances hospital profit status and heart attack outcomes.

problem Balancing covariate distributions and minimizing weight dispersion in large datasets.
method Combines kernel basis expansion and convex optimization for efficient and flexible weighting.
result For-profit hospitals use interventional cardiology similarly to other hospitals but have higher mortality and readmission rates.

Study reveals class disparities in balanced datasets through spectral imbalance.

problem Class disparities in balanced datasets are overlooked despite model performance gaps.
method Developed a theoretical framework and studied 11 encoders to diagnose spectral imbalance.
result Identified spectral imbalance as a source of class disparities in balanced datasets.

Balanced Activation improves object detection performance on long-tailed datasets.

problem Mismatch between training and testing label distributions in object detection.
method Introduces Balanced Activation (Balanced Softmax and Balanced Sigmoid) to address label distribution shift.
result Balanced Activation provides ~3% gain in mAP on LVIS-1.0 compared to state-of-the-art methods.

Image classification datasets are often imbalanced, characteristic that negatively affects the accuracy of deep-learning classifiers. In this work we propose balancing GAN (BAGAN) as an augmentation tool to restore balance in imbalanced datasets. This is challenging because the few minority-class images may not be enou…

2018-03-26abs ↗pdf ↗

This paper explores how balancing and filtering techniques affect predictive multiplicity in machine learning models.

problem Predictive multiplicity due to Rashomon effect in high-stakes environments.
method Investigates the impact of balancing and filtering techniques on predictive multiplicity using 21 real-world datasets.
result Data-centric AI strategies can mitigate predictive multiplicity, but preprocessing methods may introduce it.

This paper surveys various data balancing methods for imbalanced datasets.

problem Imbalanced datasets bias predictions and degrade classifier performance.
method Extensive review of oversampling, undersampling, adaptive, generative, combination, and ensemble methods.
result No single method universally outperforms others; selection depends on dataset characteristics.

The Synthetic Minority Oversampling TEchnique (SMOTE) is widely-used for the analysis of imbalanced datasets. It is known that SMOTE frequently over-generalizes the minority class, leading to misclassifications for the majority class, and effecting the overall balance of the model. In this article, we present an approa…

2019-08-22abs ↗pdf ↗

Contextual bandit algorithms are sensitive to the estimation method of the outcome model as well as the exploration method used, particularly in the presence of rich heterogeneity or complex outcome models, which can lead to difficult estimation problems along the path of learning. We develop algorithms for contextual …

2018-12-15abs ↗pdf ↗

Neural score matching improves high-dimensional causal inference by using neural networks for balancing scores.

problem Impracticality of traditional matching methods in high-dimensional datasets due to the curse of dimensionality.
method Develops neural networks to create non-trivial, multivariate balancing scores for high-dimensional causal inference.
result Neural score matching outperforms other methods in treatment effect estimation and reducing imbalance on high-dimensional datasets.

LDA-XGB1 balances fairness and accuracy in lending models.

problem Fair lending practices and model interpretability in binary classification.
method Biobjective optimization using binning and information value, leveraging XGBoost.
result Achieves effective balance between accuracy, fairness, and interpretability.

Dynamic information balancing reduces catastrophic forgetting in modular neural networks.

problem Catastrophic forgetting in neural networks when learning multiple tasks.
method Dynamic Information Balancing (DIB) using reinforcement learning to adaptively route inputs based on module information load.
result DIB combined with EWC regularization outperforms models with similar capacity and EWC regularization.

MCNet improves uncertainty calibration in online advertising by modeling complex relations and balancing performance.

problem Lack of effective calibration for complex relations and context features in online advertising.
method Introduces MCNet with MCF, order-preserving, and field-balance regularizers.
result Superior performance in generating well-calibrated probability predictions on public and industrial datasets.

Transfer learning improves lensless imaging through scattering media with fewer samples.

problem Training deep neural networks (DNNs) for lensless imaging through scattering media requires large datasets, leading to poor cross-dataset performance.
method Proposed transfer learning approach using LISMU-FCN and LISMU-OCN architectures with a balance loss function.
result Transfer learning enables imaging across similar and significantly different datasets with fewer samples.

In graph-based active learning, algorithms based on expected error minimization (EEM) have been popular and yield good empirical performance. The exact computation of EEM optimally balances exploration and exploitation. In practice, however, EEM-based algorithms employ various approximations due to the computational ha…

2016-09-03abs ↗pdf ↗

Study shows pre-trained models can handle long-tailed relations well, improving classifier performance.

problem Challenges in long-tailed relation classification due to class imbalance.
method Used instance-balanced sampling to pre-train models and then improved classifier performance through attentive relation routing.
result Robust classifier with attentive relation routing achieves better long-tailed classification ability.

This work studies the impact of intra-/inter-class diversity on pre-training datasets and finds a balance for optimal performance.

problem The impact of intra-/inter-class diversity on supervised pre-training datasets and their effect on downstream tasks.
method Empirical study and theoretical analysis of the relationship between diversity types and downstream performance.
result The optimal class-to-sample ratio is invariant to the size of the pre-training dataset and can be predicted.

Proposes a novel neural network method to estimate average treatment effect.

problem Bias in estimating average treatment effect due to confounding and instrumental variables.
method Self-balancing neural network (Sbnet) that estimates pseudo propensity scores and average treatment effect in one step.
result Proposed method outperforms state-of-the-art methods in simulations and real-world datasets.

New method improves object detection models for long-tailed datasets.

problem Classifier imbalance in long-tail object detection datasets.
method Balanced Group Softmax (BAGS) module for balanced training of classifiers.
result Significantly improves performance of object detection models.

New deep learning method improves financial stress testing accuracy.

problem Traditional stress testing methods are criticized for unrealistic assumptions and estimation errors.
method Proposes a novel Deep Learning approach for Dynamic Balance Sheet Stress Testing.
result Empirical results show significant improvement in accuracy over traditional methods.

TKIL improves class-balanced performance in incremental learning.

problem Catastrophic forgetting in sequential learning tasks.
method Introduces Tangent Kernel for Incremental Learning (TKIL) based on Neural Tangent Kernel (NTK).
result TKIL achieves better overall accuracy and variance across classes.

Novel characterization of augmented balancing weights combining outcome and weighting models.

problem Improving estimation accuracy in machine learning models with balancing weights.
method Characterization of augmented balancing weights as linear models, extending to ridge and lasso regression.
result Equivalence and closed-form expressions for specific model choices, providing insights into performance.

A new algorithm balances fairness in clustering to avoid discrimination.

problem Clustering data can unfairly discriminate against different demographic groups.
method Designing a stochastic alternating balance fair k-means algorithm (SAfairKM) that alternates between k-means updates and group swap updates.
result The algorithm efficiently constructs well-spread and high-quality Pareto fronts on synthetic and real datasets.

Doubly robust self-training improves semi-supervised learning by balancing labeled and pseudo-labeled data.

problem Improving semi-supervised learning performance with limited labeled data.
method Introduces doubly robust self-training, a method that combines labeled and pseudo-labeled data to balance between labeled-only and pseudo-labeled-only training.
result Demonstrates superior performance of doubly robust self-training on ImageNet and nuScenes datasets.

Unsupervised domain adaptation seeks to learn an invariant and discriminative representation for an unlabeled target domain by leveraging the information of a labeled source dataset. We propose to improve the discriminative ability of the target domain representation by simultaneously learning tightly clustered target …

2019-05-30abs ↗pdf ↗