The performance of classification algorithms with a massive and highly imbalanced data stream depends upon efficient balancing strategy. Some techniques of balancing strategy have been applied in the past with Batch data to resolve the class imbalance problem. This paper proposes a new incremental data balancing framew…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “balancing techniques”
This paper explores how balancing and filtering techniques affect predictive multiplicity in machine learning models.
problem Predictive multiplicity due to Rashomon effect in high-stakes environments.
method Investigates the impact of balancing and filtering techniques on predictive multiplicity using 21 real-world datasets.
result Data-centric AI strategies can mitigate predictive multiplicity, but preprocessing methods may introduce it.
Study examines how balancing methods affect model behavior in imbalanced classification problems.
problem Impact of balancing methods on model behavior in imbalanced classification problems.
method Used Explainable Artificial Intelligence tools (variable importance method, partial dependence profile, accumulated local effects) to compare model behavior before and after balancing.
result Significant changes in model behavior due to balancing methods, leading to biased models.
BUDS balances privacy and utility by shuffling data, achieving strong privacy with minimal loss.
problem Balancing privacy and utility in crowd-sourced statistical databases.
method One-hot encoding, iterative shuffling, loss estimation, risk minimization.
result Achieves for privacy, maintaining a privacy bound of .
We introduce a new normalization technique that exhibits the fast convergence properties of batch normalization using a transformation of layer weights instead of layer outputs. The proposed technique keeps the contribution of positive and negative weights to the layer output balanced. We validate our method on a set o…
Recent sparse MRI reconstruction models have used Deep Neural Networks (DNNs) to reconstruct relatively high-quality images from highly undersampled k-space data, enabling much faster MRI scanning. However, these techniques sometimes struggle to reconstruct sharp images that preserve fine detail while maintaining a nat…
Compared to in-clinic balance training, in-home training is not as effective. This is, in part, due to the lack of feedback from physical therapists (PTs). Here, we analyze the feasibility of using trunk sway data and machine learning (ML) techniques to automatically evaluate balance, providing accurate assessments out…
A new sampling method balances imbalanced data using gamma distribution.
problem Imbalanced class distribution in data causes bias in classification algorithms.
method Intelligent resampling of minority class instances via gamma distribution.
result The proposed method outperforms existing techniques on 12 out of 24 datasets.
Lifelong learning is a very important step toward realizing robust autonomous artificial agents. Neural networks are the main engine of deep learning, which is the current state-of-the-art technique in formulating adaptive artificial intelligent systems. However, neural networks suffer from catastrophic forgetting when…
We establish a link between Archimedes' method of integration for calculating areas, volumes and centers of mass of segments of parabolas and quadrics of revolution by factorization via the moments of a balance and an integration technique for a particular integrable system, namely Bianchi's Bäcklund transformation for…
Existence of balanced embedding proved for complex manifold into infinite-dimensional space.
problem Balanced embedding of non-compact complex manifolds into infinite-dimensional projective space.
method Gradient flow in a Hilbert space, long-time existence established by perturbation, convergence depends on a priori bounds.
result Existence of balanced embedding proved in a model case.
Let X be a smooth subvariety of CP^N. We study a flow, called balancing flow, on the space of projectively equivalent embeddings of X, which attempts to deform the given embedding into a balanced one. If L->X is an ample line bundle, considering embeddings via H^0(L^k) gives a sequence of balancing flows. We prove that…
This paper optimizes revenue and resource balance in network revenue management.
problem Maximizing revenue while ensuring fair resource consumption across different suppliers.
method Introduces a regularized revenue objective and a primal-dual UCB algorithm for continuous prices and balancing.
result Achieves a worst-case regret of for revenue maximization and balancing.
This paper surveys various data balancing methods for imbalanced datasets.
problem Imbalanced datasets bias predictions and degrade classifier performance.
method Extensive review of oversampling, undersampling, adaptive, generative, combination, and ensemble methods.
result No single method universally outperforms others; selection depends on dataset characteristics.
A modified GAN improves thermal comfort classification models by balancing imbalanced datasets.
problem Imbalanced thermal comfort datasets make it hard to train accurate models.
method Proposed a modified conditional GAN (comfortGAN) to balance the dataset.
result A balanced dataset trained with comfortGAN yields higher classification accuracy.
Random Forest variable importance is improved by class balancing techniques.
problem Class imbalance problem in machine learning.
method Proposed a variable selection algorithm using RF variable importance and its confidence interval.
result Our algorithm efficiently selects an optimal feature set, leading to improved prediction performance.
The paper proposes a neural network method to estimate treatment effects by balancing treated and control distributions.
problem Estimating individual and average treatment effects from observational data.
method Balance regularization of multi-head neural network architectures to reduce confounding effects.
result The approach reduces bias-variance trade-off and improves treatment effect estimation.
Spectral Clustering as a relaxation of the normalized/ratio cut has become one of the standard graph-based clustering methods. Existing methods for the computation of multiple clusters, corresponding to a balanced -cut of the graph, are either based on greedy techniques or heuristics which have weak connection to th…
Mathematical understanding of detailed balance condition violation and its application to Langevin dynamicscond-mat.stat-mech
We develop an efficient sampling method by simulating Langevin dynamics with an artificial force rather than a natural force by using the gradient of the potential energy. The standard technique for sampling following the predetermined distribution such as the Gibbs-Boltzmann one is performed under the detailed balance…
This work improves policy-based training by proposing an evaluation balance objective for GFlowNets.
problem Reliable estimation of policy divergence under directed acyclic graphs remains challenging.
method Proposes an evaluation balance objective over partial episodes to measure policy divergence and improve policy-based training reliability.
result Evaluation balance strengthens policy-based training reliability and broadens its flexibility.
This study improves electricity price forecasting in the Irish balancing market.
problem Limited and inconsistent research on short-term price forecasting in volatile balancing markets.
method Compared statistical, machine learning, and deep learning models using a public dataset and framework.
result LEAR, a statistical approach, outperforms complex models in the balancing market.
SurvCaus improves survival CATE estimation using neural nets.
problem Estimating Individual Treatment Effects (ITE) in survival analysis.
method Representation balancing for counterfactual inference with neural networks.
result The proposed method outperforms baseline methods in synthetic and semisynthetic datasets.
Paper generalizes balanced metrics existence to singular cases using Quot-scheme limit.
problem Existence of balanced metrics and Gieseker stability of vector bundles.
method Quot-scheme limit of Fubini-Study metrics and Bergman 1-parameter subgroups.
result Existence of balanced metrics equivalent to Gieseker stability for singular cases.
The Synthetic Minority Oversampling TEchnique (SMOTE) is widely-used for the analysis of imbalanced datasets. It is known that SMOTE frequently over-generalizes the minority class, leading to misclassifications for the majority class, and effecting the overall balance of the model. In this article, we present an approa…
The paper analyzes systoles of complex projective spaces under various metrics.
problem Behavior of systoles in complex projective spaces for different metrics.
method Integral geometric techniques and careful analysis of systole functional.
result Balanced metrics locally minimize the systole on volume-normalized metrics.
sgboost reduces variable selection bias in boosting with balanced group selection.
problem Reduces variable selection bias in boosting algorithms.
method Simulation-based approach to balance selection frequencies of base-learners.
result Demonstrates efficacy through simulations and flexible group variable selection.
This work improves structured prediction by learning the balance between signal and random noise.
problem Structured prediction with random perturbations.
method Learning the variance of randomized structured predictors to balance signal and noise.
result Learning the balance improves structured prediction effectiveness.
Study improves detection of cryptocurrency pump-and-dump schemes.
problem Class imbalance in P&D detection due to rare events.
method Synthetic Minority Oversampling Technique (SMOTE) and ensemble learning models.
result XGBoost and LightGBM achieved high recall rates (94.87% and 93.59%) with strong F1-scores.
This research tackles balancing exploration and exploitation in deep RL for partially observable systems.
problem Balancing exploration and exploitation in deep RL for partially observable systems.
method Deployed and tested several techniques including adaptive and deterministic exploration strategies, and a modified quadratic loss function.
result Adaptive methods better approximate the trade-off between exploration and exploitation.
The hyperelliptic mapping class group has been studied in various contexts within topology and algebraic geometry. What makes this study tractable is that there is a surjective map from the hyperelliptic mapping class group to a mapping class group of a punctured sphere. The more general family of superelliptic mapping…
New deep learning method improves financial stress testing accuracy.
problem Traditional stress testing methods are criticized for unrealistic assumptions and estimation errors.
method Proposes a novel Deep Learning approach for Dynamic Balance Sheet Stress Testing.
result Empirical results show significant improvement in accuracy over traditional methods.
Novel technique reduces Bayesian network complexity while preserving inference accuracy.
problem Complexity reduction in Bayesian networks for efficient inference.
method Directed convex hull structure and polynomial-time algorithm for identifying minimum localized networks.
result High dimension reduction capability and improved inference efficiency in real networks.
New scalable method balances hospital profit status and heart attack outcomes.
problem Balancing covariate distributions and minimizing weight dispersion in large datasets.
method Combines kernel basis expansion and convex optimization for efficient and flexible weighting.
result For-profit hospitals use interventional cardiology similarly to other hospitals but have higher mortality and readmission rates.
This study introduces balanced DRPS and OrderedLogitNN for better QDE of discrete-level questions.
problem Lack of ordinal regression methods and fair evaluation metrics for discrete-level QDE.
method Introduces balanced DRPS and OrderedLogitNN, fine-tunes BERT on RACE++ and ARC datasets.
result OrderedLogitNN outperforms other models on complex QDE tasks.
Cyclic Data Parallelism reduces memory usage and balances gradient communications.
problem Training large deep learning models requires efficient parallelism to scale.
method Cyclic Data Parallelism shifts micro-batches from simultaneous to sequential execution, balancing memory and gradient communications.
result Cyclic Data Parallelism reduces total memory usage and balances gradient communications.
The paper proposes a method to precisely decompose confounders and estimate treatment effects.
problem Estimating treatment effects from observational data with confounder identification and balancing.
method Learning decomposed representations to identify and balance confounders and non-confounders.
result The method achieves more precise treatment effect estimation than existing methods.
Graph machine learning lacks a balanced theory, focusing on expressive power and optimization.
problem Insufficient theoretical understanding of GNNs' generalization behavior.
method Develop a balanced theory focusing on expressive power, generalization, and optimization.
result Theoretical advancements need to align with practical success in graph machine learning.
In this paper, we propose a novel technique to implement stochastic gradient methods, which are beneficial for learning from large datasets, through accelerated stochastic dynamics. A stochastic gradient method is based on mini-batch learning for reducing the computational cost when the amount of data is large. The sto…
Flashback Learning balances model stability and plasticity in continual learning.
problem Balancing model stability and plasticity in continual learning.
method Flashback Learning (FL) uses a bidirectional regularization approach to balance stability and plasticity.
result FL improves model accuracy by up to 4.91% in Class-Incremental and 3.51% in Task-Incremental settings.
In 2003, Ozsváth and Szabó defined the concordance invariant for knots in oriented 3-manifolds as part of the Heegaard Floer homology package. In 2011, Sarkar gave a combinatorial definition of for knots in and a combinatorial proof that gives a lower bound for the slice genus of a knot. Recently, Har…
New approach tackles class imbalance in long-tailed datasets using domain adaptation techniques.
problem Class imbalance in long-tailed datasets leading to poor model performance.
method Proposes a meta-learning approach to estimate differences between class-conditioned distributions.
result Validated approach on six benchmark datasets and three loss functions.
Class imbalance problem is commonly faced while developing machine learning models for real-life issues. Due to this problem, the fitted model tends to be biased towards the majority class data, which leads to lower precision, recall, AUC, F1, G-mean score. Several researches have been done to tackle this problem, most…
TV-SurvCaus improves causal inference for dynamic treatments in survival analysis.
problem Estimating causal effects of time-varying treatments on survival outcomes.
method Representation balancing techniques extended to time-varying treatment regimes with survival outcomes.
result TV-SurvCaus outperforms existing methods in estimating individualized treatment effects with time-varying covariates and treatments.
Traditionally, in supervised machine learning, (a significant) part of the available data (usually 50% to 80%) is used for training and the rest for validation. In many problems, however, the data is highly imbalanced in regard to different classes or does not have good coverage of the feasible data space which, in tur…
BOSS learns from one labeled sample per class to match fully supervised performance.
problem Achieving fully supervised performance with minimal labeled data.
method Combines class prototype refining, class balancing, and self-training.
result BOSS achieves comparable test accuracies to fully supervised learning.
Question classification (QC) is the primary step of the Question Answering (QA) system. Question Classification (QC) system classifies the questions in particular classes so that Question Answering (QA) System can provide correct answers for the questions. Our system categorizes the factoid type questions asked in natu…
We give a procedure for constructing an -dimensional HKT Lie algebra starting from a -dimensional one by using a quaternionic representation of the latter. The strong (respectively, weak, hyper-Kähler, balanced) condition is preserved by our construction. As an application of our results we obtain a new compact…
Less Discriminatory Alternative and Interpretable XGBoost Framework for Binary Classificationstat.ML
LDA-XGB1 balances fairness and accuracy in lending models.
problem Fair lending practices and model interpretability in binary classification.
method Biobjective optimization using binning and information value, leveraging XGBoost.
result Achieves effective balance between accuracy, fairness, and interpretability.