Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

108215323430 · Jun 202019922001200920172026
48 results for evaluation balance

This work improves policy-based training by proposing an evaluation balance objective for GFlowNets.

problem Reliable estimation of policy divergence under directed acyclic graphs remains challenging.
method Proposes an evaluation balance objective over partial episodes to measure policy divergence and improve policy-based training reliability.
result Evaluation balance strengthens policy-based training reliability and broadens its flexibility.

Compared to in-clinic balance training, in-home training is not as effective. This is, in part, due to the lack of feedback from physical therapists (PTs). Here, we analyze the feasibility of using trunk sway data and machine learning (ML) techniques to automatically evaluate balance, providing accurate assessments out…

2019-06-07abs ↗pdf ↗

We present a new approach to the problems of evaluating and learning personalized decision policies from observational data of past contexts, decisions, and outcomes. Only the outcome of the enacted decision is available and the historical policy is unknown. These problems arise in personalized medicine using electroni…

2017-05-21abs ↗pdf ↗

Evaluating novel contextual bandit policies using logged data is crucial in applications where exploration is costly, such as medicine. But it usually relies on the assumption of no unobserved confounders, which is bound to fail in practice. We study the question of policy evaluation when we instead have proxies for th…

2019-08-06abs ↗pdf ↗

Estimation of importance sampling weights for off-policy evaluation of contextual bandits often results in imbalance - a mismatch between the desired and the actual distribution of state-action pairs after weighting. In this work we present balanced off-policy evaluation (B-OPE), a generic method for estimating weights…

2019-06-09abs ↗pdf ↗

We study the problem of off-policy policy evaluation (OPPE) in RL. In contrast to prior work, we consider how to estimate both the individual policy value and average policy value accurately. We draw inspiration from recent work in causal reasoning, and propose a new finite sample generalization error bound for value e…

2018-05-23abs ↗pdf ↗

This review analyzes deep learning methods for electricity price forecasting across different markets.

problem Insufficient analysis of deep learning methods in electricity price forecasting.
method Unified taxonomy of deep learning components, analysis of trends across markets.
result Shift toward probabilistic, microstructure-centric, and market-aware designs.

This study introduces balanced DRPS and OrderedLogitNN for better QDE of discrete-level questions.

problem Lack of ordinal regression methods and fair evaluation metrics for discrete-level QDE.
method Introduces balanced DRPS and OrderedLogitNN, fine-tunes BERT on RACE++ and ARC datasets.
result OrderedLogitNN outperforms other models on complex QDE tasks.

BICauseTree improves causal effect estimation by identifying clusters and balancing treatment allocation.

problem Improving interpretability and transparency in causal effect models from observational data.
method Hierarchical bias-driven stratification using decision trees with a customized objective function.
result BICauseTree provides interpretable causal effect estimation and is comparable to existing methods.

SVM used for estimating treatment effects without confounding.

problem Estimating average treatment effects in the presence of confounding variables.
method Adapts SVM classifier as a kernel-based weighting procedure to balance covariates and estimate causal effects.
result SVM provides a continuous relaxation of the quadratic integer program for balancing covariates and maximizing effective sample size.

Variational inference improves training of generative flow networks.

problem Training generative flow networks efficiently and accurately.
method Define variational objectives in terms of KL divergences and optimize convex combinations.
result Variational inference methods can reduce the variance of gradients in training generative flow networks.

Automates debiasing for large language model evaluations through Fisher random walk.

problem Rigorous and scalable evaluation of large language models.
method Semiparametric efficient estimator using Fisher random walk for weighted residual balancing.
result Efficient estimation of contextual preference scores for large language models.

Study constructs balanced datasets for seismic failure prediction.

problem Imbalanced datasets limit machine learning performance in seismic failure prediction.
method Framework with three steps: GMF identification, probability density estimation, and sample transformation.
result Framework improves machine learning performance in seismic failure mode prediction.

Study tackles OPE in confounded settings, estimating policy value from proxies.

problem Difficulty in OPE due to unobserved confounders in infinite-horizon RL.
method Two-stage approach: estimating stationary distribution ratios and combining optimal balancing.
result Policy value can be identified from off-policy data with proxies and latent variable model.

We present a method for performing Hamiltonian Monte Carlo that largely eliminates sample rejection for typical hyperparameters. In situations that would normally lead to rejection, instead a longer trajectory is computed until a new state is reached that can be accepted. This is achieved using Markov chain transitions…

2014-09-18abs ↗pdf ↗

Progress in machine learning is measured by careful evaluation on problems of outstanding common interest. However, the proliferation of benchmark suites and environments, adversarial attacks, and other complications has diluted the basic evaluation model by overwhelming researchers with choices. Deliberate or accident…

2018-06-07abs ↗pdf ↗

This paper visualizes uncertainty in classifier performance metrics.

problem Overemphasis on model performance metrics risks overlooking uncertainty.
method Developed visualizations of confusion matrix metric distributions.
result Uncertainty in performance metrics can overshadow model differences.

C-t3t^3VAE improves class representation in long-tailed generative models.

problem Latent geometric bias in VAEs under class imbalance.
method Per-class Student's t-distribution priors, closed-form objective, equal-weight latent mixture.
result Consistently lower FID scores and better class-balanced generation for severely imbalanced datasets.

CAT framework improves AI medical screening fairness and reliability.

problem Imbalanced data, varying performance across cohorts, and patient-level inconsistencies in traditional metrics.
method CAT framework introduces patient-level assessment, entropy-based distribution weighting, and cohort-weighted sensitivity and specificity.
result Enhanced predictive reliability, fairness, and interpretability of AI-driven medical screening models.

The paper addresses classification imbalance by framing it as a transfer learning problem.

problem Classification imbalance where one class is much rarer than the other.
method The paper studies oversampling procedures to balance classes, focusing on SMOTE and bootstrapping.
result The excess risk decomposes into balanced training rate and transfer cost, with SMOTE having a higher transfer cost.

Transfer learning has achieved promising results by leveraging knowledge from the source domain to annotate the target domain which has few or none labels. Existing methods often seek to minimize the distribution divergence between domains, such as the marginal distribution, the conditional distribution or both. Howeve…

2018-07-02abs ↗pdf ↗

Study reveals class disparities in balanced datasets through spectral imbalance.

problem Class disparities in balanced datasets are overlooked despite model performance gaps.
method Developed a theoretical framework and studied 11 encoders to diagnose spectral imbalance.
result Identified spectral imbalance as a source of class disparities in balanced datasets.

TAET tackles long-tailed distributions in adversarial robustness.

problem Long-tailed distributions complicate adversarial robustness in real-world applications.
method TAET integrates an initial stabilization phase followed by a stratified equalization adversarial training phase.
result TAET achieves significant improvements in robustness and efficiency.

Paper optimizes internal balancing of wind and hydropower to reduce intraday market volatility.

problem Reduction of intraday market volatility for power producers with wind and hydropower assets.
method Internal balancing within the same river system and sales/purchase in a pay-as-bid intraday market.
result Reduction in short-term marginal cost and risk through internal balancing.

This paper evaluates fairness in deep metric learning and proposes a method to reduce subgroup performance gaps.

problem The negative impact of deep metric learning representations on minority subgroup performance in downstream tasks.
method Definition of fairness in DML through inter-class, intra-class, and uniformity properties; finDML benchmark; Partial Attribute De-correlation (PARADE) method.
result Bias in DML representations propagates to downstream tasks, even with balanced training data.

BOSS learns from one labeled sample per class to match fully supervised performance.

problem Achieving fully supervised performance with minimal labeled data.
method Combines class prototype refining, class balancing, and self-training.
result BOSS achieves comparable test accuracies to fully supervised learning.

DeepSphere improves spherical CNNs by balancing efficiency and rotation equivariance.

problem Designing efficient and rotation-equivariant convolutional layers for spherical data.
method Graph-based approach to represent spherical data, focusing on the number of vertices and neighbors.
result DeepSphere achieves state-of-the-art performance and demonstrates efficiency and flexibility.

We develop a computationally efficient method to estimate Ollivier-Ricci curvature.

problem Computational infeasibility of evaluating Ollivier-Ricci curvature on large graphs.
method Derive explicit transfer moduli between OR and BF curvatures, construct lazy transport envelopes, and use cross-edge matching.
result Deterministic bounds for OR curvature parameterized by local graph combinatorics, reducing complexity to worst-case O(max_v deg(v)^1.5).

LP-FT improves personalized model training in FL by balancing generalization and personalization.

problem Federated Learning struggles with balancing global generalization and local personalization due to non-identical data distributions.
method Adapting Linear Probing followed by full Fine-Tuning (LP-FT) to the FL setting.
result LP-FT outperforms standard fine-tuning in balancing personalization and generalization across various datasets and PFT variants.

This paper surveys various data balancing methods for imbalanced datasets.

problem Imbalanced datasets bias predictions and degrade classifier performance.
method Extensive review of oversampling, undersampling, adaptive, generative, combination, and ensemble methods.
result No single method universally outperforms others; selection depends on dataset characteristics.

FSRM method improves treatment effect estimation from observational data.

problem Estimating treatment effects from observational data with missing counterfactual outcomes and selection bias.
method FSRM method based on deep representation learning and matching, which maps covariate space into a selective, nonlinear, and balanced representation space.
result FSRM method outperforms state-of-the-art methods in estimating treatment effects.

A new reward shaping method balances learning efficiency and effectiveness for robot manipulation.

problem Efficient and effective learning in robot manipulations with system uncertainty.
method Dense2Sparse reward shaping method combining dense and sparse rewards.
result Dense2Sparse method achieves higher expected reward and better system uncertainty tolerance.

LDA-XGB1 balances fairness and accuracy in lending models.

problem Fair lending practices and model interpretability in binary classification.
method Biobjective optimization using binning and information value, leveraging XGBoost.
result Achieves effective balance between accuracy, fairness, and interpretability.

Weather2vec learns representations to adjust for non-local confounding in air pollution studies.

problem Non-local confounding in evaluating environmental policies and climate events on health outcomes.
method weather2vec framework using balancing scores to learn representations of non-local information.
result The framework effectively adjusts for confounding in air pollution studies.