The performance of classification algorithms with a massive and highly imbalanced data stream depends upon efficient balancing strategy. Some techniques of balancing strategy have been applied in the past with Batch data to resolve the class imbalance problem. This paper proposes a new incremental data balancing framew…
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
New method detects bearing faults using multivariate statistical process control.
Develops a method to quantify racial bias in law enforcement systems.
Proposes FMC for fair clustering with independent parameters.
Develops a learning model predictive controller for competitive racing.
Modeling horse race betting odds with Ornstein-Uhlenbeck process.
Deep RL drone trained to compete against classical path planning in drone racing.
PAC best arm identification with a deadline, improving efficiency over sequential methods.
DeepRacing uses neural networks to predict trajectories for autonomous racing in video games.
To answer questions about racial inequality and fairness, we often need a way to infer race and ethnicity from names. One way to infer race and ethnicity from names is by relying on the Census Bureau's list of popular last names. The list, however, suffers from at least three limitations: 1. it only contains last names…
Black women and white men have the highest income disparity in the U.S.
Societal bias towards certain communities is a big problem that affects a lot of machine learning systems. This work aims at addressing the racial bias present in many modern gender recognition systems. We learn race invariant representations of human faces with an adversarially trained autoencoder model. We show that …
Improved race prediction model outperforms existing methods.
RankNet forecasts car racing positions with improved accuracy and stability.
Improved surname geocoding and name supplements enhance race imputation accuracy.
BBE simulates sports betting exchanges for data generation.
A new model predicts race places using changeover-times and log-normal distributions.
We propose Lomax delegate racing (LDR) to explicitly model the mechanism of survival under competing risks and to interpret how the covariates accelerate or decelerate the time to event. LDR explains non-monotonic covariate effects by racing a potentially infinite number of sub-risks, and consequently relaxes the ubiqu…
New analysis shows rational actors will deploy AGI despite negative social value due to catastrophic risk.
This work improves autonomous racing by creating diverse opponents and adapting risk.
This short note is intended as a "Letter to the Editor" Perspective in order that it serves as a contribution, in view of reaching the physics community caring about rare events and scaling laws and unexpected findings, on a domain of wide interest: sport and money. It is apparent from the data reported and discussed b…
In this paper, we consider the problem of predicting demographics of geographic units given geotagged Tweets that are composed within these units. Traditional survey methods that offer demographics estimates are usually limited in terms of geographic resolution, geographic boundaries, and time intervals. Thus, it would…
We find a remarkable agreement between the statistics of a randomly divided interval and the observed statistical patterns and distributions found in horse racing betting markets. We compare the distribution of implied winning odds, the average true winning probabilities, the implied odds conditional on a win, and the …
A deep RL approach generates counterfactual instances efficiently.
Assessing the fairness of a decision making system with respect to a protected class, such as gender or race, is challenging when class membership labels are unavailable. Probabilistic models for predicting the protected class based on observable proxies, such as surname and geolocation for race, are sometimes used to …
Study removes bias from chest X-ray embeddings using orthogonalization.
New approach to counterfactual reasoning avoids demographic interventions.
China and EU race to develop hydrogen for energy transition.
Understanding and modeling human driver behavior is crucial for advanced vehicle development. However, unique driving styles, inconsistent behavior, and complex decision processes render it a challenging task, and existing approaches often lack variability or robustness. To approach this problem, we propose Probabilist…
BBE simulates betting exchanges to generate synthetic data for AI research.
In the automation of many kinds of processes, the observable outcome can often be described as the combined effect of an entire sequence of actions, or controls, applied throughout its execution. In these cases, strategies to optimise control policies for individual stages of the process might not be applicable, and in…
This note examines financial distributions to competing teams at the end of the most famous multiple stage professional (male) bicyclist race, TOUR DE FRANCE. A rank-size law (RSL) is calculated for the team financial gains. The RSL is found to be hyperbolic with a surprisingly simple decay exponent (about equal to -1)…
Predictive modeling is increasingly being employed to assist human decision-makers. One purported advantage of replacing human judgment with computer models in high stakes settings-- such as sentencing, hiring, policing, college admissions, and parole decisions-- is the perceived "neutrality" of computers. It is argued…
Investigates sports betting strategies using modern portfolio theory and Kelly criterion.
"Overlearning" means that a model trained for a seemingly simple objective implicitly learns to recognize attributes and concepts that are (1) not part of the learning objective, and (2) sensitive from a privacy or bias perspective. For example, a binary gender classifier of facial images also learns to recognize races…
Paper debiases multiple word embedding biases simultaneously.
Despite their impressive performance on diverse tasks, neural networks fail catastrophically in the presence of adversarial inputs---imperceptibly but adversarially perturbed versions of natural inputs. We have witnessed an arms race between defenders who attempt to train robust networks and attackers who try to constr…
fairadapt uses causal inference to mitigate algorithmic bias in data pre-processing.
This paper presents first steps toward robust models for crisis prediction. We conduct a horse race of conventional statistical methods and more recent machine learning methods as early-warning models. As individual models are in the literature most often built in isolation of other methods, the exercise is of high rel…
Ordinal regression falls between discrete-valued classification and continuous-valued regression. Ordinal target variables can be associated with ranked random variables. These random variables are known as order statistics and they are closely related to ordinal regression. However, the challenge of using order statis…
New research shows many batch selection methods for training work just as well as full batch training.
Determining the appropriate batch size for mini-batch gradient descent is always time consuming as it often relies on grid search. This paper considers a resizable mini-batch gradient descent (RMGD) algorithm based on a multi-armed bandit for achieving best performance in grid search by selecting an appropriate batch s…
We analyze how batch learning impacts bandit problems.
Ensemble Kalman methods improve climate model calibration from noisy observations.
Machine learning outperforms crowd investors in predicting loan defaults and investment returns.
BatchGFN uses generative flow networks for efficient batch active learning.
Adaptive batch sizes improve active learning efficiency and flexibility.
A new method assesses algorithmic fairness using game theory.