Study finds option volume imbalance predicts equity market returns.
problem Predicting equity market returns using option volume imbalance.
method Nonlinear analysis of option volumes decomposed into five market participant classes.
result Strong signals of predictability of excess market returns from Market-Maker volumes.
The paper introduces a new price model based on entropy that better fits high-frequency market data.
problem Understanding fair prices in high-frequency markets with bid-ask imbalance.
method A parametrized family of prices derived from the Maximum Entropy Principle, minimizing bias given volume imbalance.
result The model can generate higher kurtosis and heavy-tailed distributions compared to standard models.
A novel probabilistic approach forecasts imbalance prices in Belgium.
problem Forecasting imbalance prices in short-term energy markets.
method Two-step approach: compute net regulation volume state transition probabilities, then infer imbalance prices.
result The probabilistic approach outperforms deterministic and Gaussian Process models.
Study reveals optimal price prediction through volume imbalance analysis.
problem Understanding the relationship between prices and volume imbalance in high-frequency trading.
method Developed a market-making model to analyze price-imbalance connection and solve optimization problems.
result Optimal quoting of predictive imbalance is confirmed, useful for financial regulation.
We study the price impact of order book events - limit orders, market orders and cancelations - using the NYSE TAQ data for 50 U.S. stocks. We show that, over short time intervals, price changes are mainly driven by the order flow imbalance, defined as the imbalance between supply and demand at the best bid and ask pri…
New framework explains market volatility and metaorder impact.
problem Reconciling contradictory observations in market microstructure.
method Introducing a new theoretical framework to describe metaorders with different signs, sizes, and durations.
result Price diffusion is ensured by long memory of cross-correlations between metaorders.
Study uses deep learning to predict asset prices, finds complex target processes lead to meaningless predictions.
problem Complexity of successful price prediction models hinders understanding.
method Deep learning models for high-frequency price prediction, focusing on volatility and directional prediction.
result Inadequately defined target price process renders predictions meaningless.
Accurate volume segmentation from the Computed Tomography (CT) scan is a common prerequisite for pre-operative planning, intra-operative guidance and quantitative assessment of therapeutic outcomes in robot-assisted Minimally Invasive Surgery (MIS). 3D Deep Convolutional Neural Network (DCNN) is a viable solution for t…
A dynamic herding model with interactions of trading volumes is introduced. At time t, an agent trades with a probability, which depends on the ratio of the total trading volume at time t−1 to its own trading volume at its last trade. The price return is determined by the volume imbalance and number of trades. The …
We first investigate the evolution of opening and closing auctions volumes of US equities along the years. We then report dynamical properties of pre-auction periods: the indicative match price is strongly mean-reverting because the imbalance is; the final auction price reacts to a single auction order placement or can…
Motivated by the literature on investment flows and optimal trading, we examine intraday predictability in the cross-section of stock returns. We find a striking pattern of return continuation at half-hour intervals that are exact multiples of a trading day, and this effect lasts for at least 40 trading days. Volume, o…
We empirically analyze the price and liquidity responses to trade signs, traded volumes and signed traded volumes. Utilizing the singular value decomposition, we explore the interconnections of price responses and of liquidity responses across the whole market. The statistical characteristics of their singular vectors …
LSVM with EBT reduces quasar detection errors by 10x.
problem Rare quasar detection in astronomy with high cost of misclassification.
method Linear Support Vector Machine (LSVM) with Ensemble Bagged Trees (EBT) and Learning from Mistakes.
result 10x reduction in False Negative Rate for quasar detection.
We investigate how the local fluctuations of the signed traded volumes affect the dependence of demands between stocks. We analyze the empirical dependence of demands using copulas and show that they are well described by a bivariate K copula density function. We find that large local fluctuations strongly …
Thousands of cryptocurrencies have been issued and publicly exchanged since Bitcoin was invented in 2008. The total cryptocurrency market value exceeds 300 billion US dollars as of 2019. This paper analyzes the prices, volumes, blockchain transactions, coin difficulties and public opinion popularities of 3607 actively …
We investigate the behavior of limit order books on the meso-scale motivated by order execution scheduling algorithms. To do so we carry out empirical analysis of the order flows from market and limit order submissions, aggregated from tick-by-tick data via volume-based bucketing, as well as various LOB depth and shape…
Deep learning shows ETF imbalances are more informative than market imbalances.
problem Determining causality between ETF and market imbalances.
method Deep learning econometric methodology applied to stock and ETF transactions.
result ETF imbalance messages are more informative than market imbalance messages.
Improved stock price prediction model using generalized order flow imbalance.
problem Improving stock price prediction models using new order flow imbalance indicators.
method Proposed a generalized order flow imbalance construction method and applied it to CSI 500 stocks.
result Generalized Stationarized Order Flow Imbalance (log-GOFI) shows significant improvement in explaining stock price changes.
SVR-Tree improves classification trees for imbalanced and sparse data.
problem Classification difficulties in imbalanced and sparse data.
method Proposes SVR-Tree, penalizing the Surface-to-Volume Ratio of decision sets.
result SVR-Tree improves generalization error compared to other imbalance algorithms.
This paper examines biases in foundation models under long-tailed data and proposes a method to mitigate parameter imbalance.
problem The bias introduced by imbalanced training data in foundation models affects long-tailed downstream tasks.
method The paper examines parameter imbalance and data imbalance, proposing a backdoor adjustment method to mitigate parameter imbalance.
result An average performance increase of about 1.67% on each dataset.
Recent studies have shown that imbalance ratio is not the only cause of the performance loss of a classifier in imbalanced data classification. In fact, other data factors, such as small disjuncts, noises and overlapping, also play the roles in tandem with imbalance ratio, which makes the problem difficult. Thus far, t…
Method detects anomalies on attributed graphs with few labeled instances.
problem Detecting anomalies on connected instances (attributed graphs) with limited labeled data.
method Embed nodes in latent space using GCNs, training to distinguish normal and anomalous nodes.
result Method outperforms existing methods on real-world attributed graph datasets.
We investigate the probability distribution of order imbalance calculated from the order flow data of 43 Chinese stocks traded on the Shenzhen Stock Exchange. Two definitions of order imbalance are considered based on the order number and the order size. We find that the order imbalance distributions of individual stoc…
This chapter tackles class imbalance in datasets to promote data democracy.
problem Class imbalance in datasets leading to biased decisions and policies.
method Statistical measures and data-level methods (oversampling, undersampling, etc.) applied to a real dataset.
result Popular data-level methods improve performance in handling class imbalance.
We analyze anomaly detection class imbalance using a solvable model.
problem Class imbalance hampers anomaly detection performance.
method We use an exact solution of the teacher-student perceptron model through replica theory.
result Optimal train imbalance is often different from 50%, influenced by intrinsic imbalance and data abundance.
Theoretical and empirical taxonomy of imbalance in binary classification.
problem Class imbalance degrades binary classification performance.
method Proposed a principled framework based on three scales: imbalance coefficient, sample-dimension ratio, and intrinsic separability. Derived closed-form Bayes errors and analyzed degradation across models.
result The triplet (η, κ, Δ) provides a model-agnostic explanation of imbalance-induced deterioration.
Proposes methods to improve multi-label learning by addressing local label imbalance.
problem Local label imbalance within minority class examples degrades multi-label learning performance.
method Introduces a measure to assess local label imbalance and two sampling approaches (MLSOL, MLUL) to address it.
result Experimental results show MLSOL and MLUL improve performance on multi-label datasets.
We propose a model for price formation in financial markets based on clearing of a standard call auction with random orders, and verify its validity for prediction of the daily closing price distribution statistically. The model considers random buy and sell orders, placed following demand- and supply-side valuation di…
Online class imbalance learning constitutes a new problem and an emerging research topic that focusses on the challenges of online learning under class imbalance and concept drift. Class imbalance deals with data streams that have very skewed distributions while concept drift deals with changes in the class imbalance s…
Modeling price dynamics in response to order flow imbalance in Chinese futures markets.
problem Understanding price dynamics in markets with order flow imbalance.
method Modeling order flow imbalance as an Ornstein-Uhlenbeck process with memory and mean-reverting characteristics.
result Horizon-dependent heterogeneity in conventional metrics' interaction with order flow imbalance.
Without any specific way for imbalance data classification, artificial intelligence algorithm cannot recognize data from minority classes easily. In general, modifying the existing algorithm by assuming that the training data is imbalanced, is the only way to handle imbalance data. However, for a normal data handling, …
The study examines how class imbalance impacts logistic regression models in low-default credit portfolios.
problem The impact of class imbalance on logistic regression models in low-default credit portfolios.
method Simulation study with controlled data-generating mechanisms to vary class imbalance and predictor-response association strength.
result Classification accuracy decreases significantly as event rate decreases, and optimal cut-off shifts with imbalance.
New method addresses class imbalance in federated learning.
problem Class imbalance in federated learning training data.
method Proposes a monitoring scheme to infer training data composition and a new loss function, Ratio Loss, to mitigate imbalance.
result Demonstrates effectiveness in mitigating class imbalance in federated learning, outperforming previous methods.
The study analyzes trading imbalances from SEC Form 13F-HR filings to identify profitable trading opportunities.
problem Identifying profitable trading opportunities based on SEC Form 13F-HR filings.
method Statistical analysis of holdings variations and imbalances between consecutive reporting periods.
result A profitable trading strategy can be implemented by betting against the sign of imbalances with a 1-2 month time horizon.
Analysis shows data imbalance slows learning curves for minority and majority classes.
problem Data imbalance impacts learning dynamics and model performance.
method Theoretical analysis of GD and SGD, including per-class normalization.
result Data imbalance causes sub-optimal learning trajectories for minority and majority classes.
AREBA algorithm improves learning from imbalanced, nonstationary data.
problem Learning from imbalanced, nonstationary data in online settings.
method Adaptive REBAlancing (AREBA) algorithm that selectively includes examples to maintain class balance.
result AREBA significantly outperforms other algorithms in learning speed and quality.
Study characterizes and mitigates imbalances in neurosymbolic learning.
problem Characterizing and mitigating class-specific risks in neural classifiers.
method Theoretical analysis and practical techniques including estimating marginal gold labels and mitigating imbalances at training and testing time.
result Learning imbalances can be greatly impacted by the symbolic component σ, unlike in supervised and weakly supervised learning.
Many real-world classification problems are significantly class-imbalanced to detriment of the class of interest. The standard set of proper evaluation metrics is well-known but the usual assumption is that the test dataset imbalance equals the real-world imbalance. In practice, this assumption is often broken for vari…
A novel approach reduces class imbalance in network traffic classification.
problem Severe class imbalance in network traffic leads to poor classification performance.
method Group & Reweight strategy: clusters classes, updates weights, optimizes model.
result Improves comprehensive performance in prediction and reduces class imbalance.
In this study, we systematically investigate the impact of class imbalance on classification performance of convolutional neural networks (CNNs) and compare frequently used methods to address the issue. Class imbalance is a common problem that has been comprehensively studied in classical machine learning, yet very lim…
Framework tackles class imbalance and noisy labels in active learning.
problem Class imbalance and noisy labels in real-world datasets.
method Uses foundation model priors to select informative samples for active learning.
result Substantial annotation savings (over 50%) with preserved performance and robustness.
Study reveals class disparities in balanced datasets through spectral imbalance.
problem Class disparities in balanced datasets are overlooked despite model performance gaps.
method Developed a theoretical framework and studied 11 encoders to diagnose spectral imbalance.
result Identified spectral imbalance as a source of class disparities in balanced datasets.
DIGRAC clusters directed graphs using flow imbalance, outperforming existing methods.
problem Clustering directed networks without label supervision.
method DIGRAC uses a graph neural network with a novel imbalance loss for directed flow imbalance.
result DIGRAC outperforms 10 state-of-the-art methods on directed graph clustering.
We study the dynamics of order flows around large intraday price changes using ultra-high-frequency data from the Shenzhen Stock Exchange. We find a significant reversal of price for both intraday price decreases and increases with a permanent price impact. The volatility, the volume of different types of orders, the b…
Analyzes how class imbalance and heterogeneity affect diffusion model learning dynamics.
problem Understanding how class imbalance and heterogeneity impact the learning dynamics of diffusion models.
method Developed a high-dimensional analytical framework to study class-dependent learning in score-based diffusion models.
result Class variance is the primary determinant of learning order, favoring higher-variance classes; centroid geometry plays a secondary role.
Paper optimizes internal balancing of wind and hydropower to reduce intraday market volatility.
problem Reduction of intraday market volatility for power producers with wind and hydropower assets.
method Internal balancing within the same river system and sales/purchase in a pay-as-bid intraday market.
result Reduction in short-term marginal cost and risk through internal balancing.
APC overcomes missing data and class imbalance in time series data.
problem Missing data and class imbalance in time series data.
method Self-supervised learning with Autoregressive Predictive Coding (APC).
result APC improves classification performance on real-world medical datasets.
Paper introduces a new performance metric for class imbalance datasets.
problem Challenges in selecting and comparing models for imbalanced datasets.
method Proposes a new performance measure based on the harmonic mean of Recall and Selectivity normalized in class labels.
result The proposed measure is less sensitive to changes in the majority class and more sensitive to changes in the minority class.