Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,982 papers · 148 categories

Trend · papers per month

12.5%25.0%37.5%50.0% · Jan 199419922001200920172026
48 results for counter-intuitive behavior

Behavioral cloning fails due to ignoring causal structure, leading to worse performance.

problem Behavioral cloning's failure to account for causal structure causes worse performance.
method Investigates and proposes interventions to correct causal misidentification.
result Causal misidentification occurs in various domains and can be mitigated.

We show that stochastic recovery always leads to counter-intuitive behaviors in the risk measures of a CDO tranche - namely, continuity on default and positive credit spread risk cannot be ensured simultaneously. We then propose a simple recovery variance regularization method to control the magnitude of negative credi…

2010-12-02abs ↗pdf ↗

The paper analyzes PLS-SVD in high-dimensional data integration, revealing its strengths and limitations.

problem Understanding the behavior of PLS-SVD in high-dimensional data integration.
method Analysis using random matrix theory and singular value decomposition.
result PLS-SVD exhibits counter-intuitive or limiting behavior in certain regimes and outperforms PCA when detecting common latent subspace.

Generative adversarial training can be generally understood as minimizing certain moment matching loss defined by a set of discriminator functions, typically neural networks. The discriminator set should be large enough to be able to uniquely identify the true distribution (discriminative), and also be small enough to …

2017-11-07abs ↗pdf ↗

Study analyzes EU ETS carbon market dynamics, revealing inefficiencies and anomalies.

problem Inefficiencies and anomalies in EU ETS trading and pricing mechanisms.
method Empirical analysis using AR-GARCH model and weighted network analysis.
result Heterogeneous and sometimes counter-intuitive elasticities in price-volume relationships.

We present an elementary analysis of the dynamical aspects of the GDP / government surplus multiplier with relevance to the assessment of a country's debt repayment policy. We show the (at first) counter intuitive result that in order to reduce the Debt/GDP ratio, countries with high Debt to GDP should go into further …

2013-10-11abs ↗pdf ↗

Fuelled by increasing computer power and algorithmic advances, machine learning techniques have become powerful tools for finding patterns in data. Since quantum systems produce counter-intuitive patterns believed not to be efficiently produced by classical systems, it is reasonable to postulate that quantum computers …

2016-11-28abs ↗pdf ↗

The motivations for using variational inference (VI) in neural networks differ significantly from those in latent variable models. This has a counter-intuitive consequence; more expressive variational approximations can provide significantly worse predictions as compared to those with less expressive families. In this …

2018-01-18abs ↗pdf ↗

Importance sampling is widely used in machine learning and statistics, but its power is limited by the restriction of using simple proposals for which the importance weights can be tractably calculated. We address this problem by studying black-box importance sampling methods that calculate importance weights for sampl…

2016-10-17abs ↗pdf ↗

EXPO framework eliminates need for reward model, achieving better optimization.

problem Optimizing large language model responses without a separate reward model.
method Introduces EXPO framework that avoids reparameterization, directly optimizing preferences.
result Demonstrates better regularization and intuitive interpolation behaviors.

We review and illustrate how the volatility smile translates into a probability distribution, the market-implied probability distribution representing believes priced in. The effects of changes in the smile are examined. Special attention is given to the effects of slope, which might appear at first counter-intuitive. …

2009-11-04abs ↗pdf ↗

The paper presents a method to reduce computational and storage costs in PCA and spectral clustering.

problem Efficiently reducing computational and storage costs in PCA and spectral clustering.
method Randomly 'puncturing' the data matrix and kernel matrix through Bernoulli masks.
result The spectral behavior of the resulting kernel is fully tractable and can be drastically punctured without significant loss in performance.

Study on heavy tails in closing auction returns, explaining imbalance through limit order submission.

problem Understanding heavy tails in closing auction return distributions.
method Used the stochastic call auction model of Derksen et al. (2020a) to derive and verify a relation between tail exponents.
result Large closing price fluctuations are not caused by large market orders, but by imbalance in limit orders.

New method accounts for hidden context in preference learning for RLHF models.

problem Incomplete data with hidden context affects RLHF model outcomes.
method Distributional Preference Learning (DPL) methods estimate hidden context distributions.
result DPL methods reduce RLHF vulnerabilities by accounting for hidden context.

Computer Vision and machine learning methods were previously used to reveal screen presence of genders in TV and movies. In this work, using head pose, gender detection, and skin color estimation techniques, we demonstrate that the gender disparity in TV in a South Asian country such as Bangladesh exhibits unique chara…

2017-11-14abs ↗pdf ↗

We derive expressions for the predicitive information rate (PIR) for the class of autoregressive Gaussian processes AR(N), both in terms of the prediction coefficients and in terms of the power spectral density. The latter result suggests a duality between the PIR and the multi-information rate for processes with mutua…

2012-06-01abs ↗pdf ↗

The paper analyzes how momentum affects convergence in stochastic gradient methods.

problem Lack of clear understanding of momentum's impact on convergence and performance.
method Unified analysis of several popular algorithms using the QHM formulation.
result Provides practical guidelines for setting learning rate and momentum parameters.

Neural Shadow-Mapping uncovers causal links in dynamic systems.

problem Discovering causal structures in dynamic systems with mirage correlations.
method Neural network based method embedding high-dimensional data into a shadow representation for causal link estimation.
result Demonstrates performance in discovering causal links from video-representations of dynamic systems.

We consider a binary sequence generated by thresholding a hidden continuous sequence. The hidden variables are assumed to have a compound symmetry covariance structure with a single parameter characterizing the common correlation. We study the parameter estimation problem under such one-parameter models. We demonstrate…

2017-12-27abs ↗pdf ↗

Sideways trains video models by overwriting activations as new frames arrive, potentially improving generalization.

problem Training deep video models synchronously slows down and requires storing activations, limiting parallelism.
method Sideways trains video models by overwriting activations as new frames arrive, breaking the precise correspondence between gradients and activations.
result Sideways training can converge and potentially generalize better than standard synchronized backpropagation.

New model reveals significant impact of data and parameter variations on machine learning benchmarks.

problem Variance in machine learning benchmarks due to data sampling, initialization, and hyperparameters.
method Modeling the benchmarking process, analyzing comparison methods, and studying error rates.
result Adding more sources of variation reduces compute cost while improving performance.

Investments with best performance are not associated with best Sharpe ratios.

problem The relationship between performance and risk-adjusted return (Sharpe ratio) is counterintuitive for heavy-tailed distributions.
method Synthetic and real data analysis of returns distributions.
result The best-performing investments are not the best in terms of Sharpe ratio, and vice versa.

How can we control for latent discrimination in predictive models? How can we provably remove it? Such questions are at the heart of algorithmic fairness and its impacts on society. In this paper, we define a new operational fairness criteria, inspired by the well-understood notion of omitted variable-bias in statistic…

2018-11-12abs ↗pdf ↗

New findings suggest deep generative models can misclassify outliers, requiring new evaluation methods.

problem Deep generative models often assign higher likelihood to outliers, challenging existing outlier detection methods.
method Analyzed the typical set and high-density region of DGMs, proposing a novel outlier test.
result Existing likelihood-based outlier tests may fail due to model calibration issues, not just misclassification.

Study competitive agents' optimal consumption and investment strategies with relative performance criteria.

problem Optimizing consumption and investment strategies for multiple agents with relative performance considerations.
method Derived a closed-form solution for an nn-player game and mean field game, analyzing the impact of risk tolerance and competitiveness parameters.
result Unique equilibria found, showing nonlinear and non-monotone dependence on agents' risk tolerance and competitiveness parameters.

Deep GNNs and self-supervision boost graph learning at scale.

problem Efficiently deploying GNNs at large scale remains challenging.
method Two large-scale GNNs: a deep transductive node classifier and a very deep inductive graph regressor.
result Award-level performance on MAG240M and PCQM4M benchmarks.

We introduce DQFIM to quantify and improve generalization of quantum machine learning models.

problem Understanding and improving generalization of quantum machine learning models.
method Data quantum Fisher information metric (DQFIM) to quantify circuit parameters and training data.
result Improves generalization by breaking symmetries of training data and using a low number of training states.

Complex-valued neural networks improve wireless fingerprinting robustness.

problem Distinguish between devices sending the same message, robust against spoofing.
method Used complex-valued neural networks for supervised learning of fingerprints from wireless signals.
result Noise augmentation by adding white Gaussian noise leads to significant performance gains.

Adversarial training enhances model transferability without sacrificing accuracy.

problem The principle of minimal information in classification models is challenged by adversarial training.
method Investigation of the dual relationship between adversarial training and information theory.
result Adversarial training improves linear transferability and introduces a trade-off between transferability and source task accuracy.

Model shows how confidence feedback can lead to different crisis outcomes.

problem Characterizing the impact of economic recessions on different social strata.
method A self-reflexive DSGE model with heterogeneous households, varying parameters to analyze crisis typologies.
result Crisis propagation can be confined to high or low income households, depending on social network structure and income inequality.

New metric captures individual neuron tuning across neural networks.

problem Need a metric that respects individual neuron tuning across different neural networks.
method Derived a 'soft' permutation-based metric using optimal transport theory.
result Metric avoids counter-intuitive outcomes and captures geometric insights.

This work challenges the assumption that shorter conformal prediction intervals are always better.

problem The conventional evaluation of conformal prediction metrics (coverage and interval length) may not fully capture the quality of predictions.
method The Prejudicial Trick (PT) is introduced, which probabilistically returns either a null interval or a longer one to maintain valid coverage while potentially reducing interval length.
result The Prejudicial Trick can yield deceptively shorter intervals without compromising coverage, but introduces practical vulnerabilities.