We study a simple model of an asset market with informed and non-informed agents. In the absence of non-informed agents, the market becomes information efficient when the number of traders with different private information is large enough. Upon introducing non-informed agents, we find that the latter contribute signif…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,742 papers · 148 categories
Trend · papers per month
48 results for “information efficiency”
Statistical test rejects market efficiency using entropy from price returns.
problem Determining market efficiency using information theory.
method Symbolic representation of price returns, Shannon entropy, and statistical test.
result Rejects market efficiency hypothesis for various datasets.
FisherSFT selects informative examples to fine-tune LLMs efficiently.
problem Adapting large language models to new domains efficiently.
method Selects examples maximizing information gain using Hessian of log-likelihood.
result Empirically demonstrates improved performance with reduced computational cost.
Information bottleneck theory of high-dimensional regression: relevancy, efficiency and optimalitycs.IT
New approach quantifies overfitting in high-dimensional regression.
problem Quantifying and avoiding overfitting in large neural networks.
method Information bottleneck theory to minimize residual information while maximizing relevant bits.
result Characterized the relative information efficiency of randomized regression compared to optimal algorithms.
On the Optimal Representation Efficiency of Barlow Twins: An Information-Geometric Interpretationcs.LG
This paper analyzes Barlow Twins' representation efficiency using information-geometric methods.
problem Understanding and comparing the efficiency of self-supervised learning methods.
method Introduces an information-geometric framework to quantify representation efficiency and applies it to Barlow Twins.
result Proves that Barlow Twins achieves optimal representation efficiency (η=1).
We study the informational efficiency of a market with a single traded asset. The price initially differs from the fundamental value, about which the agents have noisy private information (which is, on average, correct). A fraction of traders revise their price expectations in each period. The price at which the asset …
Financial Information Theoryq-fin.PM
The paper applies information theory to financial markets, improving risk management and asset allocation.
problem Improving risk management and asset allocation in financial markets.
method Information-theoretic measures (entropy, mutual information, etc.) applied to financial time series.
result Normalized mutual information (NMI) is a powerful measure of temporal dependence in financial markets.
We investigated financial market data to determine which factors affect information flow between stocks. Two factors, the time dependency and the degree of efficiency, were considered in the analysis of Korean, the Japanese, the Taiwanese, the Canadian, and US market data. We found that the frequency of the significant…
MFNets constructs efficient multifidelity surrogates from diverse information sources.
problem Creating accurate surrogates from multiple, potentially costly or inaccurate data sources.
method Directed acyclic graph of connections, gradient-based minimization of least squares objective, flexible information source structure.
result Error reduction by orders-of-magnitude, especially in low-data scenarios.
Study the link between entropy and market efficiency using fractal properties.
problem Determining market efficiency using entropy-based measures and fractal properties.
method Theoretical expression for market information using fractional Brownian motion and Lamperti transform. Multiscale method to interpret entropy and market information.
result A Hurst exponent close to 1/2 can lead to high informativeness of time series due to stationarity.
Study shows using time-series privileged information improves model efficiency.
problem Efficiently predicting future outcomes using supervised models with privileged information.
method Developed an algorithm for learning with privileged time-series data and proved its efficiency for non-stationary Gaussian-linear systems.
result Learning with privileged information is more efficient than without it for non-stationary Gaussian-linear systems.
Before the massive spread of computer technology, information was far from complex. The development of technology shifted the paradigm: from individuals who faced scarce and costly information to individuals who face massive amounts of information accessible at low costs. Nowadays we are living in the era of big data a…
Market efficiency, informational asymmetry and pseudo-collusion of adaptively learning agentsecon.TH
Study examines how traders with asymmetric information and adaptive learning strategies affect market efficiency.
problem Effect of traders' strategic behavior on market efficiency and informational asymmetry.
method Examines a market with boundedly rational, asymmetrically informed traders using multiarmed bandit algorithms.
result Strategically acting traders can lead to more efficient markets than purely competitive ones under certain conditions.
Crude oil market and geopolitical events: an analysis based on information-theory-based quantifiersq-fin.ST
This paper analyzes the informational efficiency of oil market during the last three decades, and examines changes in informational efficiency with major geopolitical events, such as terrorist attacks, financial crisis and other important events. The series under study is the daily prices of West Texas Intermediate (WT…
The role of credit rating agencies has been under severe scrutiny after the subprime crisis. In this paper we explore the relationship between credit ratings and informational efficiency of a sample of thirty nine corporate bonds of US oil and energy companies from April 2008 to November 2012. For that purpose, we use …
Differential Beliefs in Financial Markets Under Information Constraints: A Modeling Perspectiveq-fin.MF
Study market efficiency under partial information using SDEs and optimization.
problem Market efficiency under partial information constraints.
method McKean-Vlasov-type SDEs, Wasserstein barycenters, KL divergence, convex optimization, optimal control, nonlinear filtering.
result Convergence of reduced-information market price processes to true price process under increasing information flow.
Combines historical and market data for better portfolio selection.
problem Improving portfolio selection through diverse information integration.
method Bayesian learning via Gaussian mixture model to harmonize historical and market data.
result The method enhances forecasting accuracy and robustness across various capital markets.
Study tests financial market efficiency using random number generator tests.
problem Check for informational efficiencies in financial markets.
method Analysed binary daily returns as random number generators, split analysis by annual and company levels, investigated longer-term efficiency over Nasdaq-listed companies.
result Information efficiency varies across years and reflects large-scale market impacts.
The paper extends physics-based information maximization to complex bandit problems.
problem Designing efficient decision-making policies for complex bandit problems.
method Information and free-energy maximization principles adapted to three distinct bandit types.
result Information maximization leads to strong performance in complex bandit problems.
An efficient search-and-score algorithm for ancestral graphs using multivariate information scorescs.LG
Efficiently searches ancestral graphs using multivariate information.
problem Discovering causal relationships in graphs with latent variables.
method Greedy search-and-score algorithm with two-step approach.
result Outperforms existing methods on benchmark datasets.
PI-SAC agents learn predictive information to improve RL efficiency.
problem Improving sample efficiency in reinforcement learning.
method PI-SAC agents use a contrastive version of Conditional Entropy Bottleneck to learn predictive information from past and future states.
result PI-SAC agents significantly improve sample efficiency on challenging continuous control tasks.
Optimizes energy efficiency in wireless sensor networks with limited information.
problem Maximizing energy efficiency in energy harvesting wireless sensor networks with limited channel state information.
method Modeling as a Multi-Armed Bandits problem and developing an Upper Confidence Bound algorithm.
result Significant gains in energy efficiency compared to benchmark schemes.
This paper improves sample efficiency in noisy inductive matrix completion with side-information.
problem Improving sample efficiency in noisy inductive matrix completion with side-information.
method Nonconvex projected gradient descent algorithm with spectral initialization.
result Achieves linear convergence and stable recovery at a sample complexity governed by the effective side-information dimension.
Active learning optimizes correlation clustering by querying the most informative pairwise comparisons.
problem Efficiently clustering data with limited pairwise similarity information.
method Developed principled active learning approach using information-theoretic acquisition functions.
result Significantly outperforms existing baselines in clustering accuracy and query efficiency.
Since the 1960s, the question whether markets are efficient or not is controversially discussed. One reason for the difficulty to overcome the controversy is the lack of a universal, but also precise, quantitative definition of efficiency that is able to graduate between different states of efficiency. The main purpose…
New bounds on IDS for RL show how to balance computation and learning efficiency.
problem Understanding and optimizing information-directed sampling (IDS) for reinforcement learning.
method Developed novel information-theoretic tools to bound information ratio and cumulative information gain.
result Derived prior-free Bayesian regret bounds for IDS in tabular finite-horizon MDPs and improved computational efficiency.
Privileged Information Dropout improves RL performance without distillation.
problem Improving sample efficiency and performance in reinforcement learning.
method Introducing Privileged Information Dropout to directly incorporate privileged information into RL agent inputs.
result Privileged Information Dropout outperforms distillation and auxiliary tasks in a partially-observed environment.
Paper uses SDP for community detection with side information.
problem Community detection in graphs with additional non-graph data.
method Formulates SDP relaxation for maximum likelihood node labeling with side information.
result SDP achieves same exact recovery threshold as maximum likelihood with side information.
PILNO uses neural operators to solve PDEs efficiently on point clouds.
problem Solving partial differential equations (PDEs) on point cloud data efficiently.
method Physics-informed low-rank neural operator framework combining low-rank kernel approximations and an encoder-decoder architecture.
result PILNO efficiently approximates solution operators of PDEs on point cloud data, satisfying PDE constraints and boundary conditions.
Pragmatic Information Rates, Generalizations of the Kelly Criterion, and Financial Market Efficiencycs.IT
This paper is part of an ongoing investigation of "pragmatic information", defined in Weinberger (2002) as "the amount of information actually used in making a decision". Because a study of information rates led to the Noiseless and Noisy Coding Theorems, two of the most important results of Shannon's theory, we begin …
New SMC sampler improves diffusion model sampling efficiency.
problem Sampling generative diffusion models efficiently.
method Constructs correlated observation paths and designs a sampler.
result Improved statistical efficiency, especially under outlier conditions.
New algorithms for efficient learning with partial information, reducing regret.
problem Online learning with partial observability and semi-bandit feedback.
method Implicit exploration strategy for near-optimal regret guarantees.
result First algorithms with near-optimal regret guarantees without knowing the observation system.
The paper examines how markets can anticipate and react to arbitrage opportunities, revealing biases and risks.
problem The tension between no arbitrage, information efficiency, and risk anticipation in markets.
method Continuous time analysis with model- or event-risk, allowing pre-horizon risk-resolution and Risk-Neutral Equivalent pricing.
result Optimised trading can suppress the anticipation of predictable risk-outcomes, creating an apparent Status Quo Bias.
Generalizes insider trading model to multiple assets.
problem Modeling informed trading in a multi-asset context.
method Formulated an infinite-dimensional Bayesian trading game.
result Obtained a parsimonious equilibrium with closed-form solutions.
We consider the question of efficient estimation in the tails of Gaussian copulas. Our special focus is estimating expectations over multi-dimensional constrained sets that have a small implied measure under the Gaussian copula. We propose three estimators, all of which rely on a simple idea: identify certain \emph{dom…
Approximate inference via information projection has been recently introduced as a general-purpose approach for efficient probabilistic inference given sparse variables. This manuscript goes beyond classical sparsity by proposing efficient algorithms for approximate inference via information projection that are applica…
Estimates interactions between modalities for multimodal data.
problem Accurately quantifying interactions between different data types.
method Developed Lightweight Sample-wise Multimodal Interaction (LSMI) estimator using pointwise information theory.
result LSMI reveals fine-grained dynamics in multimodal data.
Bitcoin option prices reflect both market maker supply and trader demand, especially from those with insider information.
problem Understanding how market prices of bitcoin options are influenced by both market makers and informed traders.
method Analysis of Deribit options tick-level data to identify supply and demand effects.
result At-the-money option prices are driven by volatility traders, while out-of-the-money options are influenced by both volatility traders and those with insider information.
Optimizes stochastic linear bandits with efficient, asymptotically optimal algorithm.
problem Optimizing stochastic linear bandits with multiple actions.
method Frequentist information-directed sampling (IDS) with a surrogate for information gain.
result Asymptotically optimal and nearly worst-case optimal in finite time.
MICO uses mutual information co-training to improve selective search efficiency.
problem Efficiently search and route unseen queries in large-scale search systems.
method Mutual Information Co-training framework for selective search with minimal supervision.
result Significantly improves performance on multiple metrics of selective search.
New insights and algorithms improve prediction models with time-series privileged information.
problem Efficient learning of nonlinear prediction models with limited data.
method Generalization of LuPI to nonlinear tasks, using random features and representation learning.
result Theoretical and empirical evidence supports the use of privileged time-series information for nonlinear prediction.
This paper is concerned with an optimal reinsurance and investment problem for an insurance firm under the criterion of mean-variance. The driving Brownian motion and the rate in return of the risky asset price dynamic equation cannot be directly observed. And the short-selling of stocks is prohibited. The problem is f…
This paper introduces efficient approximations for fairness criteria in regression models.
problem Measuring fairness in real-valued outcomes (regression settings) is computationally challenging.
method Fast approximations of mutual information for independence, separation, and sufficiency fairness criteria.
result The method achieves state-of-the-art accuracy/fairness tradeoffs in real-world datasets.
This letter revisits the informational efficiency of the Bitcoin market. In particular we analyze the time-varying behavior of long memory of returns on Bitcoin and volatility 2011 until 2017, using the Hurst exponent. Our results are twofold. First, R/S method is prone to detect long memory, whereas DFA method can dis…
Efficiently estimates distributed mean with side information, near-optimal and universal.
problem Distributed mean estimation with side information in communication constrained settings.
method Wyner-Ziv estimators for communication and computation efficiency.
result Near-optimal and universal recovery guarantees for distributed optimization and compression.
This work tackles online memory selection in continual learning using information theory.
problem Online selection of a representative replay memory from data streams.
method Information-theoretic criteria (surprise, learnability) and Bayesian model for efficient computation.
result InfoRS improves robustness against data imbalance compared to reservoir sampling.
AI simplifies trading strategies, potentially making markets more efficient.
problem Efficient market hypothesis (EMH) relies on traders optimising trading strategies based on information.
method Generalised notion of market efficiency, distinguishing model complexity through investor beliefs and trading strategies.
result Increased availability of low-cost AI systems may push towards more advanced trading strategies, potentially harder for inefficient traders.
New method uses EKI for efficient Bayesian inference in high-dimensional problems.
problem Efficient inference for high-dimensional posterior distributions in physics-informed neural networks.
method Ensemble Kalman Inversion (EKI) for high-dimensional posterior inference.
result EKI-based inference provides comparable uncertainty estimates to HMC-based methods but with reduced computational cost.