Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

491317 · Oct 201919922001200920172026
48 results for surprisal

Auto-Surprise automates recommender system selection and optimization.

problem Finding the best algorithm and hyperparameters for recommender systems.
method Extends Surprise library with TPE optimization for algorithm selection and hyperparameter tuning.
result Significantly faster in finding optimal hyperparameters compared to grid search.

Surprise describes a range of phenomena from unexpected events to behavioral responses. We propose a measure of surprise and use it for surprise-driven learning. Our surprise measure takes into account data likelihood as well as the degree of commitment to a belief via the entropy of the belief distribution. We find th…

2016-06-17abs ↗pdf ↗

Surprise-based learning allows agents to rapidly adapt to non-stationary stochastic environments characterized by sudden changes. We show that exact Bayesian inference in a hierarchical model gives rise to a surprise-modulated trade-off between forgetting old observations and integrating them with the new ones. The mod…

2019-07-05abs ↗pdf ↗

DG separates successes and failures by gating updates with advantage and surprisal.

problem Negative learning from surprising data in distributed reinforcement learning.
method DG gates each update with the product of advantage and surprisal, suppressing failures and preserving successes.
result DG outperforms other methods in various challenging reinforcement learning tasks.

EMIX minimizes surprise in multi-agent reinforcement learning.

problem Surprise and approximation bias in multi-agent reinforcement learning.
method Energy-based MIXer (EMIX) for minimizing surprise across multiple agents.
result EMIX demonstrates consistent stable performance in challenging StarCraft II scenarios.

The Surprise index assesses autonomous systems' competency in uncertain environments.

problem Evaluating competency of autonomous systems in dynamic, uncertain environments.
method Surprise index, a measure that quantifies system performance based on available data.
result The Surprise index can be computed for dynamic systems with Gaussian marginal distributions.

DE is a new exploration method that limits resource usage based on expected improvement and surprise.

problem Limited exploration in large action spaces when resources are scarce.
method Delight-gated exploration (DE) that limits exploration actions based on a gate price set by the product of expected improvement and surprise.
result DE outperforms ε\varepsilon-greedy and Thompson Sampling in terms of regret across various bandit and MDP settings.

We show that reinforcement learning agents that learn by surprise (surprisal) get stuck at abrupt environmental transition boundaries because these transitions are difficult to learn. We propose a counter-intuitive solution that we call Mutual Information Minimising Exploration (MIME) where an agent learns a latent rep…

2020-01-16abs ↗pdf ↗

TradeR uses RL to execute trades in real markets, minimizing surprise and catastrophe.

problem Minimizing surprise and catastrophe in high-frequency trading.
method Hierarchical RL with energy-based surprise value function.
result TradeR outperforms in abrupt price changes and maintains profitability.

In this paper, we describe a new surprising example of a fibration of the Clifford torus S3 x S3 in the 7-sphere by great 3-spheres, which is fiberwise homogeneous but whose fibers are not parallel to one another. In particular it is not part of a Hopf fibration. A fibration is fiberwise homogeneous when for any two fi…

2014-07-17abs ↗pdf ↗

The purpose of the present paper is to introduce and explore two surprises that arise when we apply a standard procedure to study the number of finite type invariants of 3-manifolds introduced independently by M. Goussarov and K. Habiro based on surgery on claspers, Y-graphs or clovers, \cite{Gu,Ha,GGP}. One surprise i…

2000-06-06abs ↗pdf ↗

SAE-FiRE extracts key financial info from long documents, improving earnings surprise predictions.

problem Predicting earnings surprises from long, redundant financial documents.
method Sparse Autoencoder feature selection to filter out noise and identify key dimensions.
result SAE-FiRE significantly outperforms baseline approaches in financial datasets.

A model simulates how different types of traders react to macroeconomic news.

problem Understanding how various market participants respond to macroeconomic surprises.
method Developed a calibrated data generation process (DGP) with four trader archetypes and a Monte Carlo simulation.
result Higher information and lower risk-averse traders take larger positions and achieve higher average wealth.

We establish several new stylised facts concerning the intra-day seasonalities of stock dynamics. Beyond the well known U-shaped pattern of the volatility, we find that the average correlation between stocks increases throughout the day, leading to a smaller relative dispersion between stocks. Somewhat paradoxically, t…

2010-09-24abs ↗pdf ↗

New framework detects near vs. far out-of-distribution samples for AI safety.

problem Binary OOD detection fails to distinguish between semantically close and distant unknown risks.
method Ternary classification based on Low-Entropy Semantic Manifolds and Semantic Surprise Vector.
result Framework achieves state-of-the-art performance on ternary OOD detection task.

A new kk-NN algorithm using surprisal for robust and interpretable nonparametric learning.

problem Complex patterns and relationships in data without strong distribution assumptions.
method Surprisal-driven kk-NN framework for classification, regression, density estimation, and anomaly detection.
result State-of-the-art results in classification and anomaly detection, competitive regression results.

DG improves policy gradients by weighting actions with a sigmoid of advantage and surprisal.

problem Pathologies in standard policy gradients, leading to poor updates and over-allocation of gradient budget.
method Introduces Delightful Policy Gradient (DG) that gates each term with a sigmoid of advantage and surprisal.
result DG provably improves directional accuracy in a single context and shifts the expected gradient closer to the oracle across multiple contexts.

Model financial markets using information theory with a single parameter.

problem Capture the complexity of financial markets with a simple model.
method Derive an idealized model based on four information-theoretic assumptions, minimizing surprisal and divergence.
result The model uses squared radial Ornstein-Uhlenbeck processes for state variables and their sums.

The study explores how agents learn and adapt preferences in dynamic environments.

problem Adaptive behavior and preference learning in reinforcement learning tasks.
method The approach involves self-supervised learning of preferences, distinguishing between environmental and intrinsic observations, and evaluating with model-free and model-based reinforcement learning.
result The methodology successfully minimizes surprisal and expected free energy in dynamic environments.

Early neural networks can be simplified to linear models, revealing surprising simplicity.

problem Complexity of neural network learning dynamics.
method Formal proof and empirical verification of early-time learning dynamics of neural networks.
result Early learning dynamics of neural networks can be approximated by simple linear models.

In this article we survey, and make a few new observations about, the surprising connection between sub-monoids of mapping class groups and interesting geometry and topology in low-dimensions.

2015-04-08abs ↗pdf ↗

This paper provides an alternative approach to Duffie and Lando [Econometrica 69 (2001) 633-664] for obtaining a reduced form credit risk model from a structural model. Duffie and Lando obtain a reduced form model by constructing an economy where the market sees the manager's information set plus noise. The noise makes…

2004-07-05abs ↗pdf ↗

Breakthrough discoveries and inventions involve unexpected combinations of contents including problems, methods, and natural entities, and also diverse contexts such as journals, subfields, and conferences. Drawing on data from tens of millions of research papers, patents, and researchers, we construct models that pred…

2019-10-18abs ↗pdf ↗

We analyze dropout in deep networks with rectified linear units and the quadratic loss. Our results expose surprising differences between the behavior of dropout and more traditional regularizers like weight decay. For example, on some simple data sets dropout training produces negative weights even though the output i…

2016-02-14abs ↗pdf ↗

We show that the Cartesian product of three hereditarily infinite dimensional compact metric spaces is never hereditarily infinite dimensional. It is quite surprising that the proof of this fact (and this is the only proof known to the author) essentially relies on algebraic topology.

2012-12-12abs ↗pdf ↗

In this note we survey some recent results for the Euler equations in compressible and incompressible fluid dynamics. The main point of all these theorems is the surprising fact that a suitable variant of Gromov's hh-principle holds in several cases.

2011-11-11abs ↗pdf ↗

L. Kauffman conjectured that a particular solution of the Chinese Rings puzzle is the simplest possible. We prove his conjecture by using low-dimensional topology and group theory. We notice also a surprising connection between the Chinese Rings and Habiro moves (related to Vassiliev invariants).

2000-07-21abs ↗pdf ↗

Study shows how macroprudential policies affect credit growth in Israel, especially in housing and business sectors.

problem Impact of macroprudential policies on credit growth in Israel.
method Bank-level panel data analysis for Israel, 2004-2019; interaction of monetary and macroprudential policies.
result Accommodative monetary policy interacts with macroprudential policies to increase total credit growth.

New framework predicts earnings announcements using press release content, surpassing earnings surprises.

problem Predicting stock returns based on earnings press releases.
method Compared traditional and BERT-based embeddings of press releases, finding content as informative as earnings surprises.
result FinBERT yields highest predictive power for earnings announcement returns.

Existence of convex body with prescribed generalized curvature measures is discussed, this result is obtained by making use of Guan-Li-Li's innovative techniques. In surprise, that methods has also brought us to promote Ivochkina's C2C^2 estimates for prescribed curvature equation in \cite{I1, I}.

2011-04-27abs ↗pdf ↗

This study shows how monetary uncertainty affects stock market reactions to macroeconomic news.

problem Understanding stock market reactions to macroeconomic news under varying levels of monetary uncertainty.
method Decomposes stock market response into cash flow and risk-free rate channels, analyzing time-varying effects.
result High monetary uncertainty weakens the positive stock market response to macroeconomic news.