A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trends in terrestrial temperature variability are perhaps more relevant for species viability than trends in mean temperature. In this paper, we develop methodology for estimating such trends using multi-resolution climate data from polar orbiting weather satellites. We derive two novel algorithms for computation that …
In this paper, we generalize Magnanini-Sakaguchi's result [MS3] from Euclidean space to spaces of constant curvature. More precisely, we show that if a conductor satisfying the exterior geodesic sphere condition in the space of constant curvature has initial temperature 0 and its boundary is kept at temperature 1 (at a…
This is mainly a survey, explaining how the probabilistic (statistical mechanical) construction of Kahler-Einstein metrics on compact complex manifolds, introduced in a series of works by the author, naturally arises from classical approximation and interpolation problems in complex n-space. A fair amount of background…
We find necessary and sufficient conditions for existence of a locally isometric embedding of a vacuum space-time into a conformally-flat 5-space. We explicitly construct such embeddings for any spherically symmetric Lorentzian metric in 3+1 dimensions as a hypersurface in R4,1. For the Schwarzschild metric the…
We introduce a temperature into the exponential function and replace the softmax output layer of neural nets by a high temperature generalization. Similarly, the logarithm in the log loss we use for training is replaced by a low temperature logarithm. By tuning the two temperatures we create loss functions that are non…
Hyperfitting improves LLM generation quality by enhancing diversity, contrary to simple temperature scaling.
problem Improving open-ended generation quality of LLMs with minimal fine-tuning effort.
method Demonstrates that hyperfitting, a phenomenon where LLMs are fine-tuned to near-zero training loss, enhances generation quality and mitigates repetition.
result Hyperfitting is distinct from temperature scaling and involves a dynamic, context-dependent rank reordering mechanism in the final transformer block.
In this paper, we propose a novel uniform generalization bound on the time and inverse temperature for stochastic gradient Langevin dynamics (SGLD) in a non-convex setting. While previous works derive their generalization bounds by uniform stability, we use Rademacher complexity to make our generalization bound indepen…
A new space-time model for interacting agents on the financial market is presented. It is a combination of the Curie-Weiss model and a space-time model introduced by Järpe 2005. Properties of the model are derived with focus on the critical temperature and magnetization. It turns out that the Hamiltonian is a sufficien…
This paper measures temperature in agent systems using volatility.
problem How to measure temperature in agent systems.
method Examined an agent system with two decision options in a news environment, established the measurement equation, and outlined the concept of temperature measurement.
result Illustrated a strategy for influencing average opinion in competing subsystems.
Attention temperature improves robustness of ICL in high-dimensional settings.
problem ICL robustness failure under distribution shift in high dimensions.
method Analyzed a Transformer with approximate softmax attention, derived a closed-form error expression, and showed optimal temperature minimizes error.
result Optimal attention temperature minimizes ICL generalization error under distribution shift.
Optimizes contrastive learning with individualized temperatures for better performance on imbalanced datasets.
problem The common practice of using a global temperature parameter ignores the varying semantic similarity across different anchor data.
method Proposes a new robust contrastive loss inspired by distributionally robust optimization (DRO) and an efficient stochastic algorithm for automatic temperature individualization.
result Our method automatically learns a suitable temperature for each sample, improving performance on imbalanced datasets.
Recently it was shown that the area A and the angular momentum J of any apparent horizon on a maximal, axisymmetric and asymptotically flat Cauchy hyper-surface of a vacuum space-time satisfy necessarily the universal inequality A >= 8 pi |J|. We show here that the equality A=8 pi |J| is never attained. As equality is …
Partition functions of probability distributions are important quantities for model evaluation and comparisons. We present a new method to compute partition functions of complex and multimodal distributions. Such distributions are often sampled using simulated tempering, which augments the target space with an auxiliar…
The minute fluctuations of of S&P 500 and NASDAQ 100 indices display Boltzmann statistics over a wide range of positive as well as negative returns, thus allowing us to define a {\em market temperature} for either sign. With increasing time the sharp Boltzmann peak broadens into a Gaussian whose volatility σ measure…
In the spirit of behavioral finance, we study the process of opinion formation among investors using a variant of the 2D Voter Model with a tunable social temperature. Further, a feedback acting on the temperature is introduced, such that social temperature reacts to market imbalances and thus becomes time dependent. I…
A spin model relating physical to financial variables is presented. This work is the first to introduce the concept of negative absolute temperature into stock market dynamics by establishing a rigorous formal analogy between physical and financial variables. Based on this model, an algorithm evaluating negative temper…
Machine learning and deep learning infer surface/groundwater exchange from temperature data.
problem Inferring surface/groundwater exchange from temperature data with high temporal resolution.
method Application of machine learning and deep learning algorithms to infer surface/groundwater exchange flux from subsurface temperature observations.
result DL methods outperform ML methods in interpreting noisy temperature data, especially with a smoothing filter.
Understanding local currents in the North Atlantic region of the ocean is a key part of modelling heat transfer and global climate patterns. Satellites provide a surface signature of the temperature of the ocean with a high horizontal resolution while in situ autonomous probes supply high vertical resolution, but horiz…
We present a model of financial markets originally proposed for a turbulent flow, as a dynamic basis of its intermittent behavior. Time evolution of the price change is assumed to be described by Brownian motion in a power-law potential, where the `temperature' fluctuates slowly. The model generally yields a fat-tailed…
Model uncertainty obtained by variational Bayesian inference with Monte Carlo dropout is prone to miscalibration. The uncertainty does not represent the model error well. In this paper, temperature scaling is extended to dropout variational inference to calibrate model uncertainty. Expected uncertainty calibration erro…