Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

19375674 · Jun 202019922001200920172026
48 results for temperature hyperparameter

HET-XL improves heteroscedastic classifiers for large-scale image classification.

problem Scaling heteroscedastic classifiers to handle large numbers of classes and tuning the temperature hyperparameter.
method HET-XL, a heteroscedastic classifier with independent parameter count from the number of classes, learns the temperature hyperparameter directly from training data.
result HET-XL requires 14X fewer additional parameters and performs better than baseline heteroscedastic classifiers on large image classification datasets.

FlowVAT improves variational inference for multi-modal distributions.

problem Mode-seeking behavior and collapse in variational inference for complex posteriors.
method Conditional tempering approach for normalizing flow variational inference.
result FlowVAT outperforms traditional and adaptive annealing methods in multi-modal distributions, finding more modes and achieving better ELBO values.

Meta-SAC automatically tunes SAC's entropy temperature for better exploration.

problem Exploration-exploitation dilemma in reinforcement learning.
method Meta-SAC uses metagradient and a novel meta objective to automatically adjust SAC's entropy temperature.
result Meta-SAC outperforms SAC-v2 by 10% on the humanoid-v2 task.

Softmax temperature influences model representation rank and performance.

problem Understanding and optimizing softmax function's impact on model representations.
method Investigated softmax function's role in deep neural networks, introduced rank deficit bias.
result Softmax temperature affects model representation rank and can improve performance.

New tools evaluate and optimize conditional sequence models in bioinformatics.

problem Evaluating and optimizing conditional sequence models in bioinformatics.
method Kernel-based discrepancy measure (ACMMD) to estimate model fit and tune hyperparameters.
result Rejects the hypothesis that ProteinMPNN fits its data for various protein families and optimizes model temperature.

A cubing strategy identifies stable hyperparameter regions for uncertainty quantification in spatial deep learning.

problem Uncertainty quantification in spatial deep learning models.
method Cubing-based diagnostic framework to recursively partition hyperparameter space and evaluate regions using scoring rules.
result Our approach produces competitive or superior predictive intervals compared to a statistical baseline model.

Model predicts viscosity of multicomponent systems efficiently.

problem Expensive experimental viscosity measurements in various industries.
method Artificial neural networks trained on a database of chemical systems and temperatures.
result Model Viskositas provides more accurate predictions with lower errors, variability, and outliers.

Model-free deep reinforcement learning (RL) algorithms have been successfully applied to a range of challenging sequential decision making and control tasks. However, these methods typically suffer from two major challenges: high sample complexity and brittleness to hyperparameters. Both of these challenges limit the a…

2018-12-13abs ↗pdf ↗

This paper introduces 'General Cyclical Training' for neural networks.

problem Improving training efficiency and performance of neural networks.
method Cyclical training phases with varying hyperparameters, batch sizes, loss functions, and data augmentation.
result Cyclical weight decay, softmax temperature, and gradient clipping enhance model accuracy.

Temperature scaling improves model uncertainty but not diversity in LLMs.

problem Improving the calibration and stochasticity of probabilistic models.
method Investigates theoretical properties of temperature scaling in classification and LLMs.
result Temperature scaling increases model uncertainty but not diversity in LLMs.

Study local sensitivity of HDD and CDD temperature derivatives prices.

problem Understanding how temperature derivatives prices change with small temperature changes.
method Analyzes sensitivity of HDD and CDD futures and options prices to temperature perturbations using a CAR process.
result Identifies the order of the CAR process and its impact on temperature derivatives prices.

We introduce a temperature into the exponential function and replace the softmax output layer of neural nets by a high temperature generalization. Similarly, the logarithm in the log loss we use for training is replaced by a low temperature logarithm. By tuning the two temperatures we create loss functions that are non…

2019-06-08abs ↗pdf ↗

A new method selects optimal temperature for Bayesian Deep Learning.

problem Finding the optimal temperature for improving predictive performance in Bayesian Deep Learning.
method Data-driven approach to estimate temperature as a model parameter.
result Our method performs comparably to grid search but at a fraction of the cost.

New adaptive temperature selection improves parallel tempering efficiency.

problem Enhancing mixing in multi-modal distributions using parallel tempering.
method Adaptive temperature selection using policy gradient approach.
result Lower integrated autocorrelation times achieved compared to traditional methods.

This paper measures temperature in agent systems using volatility.

problem How to measure temperature in agent systems.
method Examined an agent system with two decision options in a news environment, established the measurement equation, and outlined the concept of temperature measurement.
result Illustrated a strategy for influencing average opinion in competing subsystems.

Attention temperature improves robustness of ICL in high-dimensional settings.

problem ICL robustness failure under distribution shift in high dimensions.
method Analyzed a Transformer with approximate softmax attention, derived a closed-form error expression, and showed optimal temperature minimizes error.
result Optimal attention temperature minimizes ICL generalization error under distribution shift.

Trends in terrestrial temperature variability are perhaps more relevant for species viability than trends in mean temperature. In this paper, we develop methodology for estimating such trends using multi-resolution climate data from polar orbiting weather satellites. We derive two novel algorithms for computation that …

2018-05-18abs ↗pdf ↗

The paper analyzes extreme temperature forecasting using machine learning models.

problem Forecasting extreme temperatures in U.S. cities.
method Auto-Regressive Integrated Moving Average, Exponential Smoothing, Multilayer Perceptrons, Gaussian Processes.
result Multilayer Perceptrons were found to be the most effective approach for forecasting extreme temperatures.

The paper analyzes the InfoNCE loss under different temperature schedules using Langevin dynamics.

problem Understanding the dynamics of InfoNCE loss under fixed versus annealed temperature schedules.
method Modeling embedding evolution under Langevin dynamics on a compact Riemannian manifold, with theoretical guarantees for convergence.
result Slow logarithmic inverse-temperature schedules ensure convergence to globally optimal representations, while faster schedules risk suboptimal minima.

The Gibbs algorithm's generalization error is bounded, improving with prior volume in low temperatures.

problem Bounding the generalization error of the Gibbs algorithm in low temperature regimes.
method Analyzes the Gibbs algorithm's performance, extending known high-temperature bounds to low-temperature scenarios.
result With high probability, the generalization error decreases with the total prior volume of similar hypotheses.

Optimizes contrastive learning with individualized temperatures for better performance on imbalanced datasets.

problem The common practice of using a global temperature parameter ignores the varying semantic similarity across different anchor data.
method Proposes a new robust contrastive loss inspired by distributionally robust optimization (DRO) and an efficient stochastic algorithm for automatic temperature individualization.
result Our method automatically learns a suitable temperature for each sample, improving performance on imbalanced datasets.

Post-hoc transforms can reverse model performance trends, especially in noisy settings.

problem Post-hoc transforms can reverse model performance trends, especially in noisy settings.
method Empirical study and analysis of post-hoc transforms like temperature scaling, ensembling, and SWA.
result Post-hoc reversal can prevent double descent and mitigate mismatches between test loss and test error.

New method uses RBM flows to find critical temperatures in Ising models.

problem Detecting critical temperatures in RBM flows without model topology information.
method Iterative sampling from RBM mapped on Ising model temperature space using a neural network thermometer.
result Flow of RBM trained on Ising spin configurations approaches critical temperature around kBTc/J2.269k_B T_c / J \approx 2.269.

Algorithm learns Sherrington-Kirkpatrick model parameters at low temperatures.

problem Learning parameters of random graphical models at low temperatures.
method Multiplicative-weight update algorithm for polynomial time learning.
result Algorithm learns SK model parameters at βlognβ\leq \sqrt{\log n}.

Study shows sample complexity for logistic regression with normal covariates.

problem Estimating parameters of logistic regression with normal design.
method Analyzes sample complexity in terms of dimension and inverse temperature.
result Shows two change-points in sample complexity curve based on inverse temperature.

The minute fluctuations of of S&P 500 and NASDAQ 100 indices display Boltzmann statistics over a wide range of positive as well as negative returns, thus allowing us to define a {\em market temperature} for either sign. With increasing time the sharp Boltzmann peak broadens into a Gaussian whose volatility σ σ measure…

2006-09-23abs ↗pdf ↗

In the spirit of behavioral finance, we study the process of opinion formation among investors using a variant of the 2D Voter Model with a tunable social temperature. Further, a feedback acting on the temperature is introduced, such that social temperature reacts to market imbalances and thus becomes time dependent. I…

2012-12-19abs ↗pdf ↗

A spin model relating physical to financial variables is presented. This work is the first to introduce the concept of negative absolute temperature into stock market dynamics by establishing a rigorous formal analogy between physical and financial variables. Based on this model, an algorithm evaluating negative temper…

2012-06-06abs ↗pdf ↗

Machine learning and deep learning infer surface/groundwater exchange from temperature data.

problem Inferring surface/groundwater exchange from temperature data with high temporal resolution.
method Application of machine learning and deep learning algorithms to infer surface/groundwater exchange flux from subsurface temperature observations.
result DL methods outperform ML methods in interpreting noisy temperature data, especially with a smoothing filter.

Researchers derive the relation between temperature and volatility in ideal agent systems.

problem Deriving the exact algebraic relation between temperature and volatility in ideal agent systems.
method Analogy with spin systems from statistical physics.
result Derive the exact algebraic relation between temperature and volatility for an ideal agent system.

New method estimates Nishimori temperature for node classification in weighted graphs.

problem Estimating Nishimori temperature for Bayesian inference.
method Spectral method using eigenvalues of Bethe Hessian matrix.
result Spectral method outperforms existing approaches in node classification.

Temperature scaling fails for distributions with class overlaps, while Mixup improves calibration.

problem Temperature scaling's performance degrades with class overlaps, leading to poor calibration.
method Identified temperature scaling's limitations and compared it with Mixup for calibration.
result Mixup significantly outperforms temperature scaling in calibration metrics with class overlaps.

Understanding local currents in the North Atlantic region of the ocean is a key part of modelling heat transfer and global climate patterns. Satellites provide a surface signature of the temperature of the ocean with a high horizontal resolution while in situ autonomous probes supply high vertical resolution, but horiz…

2019-10-18abs ↗pdf ↗