Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

59117176234 · Jun 202019922001200920172026
48 results for temperature selection

New adaptive temperature selection improves parallel tempering efficiency.

problem Enhancing mixing in multi-modal distributions using parallel tempering.
method Adaptive temperature selection using policy gradient approach.
result Lower integrated autocorrelation times achieved compared to traditional methods.

A new method selects optimal temperature for Bayesian Deep Learning.

problem Finding the optimal temperature for improving predictive performance in Bayesian Deep Learning.
method Data-driven approach to estimate temperature as a model parameter.
result Our method performs comparably to grid search but at a fraction of the cost.

Attention temperature improves robustness of ICL in high-dimensional settings.

problem ICL robustness failure under distribution shift in high dimensions.
method Analyzed a Transformer with approximate softmax attention, derived a closed-form error expression, and showed optimal temperature minimizes error.
result Optimal attention temperature minimizes ICL generalization error under distribution shift.

AEW estimator achieves optimal risk in expectation for large enough temperatures.

problem Understanding minimax-rate optimality of AEW estimator in model selection aggregation.
method Analyzing AEW estimator with exponential weights for squared loss under random design.
result AEW achieves excess risk Tlog(M)/(n+1)T \log (M) / (n+1) in expectation for large enough temperatures.

Study compares machine learning algorithms for predicting SST in the Great Barrier Reef.

problem Predicting sea surface temperature in the Great Barrier Reef region.
method Ridge regression, LASSO, Random Forest, and Extreme Gradient Boosting (XGBoost) algorithms were evaluated.
result XGBoost significantly outperforms other algorithms in terms of predictive accuracy and Kullback-Leibler Divergence.

Post-hoc transforms can reverse model performance trends, especially in noisy settings.

problem Post-hoc transforms can reverse model performance trends, especially in noisy settings.
method Empirical study and analysis of post-hoc transforms like temperature scaling, ensembling, and SWA.
result Post-hoc reversal can prevent double descent and mitigate mismatches between test loss and test error.

Method reduces model bias in water temperature prediction using physics-guided GNNs.

problem Model bias in traditional physics-based models across different income and education levels.
method Physics-guided GNNs with refined neighbor selection and weights.
result Preserves equitable performance across different sensitive groups in the Delaware River Basin.

AdaAnn optimizes annealing for efficient probability density approximation.

problem Efficiently approximating complex probability distributions with multiple modes.
method AdaAnn is an adaptive annealing scheduler that adjusts temperature increments based on KL divergence.
result AdaAnn improves computational efficiency in variational inference and parameter estimation.

We present a methodology for probabilistic load forecasting that is based on lasso (least absolute shrinkage and selection operator) estimation. The model considered can be regarded as a bivariate time-varying threshold autoregressive(AR) process for the hourly electric load and temperature. The joint modeling approach…

2016-03-04abs ↗pdf ↗

Temperature scaling improves model uncertainty but not diversity in LLMs.

problem Improving the calibration and stochasticity of probabilistic models.
method Investigates theoretical properties of temperature scaling in classification and LLMs.
result Temperature scaling increases model uncertainty but not diversity in LLMs.

Study local sensitivity of HDD and CDD temperature derivatives prices.

problem Understanding how temperature derivatives prices change with small temperature changes.
method Analyzes sensitivity of HDD and CDD futures and options prices to temperature perturbations using a CAR process.
result Identifies the order of the CAR process and its impact on temperature derivatives prices.

We introduce a temperature into the exponential function and replace the softmax output layer of neural nets by a high temperature generalization. Similarly, the logarithm in the log loss we use for training is replaced by a low temperature logarithm. By tuning the two temperatures we create loss functions that are non…

2019-06-08abs ↗pdf ↗

This paper measures temperature in agent systems using volatility.

problem How to measure temperature in agent systems.
method Examined an agent system with two decision options in a news environment, established the measurement equation, and outlined the concept of temperature measurement.
result Illustrated a strategy for influencing average opinion in competing subsystems.

Auto-Compressing Subset Pruning reduces model size for faster inference.

problem High parameter counts and slow inference times in semantic segmentation models.
method Learning a channel selection mechanism based on temperature annealing schedule.
result Significant compression of segmentation models with acceptable inference performance.

Trends in terrestrial temperature variability are perhaps more relevant for species viability than trends in mean temperature. In this paper, we develop methodology for estimating such trends using multi-resolution climate data from polar orbiting weather satellites. We derive two novel algorithms for computation that …

2018-05-18abs ↗pdf ↗

The paper analyzes extreme temperature forecasting using machine learning models.

problem Forecasting extreme temperatures in U.S. cities.
method Auto-Regressive Integrated Moving Average, Exponential Smoothing, Multilayer Perceptrons, Gaussian Processes.
result Multilayer Perceptrons were found to be the most effective approach for forecasting extreme temperatures.

We recapitulate the Bayesian formulation of neural network based classifiers and show that, while sampling from the posterior does indeed lead to better generalisation than is obtained by standard optimisation of the cost function, even better performance can in general be achieved by sampling finite temperature (TT) …

2019-04-08abs ↗pdf ↗

The paper analyzes the InfoNCE loss under different temperature schedules using Langevin dynamics.

problem Understanding the dynamics of InfoNCE loss under fixed versus annealed temperature schedules.
method Modeling embedding evolution under Langevin dynamics on a compact Riemannian manifold, with theoretical guarantees for convergence.
result Slow logarithmic inverse-temperature schedules ensure convergence to globally optimal representations, while faster schedules risk suboptimal minima.

The Gibbs algorithm's generalization error is bounded, improving with prior volume in low temperatures.

problem Bounding the generalization error of the Gibbs algorithm in low temperature regimes.
method Analyzes the Gibbs algorithm's performance, extending known high-temperature bounds to low-temperature scenarios.
result With high probability, the generalization error decreases with the total prior volume of similar hypotheses.

Optimizes contrastive learning with individualized temperatures for better performance on imbalanced datasets.

problem The common practice of using a global temperature parameter ignores the varying semantic similarity across different anchor data.
method Proposes a new robust contrastive loss inspired by distributionally robust optimization (DRO) and an efficient stochastic algorithm for automatic temperature individualization.
result Our method automatically learns a suitable temperature for each sample, improving performance on imbalanced datasets.

Study evaluates different mathematical models for three case studies using statistical fitting.

problem Estimating outcomes in population dynamics, temperature variations, and market equilibrium.
method Applied various statistical equations (e.g., fractional exponential, sinusoidal) to three case studies.
result Optimal models differ by case study (fractional exponential for population dynamics, sinusoidal for temperature and market equilibrium).

The present study provides a comparative assessment of non-invasive sensors as means of estimating the microbial contamination and time-on-shelf (i.e. storage time) of leafy green vegetables, using a novel unified spectra analysis workflow. Two fresh ready-to-eat green salads were used in the context of this study for …

2019-03-21abs ↗pdf ↗

New method uses RBM flows to find critical temperatures in Ising models.

problem Detecting critical temperatures in RBM flows without model topology information.
method Iterative sampling from RBM mapped on Ising model temperature space using a neural network thermometer.
result Flow of RBM trained on Ising spin configurations approaches critical temperature around kBTc/J2.269k_B T_c / J \approx 2.269.

Algorithm learns Sherrington-Kirkpatrick model parameters at low temperatures.

problem Learning parameters of random graphical models at low temperatures.
method Multiplicative-weight update algorithm for polynomial time learning.
result Algorithm learns SK model parameters at βlognβ\leq \sqrt{\log n}.

Evaluation of the marginal likelihood plays an important role in model selection problems. The widely applicable Bayesian information criterion (WBIC) and singular Bayesian information criterion (sBIC) give approximations to the log marginal likelihood, which can be applied to both regular and singular models. When the…

2019-06-04abs ↗pdf ↗

Study shows sample complexity for logistic regression with normal covariates.

problem Estimating parameters of logistic regression with normal design.
method Analyzes sample complexity in terms of dimension and inverse temperature.
result Shows two change-points in sample complexity curve based on inverse temperature.

The minute fluctuations of of S&P 500 and NASDAQ 100 indices display Boltzmann statistics over a wide range of positive as well as negative returns, thus allowing us to define a {\em market temperature} for either sign. With increasing time the sharp Boltzmann peak broadens into a Gaussian whose volatility σ σ measure…

2006-09-23abs ↗pdf ↗

In the spirit of behavioral finance, we study the process of opinion formation among investors using a variant of the 2D Voter Model with a tunable social temperature. Further, a feedback acting on the temperature is introduced, such that social temperature reacts to market imbalances and thus becomes time dependent. I…

2012-12-19abs ↗pdf ↗

A spin model relating physical to financial variables is presented. This work is the first to introduce the concept of negative absolute temperature into stock market dynamics by establishing a rigorous formal analogy between physical and financial variables. Based on this model, an algorithm evaluating negative temper…

2012-06-06abs ↗pdf ↗

Machine learning and deep learning infer surface/groundwater exchange from temperature data.

problem Inferring surface/groundwater exchange from temperature data with high temporal resolution.
method Application of machine learning and deep learning algorithms to infer surface/groundwater exchange flux from subsurface temperature observations.
result DL methods outperform ML methods in interpreting noisy temperature data, especially with a smoothing filter.

Researchers derive the relation between temperature and volatility in ideal agent systems.

problem Deriving the exact algebraic relation between temperature and volatility in ideal agent systems.
method Analogy with spin systems from statistical physics.
result Derive the exact algebraic relation between temperature and volatility for an ideal agent system.

New method estimates Nishimori temperature for node classification in weighted graphs.

problem Estimating Nishimori temperature for Bayesian inference.
method Spectral method using eigenvalues of Bethe Hessian matrix.
result Spectral method outperforms existing approaches in node classification.

Temperature scaling fails for distributions with class overlaps, while Mixup improves calibration.

problem Temperature scaling's performance degrades with class overlaps, leading to poor calibration.
method Identified temperature scaling's limitations and compared it with Mixup for calibration.
result Mixup significantly outperforms temperature scaling in calibration metrics with class overlaps.

Understanding local currents in the North Atlantic region of the ocean is a key part of modelling heat transfer and global climate patterns. Satellites provide a surface signature of the temperature of the ocean with a high horizontal resolution while in situ autonomous probes supply high vertical resolution, but horiz…

2019-10-18abs ↗pdf ↗