Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,738 papers · 148 categories

Trend · papers per month

0111 · Mar 201619922001200920172026
5 results for entropy-preserving

Entrocraft addresses RL performance saturation in LLMs by customizing entropy curves.

problem Performance saturation in RL algorithms for LLMs.
method Entrocraft uses rejection sampling to bias advantage distributions for customized entropy schedules.
result Entrocraft significantly improves generalization, output diversity, and long-term training in 4B models.

This work addresses two main issues of the standard Kernel Entropy Component Analysis (KECA) algorithm: the optimization of the kernel decomposition and the optimization of the Gaussian kernel parameter. KECA roughly reduces to a sorting of the importance of kernel eigenvectors by entropy instead of by variance as in K…

2016-03-09abs ↗pdf ↗

GOPO optimizes large models in Hilbert space, avoiding Kullback-Leibler's curvature.

problem Optimizing large language models with Kullback-Leibler divergence's curvature issues.
method GOPO uses Hilbert space L2(pi_k) with orthogonality constraints and a work-dissipation functional.
result GOPO achieves competitive generalization with stable gradient dynamics and entropy preservation.