Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,051 papers · 148 categories

Trend · papers per month

0.3%0.5%0.8%0.2% · Jun 202619922001200920182026
5 results for overthinking

SDN mitigates overthinking in deep networks, reducing inference cost and preserving accuracy.

problem Overthinking in deep neural networks, leading to unnecessary computations and misclassifications.
method Introducing internal classifiers (Shallow-Deep Network) to SDNs, enabling early confidence-based exits.
result SDNs reduce inference cost by more than 50% and preserve accuracy, mitigating overthinking.

Sampling more can make models more confident in wrong answers, not better.

problem The modal ceiling and correlation ceiling limit the benefit of increased sampling.
method Analyzes the trade-offs between sampling more and selecting the best answer.
result Extra sampling beyond a certain point does not improve model performance and can even degrade it.

Early stopping methods reduce unnecessary reasoning steps in LLMs by monitoring uncertainty signals.

problem LLMs sometimes generate unnecessary reasoning steps, especially under uncertainty.
method Statistically principled early stopping methods that monitor uncertainty signals during generation.
result Uncertainty-aware early stopping improves efficiency and reliability in LLM reasoning, especially in math reasoning.

EERO optimizes resource usage for efficient classification.

problem Managing computational resources in complex machine learning models.
method EERO uses multiple classifiers with a reject option to adaptively shorten processing paths.
result EERO effectively manages budget allocation and enhances accuracy in complex scenarios.

Study reveals how depth of reasoning affects generalization in models.

problem Understanding scaling behavior of generalization with CoT depth.
method Theoretical model of CoT in linear regression using random matrix theory.
result Sharp phase transition between exponential and polynomial improvement, saturation, and overthinking.