Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,694 papers · 148 categories

Trend · papers per month

count% of corpus
0111 · Sep 202419922001200920172026
2 results for “AdaLoRA”
A Bayesian Interpretation of Adaptive Low-Rank Adaptationcs.LG

Bayesian approach improves AdaLoRA's performance and efficiency.

problem Improving the efficiency and performance of adaptive low-rank adaptation.
method Utilized Bayesian metrics and the Improved Variational Online Newton (IVON) optimizer for adaptive parameter budget allocation.
result Bayesian counterpart outperforms sensitivity-based importance metric and is faster than AdaLoRA.
Bayesian interpretationAdaLoRAadaptive low-rank adaptationsignal-to-noise ratioImproved Variational Online Newton
2024-09-16abs ↗pdf ↗
Statistical Inference for Rank Allocation in Low-Rank Adaptationstat.ML

StatLoRA uses statistical inference to allocate ranks in LoRA fine-tuning, improving performance.

problem Balancing efficiency, expressiveness, and generalization in LoRA rank allocation.
method Formulates LoRA rank allocation as a statistical hypothesis testing problem, using estimated p-values to determine component retention or pruning.
result StatLoRA achieves comparable or better performance than existing methods under matched rank budgets.
Low-rank adaptationStatistical inferenceRank allocationStatistical hypothesis testingDeep learning
2026-07-22abs ↗pdf ↗