On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,051 papers · 148 categories

Trend · papers per month

count % of corpus

2 results for “back-distillation”

Network Transplanting (extended abstract)cs.LG

New method transplants specific neural networks to generic ones without training samples.

problem Learning massive tasks and categories requires collecting samples for all at once.

method Designs a functionally interpretable generic network and uses back-distillation for transplanting.

result Method without training samples outperforms with 100 samples.

network transplanting neural networks generic network back-distillation few-shot learning

2019-01-21abs ↗pdf ↗

Network Transplantingcs.LG

This paper focuses on a new task, i.e., transplanting a category-and-task-specific neural network to a generic, modular network without strong supervision. We design an functionally interpretable structure for the generic network. Like building LEGO blocks, we teach the generic network a new category by directly transp…

2018-04-26abs ↗pdf ↗