Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

count% of corpus
0.3%0.5%0.8%0.1% · Jan 202019922001200920172026
2 results for “super-net”
How to Train Your Super-Net: An Analysis of Training Heuristics in Weight-Sharing NAScs.LG

This paper evaluates heuristics and hyperparameters in weight-sharing NAS methods.

problem Improving the performance of weight-sharing NAS methods.
method Systematic evaluation of heuristics and hyperparameters in weight-sharing NAS algorithms.
result Some heuristics negatively impact super-net and stand-alone performance correlation.
neural architecture searchweight-sharingsuper-netNASheuristics
2020-03-09abs ↗pdf ↗
Deeper Insights into Weight Sharing in Neural Architecture Searchcs.LG

This paper investigates weight-sharing in NAS, revealing its impact and providing solutions.

problem Reducing the time and computational cost of training neural networks.
method Comprehensive experiments on weight-sharing in NAS, analyzing variance and interference.
result Properly reducing weight sharing can reduce variance and improve model performance.
Neural Architecture SearchWeight SharingVariance ReductionInterference
2020-01-06abs ↗pdf ↗