InstaNAS searches for a distribution of architectures to improve performance and reduce latency.
problem Finding a single architecture that represents the whole dataset with high diversity and variety.
method InstaNAS uses a controller trained to search for a 'distribution of architectures' that assigns each input sample a domain expert architecture.
result InstaNAS achieves up to 48.8% latency reduction without compromising accuracy.