On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,932 papers · 148 categories

Trend · papers per month

count % of corpus

2 results for “collage-CNN”

Collage Inference: Achieving low tail latency during distributed image classification using coded redundancy modelscs.DC

Collage-CNN reduces cloud inference latency by 1.47X with 9X reduced latency variation.

problem Reducing latency variance in cloud machine learning inference.

method Proposes a novel Collage-CNN model that combines multiple images for classification, providing redundancy and cost efficiency.

result Significant reduction in 99th percentile tail latency and variation in inference latency.

machine learning inference latency cloud computing redundancy collage-CNN

2019-06-05abs ↗pdf ↗

Collage Inference: Using Coded Redundancy for Low Variance Distributed Image Classificationcs.CV

MLaaS (ML-as-a-Service) offerings by cloud computing platforms are becoming increasingly popular. Hosting pre-trained machine learning models in the cloud enables elastic scalability as the demand grows. But providing low latency and reducing the latency variance is a key requirement. Variance is harder to control in a…

2019-04-27abs ↗pdf ↗