On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

count % of corpus

2 results for “ERNIE”

Quantization Aware Training, ERNIE and Kurtosis Regularizer: a short empirical studystat.ML

This study improves Ernie's accuracy for INT8 inference by modifying its training process.

problem Improving the accuracy of pre-trained models like Ernie for low precision inference.

method Integrates a regularizer into the training process to make it more robust to quantization.

result Increased INT8 accuracy for Ernie models.

Quantization Aware Training ERNIE Low Precision Inference Regularization Pre-trained Models

2021-06-24abs ↗pdf ↗

Application of Pre-training Models in Named Entity Recognitioncs.CL

RoBERTa outperforms other pre-trained models in NER tasks.

problem Improving Named Entity Recognition (NER) performance.

method Fine-tuning four pre-trained models (BERT, ERNIE, ERNIE2.0-tiny, RoBERTa) on NER task.

result RoBERTa achieved state-of-the-art results on MSRA-2006 dataset.

Named Entity Recognition NER Natural Language Processing Pre-training Models RoBERTa

2020-02-09abs ↗pdf ↗