Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,051 papers · 148 categories

Trend · papers per month

24487296 · Jun 202019922001200920182026
48 results for hard distillation

PS-KD distills a model's own knowledge to soften hard targets during training.

problem Improving generalization of deep neural networks by softening hard targets.
method Progressive self-knowledge distillation (PS-KD) that progressively distills a model's own knowledge to soften hard targets.
result PS-KD improves accuracy and provides high quality of confidence estimates in terms of calibration and ordinal ranking.

Survey of knowledge distillation for resource-limited devices.

problem Deploying large deep learning models on resource-limited devices.
method Knowledge distillation using a smaller model trained with information from a larger model.
result A new metric (distillation metric) for comparing different knowledge distillation algorithms.

The paper analyzes knowledge distillation in wide neural networks, providing theoretical insights and practical implications.

problem Lack of theoretical understanding of knowledge distillation in wide neural networks.
method Theoretical analysis of knowledge distillation in a linearized model of a wide neural network, introducing a metric of task training difficulty.
result For a perfect teacher, a high ratio of teacher's soft labels can be beneficial. For imperfect teacher, hard labels can correct wrong predictions.

Distillation works even with hard labels from overparameterized teacher, leading to better performance.

problem Improving model performance with hard labels from overparameterized teacher.
method Training a student model on a large held-out dataset labeled by a highly overparameterized teacher.
result Student model outperforms traditional approaches due to double descent phenomenon.

This study improves knowledge distillation for RNN-T models with noisy labels.

problem Challenges in distilling knowledge from RNN-T models with variable quality teachers.
method Full-sum distillation and sequence-level knowledge distillation.
result Full-sum distillation outperforms other methods for RNN-T models, especially for bad teachers.

Improved dataset distillation for images and texts boosts model accuracy.

problem Reducing dataset size for faster and more energy-efficient model training.
method Simultaneous distillation of images and soft labels, extending to text datasets.
result 2-4% increase in accuracy for image classification tasks, 20% reduction in distilled samples.

Knowledge distillation simplifies deep models into interpretable decision trees.

problem Interpretability of deep neural networks is challenging and important for practical deployment.
method Knowledge distillation applied to transform deep models into decision trees.
result The student model achieves better accuracy than vanilla decision trees.

Paper proposes a data-free adversarial distillation method.

problem Tackles the challenge of model compression without real-world data.
method Introduces a novel adversarial distillation mechanism to craft a compact student model without any real-world data.
result Demonstrates comparable performance to data-driven methods and achieves state-of-the-art results in semantic segmentation.

Combines experience replay and exploration for better agent performance.

problem Improving exploration efficiency and robustness in reinforcement learning.
method Integrates Intrinsic Rewards with Prioritized Oversampled Experience Replay (POER).
result Achieves better agent performance and sample efficiency compared to PPO/RND.

Top-performing machine learning systems, such as deep neural networks, large ensembles and complex probabilistic graphical models, can be expensive to store, slow to evaluate and hard to integrate into larger systems. Ideally, we would like to replace such cumbersome models with simpler models that perform equally well…

2015-10-08abs ↗pdf ↗

This work compresses BERT into simple neural networks using unlabeled data.

problem Compression of large BERT models for practical use in downstream tasks.
method Leverage unlabeled transfer data to distill BERT into simple RNN models with hard and soft distillation.
result Simple RNN models can match or exceed BERT performance with up to 26x parameter compression.

Rectified decision trees improve machine learning interpretability and effectiveness.

problem Combining interpretability and effectiveness in machine learning models.
method Knowledge distillation and modified decision tree splitting criteria.
result Soft labels improve model performance and reduce model size.

Study shows optimal self-distillation improves model performance on noisy data.

problem Improving model performance on noisy Gaussian mixture data.
method Hyperparameter-tuned multi-stage self-distillation with a linear classifier, using replica method.
result Primary driver of SD's performance improvement is denoising through hard pseudo-labels.

A new method for exploration in reinforcement learning improves performance on Atari games.

problem Improving exploration in reinforcement learning algorithms, especially for complex games.
method Random Network Distillation (RND) bonus combined with flexible reward combination.
result Significant progress on hard exploration Atari games, including Montezuma's Revenge.

The paper studies how search and distillation improve reasoning in large language models.

problem Improving reasoning capabilities of large language models.
method Viewing chain-of-thought generation as a metastable Markov process, proving benefits of search and distillation.
result Search protocol rewards sparse edges, reducing the expected number of steps to reach different clusters.

Learning shrinks hard tail, improving inference performance.

problem Improving inference performance in neural networks.
method Latent Instance Difficulty (LID) model analyzing fine-tuning of neural networks.
result Training-dependent inference scaling, with βexteffβ_ ext{eff} growing with sample size before saturating.

Labels distilled from images improve model training efficiency and flexibility.

problem Creating synthetic labels for a small set of real images to train models effectively.
method Introduce a more robust and flexible meta-learning algorithm for distillation and an effective first-order strategy based on convex optimization layers.
result Label distillation leads to improved results and greater flexibility in neural architectures.

Distillation affects some classes more than others, impacting fairness and bias.

problem Distillation affects some classes more than others, impacting fairness and bias.
method Examined class-wise accuracy and fairness metrics (DPD, EOD) on models trained with different datasets.
result Increasing the distillation temperature improves the distilled student model's fairness and individual fairness.

This paper improves robustness in small neural networks through distillation.

problem Vulnerability of small neural networks to adversarial attacks.
method Adversarially Robust Distillation (ARD) to transfer robustness from teacher to student networks.
result ARD produces small models with superior robust accuracy compared to adversarially trained networks.

Study on ensemble, distillation, and self-distillation in deep learning models.

problem Improving test accuracy in deep learning models using ensemble and distillation methods.
method Formal study of ensemble and distillation, considering multi-view data structure.
result Proven that ensemble and distillation can improve test accuracy in deep learning models, and the superior performance can be distilled into a single model.

A new distillation method transfers channel information from teacher to student.

problem Transfer knowledge from teacher to student with fewer parameters and calculations.
method Channel Distillation (CD) and Guided Knowledge Distillation (GKD) with loss decay.
result Achieved 27.68% top-1 error on ImageNet with ResNet18, outperforming state-of-the-art methods.

Repeated self-distillation improves model performance significantly.

problem How much gain is possible by applying multiple steps of self-distillation?
method Investigated linear regression tasks, applied multiple steps of self-distillation, analyzed excess risk reduction.
result Multi-step self-distillation reduces excess risk by a factor as large as dd, where dd is the input dimension.

This work explores different distillation techniques in reinforcement learning.

problem Understanding and optimizing the transfer of knowledge between policies.
method Theoretical and empirical analysis of various distillation techniques.
result Three preferred distillation techniques are identified, including expected entropy regularised distillation.

OKDDip uses diverse peers to improve online knowledge distillation.

problem Early saturation in group-based distillation.
method Two-level distillation with multiple auxiliary peers and a group leader, using attention-based aggregation weights.
result OKDDip consistently gives better performance than state-of-the-art approaches.

RID framework quantifies and regularizes task-relevant knowledge in distillation.

problem Distilling irrelevant information can hinder student model performance.
method Partial Information Decomposition to quantify and regularize task-relevant knowledge.
result RID framework leads to more resilient distillation under nuisance teachers.

Among other things, we prove the following two topologcal statements about closed hyperbolic 3-manifolds. First, every rational second homology class of a closed hyperbolic 3-manifold has a positve integral multiple represented by an oriented connected closed π1π_1-injectively immersed quasi-Fuchsian subsurface. Second…

2013-09-28abs ↗pdf ↗

Rotation invariant algorithms fail with hard labels sampled from sparse targets.

problem Rotation invariant algorithms fail to learn from hard labels sampled from sparse targets.
method Proving the excess risk of rotation invariant algorithms and proposing a simple non-rotation invariant algorithm.
result Rotation invariant algorithms incur an excess risk of $Ω\left(\frac{d-1}{n} ight)$, while non-rotation invariant algorithms have an excess risk of $O\left(\frac{s\log d}{n} ight).

This paper improves speech recognition by distilling knowledge from acoustic models.

problem Improving speech recognition accuracy using ensemble models.
method Proposes multi-teacher distillation strategies for joint CTC-attention end-to-end ASR systems, integrating error rate metric for optimization.
result Reports state-of-the-art error rates on various datasets and languages.

CAKD framework optimizes knowledge transfer by focusing on influential components of distillation.

problem Balancing and optimizing knowledge transfer in distillation models.
method Decouple KL divergence into BCD, SCD, and WCD; prioritize influential components.
result CAKD framework consistently outperforms baseline across diverse models and datasets.