Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,051 papers · 148 categories

Trend · papers per month

3468101135 · May 202619922001200920182026
48 results for ranking distillation

The paper establishes theoretical foundations for low-rank knowledge distillation in LLMs.

problem Understanding the theoretical underpinnings of low-rank knowledge distillation in LLMs.
method Theoretical framework for low-rank knowledge distillation, including convergence rates and generalization bounds.
result Theoretical analysis reveals optimal rank r=O(n)r^* = O(\sqrt{n}) for minimizing generalization error.

A new method trains compact ranking models for recommender systems.

problem Training efficient ranking models for recommender systems.
method Ranking Distillation (RD) technique to train a smaller model with similar performance to a larger teacher model.
result The student model achieves a similar ranking performance to the teacher model with significantly less model size.

This paper distills Bayesian posterior expectations for deep neural networks.

problem Improving deep neural network performance and uncertainty quantification.
method Develops a framework for distilling expectations from Bayesian posterior distributions using Monte Carlo samples.
result The framework successfully distills posterior predictive distribution and expected entropy.

Gaussian processes (GPs) are flexible models that can capture complex structure in large-scale dataset due to their non-parametric nature. However, the usage of GPs in real-world application is limited due to their high computational cost at inference time. In this paper, we introduce a new framework, \textit{kernel di…

2018-01-31abs ↗pdf ↗

This work reduces the computational cost of large-scale knowledge distillation.

problem Heavy computational costs in training large-scale knowledge distillation models.
method Dynamic Importance Sampling applied to the interaction between teacher and student.
result Our method reduces training time while maintaining competitive performance.

A new KD model for collaborative filtering improves top-N recommendation performance.

problem Challenges in applying KD to recommender models due to feedback sparsity and ambiguity.
method Proposes a new KD model (CD) for collaborative filtering, reformulating a loss function, using probabilistic rank-aware sampling, and developing training strategies.
result Outperforms state-of-the-art methods by 2.7-33.2% in hit rate (HR) and 2.7-29.1% in NDCG.

Unified transformer-based LT-TTD improves ranking efficiency and quality.

problem Decoupled L1 and L2 models in recommendation and search systems cause irreversible error propagation and suboptimal ranking.
method LT-TTD combines two-tower models with transformer expressivity in a unified listwise learning framework, providing theoretical guarantees and UPQE evaluation.
result LT-TTD reduces irretrievable relevant items and achieves better global optimization than disjoint training.

SlimNets explores efficient deep model compression and acceleration.

problem Over-parameterized deep neural networks consume excessive resources.
method SlimNets evaluates and combines three methods: weight pruning, low rank factorization, and knowledge distillation.
result Combining weight pruning and knowledge distillation reduces model size by 85 times while maintaining 96% accuracy.

PS-KD distills a model's own knowledge to soften hard targets during training.

problem Improving generalization of deep neural networks by softening hard targets.
method Progressive self-knowledge distillation (PS-KD) that progressively distills a model's own knowledge to soften hard targets.
result PS-KD improves accuracy and provides high quality of confidence estimates in terms of calibration and ordinal ranking.

This study improves knowledge distillation for RNN-T models with noisy labels.

problem Challenges in distilling knowledge from RNN-T models with variable quality teachers.
method Full-sum distillation and sequence-level knowledge distillation.
result Full-sum distillation outperforms other methods for RNN-T models, especially for bad teachers.

Paper tackles robust offline RL for non-Markovian processes, improving efficiency and applicability.

problem Learning robust policies for non-Markovian decision processes with limited offline data.
method Proposes a novel algorithm with dataset distillation and LCB design for robust values, derived new dual forms, and introduces concentrability coefficients.
result Proves polynomial sample efficiency for finding ε-optimal robust policies.

Improved dataset distillation for images and texts boosts model accuracy.

problem Reducing dataset size for faster and more energy-efficient model training.
method Simultaneous distillation of images and soft labels, extending to text datasets.
result 2-4% increase in accuracy for image classification tasks, 20% reduction in distilled samples.

Labels distilled from images improve model training efficiency and flexibility.

problem Creating synthetic labels for a small set of real images to train models effectively.
method Introduce a more robust and flexible meta-learning algorithm for distillation and an effective first-order strategy based on convex optimization layers.
result Label distillation leads to improved results and greater flexibility in neural architectures.

Distillation affects some classes more than others, impacting fairness and bias.

problem Distillation affects some classes more than others, impacting fairness and bias.
method Examined class-wise accuracy and fairness metrics (DPD, EOD) on models trained with different datasets.
result Increasing the distillation temperature improves the distilled student model's fairness and individual fairness.

Survey of knowledge distillation for resource-limited devices.

problem Deploying large deep learning models on resource-limited devices.
method Knowledge distillation using a smaller model trained with information from a larger model.
result A new metric (distillation metric) for comparing different knowledge distillation algorithms.

This paper improves robustness in small neural networks through distillation.

problem Vulnerability of small neural networks to adversarial attacks.
method Adversarially Robust Distillation (ARD) to transfer robustness from teacher to student networks.
result ARD produces small models with superior robust accuracy compared to adversarially trained networks.

Study on ensemble, distillation, and self-distillation in deep learning models.

problem Improving test accuracy in deep learning models using ensemble and distillation methods.
method Formal study of ensemble and distillation, considering multi-view data structure.
result Proven that ensemble and distillation can improve test accuracy in deep learning models, and the superior performance can be distilled into a single model.

A new distillation method transfers channel information from teacher to student.

problem Transfer knowledge from teacher to student with fewer parameters and calculations.
method Channel Distillation (CD) and Guided Knowledge Distillation (GKD) with loss decay.
result Achieved 27.68% top-1 error on ImageNet with ResNet18, outperforming state-of-the-art methods.

OKDDip uses diverse peers to improve online knowledge distillation.

problem Early saturation in group-based distillation.
method Two-level distillation with multiple auxiliary peers and a group leader, using attention-based aggregation weights.
result OKDDip consistently gives better performance than state-of-the-art approaches.

Repeated self-distillation improves model performance significantly.

problem How much gain is possible by applying multiple steps of self-distillation?
method Investigated linear regression tasks, applied multiple steps of self-distillation, analyzed excess risk reduction.
result Multi-step self-distillation reduces excess risk by a factor as large as dd, where dd is the input dimension.

This work explores different distillation techniques in reinforcement learning.

problem Understanding and optimizing the transfer of knowledge between policies.
method Theoretical and empirical analysis of various distillation techniques.
result Three preferred distillation techniques are identified, including expected entropy regularised distillation.

RID framework quantifies and regularizes task-relevant knowledge in distillation.

problem Distilling irrelevant information can hinder student model performance.
method Partial Information Decomposition to quantify and regularize task-relevant knowledge.
result RID framework leads to more resilient distillation under nuisance teachers.

Paper introduces GAMs for interpretable learning-to-rank models.

problem Need for transparent ranking models in legal or policy scenarios.
method Developed generalized additive models (GAMs) for ranking tasks using neural networks.
result Neural ranking GAMs achieve better performance than traditional GAMs while maintaining interpretability.

This paper improves speech recognition by distilling knowledge from acoustic models.

problem Improving speech recognition accuracy using ensemble models.
method Proposes multi-teacher distillation strategies for joint CTC-attention end-to-end ASR systems, integrating error rate metric for optimization.
result Reports state-of-the-art error rates on various datasets and languages.

CAKD framework optimizes knowledge transfer by focusing on influential components of distillation.

problem Balancing and optimizing knowledge transfer in distillation models.
method Decouple KL divergence into BCD, SCD, and WCD; prioritize influential components.
result CAKD framework consistently outperforms baseline across diverse models and datasets.

Consistency distillation reduces memorization in diffusion models without harming sample quality.

problem Understanding how distillation affects memorization in diffusion models.
method Analysis of consistency distillation in diffusion models using a random feature neural network model.
result Consistency distillation reduces memorization in diffusion models without harming sample quality.

Self-distillation improves model performance but can lead to underfitting.

problem Understanding why self-distillation improves model performance and its limitations.
method Theoretical analysis of self-distillation in Hilbert space with 2\ell_2 regularization.
result Self-distillation modifies regularization by limiting the number of basis functions, potentially leading to underfitting.

A new method distills datasets more efficiently and effectively.

problem Achieving competitive performance on test data with a small synthetic dataset.
method Tackles dataset distillation as a bilevel optimization problem, introduces RaT-BPTT to stabilize gradients and speed up optimization.
result Establishes new state-of-the-art performance across various benchmarks.

Improved generalization with iterative self-distillation using weighted ground-truth targets.

problem Improving generalization accuracy in neural networks.
method Iterative kernel regression with weighted ground-truth targets and 2\ell_2 regularization.
result Closed-form solution for optimal weighting parameter and efficient estimation.

The paper explains knowledge distillation by analyzing visual concepts in DNNs.

problem Understanding how knowledge distillation affects the learning of visual concepts in deep neural networks.
method The paper proposes three hypotheses and designs mathematical metrics to evaluate feature representations of DNNs.
result The hypotheses were verified through experiments on various DNNs.

This work proposes splitting deep neural networks into smaller sub-networks for faster and more efficient distillation.

problem Challenges in training deep neural networks, including local optima, gradient issues, and computational demands.
method Proposes a non-end-to-end distillation approach by splitting networks into smaller, independent sub-networks (neighbourhoods).
result Independent training of smaller sub-networks can speed up distillation and improve efficiency in various applications.

SiD distills pretrained diffusion models into a fast one-step generator.

problem Efficiently distilling pretrained diffusion models into a fast generator.
method Reformulates forward diffusion processes as semi-implicit distributions and uses three score-related identities to create a loss mechanism.
result Achieves high FID performance and significantly reduces generation time.