Paper extends knowledge tracing algorithms to infer student knowledge and predict posttest performance.
problem Lack of algorithms that directly infer student knowledge and predict posttest performance.
method Extended DKT and DKVMN to infer knowledge, and applied to BKT and PFA for comparison.
result Knowledge estimates from the extended algorithms correlate better with posttest performance than existing methods.
Deep learning based knowledge tracing model has been shown to outperform traditional knowledge tracing model without the need for human-engineered features, yet its parameters and representations have long been criticized for not being explainable. In this paper, we propose Deep-IRT which is a synthesis of the item res…
SKVMN improves KT models by tracing student knowledge states and dependencies.
problem Tackling limitations of existing KT models in deep learning.
method Proposes SKVMN, a deep learning model unifying recurrent and memory capacities.
result Significantly outperforms state-of-the-art KT models on multiple datasets.
PSI-KT improves KT accuracy and interpretability in learning materials.
problem Optimizing learning materials selection and timing for understanding and retention.
method Hierarchical generative approach using Bayesian inference.
result Superior multi-step predictive accuracy and scalable inference.
qDKT improves KT models by considering individual question outcomes.
problem Ignoring question-specific outcomes leads to inaccurate learner skill tracking.
method qDKT incorporates graph Laplacian regularization and uses a fastText-inspired initialization scheme.
result qDKT achieves state-of-the-art performance in predicting learner outcomes.
Knowledge tracing is the task of modeling each student's mastery of knowledge concepts (KCs) as (s)he engages with a sequence of learning activities. Each student's knowledge is modeled by estimating the performance of the student on the learning activities. It is an important research area for providing a personalized…
A new method predicts student skill success rates in real-time.
problem Accurate and explainable prediction of student skill success rates in real-time.
method Performance Distribution Tracing (PDT) using a Dynamic Bayesian Network with continuous random variables.
result PDT provides both explainability and accuracy in real-time predictions of student skill success rates.
RKT model improves knowledge tracing by considering exercise relations and student forget behavior.
problem Traditional KT models fail to consider both exercise relations and student forget behavior.
method RKT model uses relation-aware self-attention to incorporate exercise relations and student forget behavior.
result RKT model outperforms state-of-the-art KT methods on real-world datasets.
This paper introduces our solution to the 2018 Duolingo Shared Task on Second Language Acquisition Modeling (SLAM). We used deep factorization machines, a wide and deep learning model of pairwise relationships between users, items, skills, and other entities considered. Our solution (AUC 0.815) hopefully managed to bea…
KT models struggle with student concept drift, but BKT remains the most stable.
problem Impact of student concept drift on KT models.
method Applied four KT models to five academic years of data.
result KT models generally degrade in performance with concept drift, BKT remains stable.
We propose SPARFA-Trace, a new machine learning-based framework for time-varying learning and content analytics for education applications. We develop a novel message passing-based, blind, approximate Kalman filter for sparse factor analysis (SPARFA), that jointly (i) traces learner concept knowledge over time, (ii) an…
Knowledge tracing is a sequence prediction problem where the goal is to predict the outcomes of students over questions as they are interacting with a learning platform. By tracking the evolution of the knowledge of some student, one can optimize instruction. Existing methods are either based on temporal latent variabl…
KT models improved slightly with synthetic student data.
problem Limited access to real student data and lack of diversity in public datasets.
method Simulated student data using three statistical strategies and tested on KT baselines.
result Synthetic data can lead to similar performance as real data.
Hybrid framework injects TSLM insights into GRLM for robust time-series reasoning.
problem Lack of domain-specific knowledge in large language models for time-series reasoning.
method Hybrid knowledge-injection framework combining RLVR for efficient knowledge transfer.
result Consistently outperforms existing models by 7.9%-26.1% on multivariate time-series benchmarks.
Proposes GTTN for discovering all low-rank structures in deep multi-task learning.
problem Discovering all low-rank structures among tasks in deep multi-task models.
method Introduces GTTN, a convex combination of matrix trace norms of all tensor flattenings, to automatically determine the importance of components.
result Demonstrates the effectiveness of GTTN on real-world datasets.
Automates hair color digitization using imaging and deep learning.
problem Challenges in capturing and rendering realistic hair colors.
method Combines imaging, path-tracing, and self-supervised machine learning.
result Accurately captures and renders hair color with synthetic images.
Bayesian optimization is popular for optimizing time-consuming black-box objectives. Nonetheless, for hyperparameter tuning in deep neural networks, the time required to evaluate the validation error for even a few hyperparameter settings remains a bottleneck. Multi-fidelity optimization promises relief using cheaper p…
Paper derives constraints for Bayesian Knowledge Tracing parameters.
problem Issues with EM algorithm in BKT parameter estimation.
method From first principles, derives constraints on BKT parameter space.
result Novel algorithm respects derived constraints for parameter estimation.
A new method for optimizing deep neural networks using TKFAC.
problem Optimizing deep neural networks with second-order methods.
method Proposes Trace-restricted Kronecker-factored Approximate Curvature (TKFAC) for Fisher information matrix approximation.
result TKFAC improves performance on deep network architectures compared to state-of-the-art algorithms.
Develops a deep learning framework to predict future tech directions for high-tech companies.
problem Difficult task in predicting future R&D trends for high-tech companies due to complexity and variety of factors.
method Deep Technology Forecasting (DTF) framework with three components: PCR, CTR, and DTT neural network.
result DTF framework precisely predicts future tech emphasis of companies using hybrid factors.
Daydream predicts DNN optimization efficacy efficiently.
problem Inefficiency and error in evaluating DNN optimizations.
method Models DNN execution with a dependency graph, predicts runtime based on simulation.
result Accurately predicts performance improvements from DNN optimizations.
Deep learning model improves seismic rock property estimation.
problem Estimating reservoir rock properties from seismic reflection data.
method Proposes a deep learning-based seismic inversion workflow that models seismic traces spatiotemporally.
result Achieves best performance on SEAM dataset with r2 coefficient of 79.77\% Bayesian inference for deep neural networks using trace-class priors and MLMC.
problem Efficient Bayesian inference for deep neural networks.
method Trace-class neural network priors and Multilevel Monte Carlo method.
result Optimal computational complexity for Bayesian inference of TNN models.
TrueLearn uses Bayesian algorithms to match learners with educational resources.
problem Matching lifelong learners to open educational resources efficiently and effectively.
method TrueLearn uses a text ontology and Bayesian strategies to match learners with educational resources based on their background knowledge and material novelty.
result TrueLearn algorithms show promise in building an effective educational recommendation system.
Online knowledge repositories typically rely on their users or dedicated editors to evaluate the reliability of their content. These evaluations can be viewed as noisy measurements of both information reliability and information source trustworthiness. Can we leverage these noisy evaluations, often biased, to distill a…
We consider the problem of learning a high-dimensional but low-rank matrix from a large-scale dataset distributed over several machines, where low-rankness is enforced by a convex trace norm constraint. We propose DFW-Trace, a distributed Frank-Wolfe algorithm which leverages the low-rank structure of its updates to ac…
Study integrates attentional and spacing factors to improve category learning models.
problem Understanding the impact of training sequences on category learning.
method Introduced a novel integration of attentional factors and spacing into logistic knowledge tracing models.
result Enhanced model predicts students' learning outcomes better than existing models.
Early training phase affects deep neural network optimization and generalization.
problem The choice of learning rate influences generalization in deep learning models.
method Showed that SGD implicitly penalizes the trace of the Fisher Information Matrix (FIM) from the start of training, and explicitly penalizing the trace of FIM improves generalization.
result Catastrophic Fisher explosion (large trace of FIM early in training) is linked to poor generalization.
Deep Q-learning analyzes EEG for drowsiness during driving tests.
problem Estimating drowsiness during driving to improve safety.
method Adapting Q-learning to EEG data for drowsiness estimation.
result Trained model accurately tracks mind state variations in EEG data.
Paper proves stability for recovering connections from holonomy traces.
problem Recovering a connection from holonomy traces on Riemannian manifolds.
method Combination of microlocal analysis and non-Abelian approximate Livsic Theorem.
result Hölder type stability estimates for holonomy inverse problem.
Deep neural networks are susceptible to various inference attacks as they remember information about their training data. We design white-box inference attacks to perform a comprehensive privacy analysis of deep learning models. We measure the privacy leakage through parameters of fully trained models as well as the pa…
Framework evaluates the impact of prior knowledge in deep learning models.
problem Mitigating data-driven model shortcomings like data dependence and generalization ability.
method Model-agnostic framework inspired by interpretable machine learning, assessing data volume and estimation range effects.
result Complex relationship between data and knowledge, including dependence, synergistic, and substitution effects.
New BNN architectures reduce computational cost for uncertainty quantification.
problem High computational cost in Bayesian neural networks.
method Partial trace-class Bayesian neural networks (PaTraC BNNs).
result Comparable uncertainty quantification with fewer parameters.
Models leak information about their training data. This enables attackers to infer sensitive information about their training sets, notably determine if a data sample was part of the model's training set. The existing works empirically show the possibility of these membership inference (tracing) attacks against complex…
This survey analyzes knowledge discovery in cryptocurrency transactions.
problem Understanding user behaviors and collective actions in cryptocurrency transactions.
method Data mining techniques and literature review.
result Classified existing research into three aspects and discussed major findings.
Learning from the crowd has become increasingly popular in the Web and social media. There is a wide variety of crowdlearning sites in which, on the one hand, users learn from the knowledge that other users contribute to the site, and, on the other hand, knowledge is reviewed and curated by the same users using assessm…
Over the past few years, trace regression models have received considerable attention in the context of matrix completion, quantum state tomography, and compressed sensing. Estimation of the underlying matrix from regularization-based approaches promoting low-rankedness, notably nuclear norm regularization, have enjoye…
We study the interplay between surrogate methods for structured prediction and techniques from multitask learning designed to leverage relationships between surrogate outputs. We propose an efficient algorithm based on trace norm regularization which, differently from previous methods, does not require explicit knowled…
Deep learning optimizes wireless band switching without measurement gaps.
problem Wireless networks waste data during band switching due to measurement gaps.
method Online-learning based classifier models exploiting spatial and spectral correlation.
result 30% improvement in mean effective rates compared to industry standard.
Survey of knowledge distillation for resource-limited devices.
problem Deploying large deep learning models on resource-limited devices.
method Knowledge distillation using a smaller model trained with information from a larger model.
result A new metric (distillation metric) for comparing different knowledge distillation algorithms.
Most real-world datasets, and particularly those collected from physical systems, are full of noise, packet loss, and other imperfections. However, most specification mining, anomaly detection and other such algorithms assume, or even require, perfect data quality to function properly. Such algorithms may work in lab c…
Recently, deep models have had considerable success in several tasks, especially with low-level representations. However, effective learning from sparse noisy samples is a major challenge in most deep models, especially in domains with structured representations. Inspired by the proven success of human guided machine l…
TRAK traces model predictions to training data efficiently.
problem Inefficiency in data attribution methods for large-scale models.
method TRAK: a new data attribution method that is both effective and computationally tractable.
result TRAK matches the performance of methods requiring thousands of models with just a handful.
This paper reviews deep learning and knowledge-based methods for molecular design.
problem Optimizing molecular properties for scientific advances and process performance.
method Survey of deep learning and knowledge-based methods for molecular design.
result Deep learning models show promise in overcoming computational challenges.
New methods improve deep reinforcement learning by accelerating credit assignment.
problem Challenges in achieving fast and stable off-policy learning in deep reinforcement learning.
method Extends the generalized PBE objective to support multistep credit assignment and derives three gradient-based methods.
result Proposed methods outperform PPO and StreamQ in MuJoCo and MinAtar environments.
A new method uses denoising diffusion models to improve seismic data interpolation.
problem Improving the accuracy of seismic data interpolation to enhance imaging and interpretation.
method The approach combines denoising diffusion probabilistic models with coherence-corrected resampling strategies.
result The proposed method achieves superior performance and generalization to various missing patterns and noise levels.
Adaptive learning, also known as adaptive teaching, relies on learning path recommendation, which sequentially recommends personalized learning items (e.g., lectures, exercises) to satisfy the unique needs of each learner. Although it is well known that modeling the cognitive structure including knowledge level of lear…
NeSS combines neural and symbolic approaches for better compositional generalization.
problem Lack of compositional generalization in deep learning models.
method NeSS uses a neural network to generate traces, executed by a symbolic stack machine with sequence manipulation.
result Achieves 100% generalization performance across multiple domains.