DiffQue estimates relative difficulty of questions in CQA services.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
New ensemble models classify mouse movement trajectories to assess survey question difficulty.
This study introduces balanced DRPS and OrderedLogitNN for better QDE of discrete-level questions.
R2DE assesses new exam questions quickly and accurately.
We propose SPARFA-Trace, a new machine learning-based framework for time-varying learning and content analytics for education applications. We develop a novel message passing-based, blind, approximate Kalman filter for sparse factor analysis (SPARFA), that jointly (i) traces learner concept knowledge over time, (ii) an…
We introduce an invariant linked to some foundational questions in geometric measure theory and provide bounds on this invariant by decomposing an arbitrary cycle into uniformly rectifiable pieces. Our invariant measures the difficulty of cutting a nonorientable closed manifold or mod-2 cycle in into ori…
We propose a new probabilistic graphical model that jointly models the difficulties of questions, the abilities of participants and the correct answers to questions in aptitude testing and crowdsourcing settings. We devise an active learning/adaptive testing scheme based on a greedy minimization of expected model entro…
The paper explores when to prioritize easy or hard samples in learning tasks.
Fast approximate nearest neighbor (NN) search in large databases is becoming popular. Several powerful learning-based formulations have been proposed recently. However, not much attention has been paid to a more fundamental question: how difficult is (approximate) nearest neighbor search in a given data set? And which …
A problem faced by many instructors is that of designing exams that accurately assess the abilities of the students. Typically these exams are prepared several days in advance, and generic question scores are used based on rough approximation of the question difficulty and length. For example, for a recent class taught…
Many recent papers address reading comprehension, where examples consist of (question, passage, answer) tuples. Presumably, a model must combine information from both questions and passages to predict corresponding answers. However, despite intense interest in the topic, with hundreds of published papers vying for lead…
Estimating the difficulty level of math word problems is an important task for many educational applications. Identification of relevant and irrelevant sentences in math word problems is an important step for calculating the difficulty levels of such problems. This paper addresses a novel application of text categoriza…
Machine learning offers novel ways and means to design personalized learning systems wherein each student's educational experience is customized in real time depending on their background, learning goals, and performance to date. SPARse Factor Analysis (SPARFA) is a novel framework for machine learning-based learning a…
We develop a new model and algorithms for machine learning-based learning analytics, which estimate a learner's knowledge of the concepts underlying a domain, and content analytics, which estimate the relationships among a collection of questions and those concepts. Our model represents the probability that a learner p…
The paper tackles adaptive questioning to classify candidate ability.
Active learning reduces labeling efforts for QDE models.
Most work in machine reading focuses on question answering problems where the answer is directly expressed in the text to read. However, many real-world question answering problems require the reading of text not because it contains the literal answer, but because it contains a recipe to derive an answer together with …
The recently proposed SPARse Factor Analysis (SPARFA) framework for personalized learning performs factor analysis on ordinal or binary-valued (e.g., correct/incorrect) graded learner responses to questions. The underlying factors are termed "concepts" (or knowledge components) and are used for learning analytics (LA),…
Paper questions RNN and LSTM's long-term memory and introduces a new definition.
This paper poses some basic questions about instances (hard to find) of a special problem in 3-manifold topology. "Important though the general concepts and propositions may be with the modern industrious passion for axiomatizing and generalizing has presented us...nevertheless I am convinced that the special problems …
The study explores how partial observations of network nodes can infer the graph structure.
Book introduces principles of LCK geometry for complex manifold students.
Paper creates universal adversarial attacks.
Recent studies have significantly improved the state-of-the-art on common-sense reasoning (CSR) benchmarks like the Winograd Schema Challenge (WSC) and SWAG. The question we ask in this paper is whether improved performance on these benchmarks represents genuine progress towards common-sense-enabled systems. We make ca…
The paper explores new risk models for autonomous driving.
A new framework evaluates LLM calibration in open-ended QA.
New research shows deep learning struggles with hard problems due to biased data generation.
IRT improves algorithm evaluation across datasets.
ABC method analyzes diffusion model dependence without retraining.
Time-continuous emotion prediction has become an increasingly compelling task in machine learning. Considerable efforts have been made to advance the performance of these systems. Nonetheless, the main focus has been the development of more sophisticated models and the incorporation of different expressive modalities (…
This paper is motivated by questions about averages of stochastic processes which originate in mathematical finance, originally in connection with valuing the so-called Asian options. Starting with research of Yor's in 1992, these questions about exponential functionals of Brownian motion have been studied in terms of …
Deep networks prioritize easier examples over harder ones, leading to faster training.
Efficient exploration is one of the key challenges for reinforcement learning (RL) algorithms. Most traditional sample efficiency bounds require strategic exploration. Recently many deep RL algorithms with simple heuristic exploration strategies that have few formal guarantees, achieve surprising success in many domain…
Often, more time is spent on finding a model that works well, rather than tuning the model and working directly with the dataset. Our research began as an attempt to improve upon a simple Recurrent Neural Network for answering "simple" first-order questions (QA-RNN), developed by Ferhan Ture and Oliver Jojic, from Comc…
Develops a new trend power indicator using DSP techniques.
Optimal ability estimation in adaptive testing with binary responses.
The question of how to parallelize the stochastic gradient descent (SGD) method has received much attention in the literature. In this paper, we focus instead on batch methods that use a sizeable fraction of the training set at each iteration to facilitate parallelism, and that employ second-order information. In order…
The famous Nash embedding theorem published in 1956 was aiming for the opportunity to use extrinsic help in the study of (intrinsic) Riemannian geometry, if Riemannian manifolds could be regarded as Riemannian submanifolds. However, this hope had not been materialized yet according to \cite{G}. The main reason for this…
The article confirms a conjecture for solvmanifolds with complex commutator.
The paper analyzes SGD dynamics and generalization using Hessian of deep net losses.
Some statistical models are specified via a data generating process for which the likelihood function cannot be computed in closed form. Standard likelihood-based inference is then not feasible but the model parameters can be inferred by finding the values which yield simulated data that resemble the observed data. Thi…
We focus on the distribution regression problem: regressing to a real-valued response from a probability distribution. Although there exist a large number of similarity measures between distributions, very little is known about their generalization performance in specific learning tasks. Learning problems formulated on…
Entity Linking (EL) is the task of automatically identifying entity mentions in a piece of text and resolving them to a corresponding entity in a reference knowledge base like Wikipedia. There is a large number of EL tools available for different types of documents and domains, yet EL remains a challenging task where t…
New measure quantifies task difficulty for machine learning models.
New insights on quantifying space deformation.
Machine learning uses crowdworkers; determining their status as human subjects is tricky.
Study automorphism groups of geodesic currents and measured laminations on surfaces.
New research shows that binary classification can be done with noisy data, but only if there are clean samples available.