Proposes a new framework for semi-supervised learning with theoretical support.
problem Lack of theoretical support for using predictions as pseudo-labels in deep SSL methods.
method D2 framework with repetitive reprediction (R2) strategy.
result R2-D2 method outperforms state-of-the-art methods by 5 percentage points on ImageNet.
Generative model captures repetitive industrial processes with varying durations and dynamics.
problem Capturing repetitive industrial processes with varying durations and dynamics using Gaussian Processes.
method Posterior-weighted Gaussian Process with a novel kernel to decouple intra-repetition and inter-repetition variability.
result Generative model produces realistic synthetic trajectories from toy datasets.
This paper considers the problem of characterizing the simplest discrete point sets that are aperiodic, using invariants based on topological dynamics. A Delone set whose patch-counting function N(T), for radius T, is finite for all T is called repetitive if there is a function M(T) such that every ball of radius M(T)+…
UTE improves reinforcement learning by measuring action uncertainty, enhancing policy learning efficiency.
problem Degrading performance of action repetition in reinforcement learning, especially with sub-optimal actions.
method UTE uses ensemble methods to measure uncertainty during action extension, allowing strategic exploration or certainty.
result UTE outperforms existing action repetition algorithms, significantly enhancing policy learning efficiency.
Telescope detects LLM generated text by measuring token repetition probability.
problem Distinguishing LLM generated text from human writing.
method Telescope Perplexity, evaluating token repetition probability.
result Telescope Perplexity enables effective zero-shot LLM detection.
This study investigates abrupt learning dynamics in Transformers, revealing plateau formation and internal representation collapse.
problem Abrupt learning in Transformers, particularly during the loss plateau.
method Investigates mechanisms of abrupt learning in shallow Transformers, focusing on attention maps and hidden states.
result Reveals plateau formation, internal representation collapse, and strong repetition bias in outputs.
Spaced repetition is a technique for efficient memorization which uses repeated, spaced review of content to improve long-term retention. Can we find the optimal reviewing schedule to maximize the benefits of spaced repetition? In this paper, we introduce a novel, flexible representation of spaced repetition using the …
How does one find dimensions in multivariate data that are reliably expressed across repetitions? For example, in a brain imaging study one may want to identify combinations of neural signals that are reliably expressed across multiple trials or subjects. For a behavioral assessment with multiple ratings, one may want …
The paper uses persistent homology to estimate recurrence times in multi-variate time series.
problem Estimating recurrence times in multi-variate time series with different cyclic behaviors.
method Persistent homology framework with three specialized methods.
result Validated methods on real-world data, including a new benchmark dataset.
Study shows how repetition affects learning in bandit settings, providing algorithms with sublinear regret.
problem Effect of persistence of engagement on learning in stochastic multi-armed bandit settings.
method Novel algorithms that achieve sublinear regret under temporal constraints.
result Additive effect of priming on regret upper bound, matching popular algorithms in absence of priming.
A new neural network separates vocals from music accompaniment.
problem Separating vocals from music accompaniment in recordings.
method Self-attention convolutional neural network (CNN) with densely-connected blocks.
result 19.5% relative improvement in vocals separation.
This work uses QPGPs to improve ILC performance in repetitive tasks.
problem Performance degradation in repetitive motion tasks due to environmental changes and robot wear.
method Incorporates Quasi-Periodic Gaussian Processes into a predictive ILC framework.
result The proposed approach achieves faster convergence and robustness under disturbances.
Game aims to improve social interactions for teenagers with ASD.
problem Improving social interactions for teenagers with ASD.
method Presentation of game structure, skeleton detection, and imitation learning methods.
result Game structure and support tools for skeleton detection and imitation learning presented.
DAS3H optimizes skill-based spaced repetition schedules.
problem Optimizing adaptive and personalized spaced repetition schedules for skill-based learning.
method Developed a new student learning and forgetting model (DAS3H) that considers memory decay and multiple skills.
result DAS3H outperforms other models on real-world educational datasets.
Bayesian optimization outperforms other methods in hyperparameter tuning for reinforcement learning.
problem Finding optimal hyperparameters that generalize across random seeds in reinforcement learning.
method Benchmarked Successive Halving, Random Search, and Bayesian Optimization with and without repetitions on PPO2 algorithms for Cartpole and Inverted Pendulum tasks.
result Bayesian optimization with noise robust acquisition function is the best choice.
Experimental design is a classical statistics problem and its aim is to estimate an unknown m-dimensional vector β from linear measurements where a Gaussian noise is introduced in each measurement. For the combinatorial experimental design problem, the goal is to pick k out of the given n experiments so as to m…
New method improves text generation by assigning lower probability to repetitive sequences.
problem Dull and repetitive text generated by standard likelihood training.
method Unlikelihood training, which forces unlikely generations to be assigned lower probability.
result Unlikelihood training produces less repetitive, less dull text compared to standard techniques.
Data repetition improves SGD's learning of high-dimensional functions.
problem Learning pertinent features in multi-index models with high-dimensional noisy data.
method Investigation of two-layer shallow neural networks trained with gradient-based algorithms, focusing on data repetition.
result Data repetition significantly improves the computational efficiency of SGD, learning all directions with at most O(dlogd) steps. Estimates linear model from noisy covariates and instruments using spectral regularization.
problem Estimating a linear model from many noisy covariates and instruments.
method Two-stage least squares with spectral regularization of canonical correlations.
result Upper and lower bounds on estimation error, proving optimality of the method with noisy data.
X-ray free-electron lasers (XFELs) are the only sources currently able to produce bright few-fs pulses with tunable photon energies from 100 eV to more than 10 keV. Due to the stochastic SASE operating principles and other technical issues the output pulses are subject to large fluctuations, making it necessary to char…
We study the effect of impairment on stochastic multi-armed bandits and develop new ways to mitigate it. Impairment effect is the phenomena where an agent only accrues reward for an action if they have played it at least a few times in the recent past. It is practically motivated by repetition and recency effects in do…
Paper proposes RCD method to discover causal structure with latent confounders.
problem Causal discovery from data with latent confounders.
method Repetitive causal discovery (RCD) method to infer causal directions between observed variables.
result RCD effectively identifies latent confounders and causal directions between observed variables.
Riemannian manifolds can be realized as leaf spaces of matchbox manifolds.
problem Realizing Riemannian manifolds as leaf spaces of matchbox manifolds.
method Graph coloring techniques to prove realization of manifolds as leaves.
result Any repetitive Riemannian manifold of bounded geometry can be realized as a leaf of a minimal Riemannian matchbox manifold without holonomy.
Variance-Calibrated Modulation (VCM) addresses the likelihood trap in LLMs by reshaping the probability distribution before truncation.
problem LLMs fall into the likelihood trap, leading to repetitive degeneration and vocabulary dullness.
method VCM reshapes the probability distribution before truncation through Contextual Searchlight and Adaptive Self-Debiasing.
result VCM mitigates the likelihood trap across open-ended generation, factual QA, and mathematical reasoning.
HRL improves open-domain dialog models by optimizing long-term conversational goals.
problem Challenges in open-domain dialog generation, including repetitive outputs, difficulty tracking conversational goals, and inappropriate text.
method Proposes VHRL, a hierarchical reinforcement learning approach using policy gradients to tune utterance-level embeddings of a variational sequence model.
result Significant improvements in human evaluation and automatic metrics over state-of-the-art dialog models.
Improves generative Visual Dialog by asking diverse questions.
problem Generative Visual Dialog models degrade after a few rounds of interaction.
method Introduce a simple auxiliary objective to incentivize Qbot to ask diverse questions.
result Better dialog diversity, consistency, fluency, and detail with improved image relevance.
Characterizes Milnor invariants with limited repetitions.
problem Understanding Milnor invariants with constraints on repetition.
method Algebraic and diagrammatic approaches using k-reduced free groups and welded knot theory. result Algebraic and diagrammatic characterizations of Milnor invariants.
Automatic conflict detection has grown in relevance with the advent of body-worn technology, but existing metrics such as turn-taking and overlap are poor indicators of conflict in police-public interactions. Moreover, standard techniques to compute them fall short when applied to such diversified and noisy contexts. W…
This work addresses the problem of segmentation in time series data with respect to a statistical parameter of interest in Bayesian models. It is common to assume that the parameters are distinct within each segment. As such, many Bayesian change point detection models do not exploit the segment parameter patterns, whi…
One problem in the application of reinforcement learning to real-world problems is the curse of dimensionality on the action space. Macro actions, a sequence of primitive actions, have been studied to diminish the dimensionality of the action space with regard to the time axis. However, previous studies relied on human…
Project infinite time series graphs to finite marginal models using number theory.
problem Handling infinite time series graphs for causal inference.
method Projection method using number theory to find common ancestors in infinite graphs.
result Developed algorithm to project infinite graphs to finite marginal models.
In this paper we consider the problem of clustering collections of very short texts using subspace clustering. This problem arises in many applications such as product categorisation, fraud detection, and sentiment analysis. The main challenge lies in the fact that the vectorial representation of short texts is both hi…
EB-RANSAC uses energy-based model for robust estimation without complex sampling.
problem Robust estimation of parameters in noisy data.
method EB-RANSAC combines RANSAC's sampling scheme with an energy-based model, simplifying the process and reducing hyperparameter requirements.
result EB-RANSAC effectively solves linear regression and maximum likelihood estimation problems.
Study proposes an ad creative selection algorithm considering user fatigue.
problem Ad creative effectiveness varies with user exposure.
method Proposes an algorithm that considers user fatigue in ad selection.
result The proposed algorithm outperforms baseline algorithms in real-world testing.
Predicts local AQI using mobile sensor data, improving accuracy by 71.654 MSE.
problem Inaccurate AQI data from sparse sensors in developing countries.
method Spatio-temporal GNNs for fine-grained AQI forecasting.
result Significant improvement in AQI prediction accuracy (71.654 MSE reduction).
OpenGM is a C++ template library for defining discrete graphical models and performing inference on these models, using a wide range of state-of-the-art algorithms. No restrictions are imposed on the factor graph to allow for higher-order factors and arbitrary neighborhood structures. Large models with repetitive struc…
Iterative method learns unknown constraints for MPC control.
problem Learning to satisfy unknown polyhedral state constraints in iterative MPC.
method Collects and improves estimates of unknown constraints using collected data, designs an MPC controller to satisfy the estimated constraints.
result Robust and probabilistic guarantees of constraint satisfaction as a function of task iterations.
Deep learning methods have recently achieved great empirical success on machine translation, dialogue response generation, summarization, and other text generation tasks. At a high level, the technique has been to train end-to-end neural network models consisting of an encoder model to produce a hidden representation o…
This paper evaluates AutoML tools for ML tasks.
problem Efficiency in machine learning for ML engineers.
method Evaluation and comparison of AutoML tools on various datasets.
result Performance and advantages/disadvantages of AutoML tools.
We introduce COCO, an open source platform for Comparing Continuous Optimizers in a black-box setting. COCO aims at automatizing the tedious and repetitive task of benchmarking numerical optimization algorithms to the greatest possible extent. The platform and the underlying methodology allow to benchmark in the same f…
PG-IM uses neural-symbolic programs to manipulate images.
problem Creating holistic image representations and manipulations.
method PG-IM detects patterns, induces symbolic programs, and manipulates images using a neural network.
result PG-IM learns from a single image and achieves superior performance.
Current Flash X-ray single-particle diffraction Imaging (FXI) experiments, which operate on modern X-ray Free Electron Lasers (XFELs), can record millions of interpretable diffraction patterns from individual biomolecules per day. Due to the stochastic nature of the XFELs, those patterns will to a varying degree includ…
The sophisticated structure of Convolutional Neural Network (CNN) allows for outstanding performance, but at the cost of intensive computation. As significant redundancies inevitably present in such a structure, many works have been proposed to prune the convolutional filters for computation cost reduction. Although ex…
Recent years have seen a boom in interest in machine learning systems that can provide a human-understandable rationale for their predictions or decisions. However, exactly what kinds of explanation are truly human-interpretable remains poorly understood. This work advances our understanding of what makes explanations …
Study shows how wealth distribution leads to volatility clustering in speculative markets.
problem Volatility clustering in financial markets.
method Agent-based model of financial markets with heterogeneous wealth distribution and round-trip trading.
result Heterogeneous wealth distribution induces volatility clustering through market wealth redistribution.
A new cross-validation method reduces redundancy and improves model performance.
problem Redundancy in traditional k-fold cross-validation leads to biased results.
method Irredundant k-fold cross-validation, where each instance is used exactly once for training and testing.
result Consistent performance estimates with reduced variance and lower computational cost.
We describe an algorithm which has enabled us to give a complete list, without repetitions, of all closed oriented irreducible 3-manifolds of complexity up to 9. More interestingly, we have actually been able to give a "name" to each such manifold, by recognizing its canonical decomposition into Seifert fibred spaces a…
LLMs are compared to Markov chains for natural language processing.
problem Theoretical analysis of LLMs' generalization capabilities.
method Equivalence between LLMs and Markov chains, studying multi-step inference.
result Derives generalization bounds for LLMs, capturing their behavior in practice.