Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,878 papers · 148 categories

Trend · papers per month

138275413550 · Jun 202019922001200920172026
48 results for next frame prediction

Paper detects abnormalities in brain activity patterns using unsupervised learning.

problem Detecting abnormalities in resting-state brain activity patterns.
method Two strategies: autoencoder approach and next frame prediction.
result Both approaches can learn useful representations of rs-fMRI data for abnormality detection.

This study tackles mutual fund portfolio prediction, focusing on novel items.

problem Predicting novel items in mutual fund portfolios is challenging and less explored.
method Created a comprehensive benchmark dataset and evaluated various recommender system models.
result Autoencoder-based approaches outperform state-of-the-art models in predicting novel items.

Learning to predict future images from a video sequence involves the construction of an internal representation that models the image evolution accurately, and therefore, to some degree, its content and dynamics. This is why pixel-space video prediction may be viewed as a promising avenue for unsupervised feature learn…

2015-11-17abs ↗pdf ↗

Gradient descent biases linear models in next-token prediction towards data entropy.

problem Optimization bias in next-token prediction models.
method Analysis of gradient descent on linear models with sparse conditional distributions.
result Gradient descent selects parameters that equate token logits differences to log-odds in the data subspace.

The paper tackles video prediction by estimating conditional densities implicitly.

problem Temporal prediction uncertainty and high-dimensional probabilistic inference in natural scenes.
method Score-based conditional density estimation using sequence-to-image networks trained on a resilience-to-noise objective.
result The method handles occlusion boundaries and weights predictive evidence by reliability.

Deep models struggle with predicting multiple frames of bouncing objects.

problem Predicting the long-term dynamics of bouncing objects.
method Empirical evaluation of unsupervised deep learning models on synthetic videos.
result Deep models perform well on short-term predictions but fail on generating multiple frames.

Study on focal surfaces of lightcone framed surfaces in Lorentz-Minkowski 3-space.

problem Investigate differential geometry properties of focal surfaces of lightcone framed surfaces.
method Introduced lightcone frame to define lightcone framed surfaces, then investigated their differential geometry properties.
result Investigated differential geometry properties of focal surfaces of lightcone framed surfaces.

In this paper, we present work in progress on activity recognition and prediction in real homes using either binary sensor data or depth video data. We present our field trial and set-up for collecting and storing the data, our methods, and our current results. We compare the accuracy of predicting the next binary sens…

2019-05-20abs ↗pdf ↗

A novel approach predicts long-term stock price trends using 2D-convolutional encoders and semantic segmentation.

problem Predicting long-term daily stock price changes with deep learning models.
method Proposes a hierarchical CNN structure with Atrous Spatial Pyramid Pooling blocks to capture both long and short-term temporal relationships.
result Achieved overall accuracy and AUC of 78.18% and 0.88 for predicting trends over the next 20 days.

The paper uncovers symmetries in large language models through layer-peeled optimization.

problem Understanding geometric structure in large language model weights and context embeddings.
method Constrained layer-peeled optimization program to analyze symmetries in next-token distributions.
result Symmetries in target next-token distributions are transferred to optimal model weights and context embeddings.

In this paper we first review the covering space method with constrained BV functions for solving the classical Plateau's problem. Next, we carefully analyze some interesting examples of soap films compatible with the covering space method: in particular, the case of a soap film only partially wetting a space curve, a …

2017-10-03abs ↗pdf ↗

Study evaluates how framing affects machine learning models for sepsis prediction.

problem Understanding and reporting framing is crucial for AI technology success.
method Four different approaches applied to AI models of sepsis prediction.
result On-clinical-demand framing showed the lowest missing values and best temporal dependencies.

New kinematic model for a spin-rolling sphere using Darboux frame.

problem Control and planning of an underactuated sphere on a plane.
method Darboux frame transformation to fully-actuated model.
result Underactuated sphere model transformed into fully-actuated model.

Machine learning predicts flight connections for airline crew scheduling.

problem Predicting the next connecting flight for airline crews.
method Adapted neural network for multiclass classification from historical data.
result High accuracy (99.7%) in flight connection prediction.

Proving that next-token prediction makes language models generate coherent long documents.

problem Understanding why language models generate coherent documents despite focusing on next-token prediction.
method Proving the power of next-token prediction in learning longer-range structure using Recurrent Neural Networks (RNN).
result Optimizing next-token prediction in RNNs yields a model that closely approximates the training distribution, even for long-range coherence.

Prediction is arguably one of the most basic functions of an intelligent system. In general, the problem of predicting events in the future or between two waypoints is exceedingly difficult. However, most phenomena naturally pass through relatively predictable bottlenecks---while we cannot predict the precise trajector…

2018-08-23abs ↗pdf ↗

Which song will Smith listen to next? Which restaurant will Alice go to tomorrow? Which product will John click next? These applications have in common the prediction of user trajectories that are in a constant state of flux over a hidden network (e.g. website links, geographic location). What users are doing now may b…

2015-11-03abs ↗pdf ↗

Reinforcement learning after next-token prediction aids in learning from diverse sequence lengths.

problem Learning from sequences of varying lengths and complexity.
method Introducing a framework to study reinforcement learning with autoregressive transformers, focusing on next-token prediction and mixture distributions of short and long sequences.
result Reinforcement learning after next-token prediction enables autoregressive transformers to generalize from long sequences, even when they are rare.

Deep learning predicts frame errors in CIRN using SC2 dataset.

problem Predicting frame errors in Collaborative Intelligent Radio Networks (CIRN).
method Deep learning model trained on SC2 dataset with randomized or fixed bandwidth and channel allocation strategies.
result Deep learning model predicts frame error rates and instances with interesting characteristics over different SNR ranges.

A new approach predicts next observations without explicit decoding for better control.

problem High-dimensional observations and unknown dynamics in real-world control tasks.
method Proposes a novel information-theoretic LCE approach using predictive coding to develop a decoder-free model.
result The model reliably learns a controllable latent space leading to superior performance.

The study explores how Transformers predict the next token in a sequence.

problem Understanding the mechanism behind Transformers' autoregressive learning ability.
method Exploring the approximation ability of Transformers for next-token prediction through specific instances and a causal kernel descent method.
result Transformer models can learn context-dependent functions ff for next-token prediction based on past and current observations.

This paper examines how different decoding algorithms for LLMs align with various goals.

problem Consistency of decoding algorithms with different goals in LLMs.
method Analysis of greedy, lookahead, random sampling, and temperature-scaled random sampling algorithms.
result Random sampling is consistent with the true probability distribution, but other goals require optimal algorithms for specific probability distributions.

We advance the state of the art in polyphonic piano music transcription by using a deep convolutional and recurrent neural network which is trained to jointly predict onsets and frames. Our model predicts pitch onset events and then uses those predictions to condition framewise pitch predictions. During inference, we r…

2017-10-30abs ↗pdf ↗

Predictive business process monitoring methods exploit logs of completed cases of a process in order to make predictions about running cases thereof. Existing methods in this space are tailor-made for specific prediction tasks. Moreover, their relative accuracy is highly sensitive to the dataset at hand, thus requiring…

2016-12-07abs ↗pdf ↗

We are now witnessing the increasing availability of event stream data, i.e., a sequence of events with each event typically being denoted by the time it occurs and its mark information (e.g., event type). A fundamental problem is to model and predict such kind of marked temporal dynamics, i.e., when the next event wil…

2017-01-14abs ↗pdf ↗