We present Meena, a multi-turn open-domain chatbot trained end-to-end on data mined and filtered from public domain social media conversations. This 2.6B parameter neural network is simply trained to minimize perplexity of the next token. We also propose a human evaluation metric called Sensibleness and Specificity Ave…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,657 papers · 148 categories
Trend · papers per month
16 results for “SSA”
This study extends and evaluates the forecasting performance of the Singular Spectrum Analysis (SSA) technique using a general non-linear form for the re- current formula. In this study, we consider 24 series measuring the monthly seasonally adjusted industrial production of important sectors of the German, French and …
We propose a method called ideal regression for approximating an arbitrary system of polynomial equations by a system of a particular type. Using techniques from approximate computational algebraic geometry, we show how we can solve ideal regression directly without resorting to numerical optimization. Ideal regression…
OSA overcomes instability in skipless Transformers.
problem Instability in skipless Transformers using Softmax Self-Attention.
method OSA parametrizes attention matrix to be orthogonal via skew-symmetric matrix exponential.
result OSA allows for training non-causal Transformers without skip connections and normalisation layers.
Measures mode separation in high-dimensional densities via a reversible diffusion process.
problem Quantifying how sharply a distribution fragments into barrier-separated clusters in high dimensions.
method A unique reversible diffusion process with f as stationary distribution, extracting SSA and DA from its autocovariance matrix.
result Empirical autocovariance spectrum and readouts (SSA, DA) quantify mode separation using only samples and pretrained score-based models.
Reconstruction of seismic data with missing traces is a long-standing issue in seismic data processing. In recent years, rank reduction operations are being commonly utilized to overcome this problem, which require the rank of seismic data to be a prior. However, the rank of field data is unknown; usually it requires m…
This paper considers method of creation of an advisor and indicator based on the spectral stochastic analysis model, both with linear and non-linear approximation. The problem of entrance to one or another trade position is solved on the basis of combined analysis of dynamics of quotations of all currency pairs, what a…
FX Market Volatilityq-fin.MF
Paper examines two methods for FX market volatility modeling.
problem FX market volatility modeling problem.
method Classical econometric GCH and mathematical approaches (SSA, dynamical systems stability analysis).
result Both mathematical tools show promising results in FX market volatility modeling.
We propose an algorithm to impute and forecast a time series by transforming the observed time series into a matrix, utilizing matrix estimation to recover missing values and de-noise observed entries, and performing linear regression to make predictions. At the core of our analysis is a representation result, which st…
Neural recordings are nonstationary time series, i.e. their properties typically change over time. Identifying specific changes, e.g. those induced by a learning task, can shed light on the underlying neural processes. However, such changes of interest are often masked by strong unrelated changes, which can be of physi…
Improving the Performance of Unimodal Dynamic Hand-Gesture Recognition with Multimodal Trainingcs.CV
We present an efficient approach for leveraging the knowledge from multiple modalities in training unimodal 3D convolutional neural networks (3D-CNNs) for the task of dynamic hand gesture recognition. Instead of explicitly combining multimodal information, which is commonplace in many state-of-the-art methods, we propo…
We investigate an economic system in which one large agent - the Japan government changes the environment of numerous smaller agents - the Japan agriculture producers by indirect regulation of prices of agriculture goods. The reason for this intervention was that before the oil crisis in 1974 Japan agriculture producti…
Semi-supervised Learning Approach to Generate Neuroimaging Modalities with Adversarial Trainingcs.LG
Magnetic Resonance Imaging (MRI) of the brain can come in the form of different modalities such as T1-weighted and Fluid Attenuated Inversion Recovery (FLAIR) which has been used to investigate a wide range of neurological disorders. Current state-of-the-art models for brain tissue segmentation and disease classificati…
Variant of mSSA improves time series prediction error.
problem Improve prediction error in multivariate time series.
method Introduce spatio-temporal factor model, establish prediction error scaling.
result Prediction error scales as 1 / √(min(N, T)T).
Inferring the structural properties of a protein from its amino acid sequence is a challenging yet important problem in biology. Structures are not known for the vast majority of protein sequences, but structure is critical for understanding function. Existing approaches for detecting structural similarity between prot…
SAMoSSA combines mSSA and AR for accurate time series analysis.
problem Accurately estimating both deterministic and stationary components in time series data.
method Two-stage algorithm: first mSSA for non-stationary components, then AR for stationary residual.
result SAMoSSA provides forecasting consistency and outperforms existing methods.