Much work has been done on feature selection. Existing methods are based on document frequency, such as Chi-Square Statistic, Information Gain etc. However, these methods have two shortcomings: one is that they are not reliable for low-frequency terms, and the other is that they only count whether one term occurs in a …
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “term frequency”
A new term weighting scheme TF-IDFC-RF outperforms others in sentiment analysis.
problem Improving text classification in sentiment analysis.
method Proposes a novel supervised term weighting scheme TF-IDFC-RF and compares it with other schemes.
result TF-IDFC-RF outperforms all other schemes on two sentiment analysis datasets.
A new method integrates Fourier basis expansion and mapping for improved time series forecasting.
problem Inconsistent starting cycles and series length issues in Fourier-based methods.
method Fourier Basis Mapping (FBM) method that integrates time-frequency features through Fourier basis expansion and mapping.
result FBM addresses inconsistencies and preserves temporal characteristics, achieving SOTA performance.
We propose a new framework for measuring connectedness among financial variables that arises due to heterogeneous frequency responses to shocks. To estimate connectedness in short-, medium-, and long-term financial cycles, we introduce a framework based on the spectral representation of variance decompositions. In an e…
Study on frequencies of non-simple curves in surfaces of large genus.
problem Frequency of non-simple curves in surfaces of large genus.
method Expression for frequency, large genus asymptotics, comparison with previous work.
result Identify most common types of non-simple curves with K intersections.
We study the relationship between the frequency of a function and the speed at which a neural network learns it. We build on recent results that show that the dynamics of overparameterized neural networks trained with gradient descent can be well approximated by a linear system. When normalized training data is uniform…
The study finds that low frequency macroeconomic variables are more important for short-term electricity price forecasting.
problem Improving short-term forecasting of daily electricity prices using macroeconomic variables.
method Developed a Bayesian reverse unrestricted MIDAS model to account for frequency mismatch.
result Inclusion of macroeconomic low frequency variables improves short-term forecasts more than using only surveys or industrial production data.
HFformer outperforms LSTM in high-frequency trading with multiple signals.
problem Improving high-frequency trading performance using deep learning models.
method Introducing HFformer, a hybrid Transformer model for time series forecasting.
result HFformer achieves higher cumulative PnL than LSTM in backtesting.
Large textual corpora are often represented by the document-term frequency matrix whose elements are the frequency of terms; however, this matrix has two problems: sparsity and high dimensionality. Four dimension reduction strategies are used to address these problems. Of the four strategies, unsupervised feature trans…
Improved LSTM cell for high-frequency trading forecasts.
problem Precise stock price forecasting with minimal lags.
method Revised long short-term memory (LSTM) cell with optimal gate/state selection.
result Lower forecasting error compared to other recurrent neural networks.
Zipfian Whiteningcs.CL
PCA whitening weighted by Zipfian word frequencies improves task performance.
problem Skewed word embedding spaces in neural models.
method PCA whitening weighted by empirical word frequencies following Zipf's law.
result Significantly improves task performance, surpassing baselines.
We investigated distributions of short term price trends for high frequency stock market data. A number of trends as a function of their lengths was measured. We found that such a distribution does not fit to results following from an uncorrelated stochastic process. We proposed a simple model with a memory that gives …
The paper introduces a frequency-domain estimator for low-order systems from noisy data.
problem Estimating frequency responses of low-order systems from noisy measurements.
method Uses a quadratic data-fitting term regularized by the nuclear norm of a Loewner matrix, subject to a convex stability constraint.
result Proves a finite-sample error bound and extends it to all frequencies through rational interpolation.
We study the long-term memory in diverse stock market indices and foreign exchange rates using the Detrended Fluctuation Analysis(DFA). For all daily and high-frequency market data studied, no significant long-term memory property is detected in the return series, while a strong long-term memory property is found in th…
We continue the study of the operator of generalized Maxwell equations and completely discover the behavior of the solutions of the time-harmonic equations as the frequency tends to zero. Thereby, we identify degenerate operators in terms of special 'polynomially growing' solutions of a corresponding static problem, wh…
Predictability of Power Grid Frequencyphysics.soc-ph
A predictor improves power grid frequency forecasts up to one hour.
problem Improving frequency forecast for better power system stability.
method Developed a weighted-nearest-neighbor (WNN) predictor.
result Forecasts for up to one hour are more precise than averaged daily profiles.
Improved DOA estimation with distributed sensors across multiple frequencies.
problem Sensor gain uncertainties and directional perturbations in multi-frequency scenarios.
method Distributed optimization with local coherence models and iterative exchange of information.
result Advantages in statistical and computational efficiency through parallel iterative technique.
New Fourier-based diffusion model improves high-frequency generation quality.
problem Diffusion models struggle with high-frequency details.
method Analyzed and modified the forward process in Fourier space to equalize noise corruption across frequencies.
result Improved generation quality for high-frequency components.
The study tackles modeling high-frequency financial data using continuous distributions, finding them inadequate.
problem Challenges in modeling high-frequency integer price changes with continuous distributions.
method Proposed a modified maximum likelihood estimation procedure to account for the discreteness of high-frequency price changes.
result Traditional GARCH models are not suitable for high-frequency data due to the discreteness of price changes.
A new image completion method inspired by brain cells.
problem Image restoration from corrupted data.
method Biologically-inspired sub-Riemannian model with frequency and phase.
result Completion of two-dimensional images using cortical cell responses.
We analyze total, asymmetric and frequency connectedness between oil and forex markets using high-frequency, intra-day data over the period 2007 -- 2017. By employing variance decompositions and their spectral representation in combination with realized semivariances to account for asymmetric and frequency connectednes…
FEDformer combines Transformer with seasonal-trend decomposition for efficient long-term forecasting.
problem Transformer's inefficiency and inability to capture global time series views.
method Combines seasonal-trend decomposition with Transformer, exploiting Fourier basis for frequency enhancement.
result Reduces prediction error by 14.8% and 22.6% for multivariate and univariate time series, respectively.
For the first time, we apply the wavelet coherence methodology on biofuels (ethanol and biodiesel) and a wide range of related commodities (gasoline, diesel, crude oil, corn, wheat, soybeans, sugarcane and rapeseed oil). This way, we are able to investigate dynamics of correlations in time and across scales (frequencie…
In target tracking, the estimation of an unknown weaving target frequency is crucial for improving the miss distance. The estimation process is commonly carried out in a Kalman framework. The objective of this paper is to examine the potential of using neural networks in target tracking applications. To that end, we pr…
Explicitly taking into account the risk incurred when borrowing at a shorter tenor versus lending at a longer tenor ("roll-over risk"), we construct a stochastic model framework for the term structure of interest rates in which a frequency basis (i.e. a spread applied to one leg of a swap to exchange one floating inter…
New method estimates VaR and ES using high-frequency data, outperforming existing approaches.
problem Limitations of existing VaR and ES estimation methods in high-frequency data.
method Transforms intra-day returns using subordinator process, filters autocorrelation, fits fat-tailed distribution.
result Outperforms existing methods in VaR and ES estimation and forecasting.
FreDN: Spectral Disentanglement for Time Series Forecasting via Learnable Frequency Decompositionstat.ML
FreDN separates trends and periodicities in non-stationary time series forecasts.
problem Spectral entanglement and computational burden in frequency-domain methods for non-stationary time series.
method FreDN introduces a learnable Frequency Disentangler module to separate trend and periodic components directly in the frequency domain, and uses a ReIm Block to reduce complexity.
result FreDN outperforms state-of-the-art methods by up to 10% on long-term forecasting benchmarks.
New method for fast volatility estimation robust to change points.
problem Robust high-frequency volatility estimation with change points.
method ℓ1-regularized power variation estimators using LARS for sparse estimation and dynamic programming for change point refinement.
result Minimax rates achieved for volatility estimators, providing accurate and smooth forecasts.
Game theory model for optimal trading with end-of-day constraints.
problem Optimal trading strategy in a game between slow and fast traders.
method Coupled stochastic control problems, Fredholm integral equation solution.
result Explicit solution to the game with profitable strategies for both players.
We present a method for audio denoising that combines processing done in both the time domain and the time-frequency domain. Given a noisy audio clip, the method trains a deep neural network to fit this signal. Since the fitting is only partly successful and is able to better capture the underlying clean signal than th…
LSTM models improve macroeconomic forecasting with mixed frequency data.
problem Improving accuracy of macroeconomic forecasts using mixed frequency data.
method Adapted LSTM model to mixed frequency data, using U-MIDAS scheme.
result Proposed LSTM models outperform conventional MIDAS models in out-of-sample predictive performance.
Analyzes branch points of area-minimizing currents with non-2 planar frequency.
problem Understanding the structure of area-minimizing currents near branch points.
method Intrinsic frequency function and geometric arguments avoiding center manifolds.
result Establishes higher order asymptotics and topological control near branch points.
Improved recurrent neural networks learn long-term dependencies through multi-scale memory.
problem Capturing long-term dependencies in recurrent neural networks.
method Incremental training of a modular RNN architecture with multi-scale hidden states.
result Incremental training and multi-scale memory enhance RNNs' ability to learn long-term dependencies.
Novel LSTM network predicts pulsar timing residuals with few-shot data.
problem Predicting pulsar timing residuals with limited data.
method Long Short-Term Memory (LSTM) network optimized with model-agnostic meta-learning and particle swarm optimization.
result Robust generalization and accurate predictions across high-frequency test domains with minimal data.
Granger-causality in the frequency domain is an emerging tool to analyze the causal relationship between two time series. We propose a bootstrap test on unconditional and conditional Granger-causality spectra, as well as on their difference, to catch particularly prominent causality cycles in relative terms. In particu…
This paper models CSI 300 index volatility using machine learning and addresses jump prediction.
problem Volatility modeling and jump prediction for high-frequency CSI 300 index data.
method Generalized Barndorff-Nielsen and Shephard model with machine learning algorithms for parameter estimation and forecast evaluation.
result Deterministic component of stochastic volatility processes can be captured over short and longer-term windows.
New CFNN architecture approximates functions with machine accuracy.
problem Function approximation with high precision.
method Chebyshev Feature Neural Network (CFNN) with learnable frequencies.
result Achieves machine accuracy in function approximation.
The study analyzes macroeconomic factors affecting copper futures volatility and long-term correlation with S&P 500.
problem Understanding the impact of macroeconomic variables on copper futures volatility and long-term correlation.
method Employed GARCH-MIDAS and DCC-MIDAS modeling frameworks to examine the influence of low-frequency macroeconomic variables on copper futures returns and long-term correlation with S&P 500.
result PPI is the most efficient macroeconomic variable impacting copper futures returns, and MIDAS filter improves model fitness and long-run relationship.
Proposes a deep RL approach for high-frequency market making using tick data and periodic signals.
problem Challenges in high-frequency market making due to tick-level data complexity and high trading volume.
method Integrates tick-level data with periodic signals using deep reinforcement learning.
result The proposed framework outperforms existing methods in profitability and risk management.
We propose a framework to study optimal trading policies in a one-tick pro-rata limit order book, as typically arises in short-term interest rate futures contracts. The high-frequency trader has the choice to trade via market orders or limit orders, which are represented respectively by impulse controls and regular con…
This paper uses Gaussian processes to forecast short-term stock price volatility.
problem Inaccurate short-term volatility forecasts for high-frequency trades.
method Combines numerical and probabilistic models, specifically Gaussian Processes (GPs), to correct and forecast stock price data.
result Effective short-term volatility forecasts for high-frequency trades using Gaussian Processes.
This paper analyzes the multi-armed bandit problem using frequency-domain methods.
problem The exploration-exploitation trade-off in sequential decision-making.
method Proposes a frequency-domain analysis framework, reformulating the bandit process as a signal processing problem.
result Confidence bound term in UCB algorithm is equivalent to a time-varying gain in frequency domain.
Transformer model with mixed-frequency data improves stock volatility prediction.
problem Improving stock volatility prediction using mixed-frequency data.
method Transformer model trained on mixed-frequency data (GARCH-MIDAS model for frequency alignment).
result Transformer model reduces mean square error from 1.00 to 0.86.
Neural HMM with AGA captures multi-scale dynamics in financial markets.
problem Capturing multi-scale temporal dynamics in financial markets.
method Parallel multi-resolution encoders, adaptive gating, and multi-head attention.
result Outperforms fixed-resolution baselines in predicting price movements and liquidity shocks.
Study learns convolution operators on compact Abelian groups using regularization.
problem Learning convolution operators on compact Abelian groups.
method Regularization-based approach with ridge regression estimator.
result Characterizes the accuracy of the estimator in terms of finite sample bounds.
New DMEM models forecast volatility combining low- and high-frequency data.
problem Modeling realized volatility with both short- and long-term features.
method Doubly Multiplicative Error (DMEM) models combining daily and long-term data.
result DMEM models outperform existing GARCH-type models in forecasting.
Model assesses systemic risk in crude oil and gasoline futures markets.
problem Systemic risk in high-frequency crude oil and gasoline futures markets.
method Hawkes flocking model examining endogeneity and interactivity.
result Significantly higher endogenous systemic risk in WTI crude oil compared to gasoline, with gasoline having a higher influence on WTI.
Deep learning reveals ubiquitous predictability in high-frequency returns.
problem Predicting returns in order book markets at high frequencies.
method Volume representation of the order book, deep learning models, model confidence sets.
result Predictability in mid-price returns is ubiquitous at high frequencies.