New TVBO algorithm optimizes time-varying functions with varying sampling frequencies.
problem Optimizing time-varying, expensive, noisy functions with constant frequency assumption.
method Formulated practical recommendations and derived upper regret bound for varying sampling frequencies.
result BOLT algorithm outperforms state-of-the-art TVBO algorithms in experiments.
A new sampling method balances multi-label datasets by preserving category frequency order.
problem Sampling challenges in multi-label datasets with varying label frequencies.
method Uses multivariate Bernoulli distribution and label dependencies to estimate and weight label combinations.
result Produces a more balanced sub-sample with enhanced representation of minority categories.
Improved image restoration using frequency-guided sampling.
problem Restoring high-quality images from degraded observations with known degradation processes.
method Proposed a frequency-guided sampling approach for diffusion-based image restoration, incorporating a time-varying low-pass filter.
result Significantly improved performance on challenging image restoration tasks, including motion deblurring and image dehazing.
We analyze realized volatilities constructed using high-frequency stock data on the Tokyo Stock Exchange. In order to avoid non-trading hours issue in volatility calculations we define two realized volatilities calculated separately in the two trading sessions of the Tokyo Stock Exchange, i.e. morning and afternoon ses…
The paper proposes a new model for predicting and analyzing economic variables.
problem Predicting and analyzing economic variables in developed regions.
method Time-varying parameter global vector autoregressive (TVP-GVAR) framework combined with machine learning models.
result The proposed model provides high precision out-of-sample predictions and novel insights into economic variable connectedness.
Typically, operational risk losses are reported above a threshold. Fitting data reported above a constant threshold is a well known and studied problem. However, in practice, the losses are scaled for business and other factors before the fitting and thus the threshold is varying across the scaled data sample. A report…
The paper analyzes real-time methods to detect rapidly varying liquidity in markets.
problem Increased trade execution price uncertainty due to rapid price variations by high-frequency traders.
method A four-state Markov switching model to identify volatile liquidity states.
result The model can generate a signal to delay orders, reducing price volatility for market participants.
The study tackles rough noise in high-frequency financial data using fractional Brownian motion.
problem Impediments to analyzing high-frequency financial data due to noise.
method Assuming an efficient price process as a continuous Itô semimartingale, the study derives consistent estimators and confidence intervals for roughness parameters and volatilities.
result The rough noise model explains divergence rates in volatility signature plots over time and between assets.
Study tail risk in high-frequency finance using L1-regularized regression.
problem Measuring tail risk dynamics in high-frequency financial markets.
method Dynamic extreme value regression model with L1-regularized maximum likelihood estimator. result Severity of extreme losses well predicted by low price impact in high volatility periods.
Study cryptocurrency price dynamics using adaptive EMD and spectral analysis.
problem Analyze the time-varying volatility of cryptocurrency prices.
method Adaptive complementary ensemble empirical mode decomposition (ACE-EMD) and Hilbert spectral analysis.
result Reveal the properties of various timescales in cryptocurrency price dynamics.
SpecGrad improves neural vocoder sound quality by adapting diffusion noise to log-mel spectrogram.
problem Improving neural vocoder sound quality, especially in high-frequency bands.
method Adapting the diffusion noise distribution to the conditioning log-mel spectrogram through time-varying filtering.
result SpecGrad generates higher-fidelity speech waveform than conventional DDPM-based neural vocoders.
New estimator reveals intraday betas mainly driven by correlations.
problem Intraday fluctuations in market betas due to time-varying volatility.
method Proposes a novel subsampled quadrant estimator for high-frequency financial data.
result Intraday variation in betas primarily driven by intraday variation in correlations.
This paper analyzes the multi-armed bandit problem using frequency-domain methods.
problem The exploration-exploitation trade-off in sequential decision-making.
method Proposes a frequency-domain analysis framework, reformulating the bandit process as a signal processing problem.
result Confidence bound term in UCB algorithm is equivalent to a time-varying gain in frequency domain.
New DP methods for estimating means and frequencies with varying privacy demands.
problem Estimating statistics with users having different privacy requirements.
method Proposes algorithms for empirical mean and frequency estimation under heterogeneous privacy constraints, considering both correlated and permuted datasets.
result Establishes theoretical performance guarantees for algorithms, achieving minimax optimality.
Oil is perceived as a good diversification tool for stock markets. To fully understand this potential, we propose a new empirical methodology that combines generalized autoregressive score copula functions with high frequency data and allows us to capture and forecast the conditional time-varying joint distribution of …
Portfolio allocation with gross-exposure constraint is an effective method to increase the efficiency and stability of selected portfolios among a vast pool of assets, as demonstrated in Fan et al (2008). The required high-dimensional volatility matrix can be estimated by using high frequency financial data. This enabl…
Semi-supervised GANs with log-signatures improve credit card fraud detection.
problem Detecting fraud in large, complex financial transaction data streams.
method Conditional GANs with Bayesian inference and log-signatures for robust feature encoding.
result Consistent improvements over benchmarks in global and domain-specific metrics.
Moirai-MoE improves time series forecasting by automatically specializing tokens without human-defined frequency.
problem Unified training on time series data remains challenging due to heterogeneity and non-stationarity.
method Uses sparse mixture of experts (MoE) within Transformers to automatically specialize tokens for diverse time series patterns.
result Moirai-MoE outperforms existing foundation models in both in-distribution and zero-shot scenarios.
Study non-parametric frequency-domain system identification from finite samples.
problem Frequency-domain system identification from limited data.
method Empirical Transfer Function Estimate (ETFE) under sub-Gaussian colored noise and stability assumptions.
result ETFE estimates are concentrated around true values with a finite-sample rate of Ntot−1/3 for all frequencies in the H∞ norm. We develop and demonstrate a probabilistic method for classifying rare objects in surveys with the particular goal of building very pure samples. It works by modifying the output probabilities from a classifier so as to accommodate our expectation (priors) concerning the relative frequencies of different classes of obj…
Off-the-shelf machine learning algorithms for prediction such as regularized logistic regression cannot exploit the information of time-varying features without previously using an aggregation procedure of such sequential data. However, recurrent neural networks provide an alternative approach by which time-varying fea…
The paper introduces a frequency-domain estimator for low-order systems from noisy data.
problem Estimating frequency responses of low-order systems from noisy measurements.
method Uses a quadratic data-fitting term regularized by the nuclear norm of a Loewner matrix, subject to a convex stability constraint.
result Proves a finite-sample error bound and extends it to all frequencies through rational interpolation.
Paper introduces Simplet Frequency Distribution (SFD) for SCs.
problem Frequency analysis of simplets in large SCs.
method Developed SFD vector and uniform sampling-based algorithm.
result Validated theoretical bounds with experiments.
We study the relationship between the frequency of a function and the speed at which a neural network learns it. We build on recent results that show that the dynamics of overparameterized neural networks trained with gradient descent can be well approximated by a linear system. When normalized training data is uniform…
BASS efficiently learns time-varying graphs with low complexity and automatic tuning.
problem Estimating time-varying graphical models with efficient and automatic parameter tuning.
method BASS uses temporally-dependent spike-and-slab priors and variational inference to learn graph structures efficiently.
result BASS outperforms existing methods in recovering true graphs, especially for high-dimensional cases.
For the first time, we apply the wavelet coherence methodology on biofuels (ethanol and biodiesel) and a wide range of related commodities (gasoline, diesel, crude oil, corn, wheat, soybeans, sugarcane and rapeseed oil). This way, we are able to investigate dynamics of correlations in time and across scales (frequencie…
Model accurately gates ocean microbes from high-frequency flow cytometry data.
problem Gating of high-frequency flow cytometry data for ocean microbes is challenging.
method Trend filtered mixture of experts with smooth parameter variation.
result Model accurately matches human-annotated gating and corrects errors.
A pairs trading model with time-varying volatility using stochastic control.
problem Optimizing pairs trading strategies with fluctuating asset volatilities.
method Stochastic control techniques, Finite Difference method, Generalized Method of Moments.
result Optimal trading strategies maximizing expected power utility from terminal wealth.
We introduce and show the existence of a Hawkes self-exciting point process with exponentially-decreasing kernel and where parameters are time-varying. The quantity of interest is defined as the integrated parameter T−1∫0Tθt∗dt, where θt∗ is the time-varying parameter, and we consider the high-frequency…
New CTRL algorithm adapts to varying problem difficulty.
problem Adapting to varying levels of problem difficulty in CTRL.
method MLE with a general function approximator, estimating state marginal density.
result Regret bound scales with reward variance and measurement resolution, independent of measurement strategy.
GNNS uses graph neural networks to efficiently estimate subgraph frequency distributions.
problem Efficiently calculating subgraph frequency distributions in large networks.
method Graph Neural Networks (GNNS) for sampling and estimating subgraph frequencies.
result GNNS achieves comparable accuracy with a significant speedup of three orders of magnitude.
We propose a novel class of Gaussian processes (GPs) whose spectra have compact support, meaning that their sample trajectories are almost-surely band limited. As a complement to the growing literature on spectral design of covariance kernels, the core of our proposal is to model power spectral densities through a rect…
In this paper, we consider a framework adapting the notion of cointegration when two asset prices are generated by a driftless Itô-semimartingale featuring jumps with infinite activity, observed regularly and synchronously at high frequency. We develop a regression based estimation of the cointegrated relations method …
The paper tackles uniform sampling from databases with duplicates.
problem Sampling uniformly from entities with duplicate records.
method Two-stage process: frequency estimation followed by rejection sampling.
result Efficient sampling algorithms under various data properties.
The paper analyzes RL in high-frequency market making with theoretical and practical implications.
problem Applying RL to high-frequency market making with theoretical rigor.
method Theoretical analysis bridging RL and financial economics, focusing on sampling frequency effects.
result An interesting tradeoff between error and complexity in RL algorithms as sampling frequency decreases.
This paper develops a two-step estimation methodology, which allows us to apply catastrophe theory to stock market returns with time-varying volatility and model stock market crashes. Utilizing high frequency data, we estimate the daily realized volatility from the returns in the first step and use stochastic cusp cata…
Paper uses machine learning for nowcasting corporate earnings from mixed-frequency data.
problem Predicting corporate earnings for a large cross-section of firms with different frequency data.
method Structured machine learning regressions with sparse-group LASSO regularization for panel data.
result Machine learning models outperform traditional methods in nowcasting corporate earnings.
Model-based reinforcement learning has been empirically demonstrated as a successful strategy to improve sample efficiency. In particular, Dyna is an elegant model-based architecture integrating learning and planning that provides huge flexibility of using a model. One of the most important components in Dyna is called…
In this paper, we contribute to the literature on energy market co-movement by studying its dynamics in the time-frequency domain. The novelty of our approach lies in the application of wavelet tools to commodity market data. A major part of economic time series analysis is done in the time or frequency domain separate…
Study examines cyber losses across sectors, finds high severity and frequency.
problem Understanding the nature of cyber losses and their variability across sectors.
method Analysis of a leading industry dataset of cyber events, focusing on frequency and severity.
result Cyber risks are heavy-tailed, with high probability of extreme losses.
We measure the influence of different time-scales on the dynamics of financial market data. This is obtained by decomposing financial time series into simple oscillations associated with distinct time-scales. We propose two new time-varying measures: 1) an amplitude scaling exponent and 2) an entropy-like measure. We a…
A new WNN framework selects wavelet bases for efficient learning.
problem Challenges in constructing accurate wavelet bases and high computational costs in WNN.
method Introduces a constructive WNN that selects initial bases and trains functions by introducing new bases for predefined accuracy while reducing computational costs.
result Significantly improves computational efficiency through a frequency estimator and wavelet-basis increase mechanism.
High-throughput sequencing allows the detection and quantification of frequencies of somatic single nucleotide variants (SNV) in heterogeneous tumor cell populations. In some cases, the evolutionary history and population frequency of the subclonal lineages of tumor cells present in the sample can be reconstructed from…
SRMD uses random features for efficient time-frequency analysis.
problem Efficiently analyzing time-series data with low computational cost.
method Sparse Random Mode Decomposition (SRMD) constructs a sparse approximation to the spectrogram.
result SRMD outperforms other methods in signal representation, outlier removal, and mode decomposition.
New method estimates robust multi-period portfolios using entropy.
problem Lack of general agreement on building robust multi-period portfolios.
method Detrended cluster entropy approach to estimate portfolio weights.
result Portfolio weights are estimated reliably from real-world data at varying time horizons.
Study analyzes crypto asset risk exposures using a divide-and-conquer approach.
problem Lack of high-frequency macro-financial proxies for estimating risk.
method Two-stage divide-and-conquer approach: first stage estimates idiosyncratic and market risk, second stage identifies latent economy-wide factors.
result Heterogeneous exposures to idiosyncratic and systematic risk across crypto assets.
Ill-posed inverse problems in imaging remain an active research topic in several decades, with new approaches constantly emerging. Recognizing that the popular dictionary learning and convolutional sparse coding are both essentially modeling the high-frequency component of an image, which convey most of the semantic in…
We consider the estimation of integrated covariance (ICV) matrices of high dimensional diffusion processes based on high frequency observations. We start by studying the most commonly used estimator, the realized covariance (RCV) matrix. We show that in the high dimensional case when the dimension p and the observati…