A new method learns noise characteristics for better state estimation in real-time systems.
problem Challenges in accurately estimating states due to uncertainty in process and measurement models.
method Proposes a learning-based approach with different loss functions to identify noise characteristics.
result Demonstrates improved performance in real-time vehicle state estimation.
Using recent advances in the econometrics literature, we disentangle from high frequency observations on the transaction prices of a large sample of NYSE stocks a fundamental component and a microstructure noise component. We then relate these statistical measurements of market microstructure noise to observable charac…
New methods for estimating ARMA and GARCH models with stable noise.
problem Estimating parameters of ARMA and GARCH models with stable noise.
method Modified Hannan-Rissanen Method and Modified Empirical Characteristic Function for estimation.
result Efficiency, accuracy, and simplicity of proposed methods demonstrated through simulation.
Measures three types of noise in LLM evaluations.
problem Separating signal from noise in LLM experiments.
method Defined and measured three types of noise: prediction, data, and total noise. Proposed the all-pairs paired method for statistical power.
result Total noise level is characteristic and predictable across all model pairs.
Study reveals 1/f noise in signals made from nonoverlapping rectangular pulses.
problem Analyzing 1/f noise in signals composed of nonoverlapping pulses. method Derived a general formula for power spectral density, analyzed rectangular pulse case.
result Observed pure 1/f noise until very low frequencies with long pulse durations. The paper tackles drift identification in Lévy α-stable stochastic systems, proposing a Fourier space approach.
problem Estimating the drift field of a stochastic differential equation driven by Lévy α-stable noise.
method Fourier space approach, parameterizing the drift field using Fourier series, minimizing a loss function with gradients computed via the adjoint method.
result The method is capable of learning drift fields in qualitative and/or quantitative agreement with ground truth fields.
Volatility dynamics of wavelet - filtered stock price time series is studied. Using the universal thresholding method of wavelet filtering and a principle of minimal linear autocorrelation of noise component we find that the quantitative characteristics of volatility dynamics of denoised series are noticeably different…
As all physical adaptive quantum-enhanced metrology schemes operate under noisy conditions with only partially understood noise characteristics, so a practical control policy must be robust even for unknown noise. We aim to devise a test to evaluate the robustness of AQEM policies and assess the resource used by the po…
BNCR-GAN improves GANs to generate clean images from degraded inputs.
problem Generating clean images from blurred, noisy, and compressed degraded inputs.
method Multiple-generator model with image, blur-kernel, noise, and quality-factor generators, using masking architectures and adaptive consistency losses.
result BNCR-GAN effectively learns clean image generators from degraded images without degradation parameters.
This study links blockchain design to cryptos' distributional characteristics.
problem Understanding the relationship between blockchain design and cryptos' distributional characteristics.
method Used spectral clustering to cluster cryptos based on their blockchain mechanisms and operational features.
result Clusters of cryptos share similar blockchain mechanisms, supporting the hypothesis.
This paper studies business cycle patterns in UK sectoral output. It analyzes the distinction between white noise processes and their non-white noise counterparts in the frequency domain and further examines the associated features and patterns for the process where white noise conditions are violated. The characterist…
Improved eigenvalue distribution method for financial data.
problem Noise and complexity in financial markets.
method Matrix H theory, hierarchical structure, informational cascade.
result Captures a larger fraction of data variance in financial markets.
The log-periodic power law (LPPL) is a model of asset prices during endogenous bubbles. A major open issue is to verify the presence of LPPL in price sequences and to estimate the LPPL parameters. Estimation is complicated by the fact that daily LPPL returns are typically orders of magnitude smaller than measured price…
Develops a dynamic latent-factor model for high-dimensional asset characteristics.
problem Estimating asset pricing tests with high-dimensional data.
method Dynamic latent-factor model with Double Selection Lasso regularization.
result The inflation-mimicking portfolio in the crypto asset class has positive risk compensation.
A deep learning model improves seismic noise reduction.
problem Seismic noise attenuation in pre-stack data processing.
method N2N-Seismic model based on residual neural networks.
result The model significantly outperforms conventional approaches in noise reduction metrics.
The paper tackles inverse uncertainty quantification in neutron noise analysis.
problem Uncertainty in estimating material properties from noisy neutron correlation measurements.
method Surrogate models and inverse uncertainty quantification to account for measurement error and model bias.
result Improved prediction of neutron correlations and quantification of uncertainties.
We study the performance of stochastically trained deep neural networks (DNNs) whose synaptic weights are implemented using emerging memristive devices that exhibit limited dynamic range, resolution, and variability in their programming characteristics. We show that a key device parameter to optimize the learning effic…
Cryptocurrency time-series predictability is low, resembling Brownian noise.
problem Low predictability of cryptocurrency exchange rates.
method Complexity and model predictions of Litecoin, Binance Coin, Bitcoin, Ethereum, and XRP exchange rates.
result Simpler models outperform complex ones in cryptocurrency forecasting.
While noise is commonly considered a nuisance in computing systems, a number of studies in neuroscience have shown several benefits of noise in the nervous system from enabling the brain to carry out computations such as probabilistic inference as well as carrying additional information about the stimuli. Similarly, no…
The paper analyzes how noise geometry influences the performance of SGD in machine learning.
problem Understanding how noise geometry affects the performance of stochastic gradient descent.
method Developed two metrics to quantify noise alignment strength and analyzed their effects on loss and subspace projection dynamics.
result Noise geometry can be used to guarantee alignment under certain conditions, aiding SGD's ability to escape from sharp minima.
New method handles complex systems with discontinuous, heavy-tailed noise.
problem Handling discontinuous, heavy-tailed Lévy noise in stochastic systems.
method Developed nonlocal Kramers-Moyal formulas for SDEs with multiplicative Lévy noise.
result Validated framework for discovering interpretable SDE models from data.
Method estimates noise transition matrix from noisy labels without relying on unreliable class-posterior estimation.
problem Estimating noise transition matrix from noisy data.
method Total variation regularization to encourage distinguishable predicted probabilities.
result Consistent estimator of the noise transition matrix under mild assumptions.
Study improves parameter estimation for SDEs driven by Levy noise.
problem Challenges in estimating parameters of SDEs with non-Gaussian noises.
method Introduces PEnet, a CNN-LSTM model for efficient parameter estimation.
result PEnet offers superior accuracy and adaptability for various SDE scenarios.
Study shows topological features improve time series classification.
problem Classifying stochastic processes with varying noise and sampling.
method Topological data analysis features compared to statistical and raw features.
result Topological features lead to better classification performance.
Proposes a probabilistic model to improve hydrology predictions and trust.
problem Noisy or missing basin characteristics impact streamflow prediction.
method Probabilistic inverse modeling framework to reconstruct basin characteristics.
result 6% improvement in R2 for streamflow prediction, 17% reduction in uncertainty. Unsupervised dimension selection is an important problem that seeks to reduce dimensionality of data, while preserving the most useful characteristics. While dimensionality reduction is commonly utilized to construct low-dimensional embeddings, they produce feature spaces that are hard to interpret. Further, in applica…
Detects crypto pump-and-dump schemes with a thresholding-based model.
problem Detecting genuine anomalies from minor trading fluctuations.
method Combining threshold-based criteria with EWMA and volatility measures.
result Balances high true-positive detection with minimal noise.
NANSDE-Net models time series with memory using neural ARMA-type noise.
problem Modeling time series with long- or short-memory characteristics.
method Developed NANSDE-Net, a generative model that incorporates Neural Network-kernel ARMA-type noise.
result NANSDE-Net matches or outperforms existing models in reproducing long- and short-memory features of data.
We present a new method for the separation of superimposed, independent, auto-correlated components from noisy multi-channel measurement. The presented method simultaneously reconstructs and separates the components, taking all channels into account and thereby increases the effective signal-to-noise ratio considerably…
The paper defines the time function of stock prices using a mathematical model.
problem Understanding the movement and predictability of stock prices over time.
method Empirical evidence and mathematical modeling of white noise.
result Derives auto-correlation function, displacement formula, and power spectral density of stock price movement.
The fundamental frequency (F0) represents pitch in speech that determines prosodic characteristics of speech and is needed in various tasks for speech analysis and synthesis. Despite decades of research on this topic, F0 estimation at low signal-to-noise ratios (SNRs) in unexpected noise conditions remains difficult. T…
ALPCAHUS clusters data from multiple subspaces with varying noise.
problem Heteroscedastic data with varying noise levels.
method Develops a heteroscedastic PCA method for subspace clustering.
result Improves subspace clustering by accounting for sample-wise noise variances.
ANT improves TS diffusion models by automatically determining noise schedules.
problem Suboptimal performance of TS diffusion models due to lack of domain-specific noise schedules.
method ANT proposes an adaptive noise schedule that automatically determines proper noise schedules for TS datasets based on their statistics.
result ANT achieves state-of-the-art performance on various TS tasks, including forecasting, refinement, and generation.
Polarimetric Synthetic Aperture Radar (PolSAR) images are establishing as an important source of information in remote sensing applications. The most complete format this type of imaging produces consists of complex-valued Hermitian matrices in every image coordinate and, as such, their visualization is challenging. Th…
This paper examines fundamental error characteristics for a general class of matrix completion problems, where the matrix of interest is a product of two a priori unknown matrices, one of which is sparse, and the observations are noisy. Our main contributions come in the form of minimax lower bounds for the expected pe…
RCLA reduces noise in topological data analysis, preserving essential structure.
problem Noise in large datasets obscures topological features in persistent homology.
method Grid-based RCLA integrates data reduction and denoising with a threshold parameter.
result RCLA provides a theoretical guarantee and automatic parameter selection.
Differential privacy mechanism design has traditionally been tailored for a scalar-valued query function. Although many mechanisms such as the Laplace and Gaussian mechanisms can be extended to a matrix-valued query function by adding i.i.d. noise to each element of the matrix, this method is often suboptimal as it for…
Noise analysis detects backdoors in DNNs quickly.
problem Detecting backdoors in DNNs trained on compromised data.
method Noise-infused image titration curves to quantify robustness and detect backdoors.
result DNNs with backdoors are more sensitive to noise and reveal their targets.
Bayesian method improves deep learning for noisy EEG seizure detection.
problem Label noise in scalp EEG data hinders deep learning performance.
method Integrates domain knowledge into a Bayesian framework to inform deep learning models of label ambiguities.
result BUNDL enhances robustness of seizure detection systems under noisy label conditions.
We study a well-known estimator of the fractal index of a stochastic process. Our framework is very general and encompasses many models of interest; we show how to extend the theory of the estimator to a large class of non-Gaussian processes. Particular focus is on clarity and ease of implementation of the estimator an…
We analyze DMs using spectral methods to design effective noise schedules.
problem Lack of theoretical foundation for synthesis process decisions in DMs.
method Introduced a frequency response perspective based on Gaussianity assumption.
result Proposed a spectral transfer function to understand DM inference process.
The paper examines conditions for linearity in a conditional mean estimator under vector Poisson noise.
problem Conditions for linearity of the conditional mean estimator in vector Poisson noise.
method Analyzes prior distributions and their impact on the conditional mean estimator's linearity.
result The only prior distribution that induces linearity is a product gamma distribution, and non-zero dark current parameter prevents linearity.
Optimal multistage method solves noisy minimax problems.
problem Minimizing/maximizing in noisy conditions with smooth and strongly convex-strongly concave settings.
method Multistage Stochastic Gradient Descent Ascent (M-GDA) and Optimistic Gradient Descent Ascent (M-OGDA).
result Achieves optimal linear decay rate with respect to initial error and condition number.
Generative model for financial time series using structured noise and signature learning.
problem Creating synthetic financial data to reflect real-world market dynamics.
method Structured noise, moving average model, signature transform, reinforcement learning.
result Model effectively captures key financial characteristics and outperforms existing methods.
In order to pursue the issue of the relation between the financial cross-correlations and the conventional Random Matrix Theory we analyse several characteristics of the stock market correlation matrices like the distribution of eigenvalues, the cross-correlations among signs of the returns, the volatility cross-correl…
Gaussian Processes improve geoscience data analysis.
problem Improving function approximation in geoscience.
method Review and development of new Gaussian Process algorithms.
result Automatic feature ranking and uncertainty intervals.
ALPCAH improves PCA for noisy data by estimating sample-wise noise variances.
problem Noisy data with varying noise levels in different samples.
method Sample-wise heteroscedastic PCA with tail singular value regularization.
result Improves subspace basis estimation for low-rank data.
This paper studies the classification of high-dimensional Gaussian signals from low-dimensional noisy, linear measurements. In particular, it provides upper bounds (sufficient conditions) on the number of measurements required to drive the probability of misclassification to zero in the low-noise regime, both for rando…