Express Wavenet reduces neural network parameters to 1% of standard networks.
problem Optical neural networks with high parameter count.
method Wavelet modulation, random shift wavelets, expressway structure.
result Express Wavenet achieves high accuracy with significantly fewer parameters.
RP-WNO extends WNO with uncertainty quantification, useful for scientists and engineers.
problem Uncertainty in predictions of deep learning models.
method Randomized Prior Wavelet Neural Operator (RP-WNO) with uncertainty quantification module.
result RP-WNO effectively estimates uncertainty in predictions.
Bayesian Scattering offers a simple baseline for image data uncertainty.
problem Lack of interpretable, mathematically grounded uncertainty quantification methods for image data.
method Coupling wavelet scattering transform with a simple probabilistic head.
result Bayesian Scattering provides sensible uncertainty estimates under distribution shifts.
Proposes a new method to improve CNNs' shift invariance and accuracy.
problem Improving CNNs' shift invariance and prediction accuracy.
method Replaces RMax with CMod, a Gabor-like structure, to increase shift invariance and accuracy.
result Achieves superior accuracy on ImageNet and CIFAR-10 classification tasks.
In this paper we propose and study a family of continuous wavelets on general domains, and a corresponding stochastic discretization that we call Monte Carlo wavelets. First, using tools from the theory of reproducing kernel Hilbert spaces and associated integral operators, we define a family of continuous wavelets by …
We introduce a novel harmonic analysis for functions defined on the vertices of a strongly connected directed graph of which the random walk operator is the cornerstone. As a first step, we consider the set of eigenvectors of the random walk operator as a non-orthogonal Fourier-type basis for functions over directed gr…
Alternative wavelet analysis method for financial signals.
problem Analyzing oscillations in financial signals with noise.
method Modeling financial signals as isolated events producing ripples of various frequencies.
result Element analysis distinguishes between noise and logically matched generators.
We describe new results and algorithms for two different, but related, problems which deal with circulant matrices: learning shift-invariant components from training data and calculating the shift (or alignment) between two given signals. In the first instance, we deal with the shift-invariant dictionary learning probl…
To define oscillatory movements of securities market, we put in the non-local extension of Ito- equation for wavelet-images of random processes. It is proposed an algorithm of creation of evolutionary equation and a model of prediction of the most probable price movement path. It is carried out experimental validation …
Robust method estimates self-similarity for mammogram images, improving cancer detection.
problem Statistical assessment of self-similarity in real data with large mean level shifts.
method Theil-type weighted regression for wavelet-based estimation, compared to OLS and AV.
result Robust approach shows nearly 68% accuracy in cancer vs non-cancer classification.
New wavelet frames constructed from reproducing kernels for continuous and discrete domains.
problem Generating wavelet frames on non-Euclidean structures.
method Spectral filtering of integral operators associated with reproducing kernels.
result Discrete frames as Monte Carlo estimates of continuous frames, with finite-sample rates derived.
The paper addresses instability in CNNs' first layer by proving max pooling's shift invariance.
problem Instability in CNNs' first layer, leading to sensitivity to small input shifts.
method Establishing conditions for max pooling's shift invariance and deriving a measure of stability.
result Max pooling approximates a nearly shift-invariant complex modulus under certain conditions.
In recent years, a rapidly growing literature has focussed on the construction of wavelet systems to analyze functions defined on the sphere. Our purpose in this paper is to generalize these constructions to situations where sections of line bundles, rather than ordinary scalar-valued functions, are considered. In part…
TimeLAVA: A Learning-Agnostic Framework for Valuing Time Series
problem Valuing time series data for critical domains like healthcare, finance, and industrial monitoring
method A novel Selective Wavelet-based Wasserstein discrepancy for segmenting and valuing temporal segments
result Significantly more informative value scores than existing methods
TimeLAVA learns time series segment values without model dependence.
problem Valuation of time series data for critical domains.
method Learning-agnostic framework using Selective Wavelet-based Wasserstein discrepancy.
result TimeLAVA produces more informative value scores than existing methods.
We apply a recently developed wavelet based approach to characterize the correlation and scaling properties of non-stationary financial time series. This approach is local in nature and it makes use of wavelets from the Daubechies family for detrending purpose. The built-in variable windows in wavelet transform makes t…
Glioma grading before surgery is very critical for the prognosis prediction and treatment plan making. We present a novel wavelet scattering-based radiomic method to predict noninvasively and accurately the glioma grades. The method consists of wavelet scattering feature extraction, dimensionality reduction, and glioma…
CTRF combines logged data and randomized experiments for robust prediction.
problem Robust prediction models to handle distributional shifts between training and testing data.
method CTRF uses existing training data and a small amount of randomized experiment data to train a robust model.
result CTRF produces robust predictions and outperforms baseline methods in the presence of feature shifts.
New method denoises graph signals using wavelets, scalable for large graphs.
problem Denoising graph signals with overcomplete tight frames and correlated noise.
method Data-driven wavelet tight frame, Stein's unbiased risk estimate, Chebyshev-Jackson polynomial approximations, Monte-Carlo strategy.
result Method scales to large graphs and finds applications in differential privacy.
Wavelets help compress neural networks efficiently.
problem Efficiently compressing linear layers in neural networks.
method Learnable wavelet transforms to compress RNNs.
result Wavelet compressed RNNs have fewer parameters and perform competitively.
New method robust to random distributional shifts in prediction.
problem Random distributional shifts in real-world settings.
method Hybrid approach combining long-term and proxy outcomes.
result Hybrid approach yields lower mean-squared error than current methods.
Paper introduces rational Gaussian wavelets for efficient signal approximation.
problem Efficiently approximating complex signals with few coefficients.
method Continuous wavelet transform using rational Gaussian wavelets with adjustable parameters.
result Proposed rational Gaussian wavelets provide accurate signal approximations.
MODWST improves classification tasks with wavelet scattering.
problem Signal classification challenges.
method Combines MODWT and WST for feature extraction.
result MODWST outperforms CNNs in limited data scenarios.
In this work we propose a method for learning wavelet filters directly from data. We accomplish this by framing the discrete wavelet transform as a modified convolutional neural network. We introduce an autoencoder wavelet transform network that is trained using gradient descent. We show that the model is capable of le…
VDWs enhance graph neural networks for analyzing complex data.
problem Analyzing data on non-Euclidean geometries.
method Incorporating vector diffusion wavelets into geometric graph neural networks.
result VDW-GNNs effectively analyze synthetic and real-world data.
The wavelet transform has seen success when incorporated into neural network architectures, such as in wavelet scattering networks. More recently, it has been shown that the dual-tree complex wavelet transform can provide better representations than the standard transform. With this in mind, we extend our previous meth…
New method uses graphene transistors for efficient non-uniform random number generation.
problem Generating non-uniform random variates efficiently.
method GFET-based hardware non-uniform random number generator.
result Demonstrated speedup of Monte Carlo integration by up to 2x.
Deep convolutional neural networks have led to breakthrough results in numerous practical machine learning tasks such as classification of images in the ImageNet data set, control-policy-learning to play Atari games or the board game Go, and image captioning. Many of these applications first perform feature extraction …
New method selects diffusion scales for graph wavelets.
problem Choosing optimal diffusion scales for graph wavelets.
method Proposes an unsupervised method using information theory.
result Method selects diffusion scales for graph wavelets.
New insights into how high-dimensional models handle covariate shifts.
problem Covariate shift in high-dimensional random feature regression.
method Exact high-dimensional asymptotics of random feature regression under covariate shift.
result Overparameterized models exhibit enhanced robustness to covariate shift.
Wavelet Kolmogorov-Arnold Networks improve federated learning performance.
problem Improving performance in federated learning with heterogeneous data.
method Implemented Wav-KAN with CWT and DWT for multiresolution capability, integrating wavelet-based activation functions.
result Significant improvements in computational efficiency, robustness, and accuracy in federated learning.
This paper proposes the use of wavelet methods to estimate U.S. core inflation. It explains wavelet methods and suggests they are ideally suited to this task. Comparisons are made with traditional CPI-based and regression-based measures for their performance in following trend inflation and predicting future inflation.…
WaveLSFormer learns profitable trading policies from financial time series data.
problem Challenges in learning profitable intraday trading policies from financial time series data.
method WaveLSFormer uses a learnable wavelet-based long-short Transformer to jointly perform multi-scale decomposition and return-oriented decision learning.
result WaveLSFormer consistently outperforms MLP, LSTM, and Transformer backbones in trading performance.
Wavelet Networks learn from raw time-series data, outperforming conventional CNNs.
problem Learning from raw time-series data efficiently and effectively.
method Constructing scale-translation equivariant neural networks based on wavelet symmetries.
result Wavelet Networks outperform conventional CNNs on raw waveforms and spectrograms.
This paper improves computational efficiency in kernel ridge regression under covariate shift.
problem Covariate shift in nonparametric regression.
method Random projections in RKHS to reduce computational demands.
result Significant computational savings can be achieved without compromising learning performance under covariate shift.
Algorithm identifies fractal system's scaling exponents in high dimensions.
problem Statistical identification of Hurst distribution in high-dimensional fractal systems.
method Wavelet random matrices, modified spectral clustering, model selection.
result Algorithm consistently estimates Hurst distribution in moderately high dimensions.
Improved SVD for shifted matrices without explicit matrix construction.
problem Efficiently estimating SVD of shifted matrices.
method Shifted Randomized SVD algorithm.
result More efficient matrix factorization and low-rank approximation.
Wavelets improve VAE image quality.
problem VAEs produce blurry images due to lack of high-frequency detail emphasis.
method Wavelet space VAE that emphasizes high-frequency components.
result Wavelet-based VAE generates higher quality images.
It is the main goal of this article to address the bipartite ranking issue from the perspective of functional data analysis (FDA). Given a training set of independent realizations of a (possibly sampled) second-order random function with a (locally) smooth autocorrelation structure and to which a binary label is random…
Revisits SWIFT method for option pricing using Shannon wavelets.
problem Improving option pricing under known characteristic functions.
method SWIFT method based on Shannon wavelets.
result Exposes drawbacks and discusses improvements.
Optimizes wavelets for graph classification using spectral wavelet signatures and persistence diagrams.
problem Graph classification with geometric properties encoded in persistence diagrams.
method Optimizes spectral wavelets for graph datasets to capture best-suited features for classification.
result Competitive performance in graph classification problems compared to other persistence-based architectures.
Improved texture synthesis using wavelet-based statistics with rectifier non-linearity.
problem Improving texture synthesis quality using wavelet representations.
method Proposes a family of statistics based on non-linear wavelet representations with a generalized rectifier non-linearity.
result Significantly improves visual quality of texture synthesis compared to classical wavelet-based models.
Cake wavelets minimize orientation score uncertainty.
problem Minimizing uncertainty in orientation scores.
method Axiomatically derived wavelets for orientation score lifting.
result Uncertainty gap of cake wavelets is less than 1.1.
We present graph wavelet neural network (GWNN), a novel graph convolutional neural network (CNN), leveraging graph wavelet transform to address the shortcomings of previous spectral graph CNN methods that depend on graph Fourier transform. Different from graph Fourier transform, graph wavelet transform can be obtained …
Wavelet SGM accelerates generative modeling with linear time complexity.
problem High computational cost in SGMs.
method Factorizing data distribution into wavelet coefficients.
result WSGM synthesizes wavelet coefficients with linear time complexity.
MLShrink integrates machine learning with wavelet shrinkage for denoising.
problem Denoising signals with uncertain magnitudes
method Combines wavelet shrinkage with machine learning
result Preserves simplicity for signal coefficients while allowing data-adaptive decisions for ambiguous coefficients
A method to remove mean-shift noise from PCA using knockoffs.
problem High sensitivity of PCA to mean-shift contamination in high-dimensional data.
method Introducing knockoff mean-shift perturbation to separate and remove mean-shift components from PCA.
result The mean-shift spikes are spectrally separable from stable eigenvalues, allowing for robust PCA.
Wavelet scattering spectra model non-Gaussian time-series, proving scale invariance for self-similar processes.
problem Modeling non-Gaussian time-series with stationary increments.
method Complex wavelet transform for scale variations, joint correlation matrix for scale dependencies, second wavelet transform for diagonalization, maximum entropy models conditioned by scattering spectra coefficients.
result Scattering spectra of self-similar processes are scale invariant, allowing statistical testing and generation of new time-series.