Paper introduces rational Gaussian wavelets for efficient signal approximation.
problem Efficiently approximating complex signals with few coefficients.
method Continuous wavelet transform using rational Gaussian wavelets with adjustable parameters.
result Proposed rational Gaussian wavelets provide accurate signal approximations.
Develops wavelet-based neural network approximation theory.
problem Analyzing neural network approximation capabilities over various activation functions.
method Wavelet frame theory on spaces of homogeneous type, sufficient conditions for approximation, error estimates.
result Derives sufficient conditions for neural networks to approximate any functions in a given space, including non-smooth activations.
New method estimates and samples high-dimensional probability distributions avoiding optimization and approximation curse.
problem Estimating high-dimensional probability distributions from data samples.
method Hierarchic probability flow from coarse to fine scales, defined by conditional probabilities across scales.
result Sampling hierarchic models avoids critical slowing down at phase transitions and generates turbulence and dark matter images.
In this paper we introduce a significant improvement to the popular tree-based Stochastic Gradient Boosting algorithm using a wavelet decomposition of the trees. This approach is based on harmonic analysis and approximation theoretical elements, and as we show through extensive experimentation, our wavelet based method…
This paper proposes a new methodology to compute Value at Risk (VaR) for quantifying losses in credit portfolios. We approximate the cumulative distribution of the loss function by a finite combination of Haar wavelets basis functions and calculate the coefficients of the approximation by inverting its Laplace transfor…
Wav-KAN improves neural network interpretability and performance.
problem Challenges in interpretability, training speed, robustness, and performance of traditional neural networks.
method Integrates wavelet functions into the Kolmogorov-Arnold network structure for efficient data representation.
result Enhanced accuracy, faster training speeds, and increased robustness compared to existing methods.
Cake wavelets minimize orientation score uncertainty.
problem Minimizing uncertainty in orientation scores.
method Axiomatically derived wavelets for orientation score lifting.
result Uncertainty gap of cake wavelets is less than 1.1.
We discuss approximation of functions using deep neural nets. Given a function f on a d-dimensional manifold Γ⊂Rm, we construct a sparsely-connected depth-4 neural network and bound its error in approximating f. The size of the network depends on dimension and curvature of the manifold Γ, the…
We propose a numerical algorithm for backward stochastic differential equations based on time discretization and trigonometric wavelets. This method combines the effectiveness of Fourier-based methods and the simplicity of a wavelet-based formula, resulting in an algorithm that is both accurate and easy to implement. F…
The paper examines how kernel approximations affect Gaussian process regression in large data applications.
problem Effect of kernel approximations on Gaussian process regression in large data applications.
method Unified framework to analyze Gaussian process regression under computational and epistemic misspecification.
result Theoretical analysis of Gaussian process regression under various misspecifications.
A new method combines EMD and diffusion maps for protein shape analysis.
problem Learning shape spaces of flexible macromolecules.
method Combines Earthmover's distance with diffusion maps for dimensionality reduction.
result EMD-based diffusion maps require fewer samples to recover intrinsic geometry.
In this paper, we contribute to the literature on energy market co-movement by studying its dynamics in the time-frequency domain. The novelty of our approach lies in the application of wavelet tools to commodity market data. A major part of economic time series analysis is done in the time or frequency domain separate…
Improves CNN stability by translating classical signal denoising methods.
problem Stability of CNNs is poorly understood.
method Interprets classical signal denoising methods as ResNet architectures.
result Translates diffusivities, shrinkage functions, and regularizers into CNN activation functions.
This paper presents a basic property of region dividing of ReLU (rectified linear unit) deep learning when new layers are successively added, by which two new perspectives of interpreting deep learning are given. The first is related to decision trees and forests; we construct a deep learning structure equivalent to a …
Complex systems are composed of mutually interacting components and the output values of these components are usually long-range cross-correlated. We propose a method to characterize the joint multifractal nature of such long-range cross correlations based on wavelet analysis, termed multifractal cross wavelet analysis…
Develops a new theory for approximating functions on massive data.
problem Challenges in machine learning with massive data.
method eignets theory for local, stratified approximation.
result Solves inverse problems like finding data probability law and function smoothness.
Wavelets help compress neural networks efficiently.
problem Efficiently compressing linear layers in neural networks.
method Learnable wavelet transforms to compress RNNs.
result Wavelet compressed RNNs have fewer parameters and perform competitively.
MODWST improves classification tasks with wavelet scattering.
problem Signal classification challenges.
method Combines MODWT and WST for feature extraction.
result MODWST outperforms CNNs in limited data scenarios.
Paper establishes convergence rates for learning elliptic pseudo-differential operators.
problem Learning elliptic pseudo-differential operators in partial differential equations.
method Wavelet-Galerkin framework, structured infinite-dimensional regression problem, sparse estimator, matrix compression, nested-support strategy.
result Obtained convergence rates for the estimator and efficient Galerkin solver.
In this work we propose a method for learning wavelet filters directly from data. We accomplish this by framing the discrete wavelet transform as a modified convolutional neural network. We introduce an autoencoder wavelet transform network that is trained using gradient descent. We show that the model is capable of le…
New method denoises graph signals using wavelets, scalable for large graphs.
problem Denoising graph signals with overcomplete tight frames and correlated noise.
method Data-driven wavelet tight frame, Stein's unbiased risk estimate, Chebyshev-Jackson polynomial approximations, Monte-Carlo strategy.
result Method scales to large graphs and finds applications in differential privacy.
VDWs enhance graph neural networks for analyzing complex data.
problem Analyzing data on non-Euclidean geometries.
method Incorporating vector diffusion wavelets into geometric graph neural networks.
result VDW-GNNs effectively analyze synthetic and real-world data.
The wavelet transform has seen success when incorporated into neural network architectures, such as in wavelet scattering networks. More recently, it has been shown that the dual-tree complex wavelet transform can provide better representations than the standard transform. With this in mind, we extend our previous meth…
New method selects diffusion scales for graph wavelets.
problem Choosing optimal diffusion scales for graph wavelets.
method Proposes an unsupervised method using information theory.
result Method selects diffusion scales for graph wavelets.
In this paper, we propose a generic framework for devising an adaptive approximation scheme for value function approximation in reinforcement learning, which introduces multiscale approximation. The two basic ingredients are multiresolution analysis as well as tree approximation. Starting from simple refinable function…
Wavelet Kolmogorov-Arnold Networks improve federated learning performance.
problem Improving performance in federated learning with heterogeneous data.
method Implemented Wav-KAN with CWT and DWT for multiresolution capability, integrating wavelet-based activation functions.
result Significant improvements in computational efficiency, robustness, and accuracy in federated learning.
This paper proposes the use of wavelet methods to estimate U.S. core inflation. It explains wavelet methods and suggests they are ideally suited to this task. Comparisons are made with traditional CPI-based and regression-based measures for their performance in following trend inflation and predicting future inflation.…
Wavelet Networks learn from raw time-series data, outperforming conventional CNNs.
problem Learning from raw time-series data efficiently and effectively.
method Constructing scale-translation equivariant neural networks based on wavelet symmetries.
result Wavelet Networks outperform conventional CNNs on raw waveforms and spectrograms.
Wavelets improve VAE image quality.
problem VAEs produce blurry images due to lack of high-frequency detail emphasis.
method Wavelet space VAE that emphasizes high-frequency components.
result Wavelet-based VAE generates higher quality images.
Revisits SWIFT method for option pricing using Shannon wavelets.
problem Improving option pricing under known characteristic functions.
method SWIFT method based on Shannon wavelets.
result Exposes drawbacks and discusses improvements.
Optimizes wavelets for graph classification using spectral wavelet signatures and persistence diagrams.
problem Graph classification with geometric properties encoded in persistence diagrams.
method Optimizes spectral wavelets for graph datasets to capture best-suited features for classification.
result Competitive performance in graph classification problems compared to other persistence-based architectures.
Improved texture synthesis using wavelet-based statistics with rectifier non-linearity.
problem Improving texture synthesis quality using wavelet representations.
method Proposes a family of statistics based on non-linear wavelet representations with a generalized rectifier non-linearity.
result Significantly improves visual quality of texture synthesis compared to classical wavelet-based models.
We present graph wavelet neural network (GWNN), a novel graph convolutional neural network (CNN), leveraging graph wavelet transform to address the shortcomings of previous spectral graph CNN methods that depend on graph Fourier transform. Different from graph Fourier transform, graph wavelet transform can be obtained …
Wavelet SGM accelerates generative modeling with linear time complexity.
problem High computational cost in SGMs.
method Factorizing data distribution into wavelet coefficients.
result WSGM synthesizes wavelet coefficients with linear time complexity.
MLShrink integrates machine learning with wavelet shrinkage for denoising.
problem Denoising signals with uncertain magnitudes
method Combines wavelet shrinkage with machine learning
result Preserves simplicity for signal coefficients while allowing data-adaptive decisions for ambiguous coefficients
Wavelet scattering spectra model non-Gaussian time-series, proving scale invariance for self-similar processes.
problem Modeling non-Gaussian time-series with stationary increments.
method Complex wavelet transform for scale variations, joint correlation matrix for scale dependencies, second wavelet transform for diagonalization, maximum entropy models conditioned by scattering spectra coefficients.
result Scattering spectra of self-similar processes are scale invariant, allowing statistical testing and generation of new time-series.
Unified method for simultaneous denoising and clustering.
problem Clustering noisy signals.
method Sparse convex wavelet clustering with fusion and group-sparse penalties.
result Unified approach that denoises and clusters simultaneously.
AWD distills neural network info into interpretable wavelets.
problem Imbalanced interpretability and efficiency in deep learning models.
method Adaptive wavelet distillation (AWD) penalizes neural network attributions in wavelet domain.
result AWD yields a concise, efficient, and interpretable model.
A new WNN framework selects wavelet bases for efficient learning.
problem Challenges in constructing accurate wavelet bases and high computational costs in WNN.
method Introduces a constructive WNN that selects initial bases and trains functions by introducing new bases for predefined accuracy while reducing computational costs.
result Significantly improves computational efficiency through a frequency estimator and wavelet-basis increase mechanism.
Pixel intensity is a widely used feature for clustering and segmentation algorithms, the resulting segmentation using only intensity values might suffer from noises and lack of spatial context information. Wavelet transform is often used for image denoising and classification. We proposed a novel method to incorporate …
It is the main goal of this article to address the bipartite ranking issue from the perspective of functional data analysis (FDA). Given a training set of independent realizations of a (possibly sampled) second-order random function with a (locally) smooth autocorrelation structure and to which a binary label is random…
WaveletGAN improves GANs by homogenizing noise through multi-channel wavelet filtering.
problem Current noise generation models in GANs struggle with homogenizing noise, leading to low-fidelity samples.
method Proposes a multi-channel wavelet-based filtering method to homogenize noise in GANs.
result WaveletGAN generates high-fidelity samples with the smallest FIDs on Fashion-MNIST, KMNIST, and SVHN datasets.
In this paper we propose and study a family of continuous wavelets on general domains, and a corresponding stochastic discretization that we call Monte Carlo wavelets. First, using tools from the theory of reproducing kernel Hilbert spaces and associated integral operators, we define a family of continuous wavelets by …
Volatility dynamics of wavelet - filtered stock price time series is studied. Using the universal thresholding method of wavelet filtering and a principle of minimal linear autocorrelation of noise component we find that the quantitative characteristics of volatility dynamics of denoised series are noticeably different…
Wavelet analysis reveals non-linear dynamics in cryptocurrency prices.
problem Understanding non-linear dynamics in high-frequency cryptocurrency prices.
method Wavelet analysis of frequency and time variables.
result Cyclical persistence at different frequencies in cryptocurrency prices.
Express Wavenet reduces neural network parameters to 1% of standard networks.
problem Optical neural networks with high parameter count.
method Wavelet modulation, random shift wavelets, expressway structure.
result Express Wavenet achieves high accuracy with significantly fewer parameters.
Wavelet analysis reveals financialization effects on oil-food price correlation.
problem Investigating the correlation between oil and food prices and their determinants.
method Wavelet analysis and energy-based measures to differentiate high and low frequency movements.
result Significant local correlation between food and oil is due to financialization and emerging economies' demand.
WCAM assesses neural network reliability by attributing decisions to wavelet scales.
problem Challenges in evaluating neural network reliability and feature robustness.
method Introduces WCAM, a wavelet-based attribution method to assess decision reliability.
result WCAM reveals where and on what scales a model focuses, enabling reliable decision assessment.