We introduce general scattering transforms as mathematical models of deep neural networks with l2 pooling. Scattering networks iteratively apply complex valued unitary operators, and the pooling is performed by a complex modulus. An expected scattering defines a contractive representation of a high-dimensional probabil…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,742 papers · 148 categories
Trend · papers per month
48 results for “Deep Scattering Network”
Unified graph scattering transforms improve theoretical properties of graph neural networks.
problem Improving theoretical guarantees for graph neural networks.
method Introducing windowed and non-windowed geometric scattering transforms for graphs.
result Unified family of graph scattering transforms with provable stability and invariance.
Deep learning solves wave-based inverse problems, including super-resolution imaging.
problem Solving inverse wave scattering problems across all length scales.
method Wide-band butterfly network coupled with dynamic noise injection.
result Framework successfully solves super-resolution imaging problems.
Deep neural networks correct Mie scattering in FTIR spectra of biological samples.
problem Mie scattering obscures biochemically relevant spectral information in FTIR spectra of biological samples.
method Deep neural networks to approximate the preprocessing function that removes Mie scattering.
result The model is faster and more generalizable across different tissue types.
Enhances DSN with multi-family wavelet transforms and sparsity.
problem Improving interpretability and expressive power of DSN.
method Multi-family wavelet transforms and optimal thresholding.
result Enhanced robustness and diversity of scattering coefficients.
We introduce a sparse scattering deep convolutional neural network, which provides a simple model to analyze properties of deep representation learning for classification. Learning a single dictionary matrix with a classifier yields a higher classification accuracy than AlexNet over the ImageNet 2012 dataset. The netwo…
Wide-band butterfly network: stable and efficient inversion via multi-frequency neural networkscs.LG
WideBNet learns inverse scattering from wide-band data efficiently and stably.
problem Learning the inverse scattering map from wide-band scattering data.
method Combines butterfly factorization, FFT, and deep learning.
result WideBNet requires fewer training points and has stable training dynamics.
The Euclidean scattering transform was introduced nearly a decade ago to improve the mathematical understanding of convolutional neural networks. Inspired by recent interest in geometric deep learning, which aims to generalize convolutional neural networks to manifold and graph-structured domains, we define a geometric…
The Euclidean scattering transform was introduced nearly a decade ago to improve the mathematical understanding of the success of convolutional neural networks (ConvNets) in image data analysis and other tasks. Inspired by recent interest in geometric deep learning, which aims to generalize ConvNets to manifold and gra…
Scattering transforms are non-trainable deep convolutional architectures that exploit the multi-scale resolution of a wavelet filter bank to obtain an appropriate representation of data. More importantly, they are proven invariant to translations, and stable to perturbations that are close to translations. This stabili…
Scattering networks are a class of designed Convolutional Neural Networks (CNNs) with fixed weights. We argue they can serve as generic representations for modelling images. In particular, by working in scattering space, we achieve competitive results both for supervised and unsupervised learning tasks, while making pr…
New deep learning model estimates scattering timescale of FRBs efficiently.
problem Estimating scattering timescale of fast radio bursts (FRBs) is a bottleneck.
method Multimodal Transformer Based Generic Mixture Density Network (MT-GMDN) that ingests dynamic spectrum and timeseries profile.
result Achieves 94% on expected value of for measurable scattering.
Scattering GCN improves graph neural networks by filtering oversmoothing.
problem Oversmoothing in GCNs limits their ability to distinguish graph nodes.
method Augmenting GCNs with geometric scattering transforms and residual convolutions.
result Scattering GCN outperforms GAT in semi-supervised node classification.
Generative Adversarial Nets (GANs) and Variational Auto-Encoders (VAEs) provide impressive image generations from Gaussian white noise, but the underlying mathematics are not well understood. We compute deep convolutional network generators by inverting a fixed embedding operator. Therefore, they do not require to be o…
ELUQuant quantifies uncertainties in DIS events using BNNs and MNFs.
problem Uncertainty quantification in Deep Inelastic Scattering (DIS) events.
method Physics-informed Bayesian Neural Network with flow approximated posteriors.
result Effective extraction of kinematic variables , , and with detailed event-level uncertainty.
Bayesian Scattering offers a simple baseline for image data uncertainty.
problem Lack of interpretable, mathematically grounded uncertainty quantification methods for image data.
method Coupling wavelet scattering transform with a simple probabilistic head.
result Bayesian Scattering provides sensible uncertainty estimates under distribution shifts.
Physics-Constrained Predictive Molecular Latent Space Discovery with Graph Scattering Variational Autoencoderphysics.chem-ph
Model predicts stable molecules with AI and physics constraints.
problem Designing stable molecules with limited data.
method Graph Scattering Variational Autoencoder with physical constraints.
result Model generates stable molecules with desired properties.
Transfer learning improves lensless imaging through scattering media with fewer samples.
problem Training deep neural networks (DNNs) for lensless imaging through scattering media requires large datasets, leading to poor cross-dataset performance.
method Proposed transfer learning approach using LISMU-FCN and LISMU-OCN architectures with a balance loss function.
result Transfer learning enables imaging across similar and significantly different datasets with fewer samples.
Diffuse optical tomography (DOT) has been investigated as an alternative imaging modality for breast cancer detection thanks to its excellent contrast to hemoglobin oxidization level. However, due to the complicated non-linear photon scattering physics and ill-posedness, the conventional reconstruction algorithms are s…
Unified geometric scattering model for measure spaces.
problem Improving CNNs for non-Euclidean data.
method Unified geometric scattering model for measure spaces.
result Unified model includes previous work and applies to more general settings.
GSAN learns adaptive node representations using geometric scattering and attention.
problem Oversmoothing in node representation learning.
method Attention-based architecture integrating geometric scattering and GCN channels.
result GSAN outperforms previous networks in semi-supervised node classification.
A deep learning model organizes RNA graphs to reveal folding patterns and properties.
problem Organizing and understanding the complex folding patterns of RNA secondary structures.
method Geometric scattering autoencoder (GSAE) network for learning graph embeddings.
result GSAE accurately reflects bistable RNA structures and can sample new folding trajectories.
We explore the generalization of scattering transforms from traditional (e.g., image or audio) signals to graph data, analogous to the generalization of ConvNets in geometric deep learning, and the utility of extracted graph features in graph data analysis. In particular, we focus on the capacity of these features to r…
Deep convolutional networks provide state of the art classifications and regressions results over many high-dimensional problems. We review their architecture, which scatters data with a cascade of linear filter weights and non-linearities. A mathematical framework is introduced to analyze their properties. Computation…
New methods implement manifold scattering transform for high-dimensional point cloud data.
problem Classifying data on complex, non-linear manifolds.
method Adapting diffusion maps theory for numerical implementation.
result Effective for signal and manifold classification tasks.
In this paper we propose a scalable version of a state-of-the-art deterministic time-invariant feature extraction approach based on consecutive changes of basis and nonlinearities, namely, the scattering network. The first focus of the paper is to extend the scattering network to allow the use of higher order nonlinear…
A new hybrid GNN framework tackles oversmoothing in graph data.
problem Oversmoothing in graph convolutional networks limits their expressive power and generalization.
method Combines traditional GCN filters with band-pass filters defined via geometric scattering and introduces an attention framework.
result Improves expressive power and generalization of graph convolutional networks.
Deep Learning of Vortex Induced Vibrationsphysics.flu-dyn
Vortex induced vibrations of bluff bodies occur when the vortex shedding frequency is close to the natural frequency of the structure. Of interest is the prediction of the lift and drag forces on the structure given some limited and scattered information on the velocity field. This is an inverse problem that is not str…
Scattering networks maximize separation on low-dimensional data.
problem Maximizing separation capacity on low-dimensional datasets.
method Characterize and bound separation capacity for feature extractors, then apply to scattering networks with specific criteria.
result Design criteria for scattering networks to maximize separation on low-dimensional data.
Compact neural networks improve reinforcement learning performance with less data.
problem Sample inefficiency in deep reinforcement learning.
method Tensor factorization and wavelet scattering for compact representation.
result Achieved 2-10 times fewer total coefficients with comparable performance.
Transformers predict scattering amplitudes in theoretical physics.
problem Computing exact coefficients of scattering amplitudes in N = 4 SYM theory.
method Applied Transformers to predict integer coefficients of scattering amplitudes.
result Transformers achieve high (> 98%) accuracy on predicting scattering amplitudes.
In multi-temporal SAR interferometry (MT-InSAR), persistent scatterer (PS) pixels are used to estimate geophysical parameters, essentially deformation. Conventionally, PS pixels are selected on the basis of the estimated noise present in the spatially uncorrelated phase component along with look-angle error in a tempor…
Enhances CNN feature extractors' separation capacity analysis.
problem Understanding the separation capacity of CNNs.
method Extending Cover's function-counting theory, analyzing scattering networks.
result Identifies factors affecting scattering networks' separation capacity.
MODWST improves classification tasks with wavelet scattering.
problem Signal classification challenges.
method Combines MODWT and WST for feature extraction.
result MODWST outperforms CNNs in limited data scenarios.
Stability is a key aspect of data analysis. In many applications, the natural notion of stability is geometric, as illustrated for example in computer vision. Scattering transforms construct deep convolutional representations which are certified stable to input deformations. This stability to deformations can be interp…
The aim of this paper is to discuss the use of Haar scattering networks, which is a very simple architecture that naturally supports a large number of stacked layers, yet with very few parameters, in a relatively broad set of pattern recognition problems, including regression and classification tasks. This architecture…
The wavelet scattering transform is an invariant signal representation suitable for many signal processing and machine learning applications. We present the Kymatio software package, an easy-to-use, high-performance Python implementation of the scattering transform in 1D, 2D, and 3D that is compatible with modern deep …
A new GNN module learns geometric scattering features for better graph classification and feature exploration.
problem Learning long-range graph relations and extracting meaningful features from graphs.
method Proposes a learnable geometric scattering (LEGS) module in graph neural networks (GNNs), incorporating wavelet filters.
result LEGS-based GNNs outperform existing methods in graph classification and feature extraction tasks.
New MHSNs extract multiscale features from complex data for robust classification.
problem Signal classification and domain classification on complex data.
method Layered structure with multiscale basis dictionaries, pooling operations, and invariant features.
result High-accuracy classification with fewer parameters than traditional graph neural networks.
Deep networks learn clean structure before memorizing corrupted labels, leaving a spectral signature in gradient centered scatter.
problem Deep networks' transition from learning clean structure to memorizing corrupted labels under label noise.
method Analysis of the centered scatter of per-example last-layer gradients to identify Fisher Rank Inflation.
result Fisher Rank Inflation is a spectral signature of memorization under label noise, with effective rank expanding during memorization.
SBI provides more accurate pole positions than chi-squared minimization in model misspecification.
problem Accurate pole position estimation in pi-pi scattering models.
method Simulation Based Inference (SBI) method compared to chi-squared minimization.
result SBI leads to more robust predictions of pole positions in models of pi-pi scattering.
Charts are an excellent way to convey patterns and trends in data, but they do not facilitate further modeling of the data or close inspection of individual data points. We present a fully automated system for extracting the numerical values of data points from images of scatter plots. We use deep learning techniques t…
Combines deep learning and iterative methods for robust phase retrieval.
problem Recovering signals from noisy Fourier intensities.
method Regularization-by-denoising combining iterative phase retrieval and deep learning.
result Outperforms other noise-robust phase retrieval algorithms.
We present a technique for efficiently synthesizing images of atmospheric clouds using a combination of Monte Carlo integration and neural networks. The intricacies of Lorenz-Mie scattering and the high albedo of cloud-forming aerosols make rendering of clouds---e.g. the characteristic silverlining and the "whiteness" …
Solves a challenging problem in imaging and communication.
problem Simultaneous source separation and phase retrieval.
method Uses deep generative models to constrain the search space.
result Demonstrates solving a highly under-determined, non-convex problem.
FAT-GAN simulates electron-proton scattering without theoretical assumptions.
problem Efficiently training GANs to simulate complex particle distributions.
method Developed FAT-GAN using transformed and augmented features to improve GAN performance.
result FAT-GAN accurately reproduces electron momenta distributions in electron-proton scattering.
This paper proposes a new framework to regularize the highly ill-posed and non-linear phase retrieval problem through deep generative priors using simple gradient descent algorithm. We experimentally show effectiveness of proposed algorithm for random Gaussian measurements (practically relevant in imaging through scatt…
A scattering transform defines a signal representation which is invariant to translations and Lipschitz continuous relatively to deformations. It is implemented with a non-linear convolution network that iterates over wavelet and modulus operators. Lipschitz continuity locally linearizes deformations. Complex classes o…