Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

4488132176 · Jun 202019922001200920172026
48 results for diffusion convolution

Analyzes how diffusion models learn, revealing a spectral bias in structure mastery.

problem Understanding the learning dynamics and bias in diffusion models.
method Developed an analytical framework using a Gaussian-equivalence principle to solve gradient-flow dynamics and integrate probability-flow ODEs.
result Exposes a universal inverse-variance spectral law: high-variance structure is mastered faster than low-variance detail.

Theory explains creativity in diffusion models generating novel images.

problem Diffusion models generate highly original images far from training data.
method Identified locality and equivariance as inductive biases to prevent optimal score-matching.
result Analytic models predict diffusion model outputs with high accuracy.

Graph convolution is the core of most Graph Neural Networks (GNNs) and usually approximated by message passing between direct (one-hop) neighbors. In this work, we remove the restriction of using only the direct neighbors by introducing a powerful, yet spatially localized graph convolution: Graph diffusion convolution …

2019-10-28abs ↗pdf ↗

DELIMIT is a framework extension for deep learning in diffusion imaging, which extends the basic framework PyTorch towards spherical signals. Based on several novel layers, deep learning can be applied to spherical diffusion imaging data in a very convenient way. First, two spherical harmonic interpolation layers are a…

2018-08-04abs ↗pdf ↗

Bi-Lipschitz flows approximate a wide range of distributions.

problem Characterizing the expressivity of bi-Lipschitz normalizing flows.
method Linking score regularity to transport map bi-Lipschitzness via probability flow ODE.
result Gaussian pullbacks induced by bi-Lipschitz variance-preserving transport maps are L1L^1-dense among all probability densities.

Graph diffusion processes approximate manifold heat semigroups using graph transition matrices.

problem Approximating manifold heat semigroups from graph data under low regularity conditions.
method Iterating graph transition matrix PP to approximate Qt=etΔQ_t = e^{tΔ}, bounding error in \infty-norm.
result Convergence rates O(N2/(d+6))O(N^{-2/(d+6)}) for manifold heat semigroup approximation, valid for in-sample and out-of-sample.

Textual network embedding leverages rich text information associated with the network to learn low-dimensional vectorial representations of vertices. Rather than using typical natural language processing (NLP) approaches, recent research exploits the relationship of texts on the same edge to graphically embed text. How…

2018-05-24abs ↗pdf ↗

In this work we detail the application of a fast convolution algorithm computing high dimensional integrals to the context of multiplicative noise stochastic processes. The algorithm provides a numerical solution to the problem of characterizing conditional probability density functions at arbitrary time, and we applie…

2011-07-07abs ↗pdf ↗

The financial market is nonpredictable, as according to the Bachelier, the mathematical expectation of the speculator is zero. Nevertheless, we observe in the price fluctuations the two distinct scales, short and long time. Behaviour of a market in long terms, such as year intervals, is different from that in short ter…

2006-08-18abs ↗pdf ↗

Stability is a key aspect of data analysis. In many applications, the natural notion of stability is geometric, as illustrated for example in computer vision. Scattering transforms construct deep convolutional representations which are certified stable to input deformations. This stability to deformations can be interp…

2018-06-22abs ↗pdf ↗

Diffusion models adapt to low-dimensional structures for nonparametric density estimation.

problem High-dimensional statistical inference challenges.
method Viewing diffusion models as implicit density estimators and exploiting their low-dimensional structure.
result Achieves minimax optimal rate for total variation distance with factorizable density.

We introduce two constructions in geometric deep learning for 1) transporting orientation-dependent convolutional filters over a manifold in a continuous way and thereby defining a convolution operator that naturally incorporates the rotational effect of holonomy; and 2) allowing efficient evaluation of manifold convol…

2019-09-13abs ↗pdf ↗

Nonparametric method measures influence of training images on diffusion model outputs.

problem Quantifying influence of individual training examples on diffusion model outputs.
method Patch-level similarity between generated and training images, using optimal score function.
result Strong attribution performance, matching gradient-based approaches and outperforming baselines.

The paper develops a new probabilistic framework for denoising diffusion models using free entropy and stochastic analysis.

problem Developing a mathematical framework for denoising diffusion models in noncommutative settings.
method Formulating diffusion and reverse processes governed by operator-valued stochastic dynamics, using tools from free stochastic analysis.
result Establishing an information-geometric link between entropy production, transport, and deconvolution.

U-Nets use belief propagation for efficient image denoising and classification.

problem Efficiently denoise and classify images using generative hierarchical models.
method Interpreted U-Nets as implementing belief propagation in tree-structured models.
result U-Nets can efficiently approximate denoising functions with sample complexity bounds.

The paper proves sampling methods using discrete-time processes and information theory.

problem Proving convergence guarantees for diffusion-based sampling methods.
method Directly works with discrete-time stochastic processes and uses information theory.
result Discrepancy between sampling and comparison processes is bounded using information theory.

We simplify diffusion models by defining a design space and improving FID scores.

problem Complexity in diffusion-based generative models.
method Defined a design space, improved sampling and training processes, and pre-conditioned score networks.
result Improved FID scores of 1.79 for CIFAR-10 and 1.97 for unconditional settings.

Unified kernel framework extends to stochastic systems, improving numerical stability.

problem Extending kernel methods to stochastic dynamical systems with diffusion.
method Unified kernel framework, Feynman-Kac path-integral representations, collocation-based computational framework.
result Kernel equivalence under uniform ellipticity assumptions and improved numerical stability with moderate diffusion.

Developed a monotone numerical method for MV portfolio optimization under jump-diffusion models.

problem Efficiently optimizing portfolios with jump-diffusion dynamics and investment constraints.
method Strictly monotone numerical integration method using Fourier transforms and composite quadrature rules.
result Proven to be \ell_{\infty}-stable and pointwise consistent, converging to the MV optimization solution.

A hybrid model combines diffusion and neural operator methods for stress prediction in hyperelastic materials.

problem Challenges in predicting stress fields in hyperelastic materials with complex microstructures.
method A hybrid surrogate framework combining a conditional denoising diffusion probabilistic model (cDDPM) and a modified DeepONet.
result The hybrid model consistently outperforms traditional methods by one to two orders of magnitude.

Transfer learning improves highway traffic forecasting using graph neural networks.

problem Lack of historical data for traffic forecasting on large highway networks.
method Developed a transfer learning approach for DCRNN, a graph neural network for highway forecasting.
result TL-DCRNN can forecast traffic on unseen regions of the highway network with high accuracy.

Generative model uses random convolutional features to create financial time series.

problem Generating realistic financial time series with limited data and avoiding overfitting.
method Train generators by matching random convolutional features of real and generated time series, using SOCK (SOft Competing Kernels) feature map.
result Generators trained with random SOCK features outperform baselines across various financial datasets.

Improved graph neural network bounds using graph diffusion matrix.

problem Empirical performance of graph neural networks on real-world graphs.
method Unified model of graph neural networks, focusing on feature diffusion matrix stability.
result Generalization bounds scale with largest singular value of feature diffusion matrix, smaller than prior bounds.

Study evaluates data augmentation methods for prostate cancer detection in MRI.

problem Limited data for prostate cancer detection in MRI.
method Static application of five augmentation techniques (rotation, flip, crop, translation) to MRI dataset.
result Rotation method improved 2D slice-based AUC to 0.85.

In recent years, Graph Convolutional Networks (GCNs) and their variants have been widely utilized in learning tasks that involve graphs. These tasks include recommendation systems, node classification, among many others. In node classification problem, the input is a graph in which the edges represent the association b…

2019-12-18abs ↗pdf ↗

We propose the Lanczos network (LanczosNet), which uses the Lanczos algorithm to construct low rank approximations of the graph Laplacian for graph convolution. Relying on the tridiagonal decomposition of the Lanczos algorithm, we not only efficiently exploit multi-scale information via fast approximated computation of…

2019-01-06abs ↗pdf ↗

New method transforms complex stochastic equations into simpler ones for efficient simulation.

problem Efficient simulation of complex path-dependent stochastic processes.
method Transforms Volterra-type SDEs into standard diffusion processes using convolution kernels.
result Proposes a numerical simulation scheme with a strong convergence rate of 1/2.

The purpose of this work is to develop and study a distributed strategy for Pareto optimization of an aggregate cost consisting of regularized risks. Each risk is modeled as the expectation of some loss function with unknown probability distribution while the regularizers are assumed deterministic, but are not required…

2019-09-20abs ↗pdf ↗

A novel capsule network model improves surrogate modeling and uncertainty quantification from sparse data.

problem Surrogate modeling and uncertainty quantification of systems from sparse data.
method Adapted Capsule Network (CapsNet) architecture into image-to-image regression encoder-decoder network.
result The proposed approach accurately, efficiently, and robustly predicts responses for arbitrary diffusion fields.

Diffuse optical tomography (DOT) has been investigated as an alternative imaging modality for breast cancer detection thanks to its excellent contrast to hemoglobin oxidization level. However, due to the complicated non-linear photon scattering physics and ill-posedness, the conventional reconstruction algorithms are s…

2017-12-04abs ↗pdf ↗