ResNets approximate log-Gaussian at initialization, improving network performance.
problem Understanding the initialization behavior of deep neural networks like ResNets.
method Analyzing ReLU ResNets in the infinite-depth-and-width limit, showing log-Gaussian behavior.
result ResNets at initialization exhibit hypoactivation and interlayer correlations, which are not captured by Gaussian limits.
Active learning improves neutron spectroscopy experiments by automating measurement selection.
problem Efficiently searching for signals in neutron scattering experiments with limited beam time.
method Probabilistic active learning using log-Gaussian processes.
result Automated selection of informative measurements improves experimental efficiency.
Proposes a method for training Bayesian neural networks using synthetic data from Raman and CARS spectra.
problem Limited real observations in Raman and CARS spectroscopy.
method Log-Gaussian Gamma Processes and Bayesian Neural Networks.
result Trained Bayesian neural networks provide accurate estimates of Raman and CARS spectra with uncertainty quantification.
A new method clusters rows of a matrix of point processes.
problem Challenges in analyzing structured point process data.
method Mixture model of multi-level marked point processes, combined with ES algorithm and FPCA.
result An efficient method for clustering rows of a matrix of point processes.
McCullagh and Yang (2006) suggest a family of classification algorithms based on Cox processes. We further investigate the log Gaussian variant which has a number of appealing properties. Conditioned on the covariates, the distribution over labels is given by a type of conditional Markov random field. In the supervised…
New Hawkes processes model spatiotemporal events with triggering and clustering.
problem Modeling self-excitatory behavior in spatiotemporal data.
method Developed a new class of spatiotemporal Hawkes processes with efficient inference method.
result Efficiently modeled and inferred spatiotemporal events with triggering and clustering.
We generalize the log Gaussian Cox process (LGCP) framework to model multiple correlated point data jointly. The observations are treated as realizations of multiple LGCPs, whose log intensities are given by linear combinations of latent functions drawn from Gaussian process priors. The combination coefficients are als…
We study dynamical behavior of the Chinese stock markets by investigating the statistical properties of daily ensemble returns and varieties defined respectively as the mean and the standard deviation of the ensemble daily price returns of a portfolio of stocks traded in China's stock markets on a given day. The distri…
Solves Lp-Gaussian chord Minkowski problem using Gauss curvature flow.
problem Solving the Lp-Gaussian chord Minkowski problem. method Using Gauss curvature flow to obtain smooth even solutions.
result Obtains smooth even solutions to the Lp-Gaussian chord Minkowski problem. Spatio-temporal point process models play a central role in the analysis of spatially distributed systems in several disciplines. Yet, scalable inference remains computa- tionally challenging both due to the high resolution modelling generally required and the analytically intractable likelihood function. Here, we expl…
The spectral energy distribution (SED) is a relatively easy way for astronomers to distinguish between different astronomical objects such as galaxies, black holes, and stellar objects. By comparing the observations from a source at different frequencies with template models, astronomers are able to infer the type of t…
We propose a generic spatiotemporal event forecasting method, which we developed for the National Institute of Justice's (NIJ) Real-Time Crime Forecasting Challenge. Our method is a spatiotemporal forecasting model combining scalable randomized Reproducing Kernel Hilbert Space (RKHS) methods for approximating Gaussian …
Stochastic processes provide a mathematically elegant way model complex data. In theory, they provide flexible priors over function classes that can encode a wide range of interesting assumptions. In practice, however, efficient inference by optimisation or marginalisation is difficult, a problem further exacerbated wi…
Study sharp convergence rates of empirical UOT for spatio-temporal point processes.
problem Statistical analysis of UOT for spatio-temporal point processes.
method Empirical plug-in estimators for Kantorovich-Rubinstein distance between intensity measures.
result Sharp convergence rates of empirical UOT in terms of intrinsic dimensions of measures.
Deep neural networks approximate analytic functions in high dimensions with exponential rates.
problem Approximating analytic functions in high-dimensional spaces using neural networks.
method Analyzing convergence rates of ReLU and ReLU^k activations in L2(Rd,γd) for d∈N∪{∞}. result Exponential convergence rates for analytic functions in L2(Rd,γd) for d∈N, and dimension-independent bounds for d=∞. We introduce a new family of MCMC samplers that combine auxiliary variables, Gibbs sampling and Taylor expansions of the target density. Our approach permits the marginalisation over the auxiliary variables yielding marginal samplers, or the augmentation of the auxiliary variables, yielding auxiliary samplers. The well…
A new MCMC method combines low and high-fidelity models to reduce computation.
problem Inefficient computation of expensive target densities in scientific applications.
method Pseudo-marginal MCMC approach using a telescoping series of low-fidelity models.
result Asymptotically exact multi-fidelity MCMC algorithms for reduced computational cost.