arXiv research

Sharp bounds for approximating Sobolev functions by ridge functions and networks.

In this paper, we propose a low-rank approximation method based on discrete least-squares for the approximation of a multivariate function from random, noisy-free observations. Sparsity inducing regularization techniques are used within classical algorithms for low-rank approximation in order to exploit the possible sp…

We propose a family of multivariate Gaussian process models for correlated outputs, based on assuming that the likelihood function takes the generic form of the multivariate exponential family distribution (EFD). We denote this model as a multivariate generalized Gaussian process model, and derive Taylor and Laplace al…

Efficiently finds sparse solutions to max-plus equations for convex regression.

A new KAN variant uses sinusoidal activations to approximate functions.

New RBF networks can approximate any continuous function.

A neural network with a single hidden layer can't represent certain multivariable functions.

The univariate piecing-together approach (PT) fits a univariate generalized Pareto distribution (GPD) to the upper tail of a given distribution function in a continuous manner. We propose a multivariate extension. First it is shown that an arbitrary copula is in the domain of attraction of a multivariate extreme value …

This paper describes a hierarchical learning strategy for generating sparse representations of multivariate datasets. The hierarchy arises from approximation spaces considered at successively finer scales. A detailed analysis of stability, convergence and behavior of error functionals associated with the approximations…

Gaussian random vectors exhibit the loss of dimension phenomena, which relate to their joint survival tail behaviour. Besides, the fact that the components of such vectors are light-tailed complicates the approximations of various multivariate risk measures significantly. In this contribution we derive precise approxim…

Circular variables arise in a multitude of data-modelling contexts ranging from robotics to the social sciences, but they have been largely overlooked by the machine learning community. This paper partially redresses this imbalance by extending some standard probabilistic modelling tools to the circular domain. First w…

A new model uses neural networks to efficiently learn multivariate temporal point processes.

Proposes a new method for multivariate functional regression.

Manifold calculus of functors, due to M. Weiss, studies contravariant functors from the poset of open subsets of a smooth manifold to topological spaces. We introduce "multivariable" manifold calculus of functors which is a generalization of this theory to functors whose domain is a product of categories of open sets. …

We propose a methodology for computing single and multi-asset European option prices, and more generally expectations of scalar functions of (multivariate) random variables. This new approach combines the ability of Monte Carlo simulation to handle high-dimensional problems with the efficiency of function approximation…

The paper develops approximations for Pearson's chi-square statistic and applies them to confidence intervals.

This article describes a multivariate polynomial regression method where the uncertainty of the input parameters are approximated with Gaussian distributions, derived from the central limit theorem for large weighted sums, directly from the training sample. The estimated uncertainties can be propagated into the optimal…

Graphical Gaussian models have proven to be useful tools for exploring network structures based on multivariate data. Applications to studies of gene expression have generated substantial interest in these models, and resulting recent progress includes the development of fitting methodology involving penalization of th…

New algorithms for multivariate RL improve decision-making in complex systems.

We derive Gaussian approximations for random forest predictions using region-based stabilization.

In many applications, such as economics, operations research and reinforcement learning, one often needs to estimate a multivariate regression function f subject to a convexity constraint. For example, in sequential decision processes the value of a state under optimal subsequent decisions may be known to be convex or …

Study shows shallow ReLU networks struggle with high-dimensional Lipschitz functions.

We leverage neural networks as universal approximators of monotonic functions to build a parameterization of conditional cumulative distribution functions (CDFs). By the application of automatic differentiation with respect to response variables and then to parameters of this CDF representation, we are able to build bl…

A new machine learning model uses matrix exponentials for universal approximation.

Calibrating a Lévy process usually requires characterizing its jump distribution. Traditionally this problem can be solved with nonparametric estimation using the empirical characteristic functions (ECF), assuming certain regularity, and results to date are mostly in 1D. For multivariate Lévy processes and less smooth …

Unified method for calculating financial option prices from characteristic functions.

Deep belief networks can approximate any multivariate density with binary hidden units.

Optimizes dynamic investment portfolios with correlated jumps.

We are interested in approximation of a multivariate function $f(x_1,\dots,x_d)$ by linear combinations of products $u^1(x_1)\cdots u^d(x_d)$ of univariate functions $u^i(x_i)$, $i=1,\dots,d$. In the case $d=2$ it is a classical problem of bilinear approximation. In the case of approximation in the $L_2$ space the bili…

Archetypal analysis approximates data by means of mixtures of actual extreme cases (archetypoids) or archetypes, which are a convex combination of cases in the data set. Archetypes lie on the boundary of the convex hull. This makes the analysis very sensitive to outliers. A robust methodology by means of M-estimators f…

Copulas allow to learn marginal distributions separately from the multivariate dependence structure (copula) that links them together into a density function. Vine factorizations ease the learning of high-dimensional copulas by constructing a hierarchy of conditional bivariate copulas. However, to simplify inference, i…

Regularized MFPCA smooths multivariate functional data for clearer patterns.

We generalize the log Gaussian Cox process (LGCP) framework to model multiple correlated point data jointly. The observations are treated as realizations of multiple LGCPs, whose log intensities are given by linear combinations of latent functions drawn from Gaussian process priors. The combination coefficients are als…

The paper proposes a new method for density estimation using spline quasi-interpolation for clustering.

We introduce closed-form transition density expansions for multivariate affine jump-diffusion processes. The expansions rely on a general approximation theory which we develop in weighted Hilbert spaces for random variables which possess all polynomial moments. We establish parametric conditions which guarantee existen…

Unified framework for shrinkage, thresholding, and regularization in normal mean estimation and linear regression.

The paper introduces new estimators for multivariate functions using Fourier methods.

A new framework learns system design using neural features in function space.

New proof shows neural networks can represent all multivariate functions.

The paper introduces a new method to find meaningful data subsets in multivariate probability density functions.

This paper establishes the (nearly) optimal approximation error characterization of deep rectified linear unit (ReLU) networks for smooth functions in terms of both width and depth simultaneously. To that end, we first prove that multivariate polynomials can be approximated by deep ReLU networks of width $\mathcal{O}(N…

The paper proposes a method to learn evolving multivariate distributions from sample paths.

This article considers algorithmic and statistical aspects of linear regression when the correspondence between the covariates and the responses is unknown. First, a fully polynomial-time approximation scheme is given for the natural least squares optimization problem in any constant dimension. Next, in an average-case…

Paper improves confidence intervals for LSA with multiplier bootstrap.

Bayesian method for knot inference in multivariate spline regression.

AGCA approximates angular variation on the unit sphere, reducing extremal dependence problems to eigenanalysis.

Bayesian approach approximates probability functions of Gaussian mixtures.

The covariance structure of multivariate functional data can be highly complex, especially if the multivariate dimension is large, making extensions of statistical methods for standard multivariate data to the functional data setting challenging. For example, Gaussian graphical models have recently been extended to the…