arXiv research

Gaussian equivalence fails for simple polynomial embeddings in quadratic scaling RF models.

Classifies surfaces in hyperbolic space with constant Gaussian curvature.

RL solves discrete LQ control with Gaussian optimal policy.

LqgOpt learns optimal control in unknown LQG systems with minimal regret.

The paper models asset pricing in a partially observed market using mean field game theory and exponential quadratic Gaussian framework.

The authors aim to develop numerical schemes of the two representative quadratic hedging strategies: locally risk minimizing and mean-variance hedging strategies, for models whose asset price process is given by the exponential of a normal inverse Gaussian process, using the results of Arai et al. \cite{AIS}, and Arai …

We introduce a Bernstein-type inequality which serves to uniformly control quadratic forms of gaussian variables. The latter can for example be used to derive sharp model selection criteria for linear estimation in linear regression and linear inverse problems via penalization, and we do not exclude that its scope of a…

This paper aims at refined error analysis for binary classification using support vector machine (SVM) with Gaussian kernel and convex loss. Our first result shows that for some loss functions such as the truncated quadratic loss and quadratic loss, SVM with Gaussian kernel can reach the almost optimal learning rate, p…

New bound matches exact generalization error for quadratic Gaussian problem.

Study shows neural networks trained with GD converge to Gaussian processes with polynomial decay.

We introduce a new discriminant analysis method (Empirical Discriminant Analysis or EDA) for binary classification in machine learning. Given a dataset of feature vectors, this method defines an empirical feature map transforming the training and test data into new data with components having Gaussian empirical distrib…

The recent financial crisis has led to so-called multi-curve models for the term structure. Here we study a multi-curve extension of short rate models where, in addition to the short rate itself, we introduce short rate spreads. In particular, we consider a Gaussian factor model where the short rate and the spreads are…

The study sets limits on how well systems can be controlled adaptively.

Improved sampling from Gaussian distributions with privacy constraints.

Study cost-driven state representation learning for control from partial observations.

AQFC method estimates mesh curvatures using quadratic surfaces.

A Gaussian Process Ordinary Differential Equation framework for large continuous dynamical systems

PDHAMS improves sampling for discrete distributions with quadratic potential functions.

The study classifies parallel mean curvature spheres in a sphere-hyperbolic product space.

Gaussian belief propagation (GaBP) is an iterative algorithm for computing the mean of a multivariate Gaussian distribution, or equivalently, the minimum of a multivariate positive definite quadratic function. Sufficient conditions, such as walk-summability, that guarantee the convergence and correctness of GaBP are kn…

Bounds neural network output distribution to Gaussian for random initialization.

Paper learns DAGs with quadratic variance functions efficiently.

We study the variance of the REINFORCE policy gradient estimator in environments with continuous state and action spaces, linear dynamics, quadratic cost, and Gaussian noise. These simple environments allow us to derive bounds on the estimator variance in terms of the environment and noise parameters. We compare the pr…

The L1-regularized Gaussian maximum likelihood estimator (MLE) has been shown to have strong statistical guarantees in recovering a sparse inverse covariance matrix, or alternatively the underlying graph structure of a Gaussian Markov Random Field, from very limited samples. We propose a novel algorithm for solving the…

Gaussian surrogates improve Poisson imaging performance at low doses.

Graph matching aims at finding the vertex correspondence between two unlabeled graphs that maximizes the total edge weight correlation. This amounts to solving a computationally intractable quadratic assignment problem. In this paper we propose a new spectral method, GRAph Matching by Pairwise eigen-Alignments (GRAMPA)…

Improved HGF networks avoid negative precision errors in volatility updates.

Researchers disrupt Gaussian model inference to test adversarial attacks.

We provide explicit solutions of certain forward-backward stochastic differential equations (FBSDEs) with quadratic growth. These particular FBSDEs are associated with quadratic term structure models of interest rates and characterize the zero-coupon bond price. The results of this paper are naturally related to simila…

Group quantization applied to finance models.

This work improves texture segmentation by automatically tuning hyperparameters for Total-Variation.

We study the supervised learning problem under either of the following two models: (1) Feature vectors ${\boldsymbol x}_i$ are $d$-dimensional Gaussians and responses are $y_i = f_*({\boldsymbol x}_i)$ for $f_*$ an unknown quadratic function; (2) Feature vectors ${\boldsymbol x}_i$ are distributed as a mixture of two $…

Partition functions arise in a variety of settings, including conditional random fields, logistic regression, and latent gaussian models. In this paper, we consider semistochastic quadratic bound (SQB) methods for maximum likelihood inference based on partition function optimization. Batch methods based on the quadrati…

Study learns state representations from observations for control, proving guarantees.

Paper addresses quadratic feasibility problems and their sample complexity.

Model asset pricing with habit formation in a large market.

We explore a new method for discrete-time control problems using randomization and entropy.

This paper presents a novel one-factor stochastic volatility model where the instantaneous volatility of the asset log-return is a diffusion with a quadratic drift and a linear dispersion function. The instantaneous volatility mean reverts around a constant level, with a speed of mean reversion that is affine in the in…

Study capacity constraints in continual learning with a simple model.

We study the performance of the certainty equivalent controller on Linear Quadratic (LQ) control problems with unknown transition dynamics. We show that for both the fully and partially observed settings, the sub-optimality gap between the cost incurred by playing the certainty equivalent controller on the true system …

A new test statistic speeds up MMD while maintaining power.

The non-gaussianity of processes observed in financial markets and relatively good performance of gaussian models can be reconciled by replacing the Brownian motion with Levy processes whose Levy densities decay as exp(-lambda|x|) or faster, where lambda>0 is large. This leads to asymptotic pricing models. The leading …

New robust discriminant analysis for non-Gaussian data.

Gaussian processes are powerful, yet analytically tractable models for supervised learning. A Gaussian process is characterized by a mean function and a covariance function (kernel), which are determined by a model selection criterion. The functions to be compared do not just differ in their parametrization but in thei…

New bounds on optimal transport regularization show faster convergence rates than previously known.

We develop a class of rules spanning the range between quadratic discriminant analysis and naive Bayes, through a path of sparse graphical models. A group lasso penalty is used to introduce shrinkage and encourage a similar pattern of sparsity across precision matrices. It gives sparse estimates of interactions and pro…

Gradient span algorithms show consistent progress in high dimensions.

Study shows overparameterization helps shallow neural networks recover signals in high dimensions.