A new method reduces model complexity in DMD using LARS.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
New framework for inference with LAR, explaining variable contributions and providing stopping rules.
Parallelizes LARS for high-dimensional data with speedups and accuracy trade-offs.
Standard optimizers perform as well as LARS and LAMB at large batch sizes.
We propose Learned Accept/Reject Sampling (LARS), a method for constructing richer priors using rejection sampling with a learned acceptance function. This work is motivated by recent analyses of the VAE objective, which pointed out that commonly used simple priors can lead to underfitting. As the distribution induced …
We propose a feature selection method that finds non-redundant features from a large and high-dimensional data in nonlinear way. Specifically, we propose a nonlinear extension of the non-negative least-angle regression (LARS) called NLARS, where the similarity between input and output is measured through the norm…
The paper develops tests for variable selection using LARS in high dimensions.
Proposes LARS and LASSO methods for generalized linear models.
This article is a short nontechnical survey of recent progresses in fluid dynamics and differential geometry, relating a conjecture of Lars Onsager to the work of Nash on isometric embeddings.
New method creates minimal submanifolds using complex-valued eigenfunctions.
Complex-valued neural networks avoid spurious local minima.
Quantum algorithm speeds up Lasso regression by quadratically faster per iteration.
A complex-valued convolutional network (convnet) implements the repeated application of the following composition of three operations, recursively applying the composition to an input vector of nonnegative real numbers: (1) convolution with complex-valued vectors followed by (2) taking the absolute value of every entry…
Training large deep neural networks on massive datasets is computationally very challenging. There has been recent surge in interest in using large batch stochastic optimization methods to tackle this issue. The most prominent algorithm in this line of research is LARS, which by employing layerwise adaptive learning ra…
Complex-valued (p,q)-harmonic morphisms defined and studied.
It is difficult to find the optimal sparse solution of a manifold learning based dimensionality reduction algorithm. The lasso or the elastic net penalized manifold learning based dimensionality reduction is not directly a lasso penalized least square problem and thus the least angle regression (LARS) (Efron et al. \ci…
The paper uses complex-valued functions to simplify plane differential geometry and kinematics.
Paper presents a novel approach to predict volatility using robust least squares method.
In the spirit of Ray and Singer we define a complex valued analytic torsion using non-selfadjoint Laplacians. We establish an anomaly formula which permits to turn this into a topological invariant. Conjecturally this analytically defined invariant computes the complex valued Reidemeister torsion, including its phase. …
Bayesian sparsification improves complex-valued neural networks by 50-100x with minimal performance loss.
Study complex-valued VAEs for radar OOD detection.
The construction of synthetic complex-valued signals from real-valued observations is an important step in many time series analysis techniques. The most widely used approach is based on the Hilbert transform, which maps the real-valued signal into its quadrature component. In this paper, we define a probabilistic gene…
Complex-valued neural networks are not a new concept, however, the use of real-valued models has often been favoured over complex-valued models due to difficulties in training and performance. When comparing real-valued versus complex-valued neural networks, existing literature often ignores the number of parameters, r…
We study the curvature of a manifold on which there can be defined a complex-valued submersive harmonic morphism with either, totally geodesic fibers or that is holomorphic with respect to a complex structure which is compatible with the second fundamental form. We also give a necessary curvature condition for the exis…
Extreme learning machine (ELM) as a neural network algorithm has shown its good performance, such as fast speed, simple structure etc, but also, weak robustness is an unavoidable defect in original ELM for blended data. We present a new machine learning framework called LARSEN-ELM for overcoming this problem. In our pa…
Usually, complex-valued RKHS are presented as an straightforward application of the real-valued case. In this paper we prove that this procedure yields a limited solution for regression. We show that another kernel, here denoted as pseudo kernel, is needed to learn any function in complex-valued fields. Accordingly, we…
Unified framework for complex-valued eigenfunctions on Riemannian symmetric spaces.
This paper describes a novel energy-based probabilistic distribution that represents complex-valued data and explains how to apply it to direct feature extraction from complex-valued spectra. The proposed model, the complex-valued restricted Boltzmann machine (CRBM), is designed to deal with complex-valued visible unit…
C-SURE improves complex-valued deep learning models by shrinking estimates, outperforming MLE and SurReal.
New method constructs complex-valued r-harmonic functions on Riemannian manifolds.
Over the last decade, both the neural network and kernel adaptive filter have successfully been used for nonlinear signal processing. However, they suffer from high computational cost caused by their complex/growing network structures. In this paper, we propose two random Euler filters for complex-valued nonlinear filt…
This paper proves a generalization bound for complex-valued neural networks scaling with spectral complexity.
This research explores complex-valued neural networks and their implementation.
We propose a novel adaptive kernel based regression method for complex-valued signals: the generalized complex-valued kernel least-mean-square (gCKLMS). We borrow from the new results on widely linear reproducing kernel Hilbert space (WL-RKHS) for nonlinear regression and complex-valued signals, recently proposed by th…
New submersion proves complex-valued harmonic map existence.
CVNN outperforms RVNN on non-circular data.
We extend the complex-valued analytic torsion, introduced by Burghelea and Haller on closed manifolds, to compact Riemannian bordisms. We do so by considering a flat complex vector bundle over a compact Riemannian manifold, endowed with a fiberwise nondegenerate symmetric bilinear form. The Riemmanian metric and the bi…
CVNNs improve performance in tasks with complex-valued inputs.
Complex valued analytic torsion and dynamical zeta function studied on locally symmetric spaces.
We describe the relationship between complex-valued harmonic morphisms from Minkowski 4-space} and the shear-free ray congruences of mathematical physics. Then we show how a horizontally conformal submersion on a domain of Euclidean 3-space gives the boundary values at infinity of a complex-valued harmonic morphism on …
Complex-valued signals are used in the modeling of many systems in engineering and science, hence being of fundamental interest. Often, random complex-valued signals are considered to be proper. A proper complex random variable or process is uncorrelated with its complex conjugate. This assumption is a good model of th…
CAP-BM learns complex-valued data's amplitude and phase distributions.
PolarBM models complex-valued audio signals in polar coordinates, improving over conventional methods.
Complex-valued neural networks can approximate any continuous function with bounded widths and depths.
Survey of complex-valued neural networks for improved performance.
There are three equivalent ways of representing two jointly observed real-valued signals: as a bivariate vector signal, as a single complex-valued signal, or as two analytic signals known as the rotary components. Each representation has unique advantages depending on the system of interest and the application goals. I…
Formula for complex SVD backpropagation developed.
We propose a semismooth Newton algorithm for pathwise optimization (SNAP) for the LASSO and Enet in sparse, high-dimensional linear regression. SNAP is derived from a suitable formulation of the KKT conditions based on Newton derivatives. It solves the semismooth KKT equations efficiently by actively and continuously s…