Neural networks learn distance-based representations, not just intensity.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
We describe the impact of the intra-day activity pattern on the autocorrelation function estimator. We obtain an exact formula relating estimators of the autocorrelation functions of non-stationary process to its stationary counterpart. Hence, we proved that the day seasonality of inter-transaction times extends the me…
Gradient descent memorizes many Gaussians efficiently.
Deep networks with path norm regularization can approximate analytic functions.
We propose using active learning based techniques to further improve the state-of-the-art semi-supervised learning MixMatch algorithm. We provide a thorough empirical evaluation of several active-learning and baseline methods, which successfully demonstrate a significant improvement on the benchmark CIFAR-10, CIFAR-100…
A classical result in Riemannian geometry states that the absolutely continuous curves into a (finite-dimensional) Riemannian manifold form an infinite-dimensional manifold. In the present paper this construction and related results are generalised to absolutely continuous curves with values in a strong Riemannian mani…
The paper introduces Absolute Shapley Value to handle negative contributions in machine learning model training.
Neural decoders were shown to outperform classical message passing techniques for short BCH codes. In this work, we extend these results to much larger families of algebraic block codes, by performing message passing with graph neural networks. The parameters of the sub-network at each variable-node in the Tanner graph…
A complex-valued convolutional network (convnet) implements the repeated application of the following composition of three operations, recursively applying the composition to an input vector of nonnegative real numbers: (1) convolution with complex-valued vectors followed by (2) taking the absolute value of every entry…
A complete surface of constant mean curvature 1 (CMC-1) in hyperbolic 3-space with constant curvature -1 has two natural notions of "total curvature"-- one is the total absolute curvature which is the integral over the surface of the absolute value of the Gaussian curvature, and the other is the dual total absolute cur…
Nonlinearity is crucial to the performance of a deep (neural) network (DN). To date there has been little progress understanding the menagerie of available nonlinearities, but recently progress has been made on understanding the rôle played by piecewise affine and convex nonlinearities like the ReLU and absolute value …
In this manuscript we analyse the leading statistical properties of fluctuations of (log) 3-month US Treasury bill quotation in the secondary market, namely: probability density function, autocorrelation, absolute values autocorrelation, and absolute values persistency. We verify that this financial instrument, in spit…
Optimal trading patterns adjust based on market efficiency and slippage costs.
Deep neural nets on 1-D data are convex Lasso models with reflection features.
Identification of regions of interest (ROI) associated with certain disease has a great impact on public health. Imposing sparsity of pixel values and extracting active regions simultaneously greatly complicate the image analysis. We address these challenges by introducing a novel region-selection penalty in the framew…
We classify isotopy classes of irreducible Heegaard splittings of solvmanifolds. If the monodromy of the solvmanifold can be expressed as a 2 x 2 matrix with 0 in the lower right hand corner (as always is true when the absolute value of the trace is 3), then any irreducible splitting is strongly irreducible and of genu…
The folk result in Kyle-Back models states that the value function of the insider remains unchanged when her admissible strategies are restricted to absolutely continuous ones. In this paper we show that, for a large class of pricing rules used in current literature, the value function of the insider can be finite when…
We review recent results on classifying complete constant mean curvature 1 (CMC 1) surfaces in hyperbolic 3-space with low total curvature. There are two natural notions of "total curvature" -- one is the total absolute curvature, which is the integral over the surface of the absolute value of the Gaussian curvature, a…
We survey our recent results on classifying complete constant mean curvature 1 (CMC-1) surfaces in hyperbolic 3-space with low total curvature. There are two natural notions of "total curvature"-- one is the total absolute curvature which is the integral over the surface of the absolute value of the Gaussian curvature,…
We present a nonlinear stochastic differential equation (SDE) which mimics the probability density function (PDF) of the return and the power spectrum of the absolute return in financial markets. Absolute return as a measure of market volatility is considered in the proposed model as a long-range memory stochastic vari…
Monotone aggregation of dependent random vectors has an absolutely continuous distribution under certain conditions.
We consider the problem of portfolio selection within the classical Markowitz mean-variance framework, reformulated as a constrained least-squares regression problem. We propose to add to the objective function a penalty proportional to the sum of the absolute values of the portfolio weights. This penalty regularizes (…
We study principal curvatures of fibers and Heegaard surfaces smoothly embedded in hyperbolic 3-manifolds. It is well known that a fiber or a Heegaard surface in a hyperbolic 3-manifold cannot have principal curvatures everywhere less than one in absolute value. We show that given an upper bound on the genus of a minim…
Recent literature on unsupervised learning focused on designing structural priors with the aim of learning meaningful features, but without considering the description length of the representations. In this thesis, first we introduce the metric that evaluates unsupervised models based on their reconstruction …
In this work, we propose an order book model with herd behavior. The proposed model is built upon two distinct approaches: a recent empirical study of the detailed order book records by Kanazawa et al. [Phys. Rev. Lett. 120, 138301] and financial herd behavior model. Combining these approaches allows us to propose a mo…
Previous literature on unsupervised learning focused on designing structural priors with the aim of learning meaningful features. However, this was done without considering the description length of the learned representations which is a direct and unbiased measure of the model complexity. In this paper, first we intro…
Paper studies geometric properties of nonlinear Lebesgue spaces.
We prove uniqueness results for a Calderon type inverse problem for the Hodge Laplacian acting on graded forms on certain manifolds in three dimensions. In particular, we show that partial measurements of the relative-to-absolute or absolute-to-relative boundary value maps uniquely determine a zeroth order potential. T…
Deep neural networks favor symmetric structures, enabling multilevel symmetries.
This paper is intended as an investigation of the statistical properties of {\it absolute log-returns}, defined as the absolute value of the logarithmic price change, for the Nikkei 225 index in the 28-year period from January 4, 1975 to December 30, 2002. We divided the time series of the Nikkei 225 index into two per…
Optimal stock price prediction model using recurrent neural networks with RMSprop optimizer.
Complex-valued neural networks avoid spurious local minima.
While deep learning is a powerful tool for natural language processing (NLP) problems, successful solutions to these problems rely heavily on large amounts of annotated samples. However, manually annotating data is expensive and time-consuming. Active Learning (AL) strategies reduce the need for huge volumes of labeled…
Active learning improves ordering of items with contextual attributes.
In this paper, we consider the problem of recovering a sparse signal based on penalized least squares formulations. We develop a novel algorithm of primal-dual active set type for a class of nonconvex sparsity-promoting penalties, including , bridge, smoothly clipped absolute deviation, capped and mini…
The visibility transformation embeds data position into signature features for efficient pattern recognition.
Sharp bounds on neural network approximation rates and widths.
The paper proposes methods to find a shared active subspace for multivariate vector-valued functions.
Paper revises power theory using classical mechanics concepts.
We present an efficient algorithm for calculating the number of components of an integral lamination on an -punctured disk, given its Dynnikov coordinates. The algorithm requires arithmetic operations, where is the sum of the absolute values of the Dynnikov coordinates.
We prove that for n>4 there is no compact arithmetic hyperbolic n-manifold whose Euler characteristic has absolute value equal to 2. In particular, this shows the nonexistence of arithmetically defined hyperbolic rational homology n-sphere with n even different than 4.
Model predicts cannabis use disorder risk for adolescents and young adults.
An interesting approach to analyzing neural networks that has received renewed attention is to examine the equivalent kernel of the neural network. This is based on the fact that a fully connected feedforward network with one hidden layer, a certain weight distribution, an activation function, and an infinite number of…
Recurrent neural networks (RNNs) are notoriously difficult to train. When the eigenvalues of the hidden to hidden weight matrix deviate from absolute value 1, optimization becomes difficult due to the well studied issue of vanishing and exploding gradients, especially when trying to learn long-term dependencies. To cir…
Establishes a link between risk measures and uniform integrability in finance.
Complex-valued neural networks can approximate any continuous function with bounded widths and depths.
S2D selectively decays large singular values to improve quantization of neural activations.
We derive new theoretical results on the properties of the adaptive least absolute shrinkage and selection operator (adaptive lasso) for time series regression models. In particular, we investigate the question of how to conduct finite sample inference on the parameters given an adaptive lasso model for some fixed valu…