Quantizes contact structures using dynamical methods.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
New insights into quantized neural networks reveal learning dynamics and generalization errors.
The paper offers error bounds for quantized dynamical models.
PRISM-VQ combines financial priors with vector quantization for better stock prediction.
This paper proposes a new way to quantize classical mechanical systems. Here we use ALAG - programme to construct moduli space of half weighted Bohr - Sommerfeld lagrangian cycles of fixed volume which is our quantum phase space. "Dynamical correspondence" principle makes possible to prove that this ALAG - quantization…
Computational aspects of the optimal consumption and investment with the partially observed stochastic volatility of the asset prices are considered. The new quantization approach to filtering - density quantization - is introduced which reduces the original infinite dimensional state space of the problem to the finite…
Group quantization applied to finance models.
We present Rotated Adaptive Tetra-iterated Quantizer (RATQ), a fixed-length quantizer for gradients in first order stochastic optimization. RATQ is easy to implement and involves only a Hadamard transform computation and adaptive uniform quantization with appropriately chosen dynamic ranges. For noisy gradients with al…
The communication of gradients is costly for training deep neural networks with multiple devices in computer vision applications. In particular, the growing size of deep learning models leads to higher communication overheads that defy the ideal linear training speedup regarding the number of devices. Gradient quantiza…
Study quantization effects on high-dimensional linear regression learning.
Equivariant quantization is a new theory that highlights the role of symmetries in the relationship between classical and quantum dynamical systems. These symmetries are also one of the reasons for the recent interest in quantization of singular spaces, orbifolds, stratified spaces... In this work, we prove existence o…
This paper is a continuation of [KS]. We develop the results of [KS] principally in two directions. First, we generalize the main result of [KS], the connection between the solutions of the classical dynamical Yang-Baxter equation and Poisson homogeneous spaces of Poisson Lie groups. We hope that now we present this re…
In this lecture results on the Berezin-Toeplitz quantization of arbitrary compact quantizable Kaehler manifolds are presented. These results are obtained in joint work with M. Bordemann and E. Meinrenken. The existence of the Berezin-Toeplitz deformation quantization is also covered. Recent results obtained in joint wo…
This paper provides theoretical foundations for using quantized actions in behavior cloning.
Efficient deep neural network (DNN) inference on mobile or embedded devices typically involves quantization of the network parameters and activations. In particular, mixed precision networks achieve better performance than networks with homogeneous bitwidth for the same size constraint. Since choosing the optimal bitwi…
The nearest neighbor method together with the dynamic time warping (DTW) distance is one of the most popular approaches in time series classification. This method suffers from high storage and computation requirements for large training sets. As a solution to both drawbacks, this article extends learning vector quantiz…
In this contribution we review results on the kinematics of a quantum system localized on a connected configuration manifold and compatible dynamics for the quantum system including external fields and leading to non-linear Schrödinger equations for pure states.
We formulate the notion of minimax estimation under storage or communication constraints, and prove an extension to Pinsker's theorem for nonparametric estimation over Sobolev ellipsoids. Placing limits on the number of bits used to encode any estimator, we give tight lower and upper bounds on the excess risk due to qu…
DP-Net uses dynamic programming for efficient deep neural network compression.
Improved neural quantization reduces accuracy loss to less than 1% with 4-bit weights.
Efficiently processes dynamic inputs in AI writing assistants with incremental computation.
The elastica is a curve in that is stationary under variations of the integral of the square of the curvature. Elastica is viewed as a dynamical system that arises from the second order calculus of variations, and its quantization is discussed.
A new method improves quantile regression for high-dimensional data.
One of the most significant bottleneck in training large scale machine learning models on parameter server (PS) is the communication overhead, because it needs to frequently exchange the model gradients between the workers and servers during the training iterations. Gradient quantization has been proposed as an effecti…
This work connects point particles to spin chains using geometric methods.
While increasingly deep networks are still in general desired for achieving state-of-the-art performance, for many specific inputs a simpler network might already suffice. Existing works exploited this observation by learning to skip convolutional layers in an input-dependent manner. However, we argue their binary deci…
QTD integrates quantization with diffusion for efficient data generation.
New bracket unifies nonholonomic dynamics and Hamilton-Jacobi theory.
We construct a Poisson isomorphism between the formal Poisson manifolds g^* and G^*, where g is a finite dimensional quasitriangular Lie bialgebra. Here g^* is equipped with its Lie-Poisson (or Kostant-Kirillov-Souriau) structure, and G^* with its Poisson-Lie structure. We also quantize Poisson-Lie dynamical r-matrices…
NeuZip compresses neural network weights to save memory during training and inference.
Chaos and nonlinear economic dynamics are addressed for a quantum coupled map lattice model of an artificial economy, with quantized supply and demand equilibrium conditions. The measure theoretic properties and the patterns that emerge in both the economic business volume dynamics' diagrams as well as in the quantum m…
ActNN reduces neural network training memory by 2-bit quantization.
New bracket theory connects three nonholonomic dynamics models.
Geometric quantization extended to arbitrary connected spaces using path integration.
Deep convolutional neural networks (CNNs) are powerful tools for a wide range of vision tasks, but the enormous amount of memory and compute resources required by CNNs pose a challenge in deploying them on constrained devices. Existing compression techniques, while excelling at reducing model sizes, struggle to be comp…
We use the theory of Berezin-Toeplitz operators of Ma and Marinescu to study the quantum Hamiltonian dynamics associated with classical Hamiltonian flows over closed prequantized symplectic manifolds in the context of geometric quantization of Kostant and Souriau. We express the associated evolution operators via paral…
Survey on quantization methods on Kähler manifolds.
Paper explores low-precision SGLD for neural networks, reducing costs without sacrificing performance.
To improve the execution speed and efficiency of neural networks in embedded systems, it is crucial to decrease the model size and computational complexity. In addition to conventional compression techniques, e.g., weight pruning and quantization, removing unimportant activations can reduce the amount of data communica…
The paper classifies quantizable functions and explores symmetry in quantization methods.
Connecting ideas of geometric formulation of quantum mechanics with new results in symplectic geometry a new approach to geometrical quantization procedure is proposed. As a first result we verify that the correspondence between "classical" Poisson bracket and "quantum" one takes place.
This paper introduces a differentiable, scalable quantization method for neural networks.
Low-bit training framework reduces energy consumption in CNNs.
StatQAT optimizes quantization for deep networks, reducing computational cost and memory usage.
This study optimizes quantized neural networks by considering model architecture and quantization types.
Combining neural networks and multiscale decomposition for financial market analysis.
Extends ONNX for quantized neural networks with new formats and operators.
New method for quantizing symplectic manifolds with Lagrangian bundles.