A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Based on the notion of information bottleneck (IB), we formulate a quantization problem called "IB quantization". We show that IB quantization is equivalent to learning based on the IB principle. Under this equivalence, the standard neural network models can be viewed as scalar (single sample) IB quantizers. It is know…
A new framework for neural network classification using vector quantization.
PRISM-VQ combines financial priors with vector quantization for better stock prediction.
New method classifies manifold-valued data using Riemannian geometry.
Paper proposes IIQ for compressing embedding vectors.
Study shows simple vector quantization measures correlate with deep learning generalization.
RATQ is a new quantizer for optimizing noisy gradients in machine learning.
Develops mixed quantization for graph vector bundles.
A new method for multiclass calibration using vector quantization.
We propose a quantization based approach for fast approximate Maximum Inner Product Search (MIPS). Each database vector is quantized in multiple subspaces via a set of codebooks, learned directly by minimizing the inner product quantization error. Then, the inner product of a query to a database vector is approximated …
A new multi-scale vector quantization method for unsupervised data.
New vector quantization method reduces relevance of parallel components in database points.
Vectors of data are at the heart of machine learning and data mining. Recently, vector quantization methods have shown great promise in reducing both the time and space costs of operating on vectors. We introduce a vector quantization algorithm that can compress vectors over 12x faster than existing techniques while al…
Quantizes symplectic fibrations to analyze vector bundles and metrics.
In this work we present a review of the state of the art of Learning Vector Quantization (LVQ) classifiers. A taxonomy is proposed which integrates the most relevant LVQ approaches to date. The main concepts associated with modern LVQ approaches are defined. A comparison is made among eleven LVQ classifiers using one r…
Post-training quantization method using multiple low-precision points achieves higher precision for critical weights.
Improved vector quantization using Gaussian mixtures for better codebook utilization.
UVeQFed tackles FL model compression over limited channels.
A new method learns discrete representations for images and videos, improving upon previous models.
A simple and computationally efficient scheme for tree-structured vector quantization is presented. Unlike previous methods, its quantization error depends only on the intrinsic dimension of the data distribution, rather than the apparent dimension of the space in which the data happen to lie.
Quantizes Kähler manifolds using sheaves and differential operators.
Inverted file and asymmetric distance computation (IVFADC) have been successfully applied to approximate nearest neighbor search and subsequently maximum inner product search. In such a framework, vector quantization is used for coarse partitioning while product quantization is used for quantizing residuals. In the ori…
An appropriate choice of the activation function (like ReLU, sigmoid or swish) plays an important role in the performance of (deep) multilayer perceptrons (MLP) for classification and regression learning. Prototype-based classification learning methods like (generalized) learning vector quantization (GLVQ) are powerful…
VQ-DRAW compresses images and generates realistic samples.
Note on subgaussian bounds for sign-quantized linear maps.
ICQ improves high-dimensional similarity search without sacrificing precision.
Paper presents a semi-supervised grasp detection method using VQ-VAE.
A new framework enhances generative modeling by learning local flows over complex manifolds.
vqSGD reduces communication in distributed optimization with convergence guarantees.
Autoencoders and their variations provide unsupervised models for learning low-dimensional representations for downstream tasks. Without proper regularization, autoencoder models are susceptible to the overfitting problem and the so-called posterior collapse phenomenon. In this paper, we introduce a quantization-based …
We propose in this contribution a method for l one regularization in prototype based relevance learning vector quantization (LVQ) for sparse relevance profiles. Sparse relevance profiles in hyperspectral data analysis fade down those spectral bands which are not necessary for classification. In particular, we consider …
A new method for robust product Markovian quantization overcomes numerical instabilities.
The paper examines obstacles to extending deformation quantization of vector bundles.
A new distortion measure optimizes function approximations in vector quantization.
A new model trains prior and encoder/decoder networks simultaneously for efficient generation.
Paper proves existence of a universal codebook for low-precision quantization.
It is of fundamental importance to find algorithms obtaining optimal performance for learning of statistical models in distributed and communication limited systems. Aiming at characterizing the optimal strategies, we consider learning of Gaussian Processes (GPs) in distributed systems as a pivotal example. We first ad…
A geometric quantization of a Kähler manifold, viewed as a symplectic manifold, depends on the complex structure compatible with the symplectic form. The quantizations form a vector bundle over the space of such complex structures. Having a canonical quantization would amount to finding a natural (projectively) flat co…
VQ-GNN scales GNNs to large graphs using vector quantization.
The nearest neighbor method together with the dynamic time warping (DTW) distance is one of the most popular approaches in time series classification. This method suffers from high storage and computation requirements for large training sets. As a solution to both drawbacks, this article extends learning vector quantiz…
The paper quantizes concatenated noisy vectors to a common cluster center, improving performance over naive methods.
The paper classifies quantizable functions and explores symmetry in quantization methods.
Discretizing multi-dimensional data distributions is a fundamental step of modern indexing methods. State-of-the-art techniques learn parameters of quantizers on training data for optimal performance, thus adapting quantizers to the data. In this work, we propose to reverse this paradigm and adapt the data to the quant…
Let be a holomorphic Hermitian vector bundle over a polarized manifold. We provide a canonical quantization of the Laplacian operator acting on sections of the bundle of Hermitian endomorphisms of . If is simple we obtain an approximation of the eigenvalues and eigenspaces of the Laplacian.
Efficiently computes counterfactual explanations for LVQ models.
By computing certain cohomology of Vect(M) of smooth vector fields we prove that on 1-dimensional manifolds M there is no quantization map intertwining the action of non-projective embeddings of the Lie algebra sl(2) into the Lie algebra Vect(M). Contrariwise, for projective embeddings sl(2)-equivariant quantization ex…
Data parallelism can boost the training speed of convolutional neural networks (CNN), but could suffer from significant communication costs caused by gradient aggregation. To alleviate this problem, several scalar quantization techniques have been developed to compress the gradients. But these techniques could perform …
We study two quantization schemes for compact symplectic manifolds with almost complex structures. The first of these is the Spin-c quantization. We prove the analog of Kodaira vanishing for the Spin-c Dirac operator, which shows that the index space of this operator provides an honest (not virtual) vector space semicl…