arXiv research

We present a novel method for neural network quantization that emulates a non-uniform $k$-quantile quantizer, which adapts to the distribution of the quantized parameters. Our approach provides a novel alternative to the existing uniform quantization techniques for neural networks. We suggest to compare the results as …

Convolutional Neural Networks (CNN) has become more popular choice for various tasks such as computer vision, speech recognition and natural language processing. Thanks to their large computational capability and throughput, GPUs ,which are not power efficient and therefore does not suit low power systems such as mobil…

We propose Additive Powers-of-Two~(APoT) quantization, an efficient non-uniform quantization scheme for the bell-shaped and long-tailed distribution of weights and activations in neural networks. By constraining all quantization levels as the sum of Powers-of-Two terms, APoT quantization enjoys high computational effic…

A method for reducing neural network size using look-up tables.

DBQ quantizes lightweight networks efficiently for resource-constrained devices.

This study analyzes quantization in deep learning models using statistical physics methods.

Degree-Quant improves GNN efficiency by quantizing them without losing accuracy.

SQWA improves low-precision DNNs with model averaging and quantization.

Improved deep learning model deployment on tiny MCUs with mixed-precision quantization.

Paper proposes a learning-based sparse Bayesian method for accurate off-grid DOA estimation.

QuantEase optimizes LLMs with CD-based quantization, achieving state-of-the-art performance.

Unified framework for uniform signal recovery in nonlinear GCS with 1-bit/quantized measurements.

The task of estimating a matrix given a sample of observed entries is known as the \emph{matrix completion problem}. Most works on matrix completion have focused on recovering an unknown real-valued low-rank matrix from a random sample of its entries. Here, we investigate the case of highly quantized observations when …

Paper proposes LC-Checkpoint for efficient deep learning model checkpoints.

The study finds non-uniform lattices with thin Hitchin representations in specific Lie groups.

New approach to adversarial robustness with non-uniform perturbations.

This work studies the robustness certification problem of neural network models, which aims to find certified adversary-free regions as large as possible around data points. In contrast to the existing approaches that seek regions bounded uniformly along all input features, we consider non-uniform bounds and use it to …

New method upsamples sparse, non-uniform point clouds more accurately.

New approach finds minima of geodesic lengths for non-uniform fillings.

New method uses graphene transistors for efficient non-uniform random number generation.

Study shows how non-uniform scaling affects persistence diagrams.

Unified framework for non-uniform materials evolving over time.

New rigidity theorem for product of lattices.

Non-uniform lattices in PU(n,1) cannot geometrically act on CAT(0) cube complexes.

We apply stochastic average gradient (SAG) algorithms for training conditional random fields (CRFs). We describe a practical implementation that uses structure in the CRF gradient to reduce the memory requirement of this linearly-convergent stochastic gradient method, propose a non-uniform sampling scheme that substant…

We study primal-dual type stochastic optimization algorithms with non-uniform sampling. Our main theoretical contribution in this paper is to present a convergence analysis of Stochastic Primal Dual Coordinate (SPDC) Method with arbitrary sampling. Based on this theoretical framework, we propose Optimality Violation-ba…

New method detects communities in complex hypergraphs, matching theoretical limits.

Sharp threshold for exact recovery in non-uniform hypergraph stochastic block model.

We prove that if $G$ is a non-uniform lattice in a rank-one semi-simple Lie group $\ne Isom(\H^2_\R)$ then $G$ is quasi-isometrically co-Hopf. This means that every quasi-isometric embedding $G\to G$ is coarsely onto and thus is a quasi-isometry.

Improved sampling accuracy in SG-MCMC methods via non-uniform gradient subsampling.

A groupoid $Ω\left( \mathcal{B} \right)$ called material groupoid is naturally associated to any simple body $\mathcal{B}$. The material distribution is introduced due to the (possible) lack of differentiability of the material groupoid. Thus, the inclusion of these new objects in the theory of material bodies opens th…

In this note, we study deformations of a non-uniform real hyperbolic lattice in quaternionic hyperbolic spaces. Specially we show that the representations of the fundamental group of the figure eight knot complement into PU(2,1) cannot be deformed in $PSp(2,1)$ out of PU(2,1) up to conjugacy.

We construct a three-point compact finite difference scheme on a non-uniform mesh for the time-fractional Black-Scholes equation. We show that for special graded meshes used in finance, the Tavella-Randall and the quadratic meshes the numerical solution has a fourth-order accuracy in space. Numerical experiments are di…

We improve GANs by enforcing reproducibility and using non-uniform sampling.

We study the effectiveness of non-uniform randomized feature selection in decision tree classification. We experimentally evaluate two feature selection methodologies, based on information extracted from the provided dataset: $(i)$ \emph{leverage scores-based} and $(ii)$ \emph{norm-based} feature selection. Experimenta…

Improved matrix completion for non-uniformly sampled data.

New loss function equivalence reveals PER's uniform sampling can be improved.

Two algorithms converge to dictionary learning with geometric rate for non-uniform data.

Proof shows volumes of certain geometric representations are always integers.

Spectral algorithm recovers community structure in sparse hypergraphs.

The paper proves Zimmer's conjecture for non-uniform lattices by controlling mass escape and Lyapunov exponents.

Survey on quantization methods on Kähler manifolds.

The study finds that certain hyperbolic manifolds contain subgroups isomorphic to surface groups.

Validates conformal prediction for network data under non-uniform sampling.

The paper classifies quantizable functions and explores symmetry in quantization methods.

A new method for matrix completion with model-free weights.

We derive high-order compact finite difference schemes for option pricing in stochastic volatility models on non-uniform grids. The schemes are fourth-order accurate in space and second-order accurate in time for vanishing correlation. In our numerical study we obtain high-order numerical convergence also for non-zero …

Let $G$ and $G'$ be simple Lie groups of equal real rank and real rank at least $2$. Let $Γ<G$ and $Λ< G'$ be non-uniform lattices. We prove a theorem that often implies that any quasi-isometric embedding of $Γ$ into $Λ$ is at bounded distance from a homomorphism. For example, any quasi-isometric embedding of $SL(n,\ma…