Paper explores reducing precision in SVM for faster text classification.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Proposes rounding method for precise treatment effect estimation under budget constraints.
Similar to convolution neural networks, recurrent neural networks (RNNs) typically suffer from over-parameterization. Quantizing bit-widths of weights and activations results in runtime efficiency on hardware, yet it often comes at the cost of reduced accuracy. This paper proposes a quantization approach that increases…
The high computational and parameter complexity of neural networks makes their training very slow and difficult to deploy on energy and storage-constrained computing systems. Many network complexity reduction techniques have been proposed including fixed-point implementation. However, a systematic approach for designin…
In this paper, we investigate Dimensionality reduction (DR) maps in an information retrieval setting from a quantitative topology point of view. In particular, we show that no DR maps can achieve perfect precision and perfect recall simultaneously. Thus a continuous DR map must have imperfect precision. We further prov…
Efforts to reduce the numerical precision of computations in deep learning training have yielded systems that aggressively quantize weights and activations, yet employ wide high-precision accumulators for partial sums in inner-product operations to preserve the quality of convergence. The absence of any framework to an…
A mathematical model describes deforming manifolds with precise vectors and fields.
We study reduction of generalized complex structures. More precisely, we investigate the following question. Let be a generalized complex structure on a manifold , which admits an action of a Lie group preserving . Assume that is a -invariant smooth submanifold and the -action on is prop…
Develops precise expressions for random projections for better machine learning tasks.
Paper proposes a method to use in silico experiments with foundation models to reduce sample size.
In these notes we give an exposition of a result of G. Tian, which says that a Fano surfaces admits a Kahler-Einstein metric precisely when the Lie algebra of holomorphic vector fields is reductive.
We give a systematic treatment of the stability theory for action of a real reductive Lie group G on a topological space. More precisely, we introduce an abstract setting for actions of non-compact real reductive Lie groups on topological spaces that admit functions similar to the Kempf-Ness function. The point of this…
There is tremendous interest in precision medicine as a means to improve patient outcomes by tailoring treatment to individual characteristics. An individualized treatment rule formalizes precision medicine as a map from patient information to a recommended treatment. A treatment rule is defined to be optimal if it max…
The paper proves a new version of dimensional reduction in cohomological Donaldson-Thomas theory.
Paper interprets UMAP and t-SNE as probabilistic MAP inference.
We study finite dimensional almost and quasi-effective prolongations of nilpotent Z-graded Lie algebras, especially focusing on those having a decomposable reductive structural subalgebra. Our assumptions generalize effectiveness and algebraicity and are appropriate to obtain Levi-Malčev and Levi-Chevalley decompositio…
EMPIR combines low and full precision DNNs to enhance robustness against adversarial attacks.
We study the accuracy of estimating the covariance and the precision matrix of a -variate sub-Gaussian distribution along a prescribed subspace or direction using the finite sample covariance. Our results show that the estimation accuracy depends almost exclusively on the components of the distribution that correspo…
The precise diagnosis is of great significance in developing precise treatment plans to restore neck function and reduce the burden posed by the cervical spondylosis (CS). However, the current available neck function assessment method are subjective and coarse-grained. In this paper, based on the relationship among CS,…
In this paper we study the reduction curves of a braid, and how they can be used to decompose the braid into simpler ones in a precise way, which does not correspond exactly to the decomposition given by Thurston theory. Then we study how a cyclic sliding (which is a particular kind of conjugation) affects the normal f…
There exist three main approaches to reduction associated to canonical Lie group actions on a symplectic manifold, namely, foliation reduction, introduced by Cartan, Marsden-Weinstein reduction, and optimal reduction, introduced by the authors. When the action is free, proper, and admits a momentum map these three appr…
New deep network derived from rate reduction principles, explaining features and efficiency.
Efficient Winograd convolution for INT8 networks using RNS.
Improved EXACT strategy reduces GNN memory consumption and runtime.
We study the regular conditional law of mixed Gaussian Volterra processes under the influence of model disturbances. More precisely, we study prediction of Gaussian Volterra processes driven by a Brownian motion in a case where the Brownian motion is not observable, but only a noisy version is observed. As an applicati…
Communication overhead is a major bottleneck hampering the scalability of distributed machine learning systems. Recently, there has been a surge of interest in using gradient compression to improve the communication efficiency of distributed neural network training. Using 1-bit quantization, signSGD with majority vote …
Quantized Neural Networks (QNNs) are often used to improve network efficiency during the inference phase, i.e. after the network has been trained. Extensive research in the field suggests many different quantization schemes. Still, the number of bits required, as well as the best quantization scheme, are yet unknown. O…
State of the art deep learning models have made steady progress in the fields of computer vision and natural language processing, at the expense of growing model sizes and computational complexity. Deploying these models on low power and mobile devices poses a challenge due to their limited compute capabilities and str…
We present a theoretical analysis and empirical evaluations of a novel set of techniques for computational cost reduction of classifiers that are based on learned transform and soft-threshold. By modifying optimization procedures for dictionary and classifier training, as well as the resulting dictionary entries, our t…
Paper speeds up GP inference by reducing precision matrix computation.
Paper reduces hyperparameters in mixed-categorical Gaussian processes for green aircraft optimization.
Rollings of reductive homogeneous spaces are studied using intrinsic curves.
We consider the problem of high-dimensional classification between the two groups with unequal covariance matrices. Rather than estimating the full quadratic discriminant rule, we propose to perform simultaneous variable selection and linear dimension reduction on original data, with the subsequent application of quadr…
We study channel number reduction in combination with weight binarization (1-bit weight precision) to trim a convolutional neural network for a keyword spotting (classification) task. We adopt a group-wise splitting method based on the group Lasso penalty to achieve over 50% channel sparsity while maintaining the netwo…
RMFGP combines multi-fidelity models for efficient uncertainty quantification.
Adaptive Prespecification improves precision in randomized trials.
ProbDR framework interprets DR algorithms as probabilistic inference.
In four-dimensional gauge theory there exists a well-known correspondence between instantons and holomorphic curves, and a similar correspondence exists between certain octonionic instantons and triholomorphic curves. We prove that this latter correspondence stems from the dynamics of various dimensional reductions of …
The paper develops stability criteria for real reductive Lie groups acting on manifolds.
Let be a compact connected orientable CR manifold of dimension with non-degenerate Levi curvature. Assume that admits a connected compact Lie group action . Under certain natural assumptions about the group action , we show that the -invariant Szegö kernel for forms is a comp…
In this paper, we consider the problem of reducing the bit error rate of flash-based solid state drives (SSDs) when cells are subject to inter-cell interference (ICI). By observing that the outputs of adjacent victim cells can be correlated due to common aggressors, we propose a novel channel model to accurately repres…
Given any representation V of a complex linear reductive Lie group G_0, we show that a larger semi-simple Lie group G with g=g_0 + V + V* + ..., exists precisely when V has a finite number of G_0-orbits. In particular, V admits an open G_0-orbit. Furthermore, this corresponds to an augmentation of the Dynkin diagram of…
This paper investigates the use of multiple directions of stratification as a variance reduction technique for Monte Carlo simulations of path-dependent options driven by Gaussian vectors. The precision of the method depends on the choice of the directions of stratification and the allocation rule within each strata. S…
New methods improve subgroup analysis in trials with limited data.
ReduNet optimizes data compression by maximizing rate reduction in deep networks.
New method reduces deep learning training costs by approximating vector-jacobian products.
The universal sl_2 invariant of string links has a universality property for the colored Jones polynomial of links, and takes values in the h-adic completed tensor powers of the quantized enveloping algebra of sl_2. In this paper, we exhibit explicit relationships between the universal sl_2 invariant and Milnor invaria…
In predictive maintenance, model performance is usually assessed by means of precision, recall, and F1-score. However, employing the model with best performance, e.g. highest F1-score, does not necessarily result in minimum maintenance cost, but can instead lead to additional expenses. Thus, we propose to perform model…