arXiv research

Cost-aware multi-objective Bayesian optimization for non-uniformly expensive functions.

This letter presents an improved version of diffusion least mean ppower (LMP) algorithm for distributed estimation. Instead of sum of mean square errors, a weighted sum of mean square error is defined as the cost function for global and local cost functions of a network of sensors. The weight coefficients are updated b…

STR reparameterizes DNN weights with soft thresholds for better sparsity and accuracy.

Accelerated coordinate descent is widely used in optimization due to its cheap per-iteration cost and scalability to large-scale problems. Up to a primal-dual transformation, it is also the same as accelerated stochastic gradient descent that is one of the central methods used in machine learning. In this paper, we imp…

Much sequential data exhibits highly non-uniform information distribution. This cannot be correctly modeled by traditional Long Short-Term Memory (LSTM). To address that, recent works have extended LSTM by adding more activations between adjacent inputs. However, the approaches often use a fixed depth, which is at the …

The study finds non-uniform lattices with thin Hitchin representations in specific Lie groups.

Many stochastic optimization algorithms work by estimating the gradient of the cost function on the fly by sampling datapoints uniformly at random from a training set. However, the estimator might have a large variance, which inadvertently slows down the convergence rate of the algorithms. One way to reduce this varian…

Optimizes query routing to LLMs under cost and resource constraints.

New approach to adversarial robustness with non-uniform perturbations.

This work studies the robustness certification problem of neural network models, which aims to find certified adversary-free regions as large as possible around data points. In contrast to the existing approaches that seek regions bounded uniformly along all input features, we consider non-uniform bounds and use it to …

New method upsamples sparse, non-uniform point clouds more accurately.

New approach finds minima of geodesic lengths for non-uniform fillings.

New method uses graphene transistors for efficient non-uniform random number generation.

Study shows how non-uniform scaling affects persistence diagrams.

Unified framework for non-uniform materials evolving over time.

New rigidity theorem for product of lattices.

APoT quantization improves neural network efficiency and accuracy.

Non-uniform lattices in PU(n,1) cannot geometrically act on CAT(0) cube complexes.

We apply stochastic average gradient (SAG) algorithms for training conditional random fields (CRFs). We describe a practical implementation that uses structure in the CRF gradient to reduce the memory requirement of this linearly-convergent stochastic gradient method, propose a non-uniform sampling scheme that substant…

We study primal-dual type stochastic optimization algorithms with non-uniform sampling. Our main theoretical contribution in this paper is to present a convergence analysis of Stochastic Primal Dual Coordinate (SPDC) Method with arbitrary sampling. Based on this theoretical framework, we propose Optimality Violation-ba…

New method detects communities in complex hypergraphs, matching theoretical limits.

We present a novel method for neural network quantization that emulates a non-uniform $k$-quantile quantizer, which adapts to the distribution of the quantized parameters. Our approach provides a novel alternative to the existing uniform quantization techniques for neural networks. We suggest to compare the results as …

Sharp threshold for exact recovery in non-uniform hypergraph stochastic block model.

We prove that if $G$ is a non-uniform lattice in a rank-one semi-simple Lie group $\ne Isom(\H^2_\R)$ then $G$ is quasi-isometrically co-Hopf. This means that every quasi-isometric embedding $G\to G$ is coarsely onto and thus is a quasi-isometry.

Improved sampling accuracy in SG-MCMC methods via non-uniform gradient subsampling.

A groupoid $Ω\left( \mathcal{B} \right)$ called material groupoid is naturally associated to any simple body $\mathcal{B}$. The material distribution is introduced due to the (possible) lack of differentiability of the material groupoid. Thus, the inclusion of these new objects in the theory of material bodies opens th…

In this note, we study deformations of a non-uniform real hyperbolic lattice in quaternionic hyperbolic spaces. Specially we show that the representations of the fundamental group of the figure eight knot complement into PU(2,1) cannot be deformed in $PSp(2,1)$ out of PU(2,1) up to conjugacy.

We construct a three-point compact finite difference scheme on a non-uniform mesh for the time-fractional Black-Scholes equation. We show that for special graded meshes used in finance, the Tavella-Randall and the quadratic meshes the numerical solution has a fourth-order accuracy in space. Numerical experiments are di…

We improve GANs by enforcing reproducibility and using non-uniform sampling.

We study the effectiveness of non-uniform randomized feature selection in decision tree classification. We experimentally evaluate two feature selection methodologies, based on information extracted from the provided dataset: $(i)$ \emph{leverage scores-based} and $(ii)$ \emph{norm-based} feature selection. Experimenta…

Improved matrix completion for non-uniformly sampled data.

New loss function equivalence reveals PER's uniform sampling can be improved.

Convolutional Neural Networks (CNN) has become more popular choice for various tasks such as computer vision, speech recognition and natural language processing. Thanks to their large computational capability and throughput, GPUs ,which are not power efficient and therefore does not suit low power systems such as mobil…

Two algorithms converge to dictionary learning with geometric rate for non-uniform data.

Proof shows volumes of certain geometric representations are always integers.

Spectral algorithm recovers community structure in sparse hypergraphs.

The paper proves Zimmer's conjecture for non-uniform lattices by controlling mass escape and Lyapunov exponents.

The study finds that certain hyperbolic manifolds contain subgroups isomorphic to surface groups.

Validates conformal prediction for network data under non-uniform sampling.

We investigate the rank gradient and growth of torsion in homology in residually finite groups. As a tool, we introduce a new complexity notion for generating sets, using measured groupoids and combinatorial cost. As an application we prove the vanishing of the above invariants for Farber sequences of subgroups of righ…

Paper uses IGA for efficient pricing of financial derivatives, comparing it to FDM and FEM.

Rough Transformers improve time series modeling with lower costs and better performance.

A new method for matrix completion with model-free weights.

We derive high-order compact finite difference schemes for option pricing in stochastic volatility models on non-uniform grids. The schemes are fourth-order accurate in space and second-order accurate in time for vanishing correlation. In our numerical study we obtain high-order numerical convergence also for non-zero …

Let $G$ and $G'$ be simple Lie groups of equal real rank and real rank at least $2$. Let $Γ<G$ and $Λ< G'$ be non-uniform lattices. We prove a theorem that often implies that any quasi-isometric embedding of $Γ$ into $Λ$ is at bounded distance from a homomorphism. For example, any quasi-isometric embedding of $SL(n,\ma…

Study on Čech cohomology of Morse boundaries in hyperbolic manifolds.

Sub-sampling is a common and often effective method to deal with the computational challenges of large datasets. However, for most statistical models, there is no well-motivated approach for drawing a non-uniform subsample. We show that the concept of an asymptotically linear estimator and the associated influence func…

The fundamental group of a Riemannian manifold with $δ$-pinched negative curvature, $δ>1/4$, cannot be the fundamental group of a quasicompact Kähler manifold. The proof also implies that a non-uniform lattice in $F_{4(-20)}$ cannot be the fundamental group of a quasicompact Kähler manifold. We also construct examples …