This work certifies non-uniform bounds against adversarial attacks for neural networks.
problem Certifying robust regions around data points against non-uniform adversarial attacks.
method Formulated as an optimization problem with nonlinear constraints, using the augmented Lagrangian method for general feedforward neural networks.
result Non-uniform bounds have larger volumes and better interpretability compared to uniform bounds.
New approach to adversarial robustness with non-uniform perturbations.
problem Real-world adversaries craft adversarial examples with non-uniform perturbations.
method Proposes non-uniform perturbations based on feature dependencies and data distribution.
result Shows improved robustness to real-world attacks compared to uniform perturbations.
Improved matrix completion for non-uniformly sampled data.
problem Estimating unobserved entries in a matrix with varying sampling probabilities.
method Developed entry-specific bounds for low-rank matrix completion under structured non-uniform sampling.
result Error bounds for each entry match minimax lower bounds under certain conditions.
New method detects communities in complex hypergraphs, matching theoretical limits.
problem Detecting communities in non-uniform hypergraphs with varying hyperedge sizes.
method Developed a spectral theory for weighted non-backtracking operators on non-uniform hypergraphs.
result Achieved the Kesten-Stigum bound for weak recovery in a general class of non-uniform HSBMs.
Study shows how non-uniform scaling affects persistence diagrams.
problem Stability of persistence diagrams under non-uniform scaling.
method Explicit bounds on bottleneck distance derived for Euclidean scaling.
result Explicit bounds on the stability of persistence diagrams under non-uniform scaling.
Let G and G′ be simple Lie groups of equal real rank and real rank at least 2. Let Γ<G and Λ<G′ be non-uniform lattices. We prove a theorem that often implies that any quasi-isometric embedding of Γ into Λ is at bounded distance from a homomorphism. For example, any quasi-isometric embedding of $SL(n,\ma…
A new method for matrix completion with model-free weights.
problem Matrix completion under non-uniform missing structures.
method Constructs weights via convex optimization to adjust for non-uniformity without modeling observation probabilities.
result Recover matrix with stronger theoretical guarantees, especially in heterogeneous missing settings.
Sharp threshold for exact recovery in non-uniform hypergraph stochastic block model.
problem Community detection in random hypergraphs with non-uniform hyperedge probabilities.
method Sharp threshold established; two efficient algorithms for exact recovery.
result Sharp threshold for exact recovery; information-theoretic lower bound on misclassification.
Proves spectral gap bounds for Teichmüller geodesics on flat surfaces.
problem Quantify spectral gaps for Teichmüller geodesics.
method Bounding spectral gaps in terms of geometric quantities on flat surfaces.
result Quantitative non-uniform hyperbolicity of Teichmüller geodesic flow.
New averaging strategy achieves optimal convergence rate with high probability.
problem Optimizing convergence rate for strongly-convex functions.
method Simple non-uniform averaging strategy combined with Freedman's inequality.
result Achieves optimal O(1/T) convergence rate with high probability. Improved sampling accuracy in SG-MCMC methods via non-uniform gradient subsampling.
problem Computational inefficiency and sampling error in stochastic gradient MCMC methods.
method Proposes a non-uniform subsampling scheme to reduce sampling error in EWSG, a variant of SG-MCMC.
result EWSG reduces sampling error compared to uniform subsampling, improving accuracy without sacrificing convergence speed.
Generalizes smoothness conditions for optimization methods.
problem Optimization under non-uniform smoothness conditions.
method Develops a new analysis technique for bounding gradients.
result Obtains convergence rates for gradient descent and Nesterov's method.
The study finds non-uniform lattices with thin Hitchin representations in specific Lie groups.
problem Finding thin Hitchin representations in non-uniform lattices of Lie groups.
method Arithmetic methods to construct thin Hitchin representations.
result Infinitely many orbits of thin Hitchin representations in non-uniform lattices.
Spectral algorithm recovers community structure in sparse hypergraphs.
problem Community detection in sparse random hypergraphs with community structure and higher-order interactions.
method Spectral algorithm with three steps: hyperedge selection, spectral partition, and correction/merging.
result Weak consistency achieved for weak signal-to-noise ratio.
New PAC-Bayesian bounds improve understanding of quantum machine learning generalization.
problem Lack of data-dependent, non-uniform generalization bounds for quantum models.
method Derive PAC-Bayesian generalization bounds for quantum models using channel perturbation analysis.
result First non-uniform, data-dependent generalization bounds for quantum models.
The paper achieves nearly optimal regret bounds for contextual multinomial logit bandits.
problem The contextual multinomial logit (MNL) bandit problem with varying rewards.
method Established lower bounds and proposed OFU-MNL+ algorithm with matching upper bounds.
result Achieved minimax optimal regret bounds for both uniform and non-uniform reward settings.
New method upsamples sparse, non-uniform point clouds more accurately.
problem Suboptimal results from existing point cloud upsampling methods.
method Imposes manifold distribution constraints using Gaussian functions.
result Generates higher-quality, more uniformly distributed dense point clouds.
A streamlined DRL algorithm improves sample efficiency without entropy maximization.
problem Improving sample efficiency in off-policy DRL algorithms.
method Output normalization and non-uniform sampling.
result Proposed algorithm matches SAC's performance without entropy maximization and improves sample efficiency.
Using the existence of certain symplectic submanifolds in symplectic 4-manifolds, we prove an estimate from above for the number of singular fibers with separating vanishing cycles in minimal Lefschetz fibrations over surfaces of positive genus. This estimate is then used to deduce that mapping class groups are not uni…
New approach finds minima of geodesic lengths for non-uniform fillings.
problem Finding minima of geodesic length functions for non-uniform fillings.
method Elementary optimization for 4-regular topological fillings, analysis of fat graphs and optimization techniques.
result Minima of geodesic length functions are found to be at triangle surfaces in both analyzed classes of non-uniform fillings.
New method uses graphene transistors for efficient non-uniform random number generation.
problem Generating non-uniform random variates efficiently.
method GFET-based hardware non-uniform random number generator.
result Demonstrated speedup of Monte Carlo integration by up to 2x.
Recently theoretical guarantees have been obtained for matrix completion in the non-uniform sampling regime. In particular, if the sampling distribution aligns with the underlying matrix's leverage scores, then with high probability nuclear norm minimization will exactly recover the low rank matrix. In this article, we…
Unified framework for non-uniform materials evolving over time.
problem Dealing with non-uniform materials evolving over time.
method Constructing a material groupoid and material distribution.
result Unified framework for general non-uniform evolution materials.
Algorithm improves online learning in adversarial bandits.
problem Online learning in adversarial multi-armed bandits with non-uniform best arm distribution.
method Online-within-online setup, inner and outer learners, leveraging non-uniform empirical distribution of best arms.
result Improves regret bounds for non-uniform best arm distributions.
Hypergraph partitioning lies at the heart of a number of problems in machine learning and network sciences. Many algorithms for hypergraph partitioning have been proposed that extend standard approaches for graph partitioning to the case of hypergraphs. However, theoretical aspects of such methods have seldom received …
New rigidity theorem for product of lattices.
problem Understanding quasi-isometry of product lattices.
method Demonstrated rigidity for product of non-uniform rank one lattice and nilpotent lattice.
result Any quasi-isometric group is an extension of a non-uniform rank one lattice by a nilpotent lattice.
New algorithm achieves strong consistency in binary non-uniform hypergraph classification.
problem Node classification on binary non-uniform hypergraphs with varying edge probabilities.
method Proposes a refinement algorithm using power iteration on weighted adjacency matrices.
result Proves optimality of the refinement algorithm, achieving strong consistency and IT lower bound.
Non-uniform lattices in PU(n,1) cannot geometrically act on CAT(0) cube complexes.
problem Non-uniform lattices in PU(n,1) cannot geometrically act on CAT(0) cube complexes.
method Proving non-uniform lattices in PU(n,1) cannot geometrically act on CAT(0) cube complexes.
result Non-uniform lattices in PU(n,1) cannot geometrically act on CAT(0) cube complexes.
We apply stochastic average gradient (SAG) algorithms for training conditional random fields (CRFs). We describe a practical implementation that uses structure in the CRF gradient to reduce the memory requirement of this linearly-convergent stochastic gradient method, propose a non-uniform sampling scheme that substant…
We study representations of lattices of PU(m,1) into PU(n,1). We show that if a representation is reductive and if m is at least 2, then there exists a finite energy harmonic equivariant map from complex hyperbolic m-space to complex hyperbolic n-space. This allows us to give a differential geometric proof of rigidity …
We study primal-dual type stochastic optimization algorithms with non-uniform sampling. Our main theoretical contribution in this paper is to present a convergence analysis of Stochastic Primal Dual Coordinate (SPDC) Method with arbitrary sampling. Based on this theoretical framework, we propose Optimality Violation-ba…
We present a novel method for neural network quantization that emulates a non-uniform k-quantile quantizer, which adapts to the distribution of the quantized parameters. Our approach provides a novel alternative to the existing uniform quantization techniques for neural networks. We suggest to compare the results as …
We generalize the setting of online clustering of bandits by allowing non-uniform distribution over user frequencies. A more efficient algorithm is proposed with simple set structures to represent clusters. We prove a regret bound for the new algorithm which is free of the minimal frequency over users. The experiments …
We prove that if G is a non-uniform lattice in a rank-one semi-simple Lie group $\ne Isom(\H^2_\R)$ then G is quasi-isometrically co-Hopf. This means that every quasi-isometric embedding G→G is coarsely onto and thus is a quasi-isometry.
A groupoid Ω(B) called material groupoid is naturally associated to any simple body B. The material distribution is introduced due to the (possible) lack of differentiability of the material groupoid. Thus, the inclusion of these new objects in the theory of material bodies opens th…
New algorithms improve best-arm identification with varying rewards.
problem Identifying the best arm with varying reward variances in fixed budget.
method Proposed two algorithms: SHVar for known variances, SHAdaVar for unknown variances; uses non-uniform budget allocation.
result Bounding misidentification probabilities for both algorithms.
In this note, we study deformations of a non-uniform real hyperbolic lattice in quaternionic hyperbolic spaces. Specially we show that the representations of the fundamental group of the figure eight knot complement into PU(2,1) cannot be deformed in PSp(2,1) out of PU(2,1) up to conjugacy.
We construct a three-point compact finite difference scheme on a non-uniform mesh for the time-fractional Black-Scholes equation. We show that for special graded meshes used in finance, the Tavella-Randall and the quadratic meshes the numerical solution has a fourth-order accuracy in space. Numerical experiments are di…
We consider in this paper the problem of noisy 1-bit matrix completion under a general non-uniform sampling distribution using the max-norm as a convex relaxation for the rank. A max-norm constrained maximum likelihood estimate is introduced and studied. The rate of convergence for the estimate is obtained. Information…
Bounds on homology of hyperbolic orbifolds using simplicial models.
problem Bounding homology of hyperbolic orbifolds.
method Efficient simplicial model of the thick part of hyperbolic orbifolds.
result Linear bounds on Betti numbers and torsion homology in terms of volume.
Develops bounds for deep learning risk via Hilbert coresets.
problem Risk estimation for complex deep learning models.
method Hilbert coreset approach for transductive risk bounds.
result Effective and meaningful bounds for deep neural networks.
We improve GANs by enforcing reproducibility and using non-uniform sampling.
problem Overrepresentation of certain samples in GANs' marginal log-likelihood.
method Enforce reproducibility through matching empirical distribution to prior, use non-uniform sampling for mini-batch selection.
result Improved quality and variety in generated samples, validated on CIFAR10, Fashion MNIST, and CelebA.
We study the effectiveness of non-uniform randomized feature selection in decision tree classification. We experimentally evaluate two feature selection methodologies, based on information extracted from the provided dataset: (i) \emph{leverage scores-based} and (ii) \emph{norm-based} feature selection. Experimenta…
New loss function equivalence reveals PER's uniform sampling can be improved.
problem Improving Prioritized Experience Replay (PER) for better learning efficiency.
method Transforming non-uniformly sampled data loss functions into uniformly sampled ones.
result Some environments can replace PER with a new loss function without performance loss.
Convolutional Neural Networks (CNN) has become more popular choice for various tasks such as computer vision, speech recognition and natural language processing. Thanks to their large computational capability and throughput, GPUs ,which are not power efficient and therefore does not suit low power systems such as mobil…
Two algorithms converge to dictionary learning with geometric rate for non-uniform data.
problem Dictionary learning for non-uniform data models.
method Derivation of convergence conditions for MOD and ODL.
result Both algorithms converge to the generating dictionary with geometric rate under certain conditions.
Proof shows volumes of certain geometric representations are always integers.
problem Integrality of volumes of specific geometric representations.
method Elementary, combinatorial-geometrical proof.
result Volumes of representations are integers when n≥2. We study classification problems where features are corrupted by noise and where the magnitude of the noise in each feature is influenced by the resources allocated to its acquisition. This is the case, for example, when multiple sensors share a common resource (power, bandwidth, attention, etc.). We develop a method f…