New method detects communities in complex hypergraphs, matching theoretical limits.
problem Detecting communities in non-uniform hypergraphs with varying hyperedge sizes.
method Developed a spectral theory for weighted non-backtracking operators on non-uniform hypergraphs.
result Achieved the Kesten-Stigum bound for weak recovery in a general class of non-uniform HSBMs.
This letter presents an improved version of diffusion least mean ppower (LMP) algorithm for distributed estimation. Instead of sum of mean square errors, a weighted sum of mean square error is defined as the cost function for global and local cost functions of a network of sensors. The weight coefficients are updated b…
A new method for matrix completion with model-free weights.
problem Matrix completion under non-uniform missing structures.
method Constructs weights via convex optimization to adjust for non-uniformity without modeling observation probabilities.
result Recover matrix with stronger theoretical guarantees, especially in heterogeneous missing settings.
Recently theoretical guarantees have been obtained for matrix completion in the non-uniform sampling regime. In particular, if the sampling distribution aligns with the underlying matrix's leverage scores, then with high probability nuclear norm minimization will exactly recover the low rank matrix. In this article, we…
New method upsamples sparse, non-uniform point clouds more accurately.
problem Suboptimal results from existing point cloud upsampling methods.
method Imposes manifold distribution constraints using Gaussian functions.
result Generates higher-quality, more uniformly distributed dense point clouds.
A fast matrix factorization method for sparse data with non-uniform missing data weights.
problem Sparse and imbalanced data in real-world learning systems.
method Non-uniform weighting of missing data, efficient learning method with truncated SVD and eALS.
result Improved performance in downstream applications compared to uniform weighting.
STR reparameterizes DNN weights with soft thresholds for better sparsity and accuracy.
problem Improving sparsity in DNNs for better accuracy and lower inference cost.
method Soft Threshold Reparameterization (STR) using the soft-threshold operator on DNN weights.
result STR achieves state-of-the-art accuracy and reduces FLOPs by up to 50%.
New method calculates Ricci curvature from distances between weighted volumes.
problem Calculating Ricci curvature for weighted Riemannian manifolds.
method Asymptotic retrieval of generalized Ricci tensor from scaled metric derivatives of Wasserstein 1-distances.
result Limiting coarse curvature of random graphs converges to generalized Ricci tensor.
APoT quantization improves neural network efficiency and accuracy.
problem Efficiently quantizing weights and activations in neural networks.
method Constraining quantization levels as sums of Powers-of-Two terms, applying reparameterization, and weight normalization.
result 4-bit quantized ResNet-50 achieves 76.6% top-1 accuracy, 22% computational cost reduction.
SURF steers scalarization weights to uniformly traverse the Pareto front.
problem Non-uniform coverage of the Pareto front when using scalarization weights.
method Geometric analysis and CDF mapping to select weights for uniform coverage.
result SURF converges to uniform Pareto front coverage under provable conditions.
Improved sampling accuracy in SG-MCMC methods via non-uniform gradient subsampling.
problem Computational inefficiency and sampling error in stochastic gradient MCMC methods.
method Proposes a non-uniform subsampling scheme to reduce sampling error in EWSG, a variant of SG-MCMC.
result EWSG reduces sampling error compared to uniform subsampling, improving accuracy without sacrificing convergence speed.
Validates conformal prediction for network data under non-uniform sampling.
problem Validity of conformal prediction for network data under non-representative sampling.
method Interprets sampling mechanisms as selection rules, studies validity conditional on selection events, uses permutation invariance and joint exchangeability.
result Finite-sample validity of conformal prediction for certain selection events and asymptotic validity for random walk sampling.
New algorithm achieves strong consistency in binary non-uniform hypergraph classification.
problem Node classification on binary non-uniform hypergraphs with varying edge probabilities.
method Proposes a refinement algorithm using power iteration on weighted adjacency matrices.
result Proves optimality of the refinement algorithm, achieving strong consistency and IT lower bound.
The paper calculates the number of closed cycles in a specific complex group.
problem Counting closed cycles in a complex group structure.
method Defined edge zeta function and used rational function formula.
result Obtained exact formula for the number of closed cycles.
This work certifies non-uniform bounds against adversarial attacks for neural networks.
problem Certifying robust regions around data points against non-uniform adversarial attacks.
method Formulated as an optimization problem with nonlinear constraints, using the augmented Lagrangian method for general feedforward neural networks.
result Non-uniform bounds have larger volumes and better interpretability compared to uniform bounds.
A method for reducing neural network size using look-up tables.
problem Reducing memory and computational footprint of deep neural networks.
method Iteratively learns value dictionaries and assignment matrices for network weights.
result General framework for network reduction that can handle various reduction problems.
Estimates prediction error for non-uniform samples.
problem Account for non-uniform sampling in prediction model evaluation.
method Extends Efron's estimator with Horvitz-Thompson weights for complex samples.
result Consistent estimator of generalized prediction error for complex samples.
The study finds non-uniform lattices with thin Hitchin representations in specific Lie groups.
problem Finding thin Hitchin representations in non-uniform lattices of Lie groups.
method Arithmetic methods to construct thin Hitchin representations.
result Infinitely many orbits of thin Hitchin representations in non-uniform lattices.
Improved multiclass classification with class-weighted nearest neighbors.
problem Multiclass classification with large or imbalanced classes.
method Class-weighted k-nearest neighbors algorithm, derived bounds on accuracy and risk.
result Optimized classification metrics like F1 score or Matthew's Correlation Coefficient.
New material groupoid theory subdivides non-uniform bodies into smoothly uniform parts and isolated points.
problem Lack of differentiability in material bodies leads to non-uniformity.
method Introducing material groupoid and material distribution to study non-uniform bodies rigorously.
result Material bodies can be subdivided into smoothly uniform parts and isolated points.
New approach to adversarial robustness with non-uniform perturbations.
problem Real-world adversaries craft adversarial examples with non-uniform perturbations.
method Proposes non-uniform perturbations based on feature dependencies and data distribution.
result Shows improved robustness to real-world attacks compared to uniform perturbations.
New approach finds minima of geodesic lengths for non-uniform fillings.
problem Finding minima of geodesic length functions for non-uniform fillings.
method Elementary optimization for 4-regular topological fillings, analysis of fat graphs and optimization techniques.
result Minima of geodesic length functions are found to be at triangle surfaces in both analyzed classes of non-uniform fillings.
New method uses graphene transistors for efficient non-uniform random number generation.
problem Generating non-uniform random variates efficiently.
method GFET-based hardware non-uniform random number generator.
result Demonstrated speedup of Monte Carlo integration by up to 2x.
Study shows how non-uniform scaling affects persistence diagrams.
problem Stability of persistence diagrams under non-uniform scaling.
method Explicit bounds on bottleneck distance derived for Euclidean scaling.
result Explicit bounds on the stability of persistence diagrams under non-uniform scaling.
Unified framework for non-uniform materials evolving over time.
problem Dealing with non-uniform materials evolving over time.
method Constructing a material groupoid and material distribution.
result Unified framework for general non-uniform evolution materials.
UNIQ method quantizes neural networks adaptively, reducing BOPS.
problem Efficiently quantizing neural networks to reduce computational cost.
method Adapts to parameter distribution, using uniform noise injection.
result Shows advantages in low computational budget scenarios.
New rigidity theorem for product of lattices.
problem Understanding quasi-isometry of product lattices.
method Demonstrated rigidity for product of non-uniform rank one lattice and nilpotent lattice.
result Any quasi-isometric group is an extension of a non-uniform rank one lattice by a nilpotent lattice.
Non-uniform lattices in PU(n,1) cannot geometrically act on CAT(0) cube complexes.
problem Non-uniform lattices in PU(n,1) cannot geometrically act on CAT(0) cube complexes.
method Proving non-uniform lattices in PU(n,1) cannot geometrically act on CAT(0) cube complexes.
result Non-uniform lattices in PU(n,1) cannot geometrically act on CAT(0) cube complexes.
New model learns SDEs without gradient matching for non-uniform time increments.
problem Learning non-parametric drift and diffusion functions for SDEs.
method Formulates sensitivity equations for learning and optimizes path distributions.
result Robust and efficient learning of SDE systems with non-uniform time increments.
We apply stochastic average gradient (SAG) algorithms for training conditional random fields (CRFs). We describe a practical implementation that uses structure in the CRF gradient to reduce the memory requirement of this linearly-convergent stochastic gradient method, propose a non-uniform sampling scheme that substant…
We study primal-dual type stochastic optimization algorithms with non-uniform sampling. Our main theoretical contribution in this paper is to present a convergence analysis of Stochastic Primal Dual Coordinate (SPDC) Method with arbitrary sampling. Based on this theoretical framework, we propose Optimality Violation-ba…
Proposes QDF to improve multi-step time-series forecasting.
problem Ignoring label autocorrelation and unequal task weights in training objectives.
method Quadratic-form weighted training objective and QDF learning algorithm.
result Improves performance of various forecast models, achieving state-of-the-art results.
Sharp threshold for exact recovery in non-uniform hypergraph stochastic block model.
problem Community detection in random hypergraphs with non-uniform hyperedge probabilities.
method Sharp threshold established; two efficient algorithms for exact recovery.
result Sharp threshold for exact recovery; information-theoretic lower bound on misclassification.
We prove that if G is a non-uniform lattice in a rank-one semi-simple Lie group $\ne Isom(\H^2_\R)$ then G is quasi-isometrically co-Hopf. This means that every quasi-isometric embedding G→G is coarsely onto and thus is a quasi-isometry.
Efficient non-uniform quantizer improves CNN performance on FPGA.
problem Improving CNN performance on low-power systems like mobile devices.
method Custom hardware-friendly non-uniform quantizer for parameters and activations using a single scale integer representation.
result Little degradation in accuracy on CIFAR-10 and CIFAR-100 datasets.
In this note, we study deformations of a non-uniform real hyperbolic lattice in quaternionic hyperbolic spaces. Specially we show that the representations of the fundamental group of the figure eight knot complement into PU(2,1) cannot be deformed in PSp(2,1) out of PU(2,1) up to conjugacy.
DA-LSTM adapts LSTM depth to non-uniform data, improving efficiency.
problem Non-uniform information distribution in sequential data cannot be accurately modeled by traditional LSTM.
method Developed DA-LSTM architecture that dynamically adjusts LSTM depth based on information distribution.
result DA-LSTM reduces computation resource usage and convergence time by 41.78% and 46.01% respectively.
We construct a three-point compact finite difference scheme on a non-uniform mesh for the time-fractional Black-Scholes equation. We show that for special graded meshes used in finance, the Tavella-Randall and the quadratic meshes the numerical solution has a fourth-order accuracy in space. Numerical experiments are di…
We improve GANs by enforcing reproducibility and using non-uniform sampling.
problem Overrepresentation of certain samples in GANs' marginal log-likelihood.
method Enforce reproducibility through matching empirical distribution to prior, use non-uniform sampling for mini-batch selection.
result Improved quality and variety in generated samples, validated on CIFAR10, Fashion MNIST, and CelebA.
A new method improves adversarial robustness by optimizing importance weights.
problem Adversarial training's non-uniform robustness across different data points.
method Doubly-robust instance reweighted adversarial training using distributionally robust optimization.
result Improves robustness against attacks on the weakest data points.
This paper develops a new theory for ensemble learning beyond variance reduction.
problem Ensemble learning's effectiveness for stable estimators is not fully explained by variance reduction.
method Develops a general weighting theory for ensemble learning, formalizing ensembles as linear operators and introducing geometric and spectral constraints.
result Structured weights can outperform uniform averaging by reshaping approximation geometry and redistributing spectral complexity.
We study the effectiveness of non-uniform randomized feature selection in decision tree classification. We experimentally evaluate two feature selection methodologies, based on information extracted from the provided dataset: (i) \emph{leverage scores-based} and (ii) \emph{norm-based} feature selection. Experimenta…
Improved matrix completion for non-uniformly sampled data.
problem Estimating unobserved entries in a matrix with varying sampling probabilities.
method Developed entry-specific bounds for low-rank matrix completion under structured non-uniform sampling.
result Error bounds for each entry match minimax lower bounds under certain conditions.
New loss function equivalence reveals PER's uniform sampling can be improved.
problem Improving Prioritized Experience Replay (PER) for better learning efficiency.
method Transforming non-uniformly sampled data loss functions into uniformly sampled ones.
result Some environments can replace PER with a new loss function without performance loss.
The popular Alternating Least Squares (ALS) algorithm for tensor decomposition is efficient and easy to implement, but often converges to poor local optima---particularly when the weights of the factors are non-uniform. We propose a modification of the ALS approach that is as efficient as standard ALS, but provably rec…
Two algorithms converge to dictionary learning with geometric rate for non-uniform data.
problem Dictionary learning for non-uniform data models.
method Derivation of convergence conditions for MOD and ODL.
result Both algorithms converge to the generating dictionary with geometric rate under certain conditions.
Proof shows volumes of certain geometric representations are always integers.
problem Integrality of volumes of specific geometric representations.
method Elementary, combinatorial-geometrical proof.
result Volumes of representations are integers when n≥2. Spectral algorithm recovers community structure in sparse hypergraphs.
problem Community detection in sparse random hypergraphs with community structure and higher-order interactions.
method Spectral algorithm with three steps: hyperedge selection, spectral partition, and correction/merging.
result Weak consistency achieved for weak signal-to-noise ratio.