When the signed weighted resolution set was defined as an invariant of pseudoknots, it was unknown whether this invariant was complete. Using the Gauss-diagrammatic invariants of pseudoknots introduced by Dorais et al, we show that the signed were-set cannot distinguish all non-equivalent pseudoknots. This goal is achi…
A new algorithm solves signed Fréchet regression on manifolds with bounded curvature.
problem Signed Fréchet regression on Riemannian manifolds with bounded curvature.
method Proximal DC algorithm (FRIDA) for computing signed Fréchet regression fits.
result Existence and interiority of minimizers, strong convexity of proximal subproblems, and convergence to stationary points.
Signed network models reduce portfolio risk by considering negative edges in financial markets.
problem Tackles portfolio optimization in financial markets by exploiting negative edges in network representations.
method Proposes a discrete optimization scheme to reduce asset selection, building time series of signed networks from asset returns.
result Empirical results show that signed network portfolios perform similarly to classical mean-variance optimization and equally weighted benchmarks.
Geometric framework for signed multivariate tail-dependence compatibility at various thresholds.
problem Modeling and analyzing signed multivariate tail-dependence across different thresholds.
method Developed a geometric witness framework to represent and invert signed tail families, identifying nonnegative weights and normalized masses.
result Characterization and synthesis of signed multivariate tail-dependence at finite thresholds, preserving the complete signed tail family throughout.
A new memory-efficient sign language translation model reduces weight usage.
problem Memory constraints in real-time sign language translation.
method Variational Bayesian sequence-to-sequence network with Gaussian posterior and Indian Buffet Process prior.
result The proposed model achieves substantial weight compression without compromising performance.
FlipOut prunes neural networks by flipping weights' signs, achieving high sparsity.
problem Redundant weights in neural networks increase training time and resource usage.
method Uses sign flips during training to determine weight saliency for pruning.
result Competitive with existing methods, achieving state-of-the-art performance for high sparsity.
The backpropagation (BP) algorithm is often thought to be biologically implausible in the brain. One of the main reasons is that BP requires symmetric weight matrices in the feedforward and feedback pathways. To address this "weight transport problem" (Grossberg, 1987), two more biologically plausible algorithms, propo…
New model detects communities in networks with signed, continuous weights.
problem Detect communities in networks with signed, continuous weights.
method Heterogeneous Block Covariance Model (HBCM) with variational EM algorithm.
result Provable consistent estimates of group memberships.
New method estimates tensors from noisy data with missing entries.
problem Tensor estimation from noisy observations with missing entries.
method Sign series representation for tensor completion, addressing low- and high-rank signals.
result Excess risk bounds, estimation error rates, and sample complexities established.
A new method improves graph-based semi-supervised classification by removing noise and mixed signs.
problem Inaccurate soft labels and noise in graph-based semi-supervised classification.
method Triple-matrix-recovery-based robust auto-weighted label propagation framework (ALP-TMR).
result Improved robustness to noise and outliers in label estimation.
By specifying model free preferences towards simple nested classes of lottery pairs, we develop the dual story to stand on equal footing with that of (primal) risk apportionment. The dual story provides an intuitive interpretation, and full characterization, of dual counterparts of such concepts as prudence and tempera…
New neural network architectures use signed permutation representations for finite groups, improving performance.
problem Designing and optimizing neural networks for finite groups with signed permutation representations.
method Introduces G-invariant deep neural networks with densely connected layers and signed permutation representations. result Signed permutation representations lead to significantly better performance in classification tasks.
We introduce a principled method for the signed clustering problem, where the goal is to partition a graph whose edge weights take both positive and negative values, such that edges within the same cluster are mostly positive, while edges spanning across clusters are mostly negative. Our method relies on a graph-based …
DKMD is a fast signed statistic for comparing univariate distributions.
problem Comparing univariate distributions, especially preserving directionality.
method DKMD integrates kernel mean embeddings against an odd weighting function.
result DKMD preserves directionality and is robust to outliers.
New sketches for weighted ℓp sampling without replacement improve accuracy and efficiency.
problem Efficiently sampling weighted data with high accuracy and minimal redundancy.
method Design of novel composable sketches for WOR ℓp sampling, based on CountSketch. result First to provide WOR sampling for p>1 and signed updates. This work shows MLPs can approximate monotonic functions without bounded activations.
problem Optimizing MLPs with monotonic constraints and bounded activations.
method Generalized theoretical results showing MLPs with non-negative weights and saturating activations are universal approximators.
result MLPs with non-negative weights and saturating activations are universal approximators for monotonic functions.
Efficiently recovers network community structure from clients' small subgraphs.
problem Recovering community structure in federated myopic learning settings.
method Developed an algorithm to compute consensus signed weighted graph from clients' evidence.
result Exact recovery of network structure is possible in polynomial time under certain conditions.
The ADAM optimizer is exceedingly popular in the deep learning community. Often it works very well, sometimes it doesn't. Why? We interpret ADAM as a combination of two aspects: for each weight, the update direction is determined by the sign of stochastic gradients, whereas the update magnitude is determined by an esti…
This paper contains some vanishing theorems for L2 harmonic forms on complete Riemannian manifolds with a weighted Poincaré inequality and a certain lower bound of the curvature. The results are in the spirit of Li-Wang and Lam, but without assumptions of sign and growth rate of the weight function, so they can be a…
We study the use of "sign α-stable random projections" (where 0<α≤2) for building basic data processing tools in the context of large-scale machine learning applications (e.g., classification, regression, clustering, and near-neighbor search). After the processing by sign stable random projections, the inner pr…
The recent "Lottery Ticket Hypothesis" paper by Frankle & Carbin showed that a simple approach to creating sparse networks (keeping the large weights) results in models that are trainable from scratch, but only when starting from the same initial weights. The performance of these networks often exceeds the performance …
A new algorithm enhances minority class representation in imbalanced datasets.
problem Improving classification performance on imbalanced datasets.
method PO-QG algorithm using Proxima-Orion neighbors and q-Gaussian weighting.
result The PO-QG algorithm improves overall classification performance.
Lion optimizer performs well in training AI models with memory efficiency.
problem Lion optimizer's theoretical basis is unclear.
method Continuous-time and discrete-time analysis of Lion updates with a new Lyapunov function.
result Lion is a novel and principled approach for constrained optimization.
We introduce a new series Rk, k=2,3,4,…, of integer valued weight systems. The value of the weight system Rk on a chord diagram is a signed number of cycles of even length 2k in the intersection graph of the diagram. We show that this value depends on the intersection graph only. We check that for small o…
Ridgeless ReLU networks interpolate datasets and extrapolate based on curvature signs.
problem Interpolating and extrapolating 1D datasets with ReLU networks.
method Minimizes ℓ2-norm of weights, extrapolates based on curvature signs. result Ridgeless ReLU interpolants extrapolate as nearest neighbor curvature extrapolation.
PPC learns binary codes from data similarities and dissimilarities.
problem Creating efficient binary codes from data similarities and dissimilarities.
method PPC learns binary codes by modeling attractive and repulsive forces in a signed graph.
result PPC achieves superior results in nearest-neighbor searches compared to spectral methods.
We present a Bayesian formulation of weighted stochastic block models that can be used to infer the large-scale modular structure of weighted networks, including their hierarchical organization. Our method is nonparametric, and thus does not require the prior knowledge of the number of groups or other dimensions of the…
Current algorithms for deep learning probably cannot run in the brain because they rely on weight transport, where forward-path neurons transmit their synaptic weights to a feedback path, in a way that is likely impossible biologically. An algorithm called feedback alignment achieves deep learning without weight transp…
New method escapes local optima in neural architecture optimization.
problem Escaping local optima in neural architecture optimization.
method Signed neural splitting in steepest descent framework.
result Escapes local optima, leading to better performance.
Paper introduces stable vectorization for multiparameter PH using signed barcodes.
problem Lack of stable vectorization methods for multiparameter persistent homology.
method Signed barcodes as measures for stable vectorization of MPH.
result Stable feature vectors from signed barcodes improve performance in data science.
Novel analysis of neural networks using geometric algebra and convex optimization.
problem Understanding the inner workings of deep neural networks.
method Geometric (Clifford) algebra and convex optimization.
result Optimal weights are given by the wedge product of training samples.
A new algorithm reduces communication in distributed SVD by p factors.
problem Efficiently compute SVD in distributed systems.
method LocalPower algorithm with weighted aggregation and periodic decay of iterations.
result Reduces communication cost by a factor of p. Cautious Weight Decay modifies weight decay for better optimization.
problem Improving optimization in deep learning models.
method Applies weight decay selectively based on parameter sign alignment.
result Consistently improves model performance across various tasks and scales.
We organize the quantum hyperbolic invariants (QHI) of 3-manifolds into sequences of rational functions indexed by the odd integers N≥3 and defined on moduli spaces of geometric structures refining the character varieties. In the case of one-cusped hyperbolic 3-manifolds M we generalize the QHI and get rati…
Mean field theory has been successfully used to analyze deep neural networks (DNN) in the infinite size limit. Given the finite size of realistic DNN, we utilize the large deviation theory and path integral analysis to study the deviation of functions represented by DNN from their typical mean field solutions. The para…
Enhances LLM quantization with MDBF, improving perplexity and accuracy.
problem Limited performance of Double Binary Factorization in extreme quantization.
method Introduces Multi-envelope DBF, retaining sign matrices and replacing single envelope with rank-l envelope. result Improves perplexity and zero-shot accuracy over previous binary formats.
We prove a necessary and sufficient condition for an asymptotically Euclidean manifold to be conformally related to one with specified nonpositive scalar curvature: the zero set of the desired scalar curvature must have a positive Yamabe invariant, as defined in the article. We show additionally how the sign of the Yam…
Develops a new nonparametric trace regression model for high-dimensional data.
problem Violation of known functional form and global low-rank structure assumptions in trace regression.
method Structured sign series representations for nonparametric trace regression models.
result Establishes excess risk bounds and sample complexities for the proposed model.
Study long-only minimum variance portfolio in one-factor market with arbitrary sign betas.
problem Characterize the long-only minimum variance portfolio in a one-factor market with mixed-sign betas.
method Explicit solution for long-only minimum variance portfolio, explicit characterization of active set, asymptotic analysis in high-dimensional regime.
result Proportion of active assets in LOMV portfolio converges to F(β∗) in high-dimensional regime, with rate O(F(0)1/3) when F(0)>0. TRP uses tree-based approach for market-neutral portfolios.
problem Creating non-binary, market-neutral portfolios with signed signals.
method Tree-based portfolio construction with minimum-spanning-tree and sector-anchored variants.
result TRP outperforms HRP in preserving signal direction and managing exposures.
We provide a geometric explanation for the existence of magnification relations for the A, D, E family of caustic singularities, which were established in recent work. In particular, it was shown that for families of general mappings between planes exhibiting any of these caustic singularities, and for any non-caustic …
Meta-analysis improves personalized treatment rules across multiple sites.
problem Lack of generalizability in learning individualized treatment rules across different medical sites.
method Developed a method for individual-level meta-analysis of ITRs, borrowing sign-coherency information between sites.
result Jointly learned site-specific ITRs with improved generalizability.
A new model for detecting overlapping communities in weighted networks.
problem Community detection in overlapping weighted networks with mixed membership and edge weights.
method Mixed membership distribution-free (MMDF) model with an efficient spectral algorithm and fuzzy weighted modularity.
result The MMDF model can estimate community memberships and evaluate community quality for weighted networks.
A new GCN model detects cryptocurrency fraud by considering network evolution and balance theory.
problem Detecting fraud in evolving signed cryptocurrency trust networks.
method Motif-aware temporal GCN using balance theory and learnable weights.
result The model outperforms existing methods on bitcoin datasets.
Dropout increases the generalization of neural networks by expanding the weight space.
problem Understanding and improving the generalization of neural networks.
method Introducing weight expansion and showing that dropout leads to it.
result Dropout increases the generalization of neural networks by expanding the weight space.
Novel neural likelihood ratio estimation for negative data in particle physics.
problem Estimating likelihood ratios with negative probability densities and weights.
method Introducing a novel loss function and a new model architecture based on signed mixture models.
result Demonstrated improved estimation on a real-world example from particle physics.
Low bit-width weights and activations are an effective way of combating the increasing need for both memory and compute power of Deep Neural Networks. In this work, we present a probabilistic training method for Neural Network with both binary weights and activations, called BLRNet. By embracing stochasticity during tr…
New methods train neural networks without changing weights, achieving similar or higher performance.
problem Training neural networks efficiently with randomly initialized weights.
method Switching connections on and off, flipping weights' signs, minimizing changed connections.
result Achieves similar or higher performance with less computational cost than training all weights.