Bandlimited random neural networks may not approximate all functions perfectly.
problem Expressive power of shallow neural networks with bandlimited random weights.
method Ridgelet analysis for deriving approximation error lower bounds.
result Bandlimited random weights can lead to non-zero approximation error.
GNNs outperform NNs in interpolating bandlimited functions on Euclidean cubes.
problem Interpolating bandlimited functions on Euclidean cubes using GNNs vs. NNs.
method Investigates optimal GNN configurations and weights for function interpolation.
result GNNs require fewer weights and samples to interpolate bandlimited functions compared to NNs.
We study the problem of sampling k-bandlimited signals on graphs. We propose two sampling strategies that consist in selecting a small subset of nodes at random. The first strategy is non-adaptive, i.e., independent of the graph structure, and its performance depends on a parameter called the graph coherence. On the co…
In this work, we introduce the concept of bandlimiting into the theory of machine learning because all physical processes are bandlimited by nature, including real-world machine learning tasks. After the bandlimiting constraint is taken into account, our theoretical analysis has shown that all practical machine learnin…
Band-limited SAC improves learning efficiency and stability in simulated environments.
problem Improving sample efficiency and stability in SAC algorithms.
method Artificially bandlimiting the target critic's spatial resolution using a convolutional filter.
result Bandlimited SAC outperforms classic twin-critic SAC in various Gym environments and is more stable.
We present a new random sampling strategy for k-bandlimited signals defined on graphs, based on determinantal point processes (DPP). For small graphs, ie, in cases where the spectrum of the graph is accessible, we exhibit a DPP sampling scheme that enables perfect recovery of bandlimited signals. For large graphs, ie, …
We study signal recovery on graphs based on two sampling strategies: random sampling and experimentally designed sampling. We propose a new class of smooth graph signals, called approximately bandlimited, which generalizes the bandlimited class and is similar to the globally smooth class. We then propose two recovery s…
Graph neural networks can be adapted to new graphs with a limit object called graphon NNs.
problem Transferability of graph neural networks across different graphs.
method Introduced graphon NNs as limit objects of GNNs and proved a bound on the difference between GNN and graphon-NN outputs.
result The bound on the difference between GNN and graphon-NN outputs vanishes with growing number of nodes if the graph convolutional filters are bandlimited.
Neural networks outperform NTK on compositional tasks, revealing a complexity gap.
problem Understanding the performance gap between neural networks and NTK on tasks with compositional structure.
method Characterized Fourier and architectural complexities, and analyzed the minimax rates of the architecture class.
result The NTK estimator is exponentially sub-optimal compared to the minimax floor when complexities decouple.
The aim of this paper is to propose distributed strategies for adaptive learning of signals defined over graphs. Assuming the graph signal to be bandlimited, the method enables distributed reconstruction, with guaranteed performance in terms of mean-square error, and tracking from a limited number of sampled observatio…
Spectral clustering has become a popular technique due to its high performance in many contexts. It comprises three main steps: create a similarity graph between N objects to cluster, compute the first k eigenvectors of its Laplacian matrix to define a feature vector for each object, and run k-means on these features t…
We study the problem of sampling a bandlimited graph signal in the presence of noise, where the objective is to select a node subset of prescribed cardinality that minimizes the signal reconstruction mean squared error (MSE). To that end, we formulate the task at hand as the minimization of MSE subject to binary constr…
In this paper, we study the adversarial attack and defence problem in deep learning from the perspective of Fourier analysis. We first explicitly compute the Fourier transform of deep ReLU neural networks and show that there exist decaying but non-zero high frequency components in the Fourier spectrum of neural network…
Quantifies polynomial approximation rates for smooth functions under various distributions.
problem Approximating smooth functions with polynomials under different distributional constraints.
method Develops a quantitative analogue of Carleman's theorem using complex analysis.
result Establishes superexponential rates of approximation for certain function classes over general distributions.
TKRR improves KRR performance by aligning target functions with kernels.
problem Improving kernel ridge regression performance through target alignment.
method Focuses on truncated kernel ridge regression (TKRR) with an additional spectral truncation parameter.
result TKRR can achieve faster rates than full KRR, reaching parametric rates.
A number of applications in engineering, social sciences, physics, and biology involve inference over networks. In this context, graph signals are widely encountered as descriptors of vertex attributes or features in graph-structured data. Estimating such signals in all vertices given noisy observations of their values…
A new weighted MCC measure improves classifier performance evaluation.
problem Lack of measures sensitive to observation weights in multiclass classification.
method Proposes weighted versions of Pearson-Matthews Correlation Coefficient (MCC) for binary and multiclass classification.
result Weighted MCC values are higher for classifiers that perform better on highly weighted observations.
Stability of weighted extremal manifolds proven through blowups.
problem Stability of weighted extremal manifolds.
method Blowup technique to analyze weighted extremal Kähler manifolds.
result Proves weighted extremal manifolds are relatively weighted K-polystable.
Develops theory of weightings for Lie groupoids and algebroids.
problem Understanding differential geometry of weightings for Lie groupoids and algebroids.
method Extending work on weighted manifolds, defining weighted submanifolds, and developing theories of linear weightings and multiplicative weightings.
result Characterizes infinitesimally multiplicative weightings for Lie algebroids and classifies multiplicative weightings of Lie groupoids.
The paper extends spin geometry to weighted manifolds and defines a new mass for Ricci flow.
problem Generalizing spin geometry to weighted manifolds and defining a new mass.
method Investigates spectral properties of the weighted Dirac operator and defines a new mass.
result Defines a new mass for weighted asymptotically Euclidean manifolds and shows its monotonicity under Ricci flow.
Paper generalizes CR Obata theorem to weighted Sasakian manifolds.
problem Deriving eigenvalue estimates for weighted Kohn Laplacian.
method Derived weighted CR Reilly's formula and applied to Sasakian manifolds.
result CR Obata theorem proven for weighted Sasakian manifolds.
The study explores weightings on submanifolds and their geometric properties.
problem Understanding weightings on submanifolds and their geometric implications.
method Detailed exploration of weighted normal bundles, weighted deformation spaces, and weighted blow-ups.
result A description of weightings in terms of subbundles of higher tangent bundles, leading to new concepts for Lie algebroids and groupoids.
New mass and staticity concepts derived from weighted curvature maps.
problem Deriving mass and staticity concepts for weighted manifolds.
method Developed a weighted curvature map and its adjoint, leading to weighted mass and static metrics.
result Equivalence and uniqueness theorems for weighted static manifolds and Penrose inequality.
Proves existence and uniqueness of weighted metrics for smooth spaces.
problem Existence and uniqueness of weighted metrics for smooth metric measure spaces.
method Proves existence and uniqueness using weighted ambient metrics and Poincaré metrics.
result Existence and uniqueness of weighted metrics for smooth metric measure spaces.
Defines and proves properties of weighted renormalized volume coefficients.
problem None explicitly stated; focuses on mathematical definitions and proofs.
method Defines weighted renormalized volume coefficients and proves their variational nature and polynomial representation.
result Weighted renormalized volume coefficients are variational and can be expressed as polynomials of specific tensors.
A new weighted FDA method improves face recognition accuracy.
problem Equal treatment of all class pairs in FDA leads to suboptimal performance.
method Cosine-weighted and automatically weighted FDA methods are proposed.
result Improved face recognition accuracy through weighted FDA.
Proves positive mass theorem for non-spin weighted manifolds.
problem Proving the positive mass theorem for non-spin weighted manifolds.
method Establishing density theorem and generalizing Geroch conjecture.
result Proves positive weighted mass theorem for non-spin weighted manifolds.
New invariants help solve existence of weighted cscK metrics.
problem Existence of weighted cscK metrics in K-stability.
method Introduced weighted analytic delta invariant and beta invariant.
result Sufficient condition for existence of weighted cscK metrics.
Derives integral formulae on weighted manifolds.
problem No specific problem stated; focuses on mathematical derivations.
method Introduces weighted mean sigma-r curvature and uses weighted Newton transformations.
result Derives integral formulae generalizing previous work.
Method measures weight similarity in neural networks using normalization and statistical inference.
problem Quantifying weight similarity in non-convex neural networks.
method Chain normalization rule and hypothesis-training-testing statistical inference.
result Weights of identical neural networks converge to similar local solutions.
The paper studies weighted Ricci curvatures and characterizes Randers metrics.
problem Characterizing Randers metrics with weighted Ricci curvatures.
method General weighted Ricci curvatures and characterization of Randers metrics.
result Characterization of Randers metrics with almost isotropic weighted Ricci curvatures.
Study on stable minimal hypersurfaces under Ricci curvature constraints.
problem Stability of weighted minimal hypersurfaces under Ricci curvature bounds.
method Derive geometric consequences and prove a Schoen-Yau type criterion.
result Structure theorem for three-dimensional weighted manifolds of non-negative Ricci curvature.
Explains weightings along submanifolds, focusing on Lie groupoids.
problem None explicitly stated; focuses on theory review.
method Reviews basic notions and emphasizes multiplicative weightings.
result Provides a comprehensive overview of weightings along submanifolds.
The study establishes comparison theorems for weighted Finsler manifolds and spacetimes.
problem Analyzing weighted Finsler manifolds and spacetimes with curvature conditions.
method Using weight function and ε-range, the Bonnet-Myers theorem, Laplacian comparison theorem, and Bishop-Gromov volume comparison theorem are formulated. result New comparison theorems for weighted Finsler manifolds and spacetimes are derived, including those for weighted Riemannian manifolds.
The study analyzes weighted manifolds with curvature bounds, proving eigenvalue estimates and inequalities.
problem Analyzing geometric properties of weighted manifolds under Ricci curvature bounds.
method Develops geometric analysis techniques on weighted Riemannian manifolds with lower 0-weighted Ricci curvature bounds. result Proves eigenvalue estimates for Steklov and ABP inequalities on weighted manifolds.
The paper generalizes K-stability results to singular and weighted settings.
problem Generalizing K-stability to singular and weighted settings.
method Generalization of results in \cite{Li22a} to singular and weighted settings.
result The \(\mathbb{G}\)-uniform weighted K-stability for models implies \(\mathbb{G}\)-coercivity of the weighted Mabuchi functional.
Study on deformation of weighted scalar curvature, proving geometric results and stability.
problem Deformation of weighted scalar curvature and related geometric properties.
method Linearization of weighted scalar curvature, studying kernel of formal adjoint.
result Definition and study of weighted vacuum static spaces, stability results on flat spaces.
Reverse-weighted portfolios outperform in commodity futures markets.
problem Efficiency of commodity futures markets.
method Permutation-weighted portfolios, rank-based methods.
result Reverse-weighted portfolio outperforms price-weighted portfolio.
Paper extends trigonometric summation formula with weights.
problem Trigonometric summation formula by Grigor'yan, Lin and Yau.
method Weighted trigonometric summation formula derivation.
result Extension of trigonometric summation formula.
The Penrose theorem and Hawking's topology theorem are extended to weighted spacetimes.
problem Extending Penrose's singularity theorem and Hawking's topology theorem to weighted spacetimes.
method Using weighted null energy condition and synthetic dimension to generalize the theorems.
result Generalized versions of the Penrose and Hawking theorems hold under a weighted null energy condition.
A new method trains deep networks by separating weight locations from values.
problem Training deep networks efficiently and effectively.
method Lookahead Permutation (LaPerm) to train DNNs by reconnecting weights.
result LaPerm can train DNNs with random and dense, sparse, or single-valued initial weights.
A new method to improve deep neural networks using weight rescaling.
problem Overfitting and sensitivity to hyperparameters in weight decay.
method Weight rescaling (WRS) to control weight norm and prevent overfitting.
result WRS outperforms weight decay and other methods in various applications.
The paper predicts edge weights in weighted directed networks using metric geometry.
problem Predicting edge weights in weighted directed networks.
method Introducing new types of weighted directed networks (AWDNs), constructing metrics, and proposing modified kNN and SVM methods.
result The proposed methods outperform traditional approaches in predicting edge weights.
Optimal weight windows are found by projecting the origin onto a convex polytope.
problem Finding the best weight windows for a weighted moving average smoother.
method Formulated as a quadratic program and projection onto a convex polytope.
result Optimal weight windows are symmetrical and decrease in weight away from the center.
Optimizes weights for better model performance in shifting data.
problem Improper importance weighting leads to poor model performance in data shifts.
method Interprets weights as a bias-variance trade-off and optimizes them simultaneously with model parameters.
result Optimizing weights significantly improves model generalization performance.
Study of weighted nonlinear flags in symplectic geometry.
problem Understanding the geometry of weighted nonlinear flags.
method Generalizing weighted nonlinear Grassmannians to Frechet manifolds and using them to describe coadjoint orbits.
result Description of coadjoint orbits of Hamiltonian diffeomorphisms using weighted isotropic nonlinear flags.
Due to a resource-constrained environment, network compression has become an important part of deep neural networks research. In this paper, we propose a new compression method, \textit{Inter-Layer Weight Prediction} (ILWP) and quantization method which quantize the predicted residuals between the weights in all convol…
Study on convergence rate of weighted Yamabe flow.
problem Weighted Yamabe problem on smooth metric measure spaces.
method Weighted Yamabe flow and its convergence rate analysis.
result Study and analysis of convergence rate of the weighted Yamabe flow.