Dropout increases the generalization of neural networks by expanding the weight space.
problem Understanding and improving the generalization of neural networks.
method Introducing weight expansion and showing that dropout leads to it.
result Dropout increases the generalization of neural networks by expanding the weight space.
Proves positive mass theorem for non-spin weighted manifolds.
problem Proving the positive mass theorem for non-spin weighted manifolds.
method Establishing density theorem and generalizing Geroch conjecture.
result Proves positive weighted mass theorem for non-spin weighted manifolds.
DeepWeightFlow generates diverse neural network weights efficiently.
problem Generating complete neural network weights efficiently and accurately.
method Flow Matching in weight space with Git Re-Basin and TransFusion.
result DeepWeightFlow generates high-accuracy neural networks without fine-tuning.
The paper extends spin geometry to weighted manifolds and defines a new mass for Ricci flow.
problem Generalizing spin geometry to weighted manifolds and defining a new mass.
method Investigates spectral properties of the weighted Dirac operator and defines a new mass.
result Defines a new mass for weighted asymptotically Euclidean manifolds and shows its monotonicity under Ricci flow.
Estimates causal effects using neural networks for balancing covariates.
problem Estimating causal effects from observational data.
method Neural Balancing Weights (NBW) using α-divergence for density ratio estimation. result Generalized approach for balancing multidimensional data.
Weight Decay induces low-rank weight matrices in neural networks, improving generalization.
problem Improving generalization in neural networks.
method Training ReLU NN with Weight Decay and Stochastic Gradient Descent.
result The weight matrix of a trained NN is approximately rank-two.
A new method to improve deep neural networks using weight rescaling.
problem Overfitting and sensitivity to hyperparameters in weight decay.
method Weight rescaling (WRS) to control weight norm and prevent overfitting.
result WRS outperforms weight decay and other methods in various applications.
We develop the theory of weighted Ricci curvature in a weighted Lorentz-Finsler framework and extend the classical singularity theorems of general relativity. In order to reach this result, we generalize the Jacobi, Riccati and Raychaudhuri equations to weighted Finsler spacetimes and study their implications for the e…
The paper generalizes K-stability results to singular and weighted settings.
problem Generalizing K-stability to singular and weighted settings.
method Generalization of results in \cite{Li22a} to singular and weighted settings.
result The \(\mathbb{G}\)-uniform weighted K-stability for models implies \(\mathbb{G}\)-coercivity of the weighted Mabuchi functional.
New bound for neural networks with full-rank weights, independent of network width.
problem Understanding generalization of neural networks with full-rank weight matrices.
method Using Koopman operators to derive a tighter generalization bound for full-rank weight matrices.
result The bound is tighter than existing norm-based bounds when condition numbers are small.
Derives integral formulae on weighted manifolds.
problem No specific problem stated; focuses on mathematical derivations.
method Introduces weighted mean sigma-r curvature and uses weighted Newton transformations.
result Derives integral formulae generalizing previous work.
Develops theory of weightings for Lie groupoids and algebroids.
problem Understanding differential geometry of weightings for Lie groupoids and algebroids.
method Extending work on weighted manifolds, defining weighted submanifolds, and developing theories of linear weightings and multiplicative weightings.
result Characterizes infinitesimally multiplicative weightings for Lie algebroids and classifies multiplicative weightings of Lie groupoids.
A market portfolio is a portfolio in which each asset is held at a weight proportional to its market value. Functionally generated portfolios are portfolios for which the logarithmic return relative to the market portfolio can be decomposed into a function of the market weights and a process of locally finite variation…
The paper studies weighted Ricci curvatures and characterizes Randers metrics.
problem Characterizing Randers metrics with weighted Ricci curvatures.
method General weighted Ricci curvatures and characterization of Randers metrics.
result Characterization of Randers metrics with almost isotropic weighted Ricci curvatures.
A new model for detecting overlapping communities in weighted networks.
problem Community detection in overlapping weighted networks with mixed membership and edge weights.
method Mixed membership distribution-free (MMDF) model with an efficient spectral algorithm and fuzzy weighted modularity.
result The MMDF model can estimate community memberships and evaluate community quality for weighted networks.
We consider the tomography problem of recovering a covector field on a simple Riemannian manifold based on its weighted Doppler transformation over a family of curves Γ. This is a generalization of the attenuated Doppler transform. Uniqueness is proven for a generic set of weights and families of curves under a condi…
Improves feature selection in high-dimensional data using LLM-generated weights.
problem Inaccurate LLM-generated weights degrade feature selection performance.
method Integrates LLM-generated weights into prior inclusion probabilities using LLM Sparsity Prior (LSP).
result Improves prediction accuracy and identifies clinically relevant features.
New duality found linking neural network weights and activities for better generalization.
problem Understanding and improving neural network generalization.
method Activity-weight duality mapping between neural network layers.
result Generalization loss can be decomposed into geometric factors of sharpness and weight standard deviation.
Lo-Hp decouples weight generation into local and global policies to improve flexibility and efficiency.
problem Over-coupling and long-horizon issues in current optimization methods.
method Hybrid-Policy Sub-Trajectory Balance objective.
result Learning local optimization policies addresses long-horizon issues and enhances global weight generation.
Diffusion models accurately recover mixture weights from generated samples despite score function insensitivity.
problem Score-based generative models often fail to learn correct relative mode amplitudes (mixture weights) from generated samples.
method Relate diffusion score matching (DSM) loss to mixture weight estimation error, define diffusion score sensitivity index (DSSI), and prove its governing role in mixture weight recovery.
result Generated samples can accurately recover mixture weights from the DSM loss, even when the target score is insensitive to mixture weights.
New method calculates Ricci curvature from distances between weighted volumes.
problem Calculating Ricci curvature for weighted Riemannian manifolds.
method Asymptotic retrieval of generalized Ricci tensor from scaled metric derivatives of Wasserstein 1-distances.
result Limiting coarse curvature of random graphs converges to generalized Ricci tensor.
SGD and weight decay encourage neural networks to learn low-rank weight matrices.
problem The bias of SGD towards low-rank weight matrices in neural networks.
method The study investigates the effect of SGD and weight decay on the rank of weight matrices in neural networks, both theoretically and empirically.
result Training with SGD and weight decay induces a bias towards rank minimization in weight matrices, which becomes more pronounced with smaller batch sizes and stronger weight decay.
AWP improves robustness by flattening weight loss landscape.
problem Improving robustness of deep neural networks against adversarial examples.
method Explicitly regularizes the flatness of weight loss landscape through adversarial weight perturbation.
result AWP forms a double-perturbation mechanism in adversarial training, leading to flatter weight loss landscape.
In this paper, we generalize the CR Obata theorem for the Kohn Laplacian to a closed strictly pseudoconvex CR manifold with a weighted volume measure. More precisely, we first derive the weighted CR Reilly's formula associated with the weighted Kohn Laplacian and obtain the corresponding first eigenvalue estimate. With…
Corrects distribution shift in target shift scenarios using importance weighting.
problem Analyzes importance weighting for correcting distribution shift under target shift.
method Analyzed importance-weighted kernel ridge regression under target shift.
result Shows that importance weighting corrects the train-test mismatch without altering input-space complexity.
Machine learning approximates Calabi-Yau Hodge numbers from weight systems.
problem Approximating Hodge numbers of Calabi-Yau manifolds from weight systems.
method Neural networks learned Hodge numbers from weight systems, symbolic regression inspired truncation, and machine learning generated new datasets.
result Approximation provides tight lower bounds and dramatically faster computation.
Generative model initializes 2-layer network weights for small datasets.
problem Approximating functions with 2-layer networks using small datasets and gradient-based training.
method Initialize hidden weights with a learned proposal distribution parameterized as a deep generative model. Refine with gradient-based post-processing and regularization.
result Demonstrates effectiveness of the approach with numerical examples.
The study establishes comparison theorems for weighted Finsler manifolds and spacetimes.
problem Analyzing weighted Finsler manifolds and spacetimes with curvature conditions.
method Using weight function and ε-range, the Bonnet-Myers theorem, Laplacian comparison theorem, and Bishop-Gromov volume comparison theorem are formulated. result New comparison theorems for weighted Finsler manifolds and spacetimes are derived, including those for weighted Riemannian manifolds.
Proposes volumization for neural networks to control bias-variance tradeoff.
problem Improving generalization and preventing memorization in neural networks.
method Defines a physical volume for weights, interpolating between L2 and L∞ regularization.
result Volumization interpolates between weight decay and clipping, improving generalization.
Study of weighted nonlinear flags in symplectic geometry.
problem Understanding the geometry of weighted nonlinear flags.
method Generalizing weighted nonlinear Grassmannians to Frechet manifolds and using them to describe coadjoint orbits.
result Description of coadjoint orbits of Hamiltonian diffeomorphisms using weighted isotropic nonlinear flags.
Study weightings from singular Lie filtrations.
problem Generalize constructions for singular Lie filtrations.
method Study weightings arising from singular Lie filtrations.
result Generalizes constructions for (regular) Lie filtrations.
Sharp inequality on Siegel domain involving weighted norms and sub-Laplacian.
problem Establishing a Sobolev trace inequality on a specific domain.
method Using weighted norms and fractional powers of sub-Laplacian on Heisenberg group.
result Sharp Sobolev trace inequality on Siegel domain involving weighted norms.
The current paper deals with some new classes of Finsler metrics with reversible geodesics. We construct weighted quasi-metrics associated with these metrics. Further, we investigate some important geometric properties of weighted quasi-metric space. Finally, we discuss the embedding of quasi-metric spaces with general…
New invariants help solve existence of weighted cscK metrics.
problem Existence of weighted cscK metrics in K-stability.
method Introduced weighted analytic delta invariant and beta invariant.
result Sufficient condition for existence of weighted cscK metrics.
A new method uses nearest neighbors for importance weighting.
problem Data covariate shift problems in machine learning.
method Nearest neighbor classification scheme for determining importance weights.
result Demonstrated effectiveness through comparative experiments on various classification tasks.
Generative approach speeds hyperparameter tuning for machine learning models.
problem Computational infeasibility of cross-validation and difficulty of fully Bayesian hyper-parameter learning.
method Combines optimization-based approximations and amortization techniques.
result Rapid evaluation of hyper-parameters over grids or ranges, supporting predictive tuning and uncertainty quantification.
Develops a weighting framework to generalize ITRs from source to target populations.
problem Challenges in generalizing ITRs from a source population to a target population with differing characteristics.
method A robust sample weighting framework using a reproducing kernel Hilbert space to balance covariates and improve ITR learning methods.
result Improves ITR estimation for the target population compared to other weighting methods.
Improved neural networks by averaging late-stage weights.
problem Improving the performance of neural networks.
method Ensemble late-stage weights and average them.
result Augmenting standard models with late-phase weights improves generalization.
Proves invariance of weighted extremal Kähler metrics under smooth blowups.
problem Invariance of weighted extremal Kähler metrics under smooth blowups.
method Uniform coercivity estimate for the (relative, weighted) Mabuchi energy on blowups.
result Invariance of weighted extremal Kähler metrics under smooth blowups.
The Penrose theorem and Hawking's topology theorem are extended to weighted spacetimes.
problem Extending Penrose's singularity theorem and Hawking's topology theorem to weighted spacetimes.
method Using weighted null energy condition and synthetic dimension to generalize the theorems.
result Generalized versions of the Penrose and Hawking theorems hold under a weighted null energy condition.
This paper analyzes SGD with increasingly weighted averaging for optimization and generalization.
problem Improving optimization and generalization for non-strongly convex objectives.
method Comprehensive analysis of increasingly weighted averaging schemes for convex, strongly convex, and non-convex objectives.
result The weight α affects both optimization and generalization errors, revealing a trade-off. Survey on Kähler-Einstein and weighted solitons on Fano manifolds.
problem Existence of coupled Kähler-Einstein metrics and weighted solitons on Fano manifolds.
method Generalization of algebraic conditions for K-polystability.
result Existence of coupled Kähler-Einstein metrics and weighted solitons is equivalent to algebraic conditions.
Establishes Yau-Tian-Donaldson conjecture for weighted metrics.
problem Constant scalar curvature Kähler metrics on polarized projective manifolds.
method Extends Chi Li's work to weighted case, uses a priori estimates and slope formulas.
result Proves Yau-Tian-Donaldson conjecture for weighted extremal Kähler metrics.
Method identifies change points in high-dimensional models using sample weights.
problem Identifying change points in high-dimensional generalized linear models.
method Sample-weighted empirical risk minimization (Weighted ERM).
result Weighted ERM yields precise asymptotic performance characterization for Gaussian designs.
A new model for latent class analysis with weighted responses.
problem Limitation of latent class model for real-world data with continuous or negative responses.
method Proposed a novel generative model, the weighted latent class model (WLCM).
result The proposed WLCM is more realistic and general than the latent class model.
Real-world large-scale datasets usually contain noisy labels and are imbalanced. Therefore, we propose derivative manipulation (DM), a novel and general example weighting approach for training robust deep models under these adverse conditions. DM has two main merits. First, loss function and example weighting are commo…
DFM model detects communities in weighted networks without distributional assumptions.
problem Challenges in community detection for weighted networks.
method Distribution-Free Model (DFM) for weighted networks, using spectral clustering.
result Spectral clustering yields consistent community detection under DFM.
Kernel balancing weights are generalized as KRRR, providing better confidence intervals for treatment effects.
problem Lack of generalization error, correct feature specification, and limited to average effects.
method Interpreting kernel balancing weights as KRRR, relaxing feature specification, and extending Gaussian approximation.
result KRRR provides strong generalization properties and justifies confidence sets for causal functions.