Reservoir subspace injection improves online ICA by preserving injected features.
problem Discarding injected features in top- n n n whitening can degrade performance. method Formalized reservoir subspace injection (RSI) and developed diagnostics (IER, SSO, ρ_x) to identify and mitigate the failure mode.
result RSI controller preserves passthrough retention, improving performance by up to 2.2 dB.
Noise injection before gradient steps helps in regularization for neural networks.
problem Improving generalization in overparametrized neural networks.
method Injecting small noise perturbations before computing gradient steps, especially in layer-wise fashion.
result Small noise perturbations can explicitly regularize neural networks without variance explosion.
In this short note, we investigate some features of the space $\Inject{d}{m}$ of linear injective maps from $\bbR^d$ into $\bbR^m$ ; in particular, we discuss in detail its relationship with the Stiefel manifold V m , d V_{m,d} V m , d , viewed, in this context, as the set of orthonormal systems of d d d vectors in $\bbR^m$ . Finally, we…
This paper shows how integrating domain knowledge improves ML models for transprecision computing.
problem Improving ML models for transprecision computing with scarce or complex data.
method Injecting domain knowledge into neural networks through additional features, graph-based topology, and regularization schemes.
result ML models with domain knowledge outperform purely data-driven models by around 38%.
ESN model helps understand climate event impacts.
problem Understanding complex climate event impacts.
method Feature importance methods for ESNs on spatio-temporal climate data.
result Characterized relationships between Mount Pinatubo eruption variables.
Noise injection improves inference privacy in DNN models.
problem Malicious servers can infer sensitive attributes from input data.
method Adaptive Noise Injection (ANI) using a lightweight DNN on the client.
result Significant improvement in privacy (up to 48.5% degradation in sensitive-task accuracy with <1% degradation in primary accuracy).
New method for efficiently deleting data from ML models.
problem Efficiently removing data from trained ML models without retraining.
method Approximate deletion method for linear and logistic models.
result Significantly faster than existing methods, with linear time dependence on feature dimension.
New algorithm improves interpretability in sequence classification.
problem Lack of human-independent interpretability metrics in sequence classification.
method Combines linear classifiers with background knowledge embeddings to create a new feature space.
result Preserves predictive power while delivering more interpretable models.
Flexible VAEs using FIFs improve model likelihood on image datasets.
problem Limitations of diagonal Gaussian posteriors in VAEs.
method Regularized Free-form Injective Flow (FIF) for flexible posterior.
result Full covariance VAEs outperform diagonal Gaussian posteriors.
Optimal dividend strategy with ratcheting and capital injection under Cramér-Lundberg model.
problem Optimal dividend payout for an insurance company with ratcheting constraints and capital injections.
method Systematic probabilistic and PDE-based approach to solve HJB equation, constructing strong solution and optimal strategy.
result Existence and uniqueness of strong solution, explicit optimal feedback control strategy.
Enhances deep learning robustness to noise without sacrificing clean data accuracy.
problem Robustness of deep neural networks to input noise.
method Discriminative loss at penultimate layer and class-wise feature alignment with Gaussian noise.
result Improves robustness to various perturbations without degrading clean data accuracy.
Injectivity of ReLU networks is characterized for generative models and inverse problems.
problem Injectivity in ReLU networks for generative models and inverse problems.
method Layerwise analysis, worst-case Lipschitz constants, differential topology, random projections.
result Global injectivity of ReLU networks requires expansivity between 3.4 and 10.5 for Gaussian matrices.
New model optimizes oil product distribution via pipelines.
problem Optimizing oil product distribution via pipelines.
method Discrete-time mixed integer linear programming model.
result Significant reductions in pipeline operational cost.
Classifies π 1 π_1 π 1 -injective maps between non-compact surfaces.
problem Characterizing maps with injective fundamental groups.
method Proper homotopy classification of maps.
result All π 1 π_1 π 1 -injective proper maps are classified. Positive injectivity radius for manifolds with Lie structure at infinity.
problem Injectivity radius positivity for manifolds with specific boundary conditions.
method Lie groupoids to prove injectivity radius positivity.
result Injectivity radius is positive for manifolds with Lie structure at infinity.
Geometric analysis improves noise injection in GANs.
problem Unclear mechanism of noise injection in GANs.
method Geometric framework based on Riemannian geometry.
result A new strategy for noise injection is devised.
We propose Macau, a powerful and flexible Bayesian factorization method for heterogeneous data. Our model can factorize any set of entities and relations that can be represented by a relational model, including tensors and also multiple relations for each entity. Macau can also incorporate side information, specificall…
The paper analyzes optimal dividend and capital injection strategies under time-inconsistent preferences.
problem Optimal dividend and capital injection strategies under time-inconsistent preferences.
method Diffusion risk model with general discount functions, weak equilibrium definition, HJB equation system.
result Explicit solutions and threshold types of optimal strategies derived under different discount functions.
A new exploration strategy for contextual bandits reduces regret and is computationally efficient.
problem Improving exploration in contextual bandits to reduce regret.
method Feature perturbation, injecting randomness directly into feature inputs.
result Achieves i l d e O ( d T ) ilde{\mathcal{O}}(d\sqrt{T}) i l d e O ( d T ) worst-case regret bound, surpassing existing methods. A quasi-geodesic is Morse if and only if it is strongly contracting in injective spaces.
problem Characterizing Morse quasi-geodesics in injective spaces.
method Proving equivalence between Morse and strongly contracting quasi-geodesics.
result Injective metric spaces have the Morse local-to-global property and acylindrically hyperbolic groups with Morse elements.
High throughput sequencing techniques have highly impactedon modern biology, widening the gap between sequenced andannotated data. Automatic annotation tools are thereforeof the foremost importance to guide biologists' experiments. However, most of the state-of-the-art methods rely on annotation transfer, offering reli…
This paper connects noise injection to Bayesian inference for neural networks, improving model uncertainty.
problem Improving the reliability and confidence of neural network predictions through uncertainty quantification.
method Introducing noise into neural network parameters during training and inference to estimate prediction uncertainty.
result The MCNI method outperforms baseline models in regression and classification tasks.
Compact theorem for minimal surfaces with lower injectivity radius.
problem Proving compactness of minimal surfaces with lower injectivity radius.
method Variant of Choi--Schoen compactness theorem, focusing on injectivity radius.
result Proved compactness theorem for minimal surfaces.
Lecture notes on group actions on injective spaces and Helly graphs.
problem Understanding group actions on specific metric spaces.
method Review of injective metric spaces and Helly graphs, elementary properties, constructions, and exercises.
result Presentation of various constructions of injective metric spaces and Helly graphs with interesting group actions.
NoisyDARTS injects random noise to improve neural architecture search.
problem Performance collapse in Differentiable Architecture Search (DARTS).
method Inject unbiased random noise to skip connections to impede gradient flow.
result NoisyDARTS achieves state-of-the-art results across various tasks.
Proves polynomial injectivity of Fubini-Study map for ample line bundles.
problem Injectivity of Fubini-Study map for ample line bundles.
method Polynomial injectivity proof with polynomial dependence on ample line bundle exponent.
result Quantitative version of injectivity proved, polynomial in ample line bundle exponent.
Lower bound on boundary injectivity radius for specific tubes.
problem Estimating the boundary injectivity radius of Margulis tubes.
method Using curvature bounds to derive a lower bound.
result A lower bound on the boundary injectivity radius is provided.
Learning in adversarial settings is becoming an important task for application domains where attackers may inject malicious data into the training set to subvert normal operation of data-driven technologies. Feature selection has been widely used in machine learning for security applications to improve generalization a…
Injective and surjective neural operators for function spaces.
problem Tackles injective and surjective neural operators in function spaces.
method Combines prior work in ReLU and operator learning, uses Fredholm theory and Leray-Schauder degree theory.
result Injective and surjective neural operators are universal approximators and maintain their properties in finite-rank implementations.
Proposes a method to enhance graph models by injecting unseen connections.
problem Enhancing graph models to utilize unseen connections.
method Parametric link injection layer to find and inject weak connections.
result Improves performance on node classification and link prediction tasks.
The paper proves that certain spaces are injective and Helly graphs.
problem Understanding the structure of certain geometric and algebraic spaces.
method Building Helly graphs and injective metric spaces from lattices.
result The natural piecewise ℓ ∞ \ell^\infty ℓ ∞ metric on Euclidean buildings and Deligne complexes is injective. Smooths metrics on manifolds with curvature bounds and injectivity radius constraints.
problem Smooth metrics on manifolds with curvature and injectivity constraints.
method Bi-Lipschitz smoothing with controlled smoothing and volume lower bounds.
result Proves existence of smooth metrics with curvature bounds and injectivity radius constraints.
Nonuniform tubular neighborhoods of curves in Euclidean n-space are studied by using weighted distance functions and generalizing the normal exponential map. Different notions of injectivity radii are introduced to investigate singular but injective exponential maps. A generalization of the thickness formula is obtaine…
In this paper, we obtain two-sided bounds for the volumes of the Aloff-Wallach spaces W ( p , q ) , W(p,q), W ( p , q ) , compute maximal and minimal sectional curvature for the spaces W ( n , n + 1 ) , W(n,n+1), W ( n , n + 1 ) , and use this information to estimate the injectivity radii: We derive an upper bound for the injectivity radii of W ( p , q ) W(p,q) W ( p , q ) and a lower bound for the …
A large body of research is currently investigating on the connection between machine learning and game theory. In this work, game theory notions are injected into a preference learning framework. Specifically, a preference learning problem is seen as a two-players zero-sum game. An algorithm is proposed to incremental…
Injectivity of geodesic ray transform on specific Finsler manifolds proven.
problem Injectivity of geodesic ray transform on spherically symmetric reversible Finsler manifolds.
method Reduction to invertibility of generalized Abel transforms using angular Fourier series and Taylor expansions of geodesics.
result Injectivity of geodesic ray transform proven on specified Finsler manifolds.
Noise Injection probes deep learning dynamics during training phases.
problem Understanding the learning mechanism of deep neural networks.
method Noise Injection Nodes (NINs) are used to perturb DNN architectures without altering the optimization algorithm.
result Distinct training phases are observed based on the scale of injected noise.
Generalizes a soul-bound for noncompact Alexandrov spaces.
problem Finding a lower bound for injectivity radius in Alexandrov spaces.
method Introduces the soul of Alexandrov spaces and applies a generalized bound.
result Injectivity radius is at least πK⁻¹/² if not equal to the soul's.
Optimal control problem for firm cash flow with dividend and capital injection strategies.
problem Maximizing dividends while managing capital injections in a firm's cash flow.
method Proved two optimal strategies: mean-reverting dividends with capital injections or no injections until ruin.
result Optimal strategies are dichotomous: either mean-reverting dividends with injections or no injections.
A labeled oriented tree is called injective if each generator occurs at most once as an edge label. We show that injective labeled oriented trees are aspherical. The proof relies on a new relative asphericity test based on a lemma of Stallings.
The exponential map fails to be injective near critical points in sub-Riemannian geometry.
problem Injectivity failure of the exponential map at critical points in sub-Riemannian geometry.
method Analysis of the Hilbert invariant integral of the variational problem associated with the sub-Riemannian structure.
result Characterization of conjugate points in terms of metric structure.
Word metrics from large balls in injective spaces are exponentially generic and growth tight.
problem Understanding genericity and growth in word metrics from injective spaces.
method Geometric arguments and large ball considerations.
result Exponential genericity and growth tightness for word metrics.
Introduces injective category number for continuous maps, linking classical and contemporary research.
problem Understanding conditions for a continuous map to be injective.
method Defines injective category number and examines its behavior under various operations.
result Provides a cohomological lower bound and expressions for injective category numbers in specific cases.
The growing use of virtual autonomous agents in applications like games and entertainment demands better control policies for natural-looking movements and actions. Unlike the conventional approach of hard-coding motion routines, we propose a deep learning method for obtaining control policies by directly mimicking raw…
This paper analyzes deep and wide transformer training dynamics.
problem Understanding the training dynamics of infinitely deep and wide transformers.
method Develops a mean-field framework for gradient-based training of transformers, controlling a neural PDE.
result Establishes a rigorous foundation for gradient-based transformer training, proving convergence to global minima.
It has been shown that injecting noise into the neural network weights during the training process leads to a better generalization of the resulting model. Noise injection in the distributed setup is a straightforward technique and it represents a promising approach to improve the locally trained models. We investigate…
We give lower bounds on the maximal injectivity radius for a closed orientable hyperbolic 3-manifold M with first Betti number 2, under some additional topological hypotheses. A corollary of the main result is that if M has first Betti number 2 and contains no fibroid surface then its maximal injectivity radius exceeds…
Upper bound on Stiefel manifold's injectivity radius found.
problem Finding the maximum distance within which the Stiefel manifold remains injective.
method Exhibited conjugate points and calculated the minimum of geodesic lengths.
result Upper bound on Stiefel manifold's injectivity radius is conjectured to be equal to the injectivity radius.