For a system of second order differential equations we determine a nonlinear connection that is compatible with a given generalized Lagrange metric. Using this nonlinear connection, we can find the whole family of metric nonlinear connections that can be associated with a system of SODE and a generalized Lagrange struc…
Study nonlinear flags as coadjoint orbits of Hamiltonian diffeomorphisms.
problem Geometry of nonlinear flags and their coadjoint orbits.
method Generalization of nonlinear Grassmannians to Frechet manifolds.
result Description of symplectic nonlinear flags as coadjoint orbits.
New framework IIA identifies innovations in general nonlinear vector autoregressive processes.
problem Limited generality of NVAR models due to additive innovation assumption.
method Independent Innovation Analysis (IIA) framework, assuming mutual independence and modulation by an auxiliary variable.
result Guarantees identifiability of innovations with arbitrary nonlinearities, up to permutation and component-wise invertible nonlinearities.
Study of weighted nonlinear flags in symplectic geometry.
problem Understanding the geometry of weighted nonlinear flags.
method Generalizing weighted nonlinear Grassmannians to Frechet manifolds and using them to describe coadjoint orbits.
result Description of coadjoint orbits of Hamiltonian diffeomorphisms using weighted isotropic nonlinear flags.
Optimized nonlinearities enhance generalization in random feature models.
problem Improving generalization performance in random feature models.
method Analyzed and defined optimal nonlinearities from Gaussian model parameters.
result Optimized nonlinearities achieve better generalization performance than ReLU.
Introduces nonlinear splittings on fibre bundles for generalizing connections.
problem Generalizing connections on fibre bundles.
method Definition and properties of nonlinear splittings, including affine, homogeneous, and principal splittings.
result Curvature map defined for nonlinear splittings, linking to nonholonomic systems and magnetic Lagrangian systems.
Extends importance sampling to nonlinear models using adjoint operators.
problem Lack of tools for identifying important data points in nonlinear models.
method Introduces adjoint operator for nonlinear maps, generalizes norm and leverage scores.
result Generalized scores provide approximation guarantees for nonlinear mappings.
The paper develops adaptive deep learning methods for nonlinear time series models.
problem Estimating mean functions of non-stationary and nonlinear time series models.
method Develops non-penalized and sparse-penalized DNN estimators for general non-stationary time series, derives minimax lower bounds, and shows the sparse-penalized DNN estimator is adaptive and optimal.
result Sparse-penalized DNN estimator achieves minimax optimal rates for many nonlinear AR models.
The paper proves neural network identifiability for a broad range of nonlinearities.
problem Can a neural network's architecture, weights, and biases be uniquely determined by its input-output map?
method Derive necessary genericity conditions for identifiability of neural networks of arbitrary depth and connectivity with an arbitrary nonlinearity.
result Construct a family of nonlinearities for which these genericity conditions are minimal, necessary, and sufficient.
A new framework for nonlinear ICA using auxiliary variables and contrastive learning.
problem Recovering underlying latent variables from data.
method Augmenting data with auxiliary variables and using contrastive learning for identification.
result General theoretical framework and practical algorithm for nonlinear ICA.
The main purposes of this article are to extend our previous results on homogeneous sprays to arbitrary (generalized) sprays, to show that locally diffeomorphic exponential maps can be defined for any (generalized) spray, and to give a (possibly nonlinear) covariant derivative for any (possibly nonlinear) connection. I…
Generalizes Fenchel conjugation to nonlinear functions on arbitrary sets.
problem Extending Fenchel conjugation to functions on arbitrary sets without structure.
method Replacing linear test functions with nonlinear ones, investigating properties including biconjugation.
result Derived further results on smooth manifolds and Lie groups, relating to convexity.
This research highlights the secrecy potential of nonlinear generative models and their all-or-nothing phase transition.
problem Secrecy potential of nonlinear generative models in statistical learning.
method Replica method to derive asymptotic normalized cross entropy and statistical decoupling of Bayesian estimator.
result Strictly nonlinear models exhibit an all-or-nothing phase transition, leading to perfect secrecy.
Study solves inverse problems for equations with fractional nonlinearities.
problem Solving inverse problems for semilinear elliptic equations with fractional power nonlinearities.
method Higher order linearization method adapted for fractional order.
result Results of previous studies remain valid for general power nonlinearities.
The paper provides estimates for positive solutions to a nonlinear equation under geometric flow.
problem Analyzing positive solutions to a nonlinear equation under geometric flow.
method Gradient estimates for positive solutions under geometric flow on manifolds.
result Gradient estimates for positive solutions to a nonlinear equation under geometric flow.
Paper presents a new backward deep BSDE method for solving nonlinear FBSDE problems.
problem Nonlinear Forward Backward Stochastic Differential Equations (FBSDE) with terminal conditions.
method Backward deep BSDE method applied to FBSDE with nonlinear generators and random initial conditions.
result Derives exact and Taylor-based approximations for time-stepping nonlinear BSDEs.
We establish a general Liouville type theorem for conformally invariant fully nonlinear equations.
We present some results on a fully nonlinear version of the Yamabe problem and a Harnack type inequality for general conformally invariant fully nonlinear second order elliptic equations.
New methods for constructing submersions between different types of spaces.
problem Creating submersions between Euclidean, Minkowski, and Finsler spaces.
method Homogeneous nonlinear splittings and nonlinear lifts.
result New examples of Finsler functions on reductive homogeneous spaces.
The paper extends Li-Yau-Hamilton estimates to evolving Kähler metrics and nonlinear heat equations.
problem Deriving estimates for nonlinear heat equations on evolving Kähler metrics.
method Generalized matrix Li-Yau-Hamilton estimates to Kähler manifolds with evolving metrics and nonlinear heat equations.
result Extended Li-Yau-Hamilton estimates to evolving Kähler metrics and nonlinear heat equations.
PGD algorithms solve nonlinear inverse problems with generative priors using noisy measurements.
problem Signal estimation from noisy nonlinear measurements with generative priors.
method Projected gradient descent algorithms for two cases: unknown and known nonlinearity.
result PGD algorithms converge linearly to optimal statistical rates using arbitrary initialization.
Two new Koopman models improve nonlinear system prediction.
problem Predicting nonlinear, nonconvex dynamic systems.
method Convex and Extended Koopman Models using deep learning.
result Significantly improved predictive performance.
The study sets limits on how well nonlinear models can generalize from training data.
problem Understanding the limits of generalization for nonlinear learning models.
method Deriving explicit generalization lower bounds for multi-layer neural networks and linear regression.
result Explicit bounds for general biased estimators in nonlinear networks, showing unacceptable performance for unbiased estimators.
Abstract: Nonlinear random walk with distributionally robust transition probabilities.
problem Modeling nonlinear random walks with robust transition probabilities.
method Scaling limit and nonlinear semigroup approach.
result Explicit computation of the generator and corresponding PDE.
Causal Mosaic distinguishes cause from effect using nonlinear ICA and ensemble methods.
problem Distinguishing cause from effect in bivariate settings.
method Nonlinear ICA and ensemble framework (Causal Mosaic).
result Causal Mosaic shows state-of-the-art performance on artificial and real-world datasets.
Unified probabilistic framework for nonlinearities in neural networks.
problem Lack of a unified approach to incorporating nonlinearities in neural networks.
method Doubly truncated Gaussian distributions for generating various nonlinearities.
result Performance improvements in RBM, temporal RBM, and TGGM when nonlinearities are learned alongside weights.
Bayesian method improves predictions in overparameterized nonlinear regression.
problem Understanding overparameterization in nonlinear regression models.
method Bayesian framework with adaptive prior considering data spectral structure.
result Posterior contraction established for generalized linear and single-neuron models, demonstrating prediction consistency.
MC-MCL improves MCL for nonlinear clustering.
problem Nonlinear clustering in data science.
method MC-MCL combines MCL with Minimum Curvilinearity for nonlinear distances.
result MC-MCL outperforms classical MCL and baseline clustering algorithms in nonlinear datasets.
The geometry of the target space of an N=(2,2) supersymmetry sigma-model carries a generalized Kahler structure. There always exists a real function, the generalized Kahler potential K, that encodes all the relevant local differential geometry data: the metric, the B-field, etc. Generically this data is given by nonlin…
Develops a new method for nonlinear dimension reduction using random features.
problem Statistical challenges in generalizing Gaussian process-based latent variable models to non-Gaussian data.
method Random feature latent variable models (RFLVMs) that approximate nonlinear relationships with linear functions of random features.
result RFLVMs produce comparable results to state-of-the-art methods on various data types.
New methods generalize nonlinear ICA beyond structural sparsity.
problem Identify true latent sources from nonlinear mixtures without structural sparsity assumptions.
method Propose identifiability results for undercomplete, partial sparsity, and flexible grouping structures.
result Prove identifiability in general settings of undercompleteness, partial sparsity, and flexible grouping structures.
The paper studies fully nonlinear equations on Hermitian manifolds, proving existence and interior estimates.
problem Proving existence and interior estimates for fully nonlinear equations on Hermitian manifolds.
method Derives interior estimates and establishes the existence of smooth solutions for the Dirichlet problem and equations on closed manifolds.
result Derives interior estimates and establishes the existence of smooth solutions for the Dirichlet problem and equations on closed manifolds.
Develops VAEs for learning complex physical systems from data.
problem Learning low-dimensional representations of nonlinear physical systems.
method Variational Autoencoders with manifold latent spaces.
result Effective in learning nonlinear Burgers equation and constrained mechanical systems.
We establish a microscopic convexity principle for nonlinear elliptic and parabolic partial differential equations in general form.
We consider filtration consistent nonlinear expectations in probability spaces satisfying only the usual conditions and separability. Under a domination assumption, we demonstrate that these nonlinear expectations can be expressed as the solutions to Backward Stochastic Differential Equations with Lipschitz continuous …
Proposes a new filtering method for dynamical systems that relaxes Gaussian and affine assumptions.
problem Inferring states of dynamical systems from observations with Gaussian and affine assumptions.
method Relaxes Gaussian and affine assumptions using deep, nonlinear, non-Gaussian models.
result Significant advantage over Gaussian Filtering and nonlinear fixed kernels.
The paper provides a non-asymptotic error bound for linear system identification under nonlinear policies.
problem System identification for linear systems with nonlinear and/or time-varying policies under i.i.d. random excitation noises.
method Least square estimation with non-asymptotic error bound for bounded state and action trajectories.
result The error bound is consistent with linear policies and generalizes existing guarantees.
Characterizes Hessian eigenspectra for realistic nonlinear models.
problem Understanding Hessian eigenspectra in realistic nonlinear models.
method Deterministic equivalent techniques from random matrix theory.
result Hessian can have qualitatively different spectral behaviors.
New method identifies latent sources from nonlinear mixtures without auxiliary variables.
problem Identifying latent sources from nonlinear mixtures without additional information.
method Structural Sparsity assumptions on the mixing process.
result Latent sources can be identified up to permutation and transformation.
Enhances learning of structured distributions using nonlinear denoising score matching.
problem Learning structured distributions from noisy data.
method Latent Nonlinear Denoising Score Matching (LNDSM) integrating nonlinear dynamics with VAE-based latent score matching.
result LNDSM achieves superior sample quality and variability compared to structure-agnostic methods.
The paper proves gradient estimates for nonlinear parabolic equations on smooth metric measure spaces.
problem Proving gradient estimates for nonlinear parabolic equations on smooth metric measure spaces.
method Using Souplet-Zhang type estimates and properties of Bakry-Emery Ricci tensor and weighted mean curvature.
result Gradient estimates for nonlinear parabolic equations on smooth metric measure spaces with Dirichlet boundary condition.
Study Higgs sections and flat sections for nonlinear harmonic bundles.
problem Equivalence of Higgs and flat sections for nonlinear harmonic bundles.
method Analyze harmonic vector bundles, generalize to sub-fibrations and morphisms.
result Vanishing of a degree obstruction for general nonlinear harmonic bundles.
New method for nonlinear filtering and smoothing using factor graphs.
problem Handling deterministic nonlinear transformations in factor graphs.
method Approximate Gaussian message passing rules for factor graphs with Markov property.
result Proposed nonlinear modified Bryson-Frazier smoother.
We discuss smooth nonlinear control systems with symmetry. For a free and proper action of the symmetry group, the reduction of symmetry gives rise to a reduced smooth nonlinear control system. If the action of the symmetry group is only proper, the reduced nonlinear control system need not be smooth. Using the smooth …
The paper provides gradient estimates for nonlinear heat-type equations on smooth metric measure spaces.
problem Proving gradient estimates for nonlinear heat-type equations on smooth metric measure spaces.
method Using Hamilton type and Li-Yau type estimates, the paper proves gradient estimates on positive solutions to generalized nonlinear parabolic equations on smooth metric measure spaces with compact boundary.
result Gradient estimates for nonlinear heat-type equations on smooth metric measure spaces.
Proposes iCaRL for nonlinear OOD generalization in causal settings.
problem Machine learning systems fail to generalize to new environments.
method iCaRL, leveraging exponential family distributions and causal discovery.
result Generalization guarantees in nonlinear settings for both representations and classifiers.
This paper concerns local gradient estimates to solutions of general conformally invariant fully nonlinear elliptic equations of second order.
Higher order anisotropic superspaces are constructed as generalized vector superbundles provided with compatible nonlinear connection, distinguished connection and metric structures.