Unified probabilistic framework for nonlinearities in neural networks.
problem Lack of a unified approach to incorporating nonlinearities in neural networks.
method Doubly truncated Gaussian distributions for generating various nonlinearities.
result Performance improvements in RBM, temporal RBM, and TGGM when nonlinearities are learned alongside weights.
Study decay and compact support of solutions to certain nonlinear PDEs.
problem Decay and compact support properties of positive solutions to Δpu≥Λ(u) on manifolds. method Nonlinear PDE analysis, Feller property, integral Ricci curvature conditions.
result Characterization of stochastic completeness for the p-Laplacian. Modeling market impacts leads to perfect hedging strategies.
problem Trading with permanent market impacts and nonlinearity.
method Modeling market impacts using g-expectation and nonlinear stochastic integrals; introducing completeness condition for perfect replication.
result Under certain conditions, derivatives can be perfectly hedged dynamically.
New algorithm optimizes nonlinear SDEs online with convergence guarantees.
problem Optimizing nonlinear stochastic differential equations (SDEs) is computationally challenging.
method Forward propagation algorithm that solves an SDE derived using forward differentiation.
result Convergence theorem for nonlinear dissipative SDEs with bounds on stochastic fluctuations.
Algorithm samples constrained stochastic differential equations.
problem Sampling stochastic differential equations with complex constraints.
method Pathspace Metropolis-adjusted manifold sampling.
result Demonstrated effectiveness in various constrained conditions.
Gradient descent and SGD solve nonlinear inverse problems efficiently.
problem Solving nonlinear inverse problems with random design.
method Gradient descent and SGD with mini-batching, under classical assumptions.
result Achieves optimal convergence rates in RKHS framework.
The paper tackles data-driven optimal control of unknown nonlinear systems using RKHS.
problem Unknown nonlinear dynamics and stage cost functions.
method Embed state densities into RKHS, learn Markov operators, solve Hamilton-Jacobi-Bellman recursions.
result Solves a wide range of nonlinear control problems, including depth regulation.
A new flow-based Bayesian filter tackles high-dimensional nonlinear stochastic systems.
problem Bayesian filtering for high-dimensional nonlinear systems is challenging due to non-Gaussian distributions and computational limitations.
method Integrates normalizing flows to construct a latent linear state-space model with efficient density estimation and sampling.
result Demonstrates superior accuracy and efficiency in numerical experiments.
Study shows Skorokhod insider outperforms forward insider in logarithmic utility maximization.
problem Maximizing logarithmic utility for an insider with different anticipating techniques.
method Comparison of Russo-Vallois forward and Skorokhod integrals.
result Skorokhod insider outperforms forward insider in logarithmic utility maximization.
New deep learning method solves complex BSDEs efficiently.
problem Solving high-dimensional nonlinear BSDEs.
method Reformulate as global optimization, approximate solution with deep neural network, globally minimize quadratic local loss functions.
result Demonstrated effectiveness on various high-dimensional nonlinear BSDEs, including finance applications.
We propose a new cognitive framework for option price modelling, using quantum neural computation formalism. Briefly, when we apply a classical nonlinear neural-network learning to a linear quantum Schrödinger equation, as a result we get a nonlinear Schrödinger equation (NLS), performing as a quantum stochastic filter…
Paper extends a method to estimate Hurst parameter for rough stochastic volatility models.
problem Estimating Hurst parameter of rough stochastic volatility models from discrete observations.
method Extends a scale-invariant estimator to a general nonlinear function.
result Consistent estimation of Hurst parameter for a wide class of rough stochastic volatility models.
Paper develops methods for solving complex stochastic equations using Malliavin calculus.
problem Existence, uniqueness, and regularity of solutions to BSVIEs.
method Malliavin calculus for tackling diagonal processes and nonlinear dependence.
result Developed well-posedness results for BSVIEs, including probabilistic interpretation of PDEs and portfolio optimization.
Develops a framework for learning nonlinear operators using Mercer kernels.
problem Learning nonlinear operators between infinite-dimensional spaces.
method Stochastic approximation framework with Mercer operator-valued kernels.
result Establishes dimension-free polynomial convergence rates for nonlinear operator learning.
Reduces path integrals for interacting systems using dependent coordinates.
problem Reducing path integrals for systems with symmetry.
method Reduction procedure based on Wiener-type path integral, optimal nonlinear filtering, and projection of mean curvature vector field.
result Shows non-invariance of the measure in the path integral under reduction and generates the Jacobian.
Deep learning model simulates noisy dynamical systems without distributional assumptions.
problem Simulating noisy dynamical systems with unknown distributional properties.
method DE-LSTM model using LSTM network for multi-label classification and penalized maximum log likelihood.
result DE-LSTM makes accurate predictions of probability distributions for noisy dynamical systems.
Paper develops a novel approach for optimal control using kernel methods.
problem Optimal control of nonlinear stochastic systems.
method Infinitesimal generator approach in reproducing kernel Hilbert spaces.
result Data-driven solution to optimal control problems.
New findings show ETO outperforms IEO in well-specified models with sufficient data.
problem Comparing estimate-then-optimize (ETO) and integrated-estimation-optimization (IEO) methods in stochastic optimization.
method Analyzes the performance of ETO and IEO in well-specified and misspecified models using stochastic dominance.
result Simple ETO outperforms IEO asymptotically in well-specified models with sufficient data.
Paper solves complex stochastic control problems with a new algorithm.
problem Non-Markovian stochastic optimal control with semilinear SHJB equations.
method Policy-iteration algorithm based on successive linearization.
result Approximation sequence converges monotonically to the value function with exponential rate.
A new algorithm solves high-dimensional nonlinear BSDEs efficiently.
problem Solving high-dimensional nonlinear backward stochastic differential equations (BSDEs).
method Transformed BSDE into a differential deep learning problem using Malliavin calculus. Discretized integrals using Euler-Maruyama method. Approximated solution with three deep neural networks. Optimized parameters using a differential learning loss function.
result Our algorithm is more accurate and faster than other methods.
New method scales Bayesian inference for nonlinear SSMs using buffered stochastic gradient.
problem Inference for nonlinear, non-Gaussian SSMs is computationally challenging and particle degeneracy increases with longer series.
method Extends stochastic gradient MCMC to nonlinear SSMs using particle methods and error bounds.
result Demonstrates the importance of particle buffered stochastic gradient for long sequential data.
NKI integrates obfuscated datasets using nonlinear kernels for improved data collaboration.
problem Privacy-preserving data collaboration with reduced reconstruction risk.
method Formulates linear kernel integration, kernelizes it, and introduces graph regularization and centering constraints.
result NKI improves classification accuracy over existing linear integration methods under nonlinear dimensionality reduction.
The nonlinear equations describing all the nonsingular pencils of metrics of constant Riemannian curvature are derived and the integrability of these nonlinear equations by the method of inverse scattering problem is proved. It is proved that all the nonsingular pairs of compatible metrics of constant Riemannian curvat…
Stochastic VB improves nonlinear model inference speed and accuracy.
problem Bayesian inference of nonlinear models from noisy data.
method Stochastic Variational Bayesian (VB) inference for nonlinear models.
result Stochastic VB achieves comparable parameter recovery to analytical solution but is faster.
New methods solve complex equations using neural networks.
problem Long-time integration of nonlinear stochastic PDEs.
method Physics-Informed Neural Networks (PINNs) with dynamically orthogonal (DO) and bi-orthogonal (BO) constraints.
result Overcomes limitations of original DO/BO methods and can handle inverse problems.
NoLimits.jl: Flexible and Composable Nonlinear Mixed-Effects Modeling in Julia
problem Flexible and composable nonlinear mixed-effects modeling
method Macro-based modeling language and unified interface
result Substantially expand the range of nonlinear mixed-effects models
Method solves complex optimization problems with high probability bounds.
problem Nonlinear equality constrained stochastic optimization problems.
method Step-search sequential quadratic programming method.
result High-probability bound on iteration complexity for first-order stationarity.
The paper establishes Harnack inequalities for solutions of nonlinear parabolic equations on manifolds with integral Ricci curvature bounds.
problem Analyzing solutions of nonlinear parabolic equations on manifolds with specific curvature constraints.
method Establishing space-time gradient estimates and integrating them to find Harnack inequalities.
result Harnack inequalities for positive solutions of nonlinear parabolic equations under integral Ricci curvature bounds.
New framework for managing medical risks using convex responses.
problem Medical risk management and dosing optimization.
method Analyzes convex and concave dose-response functions, defines antifragility.
result Proposes a mathematical framework for integrating nonlinearities in oncology.
Proposes a new method combining Reservoir Computing and Normalizing Flow for predicting stochastic dynamical systems.
problem Predicting and capturing long-term behaviors of stochastic dynamical systems.
method Data-driven framework combining Reservoir Computing and Normalizing Flow, integrating error modeling and both approaches virtues.
result Successfully predicts the long-term evolution of stochastic dynamical systems and replicates dynamical behaviors.
We develop from basic economic principles a continuous-time model for a large investor who trades with a finite number of market makers at their utility indifference prices. In this model, the market makers compete with their quotes for the investor's orders and trade among themselves to attain Pareto optimal allocatio…
Fractionally integrated generalized autoregressive conditional heteroskedasticity (FIGARCH) arises in modeling of financial time series. FIGARCH is essentially governed by a system of nonlinear stochastic difference equations ut = zt $(1-\sum\limits_{j=1}^q β_j L^j)σ_{t}^2 = ω+(1-\sum\limits_{j=1}^q β_j L^j -…
We study a doubly reflected backward stochastic differential equation (BSDE) with integrable parameters and the related Dynkin game. When the lower obstacle L and the upper obstacle U of the equation are completely separated, we construct a unique solution of the doubly reflected BSDE by pasting local solutions and…
We consider a stochastic control problem for a class of nonlinear kernels. More precisely, our problem of interest consists in the optimisation, over a set of possibly non-dominated probability measures, of solutions of backward stochastic differential equations (BSDEs). Since BSDEs are nonlinear generalisations of the…
The paper characterizes stochastic incompleteness in Riemannian manifolds.
problem Stochastic incompleteness of Riemannian manifolds and its characterization.
method Characterization through solutions to nonlinear parabolic equations.
result Stochastic incompleteness is equivalent to the nonuniqueness of bounded solutions to certain nonlinear parabolic equations.
New algorithm tackles stochastic optimization with inequality constraints.
problem Stochastic optimization with inequality constraints in various applications.
method Active-set stochastic sequential quadratic programming (StoSQP) with a differentiable exact augmented Lagrangian.
result Global convergence for any initialization, KKT residuals converge to zero almost surely.
Develops interpretable model for latent stochastic systems from noisy data.
problem Learning interpretable models of latent stochastic dynamical systems from noisy data.
method Semi-parametric model using Gaussian process for drift, inference of latent paths with sparse variational description.
result Flexible nonparametric model of dynamics with interpretable portraits.
We investigate large changes, bursts, of the continuous stochastic signals, when the exponent of multiplicativity is higher than one. Earlier we have proposed a general nonlinear stochastic model which can be transformed into Bessel process with known first hitting (first passage) time statistics. Using these results w…
DeepRSCN models nonlinear systems using stochastic configurations.
problem Modeling nonlinear dynamic systems efficiently.
method Incrementally constructed deep reservoir computing framework with random parameters and online weight updates.
result DeepRSCN outperforms single-layer networks in efficiency, learning, and generalization.
We scale and analyze the empirical data of return from New York and Vilnius stock exchanges matching it to the same nonlinear double stochastic model of return in financial market.
Method uses deep learning to estimate traffic intensity.
problem Estimating stochastic intensity of traffic processes.
method Deep neural networks for nonlinear filtering.
result Deep learning method accurately estimates traffic intensity.
Paper characterizes equilibrium strategies for stochastic control with higher-order moments.
problem Stochastic control problems with higher-order moments.
method Novel characterization of time-consistent control problems, deriving equilibrium conditions via BSDEs.
result Derives sufficient and necessary conditions for an open-loop Nash equilibrium control (ONEC) in a novel way.
The paper studies frequency monotonicity for solutions of nonlinear equations under Ricci flow.
problem Frequency monotonicity for positive solutions of nonlinear equations under Ricci flow.
method Obtained parabolic frequency monotonicity for solutions of two nonlinear parabolic equations with bounded Ricci curvature.
result Established integral type Harnack inequalities using parabolic frequency monotonicity.
We describe the innovations in finances, introduced over the recent decades, and analyze most of the business and regulatory challenges, faced by the financial industry, because of the present disruptive changes in the global capital markets. We use the integrative thinking approach to formulate the new central bank st…
Analyzes explaining nonlinear model predictions.
problem Understanding the contribution of inputs to outputs in nonlinear models.
method Merges integrated gradient and deep Taylor decomposition methods.
result Provides a natural reference point for model at use.
This paper examines a Markovian model for the optimal irreversible investment problem of a firm aiming at minimizing total expected costs of production. We model market uncertainty and the cost of investment per unit of production capacity as two independent one-dimensional regular diffusions, and we consider a general…
Online learning improves state estimation of nonlinear systems.
problem Online learning of nonlinear state dynamics in Gaussian state space models.
method Stochastic variational sparse Gaussian process embedded in a particle filter framework, with model updating using stochastic gradient descent.
result State estimation performance significantly improves with online learning of state dynamics.
Dyna optimizes momentum for stochastic optimization of neural networks.
problem Optimizing neural networks with momentum for stochastic optimization.
method Introduces fictitious mass to regularize adaptive stepsize in momentum gradient descent.
result Promises improved performance and convergence in preliminary trials.