Non-Markovian point process shows power-law scaling, similar to nonlinear Markovian process.
problem Understanding the scaling behavior of non-Markovian point processes.
method Analyzed a confined fractional Brownian motion-driven point process and compared it to a nonlinear Markovian process.
result A nonlinear Markovian process can reproduce the power-law scaling behavior of a non-Markovian point process.
Study solves inverse problems for equations with fractional nonlinearities.
problem Solving inverse problems for semilinear elliptic equations with fractional power nonlinearities.
method Higher order linearization method adapted for fractional order.
result Results of previous studies remain valid for general power nonlinearities.
Improved neural network training for speech recognition using power-law nonlinearity and uniform distribution criterion.
problem Stability and uniformity of feature distribution in neural network training.
method Power-function based and histogram-based Maximum Uniformity of Distribution (MUD) algorithms.
result Power-function based MUD outperforms conventional MFCCs in speech recognition systems.
Auto-regressive conditionally heteroskedastic (ARCH) family models are still used, by practitioners in business and economic policy making, as a conditional volatility forecasting models. Furthermore ARCH models still are attracting an interest of the researchers. In this contribution we consider the well known GARCH(1…
Many problems in machine learning and statistics can be formulated as (generalized) eigenproblems. In terms of the associated optimization problem, computing linear eigenvectors amounts to finding critical points of a quadratic function subject to quadratic constraints. In this paper we show that a certain class of con…
Exact asymptotic solutions found for nonlinear Hawkes processes.
problem Analytical solutions for nonlinear Hawkes processes with positive and negative feedbacks.
method Field master equation approach to classify steady-state solutions.
result Explicit power law formulas for steady-state intensity distributions Pss(λ)∝λ−1−a, with a as a function of parameters. We introduce a method for solving Calderón type inverse problems for semilinear equations with power type nonlinearities. The method is based on higher order linearizations, and it allows one to solve inverse problems for certain nonlinear equations in cases where the solution for a corresponding linear equation is not…
Power system studies require the topological structures of real-world power networks; however, such data is confidential due to important security concerns. Thus, power grid synthesis (PGS), i.e., creating realistic power grids that imitate actual power networks, has gained significant attention. In this letter, we cas…
The study finds that only round spheres shrink self-similarly under certain curvature flows.
problem Investigating self-similar solutions to curvature flows by high powers of curvature.
method Analyzing closed strictly convex hypersurfaces in Rn+1 under specific curvature flows. result Only round spheres shrink self-similarly under the studied curvature flows.
Optimal trading strategy derived for nonlinear price impact models.
problem Optimal trading with nonlinear price impact induced by alpha signals.
method Variational approach, nonlinear Fredholm equation, iterative scheme.
result Existence and uniqueness of optimal trading strategy under monotonicity condition.
The paper examines how nonlinear transformations affect ridge sets in manifold learning.
problem Understanding the impact of nonlinear transformations on ridge sets in manifold learning.
method Examined the effects of nonlinear transformations on ridge sets using mathematical proofs and numerical experiments.
result The inclusion relationship $\cR(f\circ p)\subseteq \cR(p)$ holds for strictly increasing and concave transformations, and the Hausdorff distance between transformed and non-transformed ridge sets is smaller.
We prove the concavity of p-Rényi entropy power for positive solutions to the doubly nonlinear diffusion equations on Rn or compact Riemannian manifolds with nonnegative Ricci curvature. As applications, we give new proofs of the sharp Lp-Sobolev inequality and Lp-Gagliardo-Nirenberg inequalities on…
Power and reproducibility are key to enabling refined scientific discoveries in contemporary big data applications with general high-dimensional nonlinear models. In this paper, we provide theoretical foundations on the power and robustness for the model-free knockoffs procedure introduced recently in Candès, Fan, Jans…
New mechanism found for power laws including Zipf's law.
problem Understanding the ubiquity of power law distributions.
method Introduced nonlinear self-excited Hawkes processes with fast-accelerating intensities.
result Wide class of nonlinear Hawkes processes have power law intensity PDFs.
Probabilistic optimal power flow (POPF) is an important analytical tool to ensure the secure and economic operation of power systems. POPF needs to solve enormous nonlinear and nonconvex optimization problems. The huge computational burden has become the major bottleneck for the practical application. This paper presen…
Study short-term wind power and speed predictions using machine learning.
problem Accurate short-term wind power and speed predictions for energy systems.
method Combining numerical weather prediction models with local observations, using machine learning for variable selection and forecasting.
result Improved wind power and speed predictions for 4-hour ahead using machine learning.
Distributions derived from non-extensive Tsallis statistics are closely connected with dynamics described by a nonlinear Fokker-Planck equation. The combination shows promise in describing stochastic processes with power-law distributions and superdiffusive dynamics. We investigate intra-day price changes in the S&P500…
We present some new ideas to derive {\em a priori} second order estiamtes for a wide class of fully nonlinear parabolic equations. Our methods, which produce new existence results for the initial-boundary value problems in $\bfR^n$, are powerful enough to work in general Riemannian manifolds.
Large models follow power laws in performance with dataset size or parameters.
problem Understanding neural scaling laws in large language models.
method Joint generative data model and random feature model.
result Modeling and solving the dual limit reveals insights into scaling laws.
Kernel methods are powerful tools to capture nonlinear patterns behind data. They implicitly learn high (even infinite) dimensional nonlinear features in the Reproducing Kernel Hilbert Space (RKHS) while making the computation tractable by leveraging the kernel trick. Classic kernel methods learn a single layer of nonl…
In this paper we introduce a simple continuous-time asset pricing framework, based on general multi-dimensional diffusion processes, that combines semi-analytic pricing with a nonlinear specification for the market price of risk. Our framework guarantees existence of weak solutions of the nonlinear SDEs under the physi…
Optimizes power systems with energy storage under uncertainty using scenario-based method.
problem Optimizing power systems with energy storage, intermittent renewable generation, and uncontrollable loads under uncertainty.
method Developed a novel solution method based on scenario optimization and strategic sampling to solve the chance-constrained optimal power system operation problem.
result The strategic sampling method significantly improves computational efficiency and data-driven convex approximation of power flow.
Graph neural networks (GNNs) have emerged as a powerful tool for nonlinear processing of graph signals, exhibiting success in recommender systems, power outage prediction, and motion planning, among others. GNNs consists of a cascade of layers, each of which applies a graph convolution, followed by a pointwise nonlinea…
Global solutions found for certain reaction-diffusion equations on specific manifolds.
problem Understanding reaction-diffusion equations on various manifolds.
method Analyzing the bottom of the L2 spectrum of −Δ and using time-independent nonlinearities. result Global existence of solutions for certain power nonlinearities on specific manifolds.
We study the geometry of deep (neural) networks (DNs) with piecewise affine and convex nonlinearities. The layers of such DNs have been shown to be {\em max-affine spline operators} (MASOs) that partition their input space and apply a region-dependent affine mapping to their input to produce their output. We demonstrat…
Identifying coordinate transformations that make strongly nonlinear dynamics approximately linear is a central challenge in modern dynamical systems. These transformations have the potential to enable prediction, estimation, and control of nonlinear systems using standard linear theory. The Koopman operator has emerged…
CAG method predicts nonlinear solid mechanics responses in real-time with high accuracy and efficiency.
problem Real-time prediction of nonlinear solid mechanics responses.
method Clustering adaptive Gaussian process regression (CAG) method.
result Offers predictions within a second with high precision using only 20 samples.
New method improves nonlinear filtering accuracy with reduced computation.
problem Complex nonlinear filtering with small system noise.
method Asymptotic expansion with ordinary differential equations and Edgeworth-type correction.
result Significantly lower computational cost with improved accuracy.
Study shows how activation functions impact the storage capacity of treelike neural networks.
problem Understanding the role of activation functions in neural network expressive power.
method Analysis of treelike two-layer networks with various activation functions in the infinite-width limit.
result Activation functions affect storage capacity and robustness, with nonlinearity increasing capacity and decreasing robustness.
This paper analyzes a simplified strategy for nonlinear control using local linear models and iLQR updates.
problem Nonlinear policy optimization in control systems.
method Iterative estimation of local linear models and iLQR-like policy updates.
result Demonstrates polynomial sample complexity and overcomes exponential problem horizon dependence.
The paper introduces a framework to assess nonlinear causality in financial markets.
problem Identifying and quantifying co-dependence between financial instruments.
method Transfer entropy and convergent cross-mapping methods to assess linear and nonlinear causality.
result Stock indices exhibit significant nonlinear causality, and correlation underestimates causality.
In this paper, we study the convexity, interior gradient estimate, Liouville type theorem and asymptotic behavior at infinity of translating solutions to mean curvature flow as well as the nonlinear flow by powers of the mean curvature.
Study on identifying and inferring nonlinear dynamics on unknown networks.
problem Identifying network structure in nonlinear dynamic systems with unknown interactions.
method Showed network structure is not generically identified, requiring sufficient spectral heterogeneity. Developed necessary and sufficient conditions for identification and proposed a semiparametric estimator.
result Necessary and sufficient conditions for identification of network structure in nonlinear dynamic systems.
Uniform proof for ultradifferentiability in various classes and dimensions.
problem Generalizing ultradifferentiability conditions to multidimensional cases and infinite dimensional spaces.
method Uniform proof approach that works in all cases and dimensions, including infinite dimensional Banach spaces and convenient vector spaces.
result Characterization of ultradifferentiability for general analytic germs and functions.
Metric learning is a key problem for many data mining and machine learning applications, and has long been dominated by Mahalanobis methods. Recent advances in nonlinear metric learning have demonstrated the potential power of non-Mahalanobis distance functions, particularly tree-based functions. We propose a novel non…
The perturbative approach to nonlinear Sigma models and the associated renormalization group flow are discussed within the framework of Euclidean algebraic quantum field theory and of the principle of general local covariance. In particular we show in an Euclidean setting how to define Wick ordered powers of the underl…
Attention-based GNNs can't prevent oversmoothing, leading to homogeneous node representations.
problem The issue of oversmoothing in attention-based GNNs.
method Viewed attention-based GNNs as nonlinear time-varying dynamical systems and used tools from the theory of products of inhomogeneous matrices and the joint spectral radius.
result Graph attention mechanism cannot prevent oversmoothing and loses expressive power exponentially.
Breaks down complex nonlinear dynamics into simpler components.
problem Control of nonlinear dynamical systems remains challenging.
method Inspired by hybrid switching systems, decomposes dynamics into simpler stochastic switching linear dynamical systems.
result Extracts hierarchies of Markovian and auto-regressive locally linear controllers from nonlinear experts.
Study approximates nonlinear functionals using deep ReLU networks.
problem Approximating nonlinear continuous functionals with neural networks.
method Constructs continuous piecewise linear interpolation under simple triangulation, analyzes rates of approximation.
result Established rates of approximation for functional deep ReLU networks.
We present a simple transformation of the formulation of the log-periodic power law formula of the Johansen-Ledoit-Sornette model of financial bubbles that reduces it to a function of only three nonlinear parameters. The transformation significantly decreases the complexity of the fitting procedure and improves its sta…
Study shows how anisotropic data affects learning dynamics in phase retrieval.
problem Understanding learning dynamics in phase retrieval with anisotropic Gaussian inputs.
method Developed a tractable reduction to reveal a three-phase trajectory and derived scaling laws.
result Found that anisotropy leads to a three-phase trajectory: fast escape, slow convergence, and spectral-tail learning.
The process of transforming observed data into predictive mathematical models of the physical world has always been paramount in science and engineering. Although data is currently being collected at an ever-increasing pace, devising meaningful models out of such observations in an automated fashion still remains an op…
Deep network improves electrical tomography across multiple frequencies.
problem Nonlinear multi-frequency electrical impedance tomography (mfEIT) for tissue conductivity estimation.
method Integrates graph neural networks (GNNs) into the iterative Proximal Regularized Gauss Newton (PRGN) framework to reconstruct tissue concentrations accurately.
result Accurate reconstruction of overlapping tissue fraction concentrations across multiple frequencies.
Develops DML for nonlinear panel data models with fixed effects.
problem Estimating causal effects in nonlinear panel data models with fixed effects.
method Double machine learning (DML) procedures for approximating nuisance functions.
result First-differencing yields the least constraints on fixed effects distribution.
FLEX optimizes exploration for nonlinear systems with minimal data.
problem Efficient exploration of unknown nonlinear systems with limited data.
method FLEX uses optimal experimental design to maximize information gain.
result FLEX outperforms other methods in nonlinear environments and control tasks.
Multiview analysis aims at extracting shared latent components from data samples that are acquired in different domains, e.g., image, text, and audio. Classic multiview analysis, e.g., canonical correlation analysis (CCA), tackles this problem via matching the linearly transformed views in a certain latent domain. More…
Random feature maps are ubiquitous in modern statistical machine learning, where they generalize random projections by means of powerful, yet often difficult to analyze nonlinear operators. In this paper, we leverage the "concentration" phenomenon induced by random matrix theory to perform a spectral analysis on the Gr…
In this paper, wireless video transmission to multiple users under total transmission power and minimum required video quality constraints is studied. In order to provide the desired performance levels to the end-users in real-time video transmissions while using the energy resources efficiently, we assume that power c…