Kolmogorov-Arnold Networks promise scalable performance in high dimensions.
problem Curse of dimensionality in multilayer perceptrons.
method Kolmogorov-Arnold representation theorem and interpolation methods.
result Kolmogorov-Arnold Networks achieve true freedom from the curse of dimensionality.
New method solves high-dimensional Kolmogorov PDEs without curse of dimensionality.
problem Solving high-dimensional Kolmogorov PDEs efficiently and accurately.
method Deep learning-based numerical approximation method.
result Effective numerical approximation of Kolmogorov PDEs in high dimensions.
We provide the proof that the space of time series data is a Kolmogorov space with T0-separation axiom using the loop space of time series data. In our approach we define a cyclic coordinate of intrinsic time scale of time series data after empirical mode decomposition. A spinor field of time series data comes fro…
Kolmogorov-Arnold Networks achieve optimal convergence rates in nonparametric regression.
problem Nonparametric function approximation in multivariate settings.
method Structured additive and multiplicative KANs using B-splines.
result Achieve minimax-optimal convergence rate O(n−2r/(2r+1)) for Sobolev space functions. We link SVEs to SPDEs and derive Kolmogorov equations for singular kernels.
problem Solving stochastic Volterra equations with singular kernels.
method Establishing connections between SVEs and SPDEs, using stochastic calculus in Hilbert spaces.
result Solutions of SVEs can be expressed in terms of backward Kolmogorov equations.
Poor approximators found in neural networks and random feature models.
problem Understanding why certain neural networks and models perform poorly in approximating functions.
method Established a scale separation of Kolmogorov width type and applied it to neural networks and random feature models.
result Reproducing kernel Hilbert spaces and two-layer neural networks are poor L2-approximators for certain functions. We consider several ways to measure the `geometric complexity' of an embedding from a simplicial complex into Euclidean space. One of these is a version of `thickness', based on a paper of Kolmogorov and Barzdin. We prove inequalities relating the thickness and the number of simplices in the simplicial complex, general…
Kolmogorov neural networks can represent various types of functions.
problem Representing different types of functions with neural networks.
method Continuous, discontinuous bounded or unbounded activation functions in a two hidden layer model.
result Kolmogorov neural networks can represent continuous, discontinuous bounded and all unbounded multivariate functions.
K-DAREK improves KKANs for efficient function approximation with robust error bounds.
problem Efficient function approximation with uncertainty quantification for large-scale problems.
method Developed a novel learning algorithm, K-DAREK, for KKANs.
result Established robust error bounds that are distance-aware, improving efficiency and scalability.
Study gradient bounds for Kolmogorov type diffusions using coupling and Γ-calculus.
problem Gradient bounds for Kolmogorov type diffusions.
method Coupling techniques and Γ-calculus.
result Advantages and drawbacks of each method discussed.
Test to distinguish metric space distributions using pairwise distances.
problem Distinguishing between two distributions on a metric space.
method Use pairwise distances and a two-sample Kolmogorov--Smirnov test.
result Can determine if two distributions are the same using finite data.
Deep learning solves high-dimensional PDEs efficiently.
problem Solving high-dimensional Kolmogorov PDEs numerically.
method Reformulating as a statistical learning problem using Feynman-Kac formula.
result Single neural network learns entire family of PDEs.
Revisits the connection between neural networks and the Kolmogorov-Arnold theorem.
problem Explains the limitations of using the Kolmogorov-Arnold theorem to explain neural networks with multiple hidden layers.
method Derives modifications of the Kolmogorov-Arnold representation that transfer smoothness properties to the outer function and can be well approximated by ReLU networks.
result Shows that a deep neural network with most layers approximating the interior function is a more natural interpretation of the Kolmogorov-Arnold representation.
Researchers use estimated Kolmogorov complexity for better link prediction in graphs.
problem Improving link prediction accuracy in complex networks.
method Regularization based on an approximation of Kolmogorov complexity, which is differentiable and compatible with recent link prediction algorithms.
result The regularization method shows good performance on diverse real-world networks, but the success is likely due to an aggregation method rather than actual estimation of Kolmogorov complexity.
A new Kolmogorov-Arnold network improves function approximation and optimization.
problem Approximating potentially irregular functions in high dimensions.
method Proposes a new Kolmogorov-Arnold network (KAN) and provides error bounds and universal approximation theorems.
result Outperforms multilayer perceptrons in accuracy and convergence speed for irregular functions.
SVGP KAN integrates uncertainty quantification into Kolmogorov-Arnold networks.
problem Uncertainty quantification in scientific machine learning models.
method Sparse variational Gaussian process inference with Kolmogorov-Arnold topology.
result Demonstrated ability to distinguish aleatoric and epistemic uncertainty in various scientific applications.
Efficient algorithm approximates discrete random variables with minimal Kolmogorov distance.
problem Estimating the probability of missing deadlines in series-parallel schedules.
method An efficient algorithm that computes a random variable with minimal Kolmogorov distance to a given discrete random variable.
result The algorithm efficiently approximates the probability of missing deadlines with minimal Kolmogorov distance.
A new KAN variant uses sinusoidal activations to approximate functions.
problem Approximating multivariable functions using neural networks.
method Replacing inner and outer functions in Kolmogorov-Arnold representation with weighted sinusoidal functions.
result The new KAN variant outperforms fixed-frequency Fourier transform and achieves comparable performance to MLPs.
New method speeds up SDE inference by matching moments to FPK equation.
problem Efficiency of sampling schemes in high-dimensional SDEs.
method Direct approximation of Fokker-Planck-Kolmogorov equation by matching moments.
result Fast, scalable inference in high-dimensional latent spaces.
The usual derivation of the Fokker-Planck partial differential eqn. assumes the Chapman-Kolmogorov equation for a Markov process. Starting instead with an Ito stochastic differential equation we argue that finitely many states of memory are allowed in Kolmogorov's two pdes, K1 (the backward time pde) and K2 (the Fokker…
We developed a method to learn Kolmogorov models for binary variables.
problem Interpreting complex relationships among binary random variables.
method Proposed a framework linking outcomes of binary variables and an algorithm for model computation.
result First-order optimality of the proposed algorithm despite combinatorial complexity.
We study the solution to Kolmogorov-Feller equation and by using it provide pricing formulas of well known some options under jump-diffusion model.
Study finds conjugate points in geodesics of Kolmogorov flows on torus.
problem Characterizing pairs of integers (m,n) for which geodesics have conjugate points.
method Analysis of geodesics in the group of volume-preserving diffeomorphisms of a torus using stream functions.
result Existence of conjugate points for all pairs of strictly positive integers (m,n).
A new machine learning method solves high-dimensional Kolmogorov PDEs efficiently.
problem Solving high-dimensional Kolmogorov PDEs and SDEs.
method Stochastic weighted minimization and stochastic gradient descent with Malliavin weights.
result Accurate approximation of high-dimensional Kolmogorov PDEs and SDEs without curse of dimensionality.
Paper derives quantum Kolmogorov equations using nonlocal quantum mechanics.
problem Quantum finance equations derived from quantum stochastic calculus.
method Nonlocal approach to quantum mechanics for deriving equations.
result Nonlocal diffusions and quantum stochastic processes linked.
New test uses neural networks to compare distributions, outperforming traditional methods.
problem Comparing distributions in high dimensions and higher orders of smoothness.
method Integral probability metrics with Radon bounded variation functions and neural networks.
result The Radon-Kolmogorov-Smirnov (RKS) test outperforms traditional methods in distinguishing distributions.
Bayesian KANs achieve near-minimax posterior contraction rates in anisotropic Besov spaces.
problem Statistical foundation for Bayesian Kolmogorov-Arnold networks in anisotropic Besov spaces.
method Sparse Bayesian KANs with spike-and-slab priors, hyperprior on model size, and approximation complexity bounds.
result Posterior contraction rates depend on intrinsic anisotropic smoothness and effective dimension of the compositional structure.
Smooth KANs improve model reliability in computational biomedicine.
problem Limited convergence of KANs in representing generic smooth functions.
method Introducing smooth, structurally informed KANs that can approximate MLPs in specific function classes.
result Smooth KANs can achieve equivalence to MLPs in specific function classes, enhancing model reliability and performance.
Support spinor machine extends SVM to handle spinor fields in time series data.
problem Handling nonstationary and nonlinear time series data for classification.
method Using wedge product to extend vector fields to spinor fields, extending SVM to support spinor machine.
result Support spinor machine outperforms SVM in one class classification of physiological time series data.
KSGAN uses KS distance for deep generative modeling.
problem Deep generative modeling challenges, especially for multivariate distributions.
method Formulates adversarial training as minimization of KS distance, using quantile function as critic.
result KSGAN trained distributions closely match target distributions.
Kolmogorov-Arnold Networks improve deep learning adaptivity and can approximate Besov functions optimally.
problem Improving deep learning adaptivity and understanding approximation rates.
method Analyzing Besov norms and using Res-KANs for approximation.
result KANs can optimally approximate Besov functions at the optimal rate.
The paper explores the limits of deep neural networks in approximating various function classes.
problem Characterizing the limits of deep neural networks in function approximation.
method Develops a theory relating function complexity and network complexity, using Kolmogorov complexity.
result Deep networks are optimal approximants for various function classes and provide exponential approximation accuracy.
Kolmogorov-Arnold Networks offer improved interpretability and parsimony in science tasks.
problem Improving interpretability and parsimony in science-oriented tasks.
method Theoretical analysis of Kolmogorov-Arnold Networks (KAN) with generalization bounds and model complexity.
result Generalization bounds for KAN with various activation functions, scaling with the l1 norm of coefficient matrices and Lipschitz constants. Proposes a new neural network architecture combining MLP and basis functions.
problem Function approximation and operator learning in scientific machine learning.
method Combines robust MLP inner functions with flexible basis functions outer functions.
result KKAN outperforms MLPs and KANs in function approximation and operator learning tasks.
This paper tackles G-ZSL by learning compositional spaces to classify unseen classes.
problem Classifying unseen classes in a test set.
method Space decomposition method to estimate and fine-tune decision boundaries between source and target classes.
result State-of-the-art performance on multiple G-ZSL benchmarks.
A new autoencoder combines deep learning with SVD to reduce model complexity.
problem Overcoming the Kolmogorov barrier in high-dimensional systems.
method Learnable weighted hybrid autoencoder combining SVD and deep learning.
result Empirically, the model exhibits a sharpness thousands of times smaller than other models.
Method infers causal direction using data discretization and complexity calculation.
problem Determining causal direction between continuous variables.
method MDL Binning technique for data discretization and complexity calculation.
result Captures the shape of the data to determine causal direction.
S2KAN integrates symbolic primitives into neural network activations for improved interpretability.
problem Training activations in KANs often lack symbolic fidelity, leading to unintelligible models.
method Softly Symbolified Kolmogorov-Arnold Networks (S2KAN) integrates symbolic primitives into training with learnable gates and a Minimum Description Length objective.
result S2KAN discovers interpretable forms when symbolic terms suffice, gracefully degrading to dense splines when necessary.
NN-Turb generates turbulent velocity statistics using neural networks.
problem Creating a 1D field with turbulent velocity statistics.
method Fully-convolutional neural network (NN-Turb) to generate the field.
result NN-Turb generates a 1D field that satisfies Kolmogorov's 2/3 and 4/5 laws, exhibiting intermittency.
The goal of this article is to describe the concepts of system dynamics and its applications to the simulation modeling of financial institutions daily activity. The hybrid method of the re-engineering of banking business processes based upon combination of system dynamics, queuing theory and tools of ordinary differen…
Researchers compute heat kernel coefficients for 2D diffusion operators.
problem Analyzing heat kernel coefficients for 2D hypoelliptic operators.
method Explicit computation of heat kernel coefficients and interpretation in terms of curvature.
result Interpretation of heat kernel asymptotics for non-sub-Riemannian operators.
KANEL combines models for early hit enrichment in virtual screening.
problem Assessing model accuracy in chemical bioactivity predictions.
method Ensemble workflow using Kolmogorov-Arnold Networks (KANs) and other models.
result Improves early hit enrichment metrics like PPV@N.
Kolmogorov-Arnold Networks offer interpretable models for energy applications.
problem Lack of interpretability in modern machine learning methods for sensitive industries.
method Symbolic regression with Kolmogorov-Arnold Networks compared to traditional feedforward neural networks.
result Kolmogorov-Arnold Networks yield perfectly interpretable models and learn real, physical relations.
KANs replace fixed MLP weights with learnable edge functions, improving accuracy and interpretability.
problem Lack of interpretability and scalability in MLPs.
method KANs use learnable activation functions on edges instead of fixed weights, replacing weights with spline functions.
result KANs outperform MLPs in accuracy and interpretability with smaller models.
Kolmogorov-Arnold Networks enable ultrafast online learning with fixed-point quantization.
problem Efficient online learning for high-frequency systems with strict memory constraints.
method Fixed-point online training on FPGAs exploiting B-spline locality in KANs.
result Kolmogorov-Arnold Networks are more efficient and expressive than MLPs for low-latency tasks.
Study reveals DNNs prefer easy-to-learn cues over essential ones in image recognition.
problem DNNs learn easy-to-learn features that aren't essential to the task.
method WCST-ML training setup with shortcut cues on synthetic and face datasets.
result DNNs converge to solutions focusing on preferred cues, leading to flat minima.
Presented are two neural network architectures for convex functions, demonstrating competitive performance.
problem Approximating convex functions efficiently and accurately.
method Developed two neural network architectures: one based on linear-by-part representation and the other on cubic splines.
result Cubic ICKAN networks produce results similar to classical ICNNs in solving convex approximation problems.
The study improves volatility model pricing accuracy with new statistical expansions.
problem Improving option pricing accuracy in volatility models.
method Developed Edgeworth expansions for various volatility models.
result Enhanced statistical expansions for volatility models.