LS-SVR and Bayesian RBF networks are shown to be theoretically similar.
problem Improving LS-SVR performance through Bayesian methods.
method Formal demonstration of theoretical similarities between LS-SVR and Bayesian RBF networks.
result LS-SVR and Bayesian RBF networks have equivalent theoretical expressions.
AEN-RBF kernel improves robustness in Bayesian optimization for complex systems.
problem Bayesian optimization struggles with outliers in RBF kernel, leading to poor performance.
method Proposes AEN-RBF kernel function, demonstrating improved robustness and convergence.
result The AEN-RBF kernel function reduces mean squared prediction error and improves convergence.
New RBF networks can approximate any continuous function.
problem Approximating any continuous function on a compact subset.
method Replacing smoothing factors with shifts in RBF networks and proving approximation under certain conditions.
result RBF networks can approximate any continuous function on any compact subset.
Spatio-temporal RBF neural networks improve chaotic time series prediction.
problem Predicting chaotic time series due to their dynamic nature.
method Proposes an spatio-temporal extension of RBF neural networks.
result Spatio-temporal RBF outperforms standard RBF in chaotic time series prediction.
Estimates individualized treatment effects using shared RBF-net neurons.
problem Identifying differential treatment effects based on covariates.
method Non-parametric radial basis function (RBF)-nets with shared hidden neurons in a Bayesian framework.
result Demonstrated through simulations and real data, the method identifies interesting treatment effects.
Optimizes expensive functions using adaptive RBF surrogate model.
problem Global optimization of expensive, possibly non-differentiable functions.
method Adaptive Radial Basis Function (RBF) surrogate model with uncertainty quantification.
result The proposed method identifies optimal points efficiently, especially for non-smooth surfaces.
Bayesian model connects KMs and ELMs for multitask regression.
problem Multitask regression with shared features and sparsity.
method Bayesian framework using RFFs and RBF kernels.
result Significant performance improvements over state-of-the-art methods.
A novel adaptive kernel improves RBF neural networks performance.
problem Improving performance of RBF neural networks.
method Adaptive fusion of Euclidean and cosine distance measures using gradient descent.
result The method outperforms manual fusion on three major problems.
Improved sample efficiency with normalized RBF kernels in neural networks.
problem Learning more with less data in deep learning models.
method Two-phase method to train neural networks with normalized RBF kernels as output layer.
result Normalized RBF kernel networks achieve higher sample efficiency, compactness, and separability.
Bayesian Optimization improves machine learning for detecting network attacks.
problem Detecting network attacks to secure critical information.
method Bayesian Optimization for tuning machine learning algorithms (SVM-RBF, RF, k-NN).
result The proposed framework achieves high accuracy and low false alarms.
Adaptive RBF-KAN improves KANs by dynamically adjusting kernel parameters.
problem Efficiently approximating multivariate functions using learnable univariate edge functions.
method Integrates LOOCV-based kernel scale estimation with adaptive kernel learning.
result Adaptive RBF-KAN outperforms fixed kernel KANs on various benchmark functions.
One of the main drawbacks of deep neural networks, like many other classifiers, is their vulnerability to adversarial attacks. An important reason for their vulnerability is assigning high confidence to regions with few or even no feature points. By feature points, we mean a nonlinear transformation of the input space …
Improved RBFNN for nonlinear system identification.
problem Nonlinear system identification problem.
method Spatio-temporal extension of RBFNN with time-space orthogonality.
result Spatio-temporal RBFNN outperforms standard RBFNN in convergence and error reduction.
K-Means and RBF networks are shown to be equivalent under certain conditions.
problem Discrete clustering vs. continuous optimization in machine learning.
method Established variational and gradient-based equivalence between K-Means and RBF networks.
result Gradient-based updates of RBF centers recover K-Means centroid update rule.
A new multi-kernel RBFNN design improves performance and speed.
problem Improving the performance and speed of RBFNNs.
method Proposes a novel multi-kernel RBFNN where each base kernel has its own weight.
result Better performance gains including faster convergence, better local minima, and resilience against poor local minima.
We propose a novel reversible jump Markov chain Monte Carlo (MCMC) simulated annealing algorithm to optimize radial basis function (RBF) networks. This algorithm enables us to maximize the joint posterior distribution of the network parameters and the number of basis functions. It performs a global search in the joint …
Empirical comparison of 18 hyperparameter tuning algorithms for SVM.
problem Tuning hyperparameters C and γ for SVM with RBF kernel. method Compared 18 search algorithms on 115 real-life data sets.
result Trees of Parzen estimators and particle swarm optimization perform similarly to grid search.
The aim of this paper is to train an RBF neural network and select centers under concurrent faults. It is well known that fault tolerance is a very attractive property for neural networks. And center selection is an important procedure during the training process of an RBF neural network. In this paper, we devise two n…
This work explores CS-RBFs as novel probability density functions.
problem Underexplored use of CS-RBFs in statistics and probability modeling.
method Derivation of statistical properties of CS-RBFs as univariate and conditional densities, analysis of mixture models, and introduction of an incremental learning algorithm.
result CS-RBF densities provide competitive results in likelihood and model complexity compared to Gaussian mixture models.
In the classical Gaussian SVM classification we use the feature space projection transforming points to normal distributions with fixed covariance matrices (identity in the standard RBF and the covariance of the whole dataset in Mahalanobis RBF). In this paper we add additional information to Gaussian SVM by considerin…
CKA with Gaussian RBF kernels converges linearly as bandwidth increases.
problem Understanding the behavior of CKA with large bandwidth Gaussian kernels.
method Analyzing the convergence of CKA based on Gaussian RBF kernels in the large-bandwidth limit.
result CKA based on Gaussian RBF kernels converges linearly as bandwidth increases.
Complex analysis techniques link Gaussian RBF kernels to quantum mechanics.
problem Understanding the Gaussian RBF kernel in machine learning and SVMs.
method Using Fock space and Segal-Bargmann theories in complex analysis.
result Proves connections between Gaussian RBF kernels and quantum mechanics operators.
DCA algorithm applied to SVR with RBF kernel for nonconvex optimization.
problem Nonconvex optimization of SVR with Gaussian RBF kernel.
method DC algorithm with analytical DC decomposition of SVR objective.
result Convergence properties of DCA on RBF-SVR can be assessed through Cαρ. Echo state network (ESN) is viewed as a temporal non-orthogonal expansion with pseudo-random parameters. Such expansions naturally give rise to regressors of various relevance to a teacher output. We illustrate that often only a certain amount of the generated echo-regressors effectively explain the variance of the tea…
A comparative study of the application of Gaussian Mixture Model (GMM) and Radial Basis Function (RBF) in biometric recognition of voice has been carried out and presented. The application of machine learning techniques to biometric authentication and recognition problems has gained a widespread acceptance. In this res…
New methods improve global optimisation for expensive functions using lookahead strategies.
problem Optimising expensive functions without gradient info in high dimensions.
method Nonmyopic acquisition strategies based on approximate dynamic programming.
result Nonmyopic methods outperform myopic approaches in various applications.
BEKAN uses RBFs and evolutionary methods to solve PDEs with boundary conditions.
problem Enforcing boundary conditions in neural networks for PDE solutions.
method Boundary condition-guaranteed evolutionary Kolmogorov-Arnold Network (BEKAN) with radial basis functions (RBFs). Incorporates Dirichlet, periodic, and Neumann conditions.
result BEKAN outperforms MLP and B-splines KAN in solving PDEs with boundary conditions.
POAP and pySOT improve surrogate optimization of expensive functions.
problem Optimizing expensive functions with concurrent evaluations.
method Event-driven asynchronous framework for optimization strategies.
result Asynchronous computation offers significant speed-up advantages.
Bayesian optimisation's mean function choice affects convergence speed.
problem The choice of mean function in Bayesian optimisation impacts convergence speed.
method Empirical investigation of 8 mean functions on 10 synthetic and 2 real-world problems.
result Using a constant mean function equal to the worst observed quality value promotes faster convergence.
Paper presents a breast cancer detection model using ELM-RBF.
problem Detecting breast cancer using mammography with high cost and side effects.
method Multilayer fuzzy expert system with ELM-RBF model.
result ELM-RBF model outperforms linear-SVM model in accuracy, precision, sensitivity, specificity, and other metrics.
OKSVM optimizes RBF kernel hyperparameter for SVMs, improving classification performance.
problem Intrinsic dependence of RBF kernel hyperparameter on SVM performance.
method Gradient descent method for automatic hyperparameter learning and SVM weights adjustment.
result OKSVM outperforms classical SVM regardless of initial RBF hyperparameter values.
The idea of end-to-end learning of communications systems through neural network -based autoencoders has the shortcoming that it requires a differentiable channel model. We present in this paper a novel learning algorithm which alleviates this problem. The algorithm iterates between supervised training of the receiver …
Study uses multi-task Bayesian optimization to speed up SVM hyperparameter tuning for nodules diagnosis.
problem Redundant and time-consuming hyperparameter tuning for SVM classifiers in medical imaging.
method Employed multi-task Bayesian optimization to accelerate hyperparameter search.
result Multi-task Bayesian optimization significantly accelerates hyperparameter search.
New matrix approximation method using RBF components for better memory efficiency.
problem Efficiently approximate any real matrix without being symmetric or positive definite.
method Formulate as an optimization problem with gradient descent methods.
result Significantly reduces memory usage for various matrix types.
The method of "random Fourier features (RFF)" has become a popular tool for approximating the "radial basis function (RBF)" kernel. The variance of RFF is actually large. Interestingly, the variance can be substantially reduced by a simple normalization step as we theoretically demonstrate. We name the improved scheme …
In this paper, we compare 5 different nonlinear kernels: min-max, RBF, fRBF (folded RBF), acos, and acos-χ2, on a wide range of publicly available datasets. The proposed fRBF kernel performs very similarly to the RBF kernel. Both RBF and fRBF kernels require an important tuning parameter (γ). Interestingly, for a …
We propose two localized Radial Basis Function (RBF) methods, the Radial Basis Function Partition of Unity method (RBF-PUM) and the Radial Basis Function generated Finite Differences method (RBF-FD), for solving financial derivative pricing problems arising from market models with multiple stochastic factors. We demons…
The GMM (generalized min-max) kernel was recently proposed (Li, 2016) as a measure of data similarity and was demonstrated effective in machine learning tasks. In order to use the GMM kernel for large-scale datasets, the prior work resorted to the (generalized) consistent weighted sampling (GCWS) to convert the GMM ker…
Kernelized Q-learning achieves good performance with minimal data.
problem Efficient Q-learning in high-dimensional spaces.
method Kernelized Q-learning framework with effective dimensionality.
result Concrete regret bounds for linear and Gaussian RBF kernels.
Paper proposes machine learning models for more accurate road inspection.
problem Traditional road inspection systems have safety, energy, and cost issues.
method Hybrid machine learning models using surface deflection data from FWD tests.
result CMIS model outperforms other models with APRE=2.3303, AAPRE=11.6768, RMSE=12.0056, and SD=0.0210.
One-shot algorithm for feature-distributed kernel PCA reduces communication costs.
problem Efficiently perform kernel PCA in distributed computing environments.
method Inspired by dual relationship between sample-distributed and feature-distributed scenarios, proposes a one-shot algorithm for feature-distributed kernel PCA.
result The algorithm provides high-quality results with low communication costs, especially when eigenvalues decay fast.
GLIS uses IDW and RBF for efficient global optimization.
problem Expensive objective function in optimization problems.
method Combines inverse distance weighting and radial basis functions for acquisition function.
result Competitive and computationally lighter than Bayesian optimization.
New ML models improve VVLC channel characterization for vehicular OWC.
problem Inaccurate channel models for VVLC due to mobility effects.
method Machine learning (ML) models incorporating ambient light, turbulence, and reflection effects.
result ML models predict VVLC channel loss and CFR more accurately than existing methods.
In-BO optimizes complex constrained domains using SIn-GP surrogate models.
problem Optimizing in complex constrained domains with irregular shapes.
method Sparse Intrinsic Gaussian Processes (SIn-GP) on manifolds with heat kernel estimation.
result In-BO outperforms traditional BO in complex constrained domains.
Paper provides unbiased spectral moment estimates from finite data.
problem Challenges in estimating spectral moments from limited data.
method Dynamic programming approach to estimate spectral moments of kernel integral operator.
result Demonstrates consistency with theoretical spectra and practical utility in neural networks.
Automatically searching for optimal hyperparameter configurations is of crucial importance for applying deep learning algorithms in practice. Recently, Bayesian optimization has been proposed for optimizing hyperparameters of various machine learning algorithms. Those methods adopt probabilistic surrogate models like G…
Paper proposes an efficient method for pricing FX options with stochastic volatility and interest rates.
problem Pricing foreign exchange options in a model with stochastic interest rates and volatility.
method Developed a RBF--FD method to solve the associated PDE numerically.
result Demonstrates efficiency in terms of accuracy and computational cost for pricing FX options.
In this paper, we study the benefits of using polyharmonic splines and node layouts with smoothly varying density for developing robust and efficient radial basis function generated finite difference (RBF-FD) methods for pricing of financial derivatives. We present a significantly improved RBF-FD scheme and successfull…