Paper compares SVM and Bayesian Logistic Regression for breast cancer diagnosis.
problem Improving breast cancer diagnosis accuracy using machine learning.
method Used SVM, Bayesian Logistic Regression, and K-Nearest-Neighbors for classification.
result SVM outperformed other classifiers, closely matched by Bayesian Logistic Regression.
Study uses multi-task Bayesian optimization to speed up SVM hyperparameter tuning for nodules diagnosis.
problem Redundant and time-consuming hyperparameter tuning for SVM classifiers in medical imaging.
method Employed multi-task Bayesian optimization to accelerate hyperparameter search.
result Multi-task Bayesian optimization significantly accelerates hyperparameter search.
Improved Bayesian analysis for SVM models using a mixture sampler.
problem Efficient simulation-based analysis of stochastic volatility in mean models.
method Developed a generalized mixture sampler for SVM models, approximating non-central chi-squared distributions as mixtures of normal distributions.
result The proposed method outperforms other volatility models based on marginal likelihoods in empirical studies.
We propose a Bayesian evidence framework to facilitate transfer learning from pre-trained deep convolutional neural networks (CNNs). Our framework is formulated on top of a least squares SVM (LS-SVM) classifier, which is simple and fast in both training and testing, and achieves competitive performance in practice. The…
A mean field variational Bayes approach to support vector machines (SVMs) using the latent variable representation on Polson & Scott (2012) is presented. This representation allows circumvention of many of the shortcomings associated with classical SVMs including automatic penalty parameter selection, the ability to ha…
Optimal posterior distributions improve SVM classifiers and parameter selection.
problem Improving SVM classifiers and selecting optimal regularization parameters.
method PAC-Bayesian approach with optimal posterior identification for stochastic classifiers.
result Optimal posteriors yield tight risk bounds and improved SVM performance.
To model categorical response variables given their covariates, we propose a permuted and augmented stick-breaking (paSB) construction that one-to-one maps the observed categories to randomly permuted latent sticks. This new construction transforms multinomial regression into regression analysis of stick-specific binar…
RHPSVM improves SVM performance with robust loss function.
problem Outliers and resampling instability in SVM models.
method RHPSVM uses a rescaled Huberized pinball loss function.
result RHPSVM outperforms existing SVM models in noisy and small-sample scenarios.
Paper proposes SVM-based methods for inferring interaction networks.
problem Modeling interaction between variables in time series and high dimensions.
method Two approaches: neighborhood SVM and restricted Bayesian network for time series.
result Efficiency demonstrated through simulations with linear and nonlinear data.
New scalable multi-class SVM for structured and unstructured data.
problem Classification of structured and unstructured data.
method Bayesian multi-class support vector machine with pseudo-likelihood, variational inference, and inducing point approximation.
result Outperforms competitor methods in training time and accuracy.
Empirical comparison of 18 hyperparameter tuning algorithms for SVM.
problem Tuning hyperparameters C and γ for SVM with RBF kernel. method Compared 18 search algorithms on 115 real-life data sets.
result Trees of Parzen estimators and particle swarm optimization perform similarly to grid search.
The Support Vector Machine (SVM) of Vapnik (1998) has become widely established as one of the leading approaches to pattern recognition and machine learning. It expresses predictions in terms of a linear combination of kernel functions centred on a subset of the training data, known as support vectors. Despite its wide…
A new method reduces energy consumption in machine learning by using multiple, less costly data sources.
problem High computational and energy costs in machine learning model training.
method Augmented Gaussian Process (AGP-MISO) with multi-source optimization.
result The AGP-MISO method reduces computational time and energy consumption compared to traditional approaches.
Stochastic Volatility in Mean models with heavy-tailed distributions using Hidden Markov Models
problem Accurate inference for Stochastic Volatility in Mean models with heavy-tailed distributions
method Numerically stable estimation procedure and parallel computing
result Significant reduction in computational times
Study compares chi-squared divergence and KL-divergence posteriors for PAC-Bayesian bounds.
problem Investigates optimal posteriors for PAC-Bayesian bounds using chi-squared divergence.
method Analyzes bounds for three distance functions, derives FP equations for computation.
result Chi-squared divergence based posteriors have weaker bounds and worse test errors.
Proposed SMO algorithm for OC-SVM+ significantly outperforms non-sequential algorithms.
problem One-class SVM with privileged information
method Sequential Minimal Optimization (SMO) algorithm
result Finite-time convergence established
Support Vector Machines, SVMs, and the Large Margin Nearest Neighbor algorithm, LMNN, are two very popular learning algorithms with quite different learning biases. In this paper we bring them into a unified view and show that they have a much stronger relation than what is commonly thought. We analyze SVMs from a metr…
Bayesian Optimization improves machine learning for detecting network attacks.
problem Detecting network attacks to secure critical information.
method Bayesian Optimization for tuning machine learning algorithms (SVM-RBF, RF, k-NN).
result The proposed framework achieves high accuracy and low false alarms.
Unified Pin-SVM improves accuracy over existing Pin-SVM model.
problem Difficulty in Pin-SVM model for −1≤τ<0. method Unified Pin-SVM model that solves a QPP for −1≤τ≤1. result Significant improvement in accuracy over existing Pin-SVM model.
Localized SVMs maintain SVM's consistency properties for large datasets.
problem Inefficient computational requirements of global SVMs for large data sets.
method Localized SVMs apply different hyperparameters to different regions of the input space.
result Localized SVMs inherit Lp- and risk consistency from global SVMs. MU-SVM improves multiclass classification accuracy.
problem Multiclass classification problems.
method Proposes MU-SVM for multiclass learning and an analytic span bound for model selection.
result Achieves > 20% improvement in test accuracies compared to multi-class SVM.
Paper proposes fully Bayesian approach for RVM classification, improving accuracy especially in imbalanced data.
problem Difficulty in conducting RVM classification due to lack of closed-form solution for weight parameter posterior.
method Proposes Generic Bayesian and Fully Bayesian approaches with hierarchical hyperprior structure.
result Improves classification performance, especially in imbalanced data.
BAEN-SVM improves SVM robustness to noisy data.
problem Noise and geometric irrationalities in SVM.
method Bounded asymmetric elastic net loss combined with SVM.
result BAEN-SVM is robust to noise and geometrically well-defined.
This work extends SVM error bounds to weighted SVM and introduces hyperparameter selection methods.
problem Improving SVM performance through effective hyperparameter selection.
method Extending span error bound theory to weighted SVM and introducing hyperparameter selection methods.
result The span rule is the most effective method for weighted SVM hyperparameter selection and provides the best predictor of test error.
New SVM feature selection methods improve wafer testing accuracy.
problem Need for improved SVM feature selection methods.
method Entropy measurement and K-medoid clustering for feature selection.
result One-class SVM's enhance wafer testing accuracy.
Support vector machines (SVMs) are invaluable tools for many practical applications in artificial intelligence, e.g., classification and event recognition. However, popular SVM solvers are not sufficiently efficient for applications with a great deal of samples as well as a large number of features. In this paper, thus…
A quantum-inspired classical algorithm speeds up LS-SVM classification.
problem Big data challenge in SVM classification.
method Improved indirect sampling technique for LS-SVM.
result Algorithm achieves logarithmic runtime for low rank data matrices.
This paper improves SVM prediction uncertainty quantification methods.
problem Lack of comprehensive UQ methods for SVM predictions.
method Developed SSVQR model for sparse PI estimation and feature selection algorithm.
result Proposed SSVQR model achieves sparse solutions and improves PI quality.
Introduces Soft-SVM for binary classification bridging logistic and SVM.
problem Data separability issues in binary classification.
method Soft-SVM regression using convex relaxation of hinge loss with softness and class-separation parameters.
result Soft-SVM performs well in classification and prediction errors.
In this paper, we consider asymptotic properties of the support vector machine (SVM) in high-dimension, low-sample-size (HDLSS) settings. We show that the hard-margin linear SVM holds a consistency property in which misclassification rates tend to zero as the dimension goes to infinity under certain severe conditions. …
Paper proposes an ensemble SVM method for efficient VAD.
problem Efficient and accurate VAD for speech processing.
method Supervised learning with ensemble SVM on large datasets.
result Ensemble SVM outperforms stand-alone SVM in VAD accuracy.
GADGET SVM uses gossip-based distributed learning for scalable SVMs.
problem Scalability issues in traditional SVM algorithms for large datasets.
method Gossip-based distributed learning for the primal SVM formulation.
result Performance comparable to centralized and online SVM algorithms.
Proposes SVM-based Deep Stacking Network for improved deep learning.
problem Improving deep learning performance and interpretability.
method Uses stacked SVM classifiers within a DSN architecture and a BP-like layer tuning scheme.
result Demonstrates superior performance compared to benchmark models on image and text data.
Prior knowledge can be used to improve predictive performance of learning algorithms or reduce the amount of data required for training. The same goal is pursued within the learning using privileged information paradigm which was recently introduced by Vapnik et al. and is aimed at utilizing additional information avai…
Paper introduces MKL-L0/1-SVM for SVM with (0,1) loss.
problem Optimization of SVM with (0,1) loss function. method MKL framework combined with ADMM algorithm for solving the optimization problem.
result Performance of MKL-L0/1-SVM comparable to SimpleMKL. Training of one-vs.-rest SVMs can be parallelized over the number of classes in a straight forward way. Given enough computational resources, one-vs.-rest SVMs can thus be trained on data involving a large number of classes. The same cannot be stated, however, for the so-called all-in-one SVMs, which require solving a …
SVM used for estimating treatment effects without confounding.
problem Estimating average treatment effects in the presence of confounding variables.
method Adapts SVM classifier as a kernel-based weighting procedure to balance covariates and estimate causal effects.
result SVM provides a continuous relaxation of the quadratic integer program for balancing covariates and maximizing effective sample size.
SaR-SVM-STV improves hyperspectral image classification with shape-adaptive reconstruction and denoising.
problem Classifying hyperspectral images with limited labeled data.
method Shape-adaptive Reconstruction (SaR) for pixel preprocessing, SVM for probability estimation, and Smoothed Total Variation (STV) for denoising.
result SaR-SVM-STV outperforms SVM-STV with fewer labeled data.
We describe a novel binary classification technique called Banded SVM (B-SVM). In the standard C-SVM formulation of Cortes et al. (1995), the decision rule is encouraged to lie in the interval [1, \infty]. The new B-SVM objective function contains a penalty term that encourages the decision rule to lie in a user specif…
One of the limiting factors of using support vector machines (SVMs) in large scale applications are their super-linear computational requirements in terms of the number of training samples. To address this issue, several approaches that train SVMs on many small chunks of large data sets separately have been proposed in…
In support vector machine (SVM) applications with unreliable data that contains a portion of outliers, non-robustness of SVMs often causes considerable performance deterioration. Although many approaches for improving the robustness of SVMs have been studied, two major challenges remain in robust SVM learning. First, r…
Quantum LS-SVM simplifies matrix inversion for faster machine learning.
problem Speeding up machine learning algorithms for large datasets.
method Introduces a novel quantum algorithm using continuous variables to simplify matrix inversion in LS-SVM, and proposes a hybrid quantum-classical approach for sparse solutions.
result Quantum LS-SVM achieves exponential speed-up and can solve classically difficult tasks.
SVM predicts economic recessions in real-time.
problem Determining the onset and end of recessions quickly.
method Support Vector Machines (SVM) applied to nowcasting.
result SVM achieves excellent predictive performance for nowcasting recessions.
The paper improves SVM and localized SVM stability under triple perturbations.
problem Stability of SVMs and localized SVMs under triple perturbations.
method Generalizes and improves existing results, considering simultaneous variations in probability measure, regularization parameter, and kernel.
result Improved stability of SVMs and localized SVMs under triple perturbations.
When applying the support vector machine (SVM) to high-dimensional classification problems, we often impose a sparse structure in the SVM to eliminate the influences of the irrelevant predictors. The lasso and other variable selection techniques have been successfully used in the SVM to perform automatic variable selec…
EDSVM uses elite observations to guide SVM classification.
problem Classical SVMs lack ways to encode trusted models or preferences.
method EDSVM augments SVMs by guiding slack variables for elite observations.
result EDSVM models closely track reference SVMs while achieving competitive performance.
New SVM model balances sparsity and robustness in noisy data.
problem Noise sensitivity and lack of sparsity in traditional SVM models.
method Combines elastic net loss with robust loss framework, integrates with SVM, uses half-quadratic algorithm.
result Proves sparsity and robustness, outperforms traditional SVMs in noisy environments.
A new procedure for learning cost-sensitive SVM(CS-SVM) classifiers is proposed. The SVM hinge loss is extended to the cost sensitive setting, and the CS-SVM is derived as the minimizer of the associated risk. The extension of the hinge loss draws on recent connections between risk minimization and probability elicitat…