This paper improves SVM classification using a differentiable loss function and a gradient method.
problem Improving SVM classification with a differentiable loss function.
method Uses the Huberized Support Vector Machine (HSVM) and Proximal Gradient (PG) method.
result The proposed method converges linearly and supports the solution in finite time.
We prove new fast learning rates for the one-vs-all multiclass plug-in classifiers trained either from exponentially strongly mixing data or from data generated by a converging drifting distribution. These are two typical scenarios where training data are not iid. The learning rates are obtained under a multiclass vers…
New algorithm improves online binary classification with constant time complexity.
problem Online binary classification with rebalancing.
method Non-iteratively reweighted recursive least-squares.
result Exacts converges to batch formulation and outperforms existing algorithms.
New algorithms parallelize all-in-one SVM training, improving text classification accuracy.
problem Training all-in-one SVMs is computationally infeasible for many classes.
method Developed distributed algorithms for two all-in-one SVM formulations.
result Superior accuracy on text classification data compared to one-vs.-rest SVMs.
Proposed SMO algorithm for OC-SVM+ significantly outperforms non-sequential algorithms.
problem One-class SVM with privileged information
method Sequential Minimal Optimization (SMO) algorithm
result Finite-time convergence established
Support Vector Machines, SVMs, and the Large Margin Nearest Neighbor algorithm, LMNN, are two very popular learning algorithms with quite different learning biases. In this paper we bring them into a unified view and show that they have a much stronger relation than what is commonly thought. We analyze SVMs from a metr…
Unified Pin-SVM improves accuracy over existing Pin-SVM model.
problem Difficulty in Pin-SVM model for −1≤τ<0. method Unified Pin-SVM model that solves a QPP for −1≤τ≤1. result Significant improvement in accuracy over existing Pin-SVM model.
Localized SVMs maintain SVM's consistency properties for large datasets.
problem Inefficient computational requirements of global SVMs for large data sets.
method Localized SVMs apply different hyperparameters to different regions of the input space.
result Localized SVMs inherit Lp- and risk consistency from global SVMs. MU-SVM improves multiclass classification accuracy.
problem Multiclass classification problems.
method Proposes MU-SVM for multiclass learning and an analytic span bound for model selection.
result Achieves > 20% improvement in test accuracies compared to multi-class SVM.
BAEN-SVM improves SVM robustness to noisy data.
problem Noise and geometric irrationalities in SVM.
method Bounded asymmetric elastic net loss combined with SVM.
result BAEN-SVM is robust to noise and geometrically well-defined.
This work extends SVM error bounds to weighted SVM and introduces hyperparameter selection methods.
problem Improving SVM performance through effective hyperparameter selection.
method Extending span error bound theory to weighted SVM and introducing hyperparameter selection methods.
result The span rule is the most effective method for weighted SVM hyperparameter selection and provides the best predictor of test error.
A new multi-class active learning method combining informativeness and representativeness.
problem Efficiently labeling large datasets with limited resources.
method A hybrid informative and representative criterion approach for multi-class active learning.
result The proposed method outperforms state-of-the-art methods on multiple UCI datasets.
New SVM feature selection methods improve wafer testing accuracy.
problem Need for improved SVM feature selection methods.
method Entropy measurement and K-medoid clustering for feature selection.
result One-class SVM's enhance wafer testing accuracy.
Support vector machines (SVMs) are invaluable tools for many practical applications in artificial intelligence, e.g., classification and event recognition. However, popular SVM solvers are not sufficiently efficient for applications with a great deal of samples as well as a large number of features. In this paper, thus…
A quantum-inspired classical algorithm speeds up LS-SVM classification.
problem Big data challenge in SVM classification.
method Improved indirect sampling technique for LS-SVM.
result Algorithm achieves logarithmic runtime for low rank data matrices.
This paper improves SVM prediction uncertainty quantification methods.
problem Lack of comprehensive UQ methods for SVM predictions.
method Developed SSVQR model for sparse PI estimation and feature selection algorithm.
result Proposed SSVQR model achieves sparse solutions and improves PI quality.
Introduces Soft-SVM for binary classification bridging logistic and SVM.
problem Data separability issues in binary classification.
method Soft-SVM regression using convex relaxation of hinge loss with softness and class-separation parameters.
result Soft-SVM performs well in classification and prediction errors.
Paper addresses SVM bias in high-dimension, low-sample-size settings.
problem Bias in SVM performance in high-dimension, low-sample-size settings.
method Proposes a bias-corrected SVM (BC-SVM) to improve SVM performance.
result BC-SVM gives preferable performances in high-dimension, low-sample-size settings.
Paper proposes an ensemble SVM method for efficient VAD.
problem Efficient and accurate VAD for speech processing.
method Supervised learning with ensemble SVM on large datasets.
result Ensemble SVM outperforms stand-alone SVM in VAD accuracy.
GADGET SVM uses gossip-based distributed learning for scalable SVMs.
problem Scalability issues in traditional SVM algorithms for large datasets.
method Gossip-based distributed learning for the primal SVM formulation.
result Performance comparable to centralized and online SVM algorithms.
Proposes SVM-based Deep Stacking Network for improved deep learning.
problem Improving deep learning performance and interpretability.
method Uses stacked SVM classifiers within a DSN architecture and a BP-like layer tuning scheme.
result Demonstrates superior performance compared to benchmark models on image and text data.
Prior knowledge can be used to improve predictive performance of learning algorithms or reduce the amount of data required for training. The same goal is pursued within the learning using privileged information paradigm which was recently introduced by Vapnik et al. and is aimed at utilizing additional information avai…
L3-SVMs clusters data, reduces dimensions, and learns linear models.
problem Capturing non-linearities and scaling to large datasets.
method Clusters input space, projects data onto landmarks, learns linear combination of local models.
result L3-SVMs achieves generalization guarantees and competitive performance. Paper introduces MKL-L0/1-SVM for SVM with (0,1) loss.
problem Optimization of SVM with (0,1) loss function. method MKL framework combined with ADMM algorithm for solving the optimization problem.
result Performance of MKL-L0/1-SVM comparable to SimpleMKL. The paper uses KKT conditions to reveal new insights into SVM behavior.
problem Understanding SVM behavior and tuning.
method Using Karush-Kuhn-Tucker conditions to explore SVM connections with other classifiers.
result SVM can be seen as a cropped version of mean difference and maximal data piling direction classifiers.
Reduced SVM training time by limiting solver time for model selection.
problem Time-consuming parameter tuning in SVM model selection.
method Introduced a stopping criterion for SVM training time during parameter tuning.
result Significantly reduced model selection times by an order of magnitude.
SVM used for estimating treatment effects without confounding.
problem Estimating average treatment effects in the presence of confounding variables.
method Adapts SVM classifier as a kernel-based weighting procedure to balance covariates and estimate causal effects.
result SVM provides a continuous relaxation of the quadratic integer program for balancing covariates and maximizing effective sample size.
SaR-SVM-STV improves hyperspectral image classification with shape-adaptive reconstruction and denoising.
problem Classifying hyperspectral images with limited labeled data.
method Shape-adaptive Reconstruction (SaR) for pixel preprocessing, SVM for probability estimation, and Smoothed Total Variation (STV) for denoising.
result SaR-SVM-STV outperforms SVM-STV with fewer labeled data.
We describe a novel binary classification technique called Banded SVM (B-SVM). In the standard C-SVM formulation of Cortes et al. (1995), the decision rule is encouraged to lie in the interval [1, \infty]. The new B-SVM objective function contains a penalty term that encourages the decision rule to lie in a user specif…
One of the limiting factors of using support vector machines (SVMs) in large scale applications are their super-linear computational requirements in terms of the number of training samples. To address this issue, several approaches that train SVMs on many small chunks of large data sets separately have been proposed in…
In support vector machine (SVM) applications with unreliable data that contains a portion of outliers, non-robustness of SVMs often causes considerable performance deterioration. Although many approaches for improving the robustness of SVMs have been studied, two major challenges remain in robust SVM learning. First, r…
Quantum LS-SVM simplifies matrix inversion for faster machine learning.
problem Speeding up machine learning algorithms for large datasets.
method Introduces a novel quantum algorithm using continuous variables to simplify matrix inversion in LS-SVM, and proposes a hybrid quantum-classical approach for sparse solutions.
result Quantum LS-SVM achieves exponential speed-up and can solve classically difficult tasks.
The study analyzes LS-SVM performance using random matrix theory.
problem Performance analysis of LS-SVM in large dimensional settings.
method Random matrix theory applied to LS-SVM performance analysis.
result The LS-SVM decision function is asymptotically normal.
SVM predicts economic recessions in real-time.
problem Determining the onset and end of recessions quickly.
method Support Vector Machines (SVM) applied to nowcasting.
result SVM achieves excellent predictive performance for nowcasting recessions.
Stepwise SVM reduces dimensions of large p small n datasets effectively.
problem Reducing dimensions of large p small n datasets.
method Stepwise support vector machine (SVM) for dimension reduction.
result Stepwise SVM achieves better prediction performance and is more stable than other methods.
Paper examines M-SVM for multi-task learning, showing reliability and pre-convergence-rate factor improvements.
problem Whether MTL always provides reliable results and how MTL outperforms independent learning.
method Regularized multi-task learning (MTL) based on SVM models (M-SVM).
result M-SVM is Bayes risk consistent in large sample size, improving pre-convergence-rate factor (PCR) for small data.
The paper improves SVM and localized SVM stability under triple perturbations.
problem Stability of SVMs and localized SVMs under triple perturbations.
method Generalizes and improves existing results, considering simultaneous variations in probability measure, regularization parameter, and kernel.
result Improved stability of SVMs and localized SVMs under triple perturbations.
When applying the support vector machine (SVM) to high-dimensional classification problems, we often impose a sparse structure in the SVM to eliminate the influences of the irrelevant predictors. The lasso and other variable selection techniques have been successfully used in the SVM to perform automatic variable selec…
EDSVM uses elite observations to guide SVM classification.
problem Classical SVMs lack ways to encode trusted models or preferences.
method EDSVM augments SVMs by guiding slack variables for elite observations.
result EDSVM models closely track reference SVMs while achieving competitive performance.
Fast online Kernel SVM for big data with limited resources.
problem Efficiently training SVM on large datasets with limited computational resources.
method Split input space using LVQ, train SVM in clusters, limit support vectors.
result Achieves high accuracy with high throughput on large datasets.
New SVM model balances sparsity and robustness in noisy data.
problem Noise sensitivity and lack of sparsity in traditional SVM models.
method Combines elastic net loss with robust loss framework, integrates with SVM, uses half-quadratic algorithm.
result Proves sparsity and robustness, outperforms traditional SVMs in noisy environments.
A new procedure for learning cost-sensitive SVM(CS-SVM) classifiers is proposed. The SVM hinge loss is extended to the cost sensitive setting, and the CS-SVM is derived as the minimizer of the associated risk. The extension of the hinge loss draws on recent connections between risk minimization and probability elicitat…
A novel linear classification method that possesses the merits of both the Support Vector Machine (SVM) and the Distance-weighted Discrimination (DWD) is proposed in this article. The proposed Distance-weighted Support Vector Machine method can be viewed as a hybrid of SVM and DWD that finds the classification directio…
Rgtsvm speeds up SVMs on GPUs for big data.
problem Scaling SVMs to large datasets.
method GPU acceleration for SVM classification and regression.
result Up to 100x performance improvement for millions of examples.
liquidSVM speeds up SVM for various tasks.
problem Efficiently solving SVM for large datasets.
method C++ implementation, hyper-parameter selection, multi-threading, GPU support, data decomposition.
result Unprecedented speed for small and large datasets.
New SVM models correct mean of volatility processes to satisfy efficient market hypothesis.
problem Capturing complex market behavior while maintaining efficient market hypothesis.
method Propose mean-corrections for generalized Taylor SVM models.
result Models satisfy efficient market hypothesis and capture complex market behavior.
Efficiently solves large-scale SVMs with sparse semismooth Newton method.
problem Numerical difficulties in solving large-scale SVMs.
method Sparse semismooth Newton based augmented Lagrangian method.
result Outperforms state-of-the-art solvers for large-scale SVMs.
Paper uses SVM+ for valid prediction intervals in drug discovery datasets.
problem Valid prediction intervals in drug discovery datasets.
method LUPI paradigm, SVM+, inductive conformal predictor.
result Valid prediction intervals at specified significance levels.