New algorithms reduce computational burden for principal support vector machines.
problem High computational cost of principal support vector machines for large datasets.
method Two distributed estimation algorithms for principal support vector machines.
result Statistical efficiency is maintained with distributed algorithms.
Distributed SVM algorithm improves performance in real-world applications.
problem Improving SVM performance in distributed computing environments.
method Proposes HPSVM, a distributed SVM algorithm that minimizes inter-machine communications.
result HPSVM achieves similar or better results than state-of-the-art SVM techniques.
This paper proposes MMD-SVR to improve SVR's margin distribution for better generalization.
problem Improving SVR's generalization performance by maximizing the margin distribution of the whole dataset.
method Introducing MMD-SVR with coupled constraints to convert a non-convex optimization problem into a convex one.
result MMD-SVR significantly improves prediction accuracy and generalization compared to classic SVR.
Enhances SVM for uncertain data with probabilistic Gaussian distributions.
problem Binary classification with uncertain data and error bounds.
method Probabilistic kernel Support Vector Machines using Gaussian distributions.
result Suitable kernel function for uncertain data.
It is shown that bootstrap approximations of support vector machines (SVMs) based on a general convex and smooth loss function and on a general kernel are consistent. This result is useful to approximate the unknown finite sample distribution of SVMs by the bootstrap approach.
Improved fuzzy support vector machine for stock price trend forecasting.
problem Weak performance of traditional support vector machines in handling fuzzy and noisy data.
method Proposed a novel advanced fuzzy support vector machine (NA-FSVM) to improve precision.
result Improved model precision in predicting stock price trends.
Support Vector Machines predict gas-liquid flow patterns with 97% accuracy.
problem Predicting gas-liquid flow patterns in multiphase flow systems.
method Support Vector Machine (SVM) applied to a dataset of two-phase flow patterns.
result Achieved 97% correct classification of flow patterns.
Support spinor machine extends SVM to handle spinor fields in time series data.
problem Handling nonstationary and nonlinear time series data for classification.
method Using wedge product to extend vector fields to spinor fields, extending SVM to support spinor machine.
result Support spinor machine outperforms SVM in one class classification of physiological time series data.
Distributed-OMP recovers sparse vectors with low communication costs.
problem High-dimensional sparse linear regression with limited computation and communication.
method Distributed orthogonal matching pursuit (OMP) scheme.
result Support of the regression vector can be recovered with linear communication per machine and logarithmic in dimension.
This work develops secure distributed algorithms for machine learning to protect against data poisoning and network attacks.
problem Vulnerability of distributed machine learning algorithms to cyber threats.
method Game-theoretic framework to capture conflicting goals of a learner and an attacker, iterative distributed algorithm.
result Distributed SVM is prone to fail in different types of attacks, with impact depending on network structure and attack capabilities.
Support vector machines have attracted much attention in theoretical and in applied statistics. Main topics of recent interest are consistency, learning rates and robustness. In this article, it is shown that support vector machines are qualitatively robust. Since support vector machines can be represented by a functio…
This research develops secure DSVM algorithms using game theory.
problem Vulnerability of DSVM in adversarial environments.
method Game-theoretic framework to model conflicting interests between adversary and DSVM units.
result Guaranteed convergence of distributed learning algorithms without data or network topology assumptions.
Minimal SVM reduces support vectors for better classification.
problem Finding optimal hyperplane for classification with fewer support vectors.
method Proposes a Minimal SVM using L0.5 norm on slack variables.
result Increases classification performance by reducing support vectors.
This work designs secure DSVMs against adversaries using game theory.
problem Adversaries can deceive DSVMs leading to misclassification and misprediction.
method Game-theoretic framework to model DSVM learner and attacker interactions, finding Nash equilibrium.
result DSVM learner is less vulnerable with balanced networks and more training samples.
For binary classification we establish learning rates up to the order of n−1 for support vector machines (SVMs) with hinge loss and Gaussian RBF kernels. These rates are in terms of two assumptions on the considered distributions: Tsybakov's noise assumption to establish a small estimation error, and a new geometr…
We describe a method for predicting a classification of an object given classifications of the objects in the training set, assuming that the pairs object/classification are generated by an i.i.d. process from a continuous probability distribution. Our method is a modification of Vapnik's support-vector machine; its ma…
The Support Vector Machine (SVM) of Vapnik (1998) has become widely established as one of the leading approaches to pattern recognition and machine learning. It expresses predictions in terms of a linear combination of kernel functions centred on a subset of the training data, known as support vectors. Despite its wide…
Quantum SVM clustering speeds up big data analysis.
problem Performance degradation of classical SVM clustering on big data.
method Developed a quantum version of SVM clustering using quantum support vector machine and kernels.
result Significant speed-up gain on run-time complexity.
We propose an algorithm for exploring the entire regularization path of asymmetric-cost linear support vector machines. Empirical evidence suggests the predictive power of support vector machines depends on the regularization parameters of the training algorithms. The algorithms exploring the entire regularization path…
Introduces STTM to improve STM's performance.
problem Overfitting and curse of dimensionality in SVM.
method Replaces rank-one tensor in STM with tensor train.
result STTM outperforms SVM and STM.
A main goal of regression is to derive statistical conclusions on the conditional distribution of the output variable Y given the input values x. Two of the most important characteristics of a single distribution are location and scale. Support vector machines (SVMs) are well established to estimate location functions …
SVM generalizes well even with many support vectors in high dimensions.
problem Generalization of SVM in high-dimensional spaces with many support vectors.
method Identified new deterministic equivalences and proved conditions for support vector proliferation.
result Broadened conditions for SVM generalization in high-dimensional settings and proved converse result.
The paper proposes an algorithm to enumerate K best models with distinct support vectors for SVM.
problem Finding multiple models with distinct support vectors for non-standard machine learning applications.
method A K-best model enumeration algorithm for SVM that efficiently finds models with distinct support vectors in the dual SVM problem.
result The algorithm efficiently finds the next best model with small latency, useful for interactive examination of requirements.
This paper presents a kernel-based discriminative learning framework on probability measures. Rather than relying on large collections of vectorial training examples, our framework learns using a collection of probability distributions that have been constructed to meaningfully represent training data. By representing …
Training structured prediction models is time-consuming. However, most existing approaches only use a single machine, thus, the advantage of computing power and the capacity for larger data sets of multiple machines have not been exploited. In this work, we propose an efficient algorithm for distributedly training stru…
LIBTwinSVM offers a free library for efficient Twin Support Vector Machines.
problem Large-scale classification problems.
method Efficient implementation of Twin Support Vector Machines.
result Effectiveness demonstrated through benchmarks.
Additive noise protects privacy in releasing datasets for SVM classification.
problem Maintaining privacy in releasing datasets for SVM classification.
method Additive noise applied to obfuscate the dataset, optimizing privacy and utility measures.
result Optimal noise distribution ensures close classifier performance between original and obfuscated datasets, achieving local differential privacy.
Improved SVMs handle large datasets more efficiently and robustly.
problem Handling large datasets in SVMs for runtime and storage.
method Developed a locally learned predictor using influence function analysis.
result The locally learned predictor is differentiable and robust to distribution changes.
New spectral mixture representation for isotropic kernels simplifies random Fourier features.
problem Applying Random Fourier Features to complex kernels.
method Decompose isotropic kernels into scale mixtures of α-stable random vectors.
result Constructive spectral sampling formula for various kernels.
SecVM preserves user privacy in training SVMs for classification tasks.
problem Training supervised classifiers on sensitive user data while maintaining privacy.
method A novel secret vector machine (SecVM) framework for training linear SVMs in a distributed, privacy-preserving manner.
result SecVM outperforms baselines in a large-scale online evaluation, preserving user privacy and classification accuracy.
This paper uses synthetic data to improve machine learning performance on small, imbalanced datasets.
problem Improving machine learning performance on small and imbalanced datasets.
method Generates synthetic data through convex combination and uses it in a semi-supervised learning framework with support vector machines.
result Synthetic data over-sampling supports the cluster assumption in semi-supervised learning, leading to outstanding results for small high-dimensional datasets and imbalanced learning problems.
In this paper we solve support vector machines in reproducing kernel Banach spaces with reproducing kernels defined on nonsymmetric domains instead of the traditional methods in reproducing kernel Hilbert spaces. Using the orthogonality of semi-inner-products, we can obtain the explicit representations of the dual (nor…
New results on max-entropy distributions with succinct descriptions and stability.
problem Understanding the complexity and stability of max-entropy distributions.
method Polynomial-time algorithms and bounds on bit complexity.
result Polynomial bit complexity of ε-optimal dual solutions to max-entropy convex programs.
Efficiently trains SVM models on large datasets using coreset technology.
problem Training large-scale SVM models efficiently on Big Data.
method Developed an algorithm to create a coreset, a small representative subset of data.
result Proved the size of coreset required for SVM models and showed its applicability to streaming data.
We propose one-class support measure machines (OCSMMs) for group anomaly detection which aims at recognizing anomalous aggregate behaviors of data points. The OCSMMs generalize well-known one-class support vector machines (OCSVMs) to a space of probability measures. By formulating the problem as quantile estimation on …
We propose one-class support measure machines (OCSMMs) for group anomaly detection which aims at recognizing anomalous aggregate behaviors of data points. The OCSMMs generalize well-known one-class support vector machines (OCSVMs) to a space of probability measures. By formulating the problem as quantile estimation on …
Bayesian SVM method speeds up big data predictions.
problem Efficiently predicting with big data and uncertainty.
method Stochastic variational inference and inducing points.
result Faster than competing Bayesian methods, scalable to millions of data points.
PET-TURTLE improves clustering accuracy for imbalanced data.
problem Imbalanced data causes clustering errors.
method Generalizes cost function and introduces sparse logits.
result PET-TURTLE enhances overall clustering accuracy for imbalanced data.
The least-squares support vector machine is a frequently used kernel method for non-linear regression and classification tasks. Here we discuss several approximation algorithms for the least-squares support vector machine classifier. The proposed methods are based on randomized block kernel matrices, and we show that t…
Paper develops distributed inference for SVM binary classification.
problem Challenges in modern data size for existing statistical inference.
method Proposes MDL estimator for linear SVM, computationally efficient.
result MDL estimator achieves optimal statistical efficiency.
Optimizes memory and computation in wearable systems.
problem Minimizing resource usage in real-time classification for wearable systems.
method Hierarchical SVM classifier structure and memory optimization techniques.
result Up to 56% reduction in memory storage for activity recognition.
Efficient algorithms solve large-scale DRSVM problems.
problem Optimizing support vector machines under worst-case distribution uncertainty.
method Epigraphical projection-based incremental algorithms.
result Incremental algorithms solve DRSVM problems up to 1000x faster than state-of-the-art methods.
Rgtsvm provides a fast and flexible support vector machine (SVM) implementation for the R language. The distinguishing feature of Rgtsvm is that support vector classification and support vector regression tasks are implemented on a graphical processing unit (GPU), allowing the libraries to scale to millions of examples…
Morse neural networks improve uncertainty quantification and detection.
problem Uncertainty quantification and out-of-distribution detection.
method Generalizes unnormalized Gaussian densities to high-dimensional submanifolds using KL-divergence loss.
result Unified approach for OOD detection, anomaly detection, and continuous learning.
The support vector machine (SVM) is an important class of learning machines for function approach, pattern recognition, and time-serious prediction, etc. It maps samples into the feature space by so-called support vectors of selected samples, and then feature vectors are separated by maximum margin hyperplane. The pres…
Statistical learning theory explains SVMs for data-driven decision making.
problem Decision making and model construction from data.
method Statistical learning theory, focusing on empirical and structural risk minimization.
result Support Vector Machines (SVMs) are a prominent implementation of structural risk minimization.
We improve recently published results about resources of Restricted Boltzmann Machines (RBM) and Deep Belief Networks (DBN) required to make them Universal Approximators. We show that any distribution p on the set of binary vectors of length n can be arbitrarily well approximated by an RBM with k-1 hidden units, where …
Proposes MLPSVM for multi-label learning, improving on binary relevance.
problem Handles multi-label learning tasks more efficiently than binary relevance.
method Uses standard support vector machines with parallel decision hyper-planes.
result Outperforms other multi-label learning algorithms on various data sets.