Paper presents an efficient algorithm for learning minimax risk classifiers with large-scale data.
problem Efficient learning of minimax risk classifiers for large-scale data with multiple classes.
method Combination of constraint and column generation for efficient learning.
result 10x speedup for general large-scale data and 100x speedup with many classes.
A novel approach calibrates Gaussian process for fast large-scale classification.
problem Deriving fast and accurate classification algorithms with uncertainty quantification.
method Applying Gaussian process regression to classification labels and calibrating predictions.
result The proposed approach provides similar accuracy and uncertainty quantification as Gaussian process classification but with significantly reduced computational resources.
We propose a method to visualize class similarity in large-scale classifiers.
problem Analyzing hierarchical structures and relationships in large-scale classification.
method Compute class similarity based on prediction scores and visualize the class similarity matrix.
result Visualizing class similarity matrices reveals hierarchical structures and relationships.
Hierarchical Softmax approximates class probabilities for large datasets efficiently.
problem Computational inefficiency of Softmax for large-scale classification tasks.
method Used Hierarchical Softmax to approximate class probabilities efficiently.
result Hierarchical Softmax performance degrades as the number of classes increases.
Large-scale Hierarchical Classification (HC) involves datasets consisting of thousands of classes and millions of training instances with high-dimensional features posing several big data challenges. Feature selection that aims to select the subset of discriminant features is an effective strategy to deal with large-sc…
Efficient Gaussian Process methods for large-scale remote sensing image classification.
problem Large-scale remote sensing data and classification challenges.
method Introduced two novel efficient methodologies for Gaussian Process classification: random Fourier features and variational Bayes.
result Demonstrated excellent computational cost and accuracy in cloud detection from multispectral and infrared imagery.
New DAM method improves AUC scores in medical image classification.
problem Maximizing AUC in large-scale medical image classification.
method Proposes AUC margin loss for robust optimization, conducts extensive empirical studies.
result Improves performance on four medical image classification tasks, achieving 1st place on Stanford CheXpert.
Paper presents Label Mapping method to solve large-scale multi-class classification problems.
problem Large-scale multi-class classification problems in deep neural networks.
method Label Mapping (LM) method to decompose the problem into smaller sub-problems.
result LM significantly outperforms standard methods in terms of accuracy and model complexity.
Study large-scale geometry of infinite type surface mapping class groups.
problem Classify surfaces based on mapping class group properties.
method Coarse geometry, using Rosendal's framework.
result Classification of surfaces based on group properties.
Proposes a novel framework for multi-label text classification.
problem Lack of coherent consideration of non-consecutive and long-distance semantics and hierarchical relations among labels.
method Hierarchical taxonomy-aware and attentional graph capsule recurrent CNNs framework.
result Significantly improves multi-label text classification performance.
HET-XL improves heteroscedastic classifiers for large-scale image classification.
problem Scaling heteroscedastic classifiers to handle large numbers of classes and tuning the temperature hyperparameter.
method HET-XL, a heteroscedastic classifier with independent parameter count from the number of classes, learns the temperature hyperparameter directly from training data.
result HET-XL requires 14X fewer additional parameters and performs better than baseline heteroscedastic classifiers on large image classification datasets.
Augments graph node features to improve GNN performance.
problem Improving graph neural networks' performance on large-scale datasets.
method Iteratively augments node features with gradient-based adversarial perturbations.
result Boosts model performance in node classification, link prediction, and graph classification tasks.
DPEs use ensembles to approximate BNNs for efficient large-scale visual active learning.
problem Efficiently annotating data for deep neural networks training.
method Deep Probabilistic Ensembles (DPEs) using regularized ensemble approximations of deep BNNs.
result DPEs achieve competitive performance with significantly less training data.
Crowdsourced satellite imagery dataset enables accurate crosswalk classification.
problem Zebra crossing classification on large-scale satellite imagery.
method Crowdsourcing for dataset creation, deep learning for model training.
result Deep learning models achieved 97.11% accuracy in crosswalk classification.
Bayesian batch active learning approximates model parameters efficiently.
problem High label acquisition cost for large-scale supervised models.
method Sparse subset approximation using Bayesian active learning.
result Efficient active learning at scale with diverse batches.
We study large-scale classification problems in changing environments where a small part of the dataset is modified, and the effect of the data modification must be quickly incorporated into the classifier. When the entire dataset is large, even if the amount of the data modification is fairly small, the computational …
Online BSP-Forest improves space partitioning for large-scale classification and regression.
problem Efficient space partitioning for large-scale classification and regression problems.
method Developed an online BSP-Forest framework that expands space coverage and refines partition structure in real-time.
result Guaranteed universal consistency for both classification and regression problems.
Paper proposes an approximate margin method for fast multi-class classification.
problem Challenges in multi-class classification with many classes.
method Uses ANN search structures and LSH for approximate margin estimation.
result Approximate margin method is highly competitive in time, memory, and performance.
A method for large scale Gaussian process classification has been recently proposed based on expectation propagation (EP). Such a method allows Gaussian process classifiers to be trained on very large datasets that were out of the reach of previous deployments of EP and has been shown to be competitive with related tec…
LIBTwinSVM offers a free library for efficient Twin Support Vector Machines.
problem Large-scale classification problems.
method Efficient implementation of Twin Support Vector Machines.
result Effectiveness demonstrated through benchmarks.
Efficiently implements large-scale CNNs using memristors.
problem Implementing high-dimensional convolution in deep neural networks efficiently.
method Developed a method to convert CNN kernels to memristor-based circuits, optimized for accuracy and minimized error.
result 8-bit ADC/DAC is necessary to preserve software level classification accuracy in memristor-based CNNs.
UniShape improves time series classification by selecting relevant subsequences.
problem Classifying time series data requires capturing interpretable shapelets.
method UniShape uses a shape-aware adapter to aggregate multiscale subsequences into class tokens.
result UniShape achieves state-of-the-art classification performance.
Many real-world regression problems demand a measure of the uncertainty associated with each prediction. Standard decision forests deliver efficient state-of-the-art predictive performance, but high-quality uncertainty estimates are lacking. Gaussian processes (GPs) deliver uncertainty estimates, but scaling GPs to lar…
This work analyzes label embedding for large multiclass classification problems.
problem Label embedding for large multiclass classification problems.
method Analysis of label embedding in extreme multiclass classification, presenting an excess risk bound and showing a trade-off between computational and statistical efficiency.
result The statistical penalty for label embedding vanishes with sufficiently low coherence under the Massart noise condition.
We study the large scale geometry of the upper triangular subgroup of PSL(2,Z[1/n]), which arises naturally in a geometric context. We prove a quasi-isometry classification theorem and show that these groups are quasi-isometrically rigid with infinite dimensional quasi-isometry group. We generalize our results to a lar…
LoCEC classifies user relationships in large social networks, addressing sparsity issues.
problem Sparse relationship feature and label data in real social platforms.
method Local Community-based Edge Classification (LoCEC) framework with three-phase processing.
result Effective and efficient classification of user relationships in large-scale networks.
GPU optimization speeds up large-scale classification tasks.
problem Efficiently training large-scale classification models on GPUs.
method Judecious GPU-optimization principles applied to TRON algorithm.
result Significant speedups for logistic regression and SVM classification.
Paper proposes a SIMO DNN for indoor localization using Wi-Fi fingerprints.
problem Indoor localization with high accuracy and efficiency.
method Single-input and multi-output deep neural network architecture.
result SIMO-DNN scheme outperforms existing methods in floor detection and location accuracy.
Study develops a new algorithm for assessing clinical trial abstracts.
problem Limited tools for assessing qualitative statements in clinical research.
method Developed a three-class sentiment classification algorithm using BERT model.
result Algorithm achieved 91.3% classification accuracy and 0.92 macro F1-Score.
Frank-Wolfe algorithms have recently regained the attention of the Machine Learning community. Their solid theoretical properties and sparsity guarantees make them a suitable choice for a wide range of problems in this field. In addition, several variants of the basic procedure exist that improve its theoretical proper…
SDHR improves data hashing for better classification accuracy.
problem Efficient data hashing for high-dimensional data retrieval.
method Supervised Discrete Hashing with Relaxation (SDHR) using optimized regression targets.
result SDHR outperforms traditional methods in classification accuracy.
We propose RoBiRank, a ranking algorithm that is motivated by observing a close connection between evaluation metrics for learning to rank and loss functions for robust classification. The algorithm shows a very competitive performance on standard benchmark datasets against other representative algorithms in the litera…
A&R method reduces computational cost for large categorical distributions.
problem High computational cost for large categorical distributions.
method Latent variable augmentation and stochastic variational inference.
result A&R provides a tighter bound on the marginal likelihood and better predictive performance.
Paper develops a method to reduce computational complexity for large-scale kernel methods.
problem Efficiency in handling large-scale data for kernel methods.
method Nyström type subsampling combined with multi-penalty regularization.
result Achieves optimal minimax convergence rates for multi-penalty regularization.
The softmax representation of probabilities for categorical variables plays a prominent role in modern machine learning with numerous applications in areas such as large scale classification, neural language modeling and recommendation systems. However, softmax estimation is very expensive for large scale inference bec…
This paper compresses large datasets for efficient machine learning.
problem Efficiently processing large datasets for machine learning.
method Constructing a sketch of the dataset using random features and averaging, then learning from the sketch.
result The approach can perform machine learning tasks without full dataset access, preserving both information and privacy.
Large-scale classification of data where classes are structurally organized in a hierarchy is an important area of research. Top-down approaches that exploit the hierarchy during the learning and prediction phase are efficient for large scale hierarchical classification. However, accuracy of top-down approaches is poor…
Space-efficient feature maps improve string alignment kernel scalability.
problem String alignment kernels scale poorly with quadratic complexity, limiting large-scale applications.
method Presented SFMEDM, a space-efficient feature map for edit distance with moves using metric embedding and random Fourier features.
result Demonstrated superior performance of SFMEDM in prediction accuracy, scalability, and computation efficiency.
This research shows unsupervised GANs can perform object segmentation without labels.
problem Performing object segmentation without pixel or image-level labels.
method Used large-scale unsupervised GAN models to differentiate foreground from background.
result Demonstrated high-quality saliency masks and new state-of-the-art performance.
New privacy mechanisms allow fitting large-scale models without degrading utility.
problem Maintaining privacy in large-scale decentralized learning.
method Reconceptualizing local differential privacy protections against limited prior information.
result Practical locally differentially private mechanisms for all privacy levels.
Efficiently trains large-scale ordinal regression models using DCD.
problem Efficiently training large-scale ordinal regression models.
method Dual coordinate descent method (DCD) for training and a new prediction function.
result Extensive experiments show the DCD method is suitable for large-scale data.
Efficient algorithms for large-scale multiclass classification with linear classifiers.
problem Training ℓ1-regularized linear classifiers with high dimensionality and many classes. method Combines quasi-bilinear objective, stochastic mirror descent, and non-uniform sampling.
result Proposes a sublinear algorithm for multiclass hinge loss.
New neural network method simplifies high-dimensional data.
problem Scalability issues in nonlinear sufficient dimension reduction.
method Stochastic neural network with adaptive gradient algorithm.
result Proposed method outperforms existing methods on large-scale data.
Bayesian inference improves deep learning performance and uncertainty.
problem Overfitting and lack of robustness in deep learning models.
method ATMC (Adaptive Noise MCMC) algorithm for sampling from posterior distributions of neural networks.
result ATMC outperforms optimization baselines in classification accuracy and test log-likelihood on Cifar10 and ImageNet benchmarks.
This paper surveys large-scale machine learning methods for efficient data analysis.
problem Efficiently processing large-scale data with machine learning models.
method Divided into three categories: model simplification, optimization approximation, and computation parallelism.
result Blueprint for future developments in large-scale machine learning.
A method reduces dimensionality for multi-block data, enhancing feature extraction and classification accuracy.
problem Tractable feature extraction from large-scale, multi-dimensional data.
method Common and individual feature extraction from multi-block data structures using tensor decompositions.
result Significant reduction in dimensionality and enhanced accuracy in feature extraction and classification.
Improved audio event recognition using audiovisual transformers.
problem Weakly labeled audio event classification with limited temporal information.
method Adapted transformer architecture that combines audio and video inputs.
result State-of-the-art performance on audiovisual data set.
New machine learning method detects quantum separability in large-scale systems.
problem Deciding quantum separability of large-scale bipartite density matrices.
method Frank-Wolfe-based algorithm for finding nearest separable density matrices and classification of density matrices as separable or entangled.
result The method scales up to thousands of density matrices and achieves high quantum entanglement detection accuracy.