Active learning method balances bias and variance under class imbalance.
problem Active learning under label shift when class proportions differ.
method Mediated Active Learning under Label Shift (MALLS) using a 'medial distribution'.
result MALLS reduces asymptotic sample complexity under arbitrary label shift.
A simple method for learning activation functions in neural networks.
problem Determining the best activation function for neural networks is challenging.
method Adding local subnetworks with a small amount of neurons to the neural network.
result The proposed method leads to better results compared to using a pre-defined activation function.
DAL uses disentanglement for automatic labeling in GAN-based active learning.
problem Reducing human labeling in GAN-based active learning.
method DAL leverages disentanglement in InfoGAN to automatically label datapoints, deciding human labeling based on disagreement with InfoGAN labels and label correction.
result DAL achieves better performance than existing GAN-based active learning approaches on image classification tasks.
Active learning method improves AI performance by balancing exploration and exploitation.
problem Efficiently acquiring samples for supervised learning in streaming data.
method Ensemble active learning by contextual bandits.
result Improved AI modeling performance through better sample acquisition.
New active learning methods for Gaussian process improve predictive modeling of composite fuselage.
problem Improving predictive modeling of composite fuselage with limited training samples and uncertainties.
method Proposed two new active learning algorithms for Gaussian process considering uncertainties.
result The proposed approach realizes better prediction performance for automatic shape control of composite fuselage.
New active learning method uses combinatorial coverage to improve data transfer and reduce bias.
problem Inability to transfer sampled data to new models and sampling bias issues.
method Data-centric active learning methods utilizing combinatorial coverage.
result Sampling data with coverage leads to better data transfer and competitive sampling bias.
Bayesian active learning method improved for censored regression data.
problem Challenges in estimating BALD for censored regression data.
method Derived entropy and mutual information for censored distributions, developed C-BALD objective, proposed novel modelling approach. result Demonstrated C-BALD outperforms other methods in censored regression. O-MedAL optimizes medical image analysis with online active deep learning.
problem Improving accuracy in medical image analysis with limited labeled data.
method Online Active Deep Learning method that queries examples maximizing average distance to training set.
result Significant performance improvements, including 6.30% accuracy boost with 25% labeled data.
A new AI framework optimizes expert labeling of unlabeled data.
problem Efficiently labeling unlabeled data for AI systems.
method Human-in-the-loop active learning framework with innovative query schemes.
result Higher accuracy and lower loss compared to other methods.
Improved video tracking accuracy with active learning.
problem Efficiently predicting object matches in videos with active learning.
method Adversarial approach for active learning with structured prediction domains.
result Better accuracy and computational efficiency for object tracking.
A new active learning method that improves model diversity and performance.
problem Efficiently selecting examples to label for training multiple models.
method Trains multiple models on bootstrap samples and selects examples based on minimum margin.
result Min-margin outperforms other methods, especially with larger batch sizes.
Bayesian batch active learning approximates model parameters efficiently.
problem High label acquisition cost for large-scale supervised models.
method Sparse subset approximation using Bayesian active learning.
result Efficient active learning at scale with diverse batches.
Proposes a graph-based method for active learning in regression.
problem Active learning for regression is understudied and faces challenges with noisy labels and parameter uncertainty.
method Formulates active regression as a bipartite graph optimization problem.
result Demonstrates the effectiveness of the proposed graph-based approach on benchmark data sets.
Collaborative filtering is a useful technique for exploiting the preference patterns of a group of users to predict the utility of items for the active user. In general, the performance of collaborative filtering depends on the number of rated examples given by the active user. The more the number of rated examples giv…
New batch active learning method using DPP reduces computational costs.
problem Efficiently labeling data samples in parallel settings with limited data.
method Batch active learning using Determinantal Point Processes (DPP).
result DPP-based batch active learning reduces computational costs compared to previous methods.
Deep active learning improves solvability prediction in power systems.
problem Inconclusive conservatism in traditional solvability region analysis methods.
method Proposes a deep active learning framework to reduce labeled dataset size.
result Significantly reduces the size of labeled dataset for training.
DAL improves active learning for neural networks with large batch sizes.
problem Efficiently choosing examples to label for neural networks with large batch sizes.
method DAL treats active learning as a binary classification task to make labeled and unlabeled sets indistinguishable.
result DAL performs on par with state-of-the-art methods in medium and large query batch sizes.
Paper proposes a few-shot learning method for human activity recognition.
problem Efficiently recognize human activities with limited labeled data.
method Uses deep learning for feature extraction and knowledge transfer from existing models.
result Promising results show the proposed method's advantages over traditional approaches.
Study improves peptide design efficiency using active and meta-learning.
problem Designing novel functional peptides is inefficient due to low throughput and lack of data.
method Investigated active learning and meta-learning for optimizing peptide design experiments.
result Meta-learning improved average accuracy, but neither method outperformed random choice.
Even though active learning forms an important pillar of machine learning, deep learning tools are not prevalent within it. Deep learning poses several difficulties when used in an active learning setting. First, active learning (AL) methods generally rely on being able to learn and update models from small amounts of …
Active learning methods increase classification quality by means of user feedback. An important subcategory is active learning for outlier detection with one-class classifiers. While various methods in this category exist, selecting one for a given application scenario is difficult. This is because existing methods rel…
New approach for active learning in overparameterized models.
problem Efficiently labeling datasets in machine learning.
method MaxiMin Active Learning for nonparametric or overparameterized models.
result Automatically identifies decision boundaries and data clusters.
Proposes an offline active learning method for graphs.
problem Active learning on graphs where labeling is expensive.
method Two-stage biased sampling strategy considering informativeness and representativeness.
result Establishes a theoretical relationship between generalization error and number of nodes selected.
Efficient active learning method defends against malicious mislabeling and data poisoning attacks.
problem Malicious mislabeling and data poisoning attacks on deep neural networks.
method Adversarial retraining and active learning with random sampling strategy.
result The proposed method achieves 89% accuracy with only one-third of the labeled data, significantly outperforming the baseline method.
New method uses neural tangent kernel for efficient active learning.
problem Efficiently approximating deep learning's look-ahead selection criteria.
method Approximates retraining with neural tangent kernel for active learning.
result Approximation works asymptotically and enables sequential active learning.
New method learns neural network activation functions from data.
problem Learning activation functions for neural networks.
method Model each neuron's activation function as a small neural network.
result Learned activation functions improve network performance.
ADS filters data points for efficient batch active learning.
problem Efficiently selecting data points for annotation in parallel settings.
method Active Data Shapley (ADS) using the Shapley value of data.
result Significantly increases efficiency of active learning by 6x.
This paper proposes an active metric learning method for clustering with pairwise constraints.
problem Clustering with pairwise constraints and improving clustering performance.
method Active metric learning method that queries informative instance pairs and updates the learned metric sequentially.
result The proposed method enhances clustering performance and provides a tighter error bound.
Deep learning models outperform classical methods in forecasting neural activity.
problem Improving forecasting of neural activity using deep learning models.
method Systematic evaluation of eight probabilistic deep learning models against classical statistical models and baseline methods.
result Several deep learning models consistently outperform classical approaches in forecasting neural activity.
ICAL improves deep learning model accuracy and NLL with optimized batch labeling.
problem Deep Bayesian Active Learning for efficient model training.
method ICAL uses HSIC to measure dependency and optimizes batch size scaling.
result Significant improvements in model accuracy and NLL on image datasets.
Supervised machine learning methods usually require a large set of labeled examples for model training. However, in many real applications, there are plentiful unlabeled data but limited labeled data; and the acquisition of labels is costly. Active learning (AL) reduces the labeling cost by iteratively selecting the mo…
Improves graph-based active learning for non-Gaussian models.
problem Efficiently selecting data points for labeling in graph-based semi-supervised learning.
method Approximates non-Gaussian distributions, introduces rank-one update and model change acquisition function.
result Enhanced active learning for graph-based SSL under non-Gaussian models.
Annotation of training data is the major bottleneck in the creation of text classification systems. Active learning is a commonly used technique to reduce the amount of training data one needs to label. A crucial aspect of active learning is determining when to stop labeling data. Three potential sources for informing …
Study proposes a stopping criterion for active learning based on error stability.
problem Improving predictive performance in active learning by adaptively annotating samples.
method Proposes a stopping criterion based on error stability for Bayesian active learning.
result Demonstrates the proposed criterion stops active learning at the appropriate timing for various models and datasets.
Logistic regression is by far the most widely used classifier in real-world applications. In this paper, we benchmark the state-of-the-art active learning methods for logistic regression and discuss and illustrate their underlying characteristics. Experiments are carried out on three synthetic datasets and 44 real-worl…
Extends batch active learning to non-differentiable models.
problem Efficiently training machine learning models on large, initially unlabelled datasets.
method Black-box batch active learning for regression tasks that relies solely on model predictions.
result Achieves strong performance on regression datasets compared to white-box approaches for deep learning models.
New method uses GNNs and node feature propagation for active learning in graph node classification.
problem Lack of labeled data for graph neural networks.
method Node feature propagation followed by K-Medoids clustering for instance selection.
result Proposed method significantly outperforms other methods on benchmark datasets.
Transfer learning improves activity recognition accuracy on smartwatches.
problem Inconsistent activity recognition accuracy across different users.
method On-device calibration of GBM by tuning parameters without retraining.
result Significant improvement in user-based accuracy for activity recognition.
A new method uses active learning to improve chemical simulation efficiency.
problem Efficiently estimating equilibrium-based chemical simulations.
method Sequential data-driven approach using Gaussian process uncertainty.
result Significantly reduced number of function evaluations.
This paper proposes an improved active learning method using classification trees.
problem Reducing the size of training sets while maintaining high accuracy in supervised learning.
method A wrapper active learning method using a classification tree to sub-sample from low-entropy regions.
result The proposed method constructs accurate classification models even with severely restricted labeled data.
Proposes a method to improve deep active learning for NER tasks.
problem Weaknesses of existing deep active learning algorithms in practice.
method Estimates error decay curves of feature-defined subsets to improve sampling efficiency and robustness.
result Significantly outperforms diversification-based methods for black-box NER taggers and makes sampling more robust to labeling noise.
Efficiently learns reward functions with fewer queries and shorter computation times.
problem Expensive data generation and labeling in robot learning.
method Batch active preference-based learning methods using determinantal point processes (DPP) and heuristic alternatives.
result Our batch active learning algorithm requires only a few queries and computes them in a short amount of time.
A method to improve sequential learning by keeping past data errors in check.
problem Challenges in sequential learning with Gaussian processes due to accumulating errors.
method Memory-based dual sparse variational Gaussian processes.
result Improves accuracy in inference and learning for various applications.
Novel active learning framework using sparse approximation for efficient model training.
problem Efficient model training with limited labeled data.
method Formulates batch active learning as sparsity-constrained discontinuous optimization problems, using greedy or proximal iterative hard thresholding algorithms.
result Achieves competitive performance with lower computational complexity across different settings.
New method speeds up neural kernel computations for various activations.
problem Inefficient computation of neural kernels for general activations.
method Fast sketching method using truncated Hermite expansion.
result 106x speedup for approximate CNTK computation on CIFAR-10.
Unified query framework for active metric learning and classification.
problem Combining representation learning and task-specific goals in machine learning.
method Adaptive selection of nearest neighbor queries using information theoretic criterion.
result Actively selected nearest neighbor queries outperform recent methods in deep metric learning and classification.
Labeling each instance in a large dataset is extremely labor- and time- consuming . One way to alleviate this problem is active learning, which aims to which discover the most valuable instances for labeling to construct a powerful classifier. Considering both informativeness and representativeness provides a promising…
This work approximates neural networks with Gaussian processes for more efficient active learning.
problem Efficiently updating uncertainty estimates for neural networks without retraining.
method Approximating Bayesian neural networks with Gaussian processes.
result The proposed approach outperforms state-of-the-art methods in experiments.