We propose an active set selection framework for Gaussian process classification for cases when the dataset is large enough to render its inference prohibitive. Our scheme consists of a two step alternating procedure of active set update rules and hyperparameter optimization based upon marginal likelihood maximization.…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,742 papers · 148 categories
Trend · papers per month
48 results for “active set”
Screening rules help identify active sets in optimization problems.
problem Identifying active sets in optimization problems.
method Screening rules based on subdifferential sets and optimality conditions.
result The number of iterations needed depends only on the convergence rate.
Active learning improves SR by proposing experiments in data-limited settings.
problem Efficiently gathering data for symbolic regression with physical constraints.
method Query by committee using the Pareto frontier of equations, with physical constraints.
result Reduces data required for SR and achieves state-of-the-art results.
Active learning can't improve over passive in certain settings.
problem Active learning vs. passive learning in nonparametric settings.
method Analyzing margin conditions and their effects on active learning performance.
result Nuances in margin conditions determine whether active learning can outperform passive learning.
This paper proposes an improved active learning method using classification trees.
problem Reducing the size of training sets while maintaining high accuracy in supervised learning.
method A wrapper active learning method using a classification tree to sub-sample from low-entropy regions.
result The proposed method constructs accurate classification models even with severely restricted labeled data.
A Primal Dual Active Set with Continuation Algorithm for the \ell^0-Regularized Optimization Problemmath.OC
We develop a primal dual active set with continuation algorithm for solving the \ell^0-regularized least-squares problem that frequently arises in compressed sensing. The algorithm couples the the primal dual active set method with a continuation strategy on the regularization parameter. At each inner iteration, it fir…
Automatic recognition of human activities from time-series sensor data (referred to as HAR) is a growing area of research in ubiquitous computing. Most recent research in the field adopts supervised deep learning paradigms to automate extraction of intrinsic features from raw signal inputs and addresses HAR as a multi-…
Active feature selection uses mutual information to choose fewer labels for better feature selection.
problem Selecting features with limited labeled data.
method Uses active feature selection with mutual information criterion, optimizing label selection for better feature quality.
result Algorithm selects features with higher mutual information using fewer labels than the data set size.
Early stopping in meta-learning improved by analyzing neural activation patterns.
problem Early stopping in few-shot learning is challenging due to distributional shifts between meta-validation and meta-test sets.
method Activation-Based Early-stopping (ABE) analyzes hidden layer activations from unlabelled support examples to detect when target generalization diverges from source data.
result Simple activation statistics can effectively estimate target generalization, improving few-shot transfer learning across various algorithms and datasets.
This paper proposes a new method to select labeled data points using VAEs for active learning.
problem High cost of acquiring labels in supervised machine learning.
method Data-driven approach using Variational Autoencoders (VAEs) to select a diverse core-set in a low-dimensional latent space.
result Improvement in accuracy over related techniques, highlighting the representation power of generative modeling.
REALITrees uses a Rashomon ensemble approach for active learning in sparse decision trees.
problem Active learning reduces labeling costs by selecting informative samples, but current methods often sacrifice model diversity and direct characterization of the hypothesis space.
method REALITrees constructs a committee of all near-optimal sparse decision tree models using a Rashomon Set and a Gibbs posterior to weight them by empirical risk.
result REALITrees outperforms randomized ensembles, especially in noisy environments, by leveraging expanded model multiplicity.
Active learning holds promise of significantly reducing data annotation costs while maintaining reasonable model performance. However, it requires sending data to annotators for labeling. This presents a possible privacy leak when the training set includes sensitive user data. In this paper, we describe an approach for…
Proposes a graph-based method for active learning in regression.
problem Active learning for regression is understudied and faces challenges with noisy labels and parameter uncertainty.
method Formulates active regression as a bipartite graph optimization problem.
result Demonstrates the effectiveness of the proposed graph-based approach on benchmark data sets.
In this paper, we consider the problem of recovering a sparse signal based on penalized least squares formulations. We develop a novel algorithm of primal-dual active set type for a class of nonconvex sparsity-promoting penalties, including , bridge, smoothly clipped absolute deviation, capped and mini…
Active learning selects samples for labeling to build accurate models with minimal labeled data.
problem Costly acquisition of labeled data in supervised learning.
method Adaptive selection of unlabeled data samples for labeling.
result Efficient model building with minimal labeled data.
The most widely used activation functions in current deep feed-forward neural networks are rectified linear units (ReLU), and many alternatives have been successfully applied, as well. However, none of the alternatives have managed to consistently outperform the rest and there is no unified theory connecting properties…
UNREAL selectively ensembles distinct models to improve active learning performance.
problem Difficulty in distinguishing genuine uncertainty from noise in limited labeled data.
method Selective ensembling of distinct models from the Rashomon set.
result UNREAL achieves faster convergence and up to 20% predictive accuracy improvement.
Unsupervised detection and open-set classification of fast-ramped flexibility activation eventseess.SY
Automates detection of fast-ramped flexibility events for DSOs.
problem Monitoring and supervising flexibility activations in power systems.
method Unsupervised detection and open-set classification.
result Automatically identifies critical flexibility activations for early intervention.
ADS filters data points for efficient batch active learning.
problem Efficiently selecting data points for annotation in parallel settings.
method Active Data Shapley (ADS) using the Shapley value of data.
result Significantly increases efficiency of active learning by 6x.
Develops active intervals for geodesics in Teichmüller space.
problem Understanding geodesics in Teichmüller space with no backtracking.
method Defines active intervals for subsurfaces along geodesics in Thurston metric.
result Active intervals represent reparametrized quasi-geodesics in curve graphs with bounded movement outside.
Efficiently selects nearest neighbors for labeling to speed up active learning.
problem Intractable active learning and search for large-scale unlabeled data.
method Restricts candidate pool to nearest neighbors of labeled set.
result Achieved similar performance to global approach but reduced computational cost by up to 3 orders of magnitude.
Supervised machine learning methods usually require a large set of labeled examples for model training. However, in many real applications, there are plentiful unlabeled data but limited labeled data; and the acquisition of labels is costly. Active learning (AL) reduces the labeling cost by iteratively selecting the mo…
Deep networks can approximate various activation functions with modest adjustments.
problem Expressive power of deep neural networks with diverse activation functions.
method Approximation of any activation function in set A by ReLU networks with specific scaling factors.
result Approximation of any activation function in a specific subset of A by ReLU networks with (1,1) scaling factors.
Study active learning of PTFs with derivative access.
problem Active learning of polynomial threshold functions (PTFs).
method Algorithm for active learning degree- univariate PTFs with derivative access.
result Computational efficient algorithm for active learning degree- univariate PTFs.
The Use of Unlabeled Data versus Labeled Data for Stopping Active Learning for Text Classificationcs.LG
Annotation of training data is the major bottleneck in the creation of text classification systems. Active learning is a commonly used technique to reduce the amount of training data one needs to label. A crucial aspect of active learning is determining when to stop labeling data. Three potential sources for informing …
We study agnostic active learning, where the goal is to learn a classifier in a pre-specified hypothesis class interactively with as few label queries as possible, while making no assumptions on the true function generating the labels. The main algorithms for this problem are {\em{disagreement-based active learning}}, …
This research improves neural network performance with adaptive activation functions in sparse data settings.
problem Limited data availability in scientific and engineering problems.
method Investigation of two types of adaptive activation functions with individual trainable parameters.
result Adaptive activation functions, especially with individual trainable parameters, enhance prediction accuracy and confidence in sparse data settings.
Recognizing group activities is challenging due to the difficulties in isolating individual entities, finding the respective roles played by the individuals and representing the complex interactions among the participants. Individual actions and group activities in videos can be represented in a common framework as the…
Paper presents a robust transfer learning method for active level set estimation.
problem Efficiently identifying regions of a black-box function with limited function evaluations.
method Incorporates prior knowledge from a related function while locally adapting it.
result The method achieves better convergence of level sets compared to standard transfer learning.
Novel active learning framework using sparse approximation for efficient model training.
problem Efficient model training with limited labeled data.
method Formulates batch active learning as sparsity-constrained discontinuous optimization problems, using greedy or proximal iterative hard thresholding algorithms.
result Achieves competitive performance with lower computational complexity across different settings.
Convolutional neural networks (CNNs) have been successfully applied to many recognition and learning tasks using a universal recipe; training a deep model on a very large dataset of supervised examples. However, this approach is rather restrictive in practice since collecting a large set of labeled images is very expen…
Smartwatches are increasingly being used to recognize human daily life activities. These devices may employ different kind of machine learning (ML) solutions. One of such ML models is Gradient Boosting Machine (GBM) which has shown an excellent performance in the literature. The GBM can be trained on available data set…
Model Selection for High-Dimensional Regression under the Generalized Irrepresentability Conditionmath.ST
In the high-dimensional regression model a response variable is linearly related to covariates, but the sample size is smaller than . We assume that only a small subset of covariates is `active' (i.e., the corresponding coefficients are non-zero), and consider the model-selection problem of identifying the a…
We propose a new active learning by query synthesis approach using Generative Adversarial Networks (GAN). Different from regular active learning, the resulting algorithm adaptively synthesizes training instances for querying to increase learning speed. We generate queries according to the uncertainty principle, but our…
Active WeaSuL uses active learning to improve weak supervision for better model performance.
problem Limited labelled data in machine learning.
method Combines active learning with weak supervision to improve probabilistic labels.
result Active WeaSuL outperforms weak supervision and active learning with limited labelled data.
ICAL improves deep learning model accuracy and NLL with optimized batch labeling.
problem Deep Bayesian Active Learning for efficient model training.
method ICAL uses HSIC to measure dependency and optimizes batch size scaling.
result Significant improvements in model accuracy and NLL on image datasets.
Improved GP decoder training with SAS approximations.
problem Training expensive Gaussian process decoders is challenging and computationally expensive.
method Developed a new stochastic estimate of log-marginal likelihood based on cross-validation.
result SAS-GP improves robustness and reduces computational cost compared to variational autoencoders.
A new framework scales active search for large datasets.
problem Scaling active search for large, high-dimensional data sets.
method Hierarchical Batch Bandit Search (HBBS) framework.
result HBBS improves performance and scalability for batch search.
A semi-supervised learning framework for quantitative structure-activity regression modellingstat.AP
Semi-supervised learning improves QSAR model predictions for novel compounds.
problem Improving model predictions for compounds not in the training set and adjusting for selection bias.
method Semi-supervised learning framework to estimate model quality and adjust for selection bias.
result Predictions for novel compounds are improved by accounting for compound similarity and selection bias.
New algorithm for active learning in multiple matrix completion problems.
problem Simultaneous matrix completion with unknown ranks and varying sizes.
method MAlocate algorithm that adapts to unknown ranks and sizes.
result Minimax-optimal performance demonstrated with lower-bound analysis.
Extends active subspace analysis to infinite dimensions.
problem Dimension reduction in infinite dimensional functionals.
method Defines an operator for Hilbert space, extends Euclidean properties, proposes Monte Carlo procedure.
result Desirable properties extend to infinite dimensional setting.
Efficient active learning with abstention reduces label complexity exponentially.
problem Achieving high accuracy with minimal labels.
method Developed a computationally efficient active learning algorithm with abstention.
result Achieves polylog(1/ε) label complexity, reducing by an exponential factor.
We consider the problem of estimating the underlying graph associated with a Markov random field, with the added twist that the decoding algorithm can iteratively choose which subsets of nodes to sample based on the previous samples, resulting in an active learning setting. Considering both Ising and Gaussian models, w…
We tested in a live setting the use of active learning for selecting text sentences for human annotations used in training a Thai segmentation machine learning model. In our study, two concurrent annotated samples were constructed, one through random sampling of sentences from a text corpus, and the other through model…
Probabilistic active meta-learning improves data efficiency in robotics.
problem Data-efficient learning in robotics where data collection is expensive.
method Conceptualizing meta-learning with a probabilistic latent variable model for sequential task selection.
result Improves data efficiency compared to baselines on simulated robotic experiments.
New active learning framework for multiclass classification beyond realizability assumption.
problem Active learning in non-realizable settings with convex model classes.
method Surrogate risk minimization, epoch-based fitting, aggregation of models.
result Achieves label and sample complexity comparable to prior work in non-realizable settings.
Active sampling selects few points for accurate model reduction of high-fidelity systems.
problem Efficiently identify dominant subspaces for model reduction of large training sets.
method Proposes an active sampling strategy to select a few points from the training set to estimate dominant subspaces accurately.
result Active sampling can provide 17x speed-up without sacrificing accuracy.
This work presents an explicit-implicit procedure to compute a model predictive control (MPC) law with guarantees on recursive feasibility and asymptotic stability. The approach combines an offline-trained fully-connected neural network with an online primal active set solver. The neural network provides a control inpu…