Study uses HMM for real-time activity recognition from sensor data.
problem Real-time activity recognition from streaming sensor data.
method Online hierarchical hidden Markov model.
result Improved activity recognition accuracy compared to existing methods.
Unlabeled data helps stop active learning better than labeled data.
problem Reducing the need for manual annotation in text classification.
method Compared stopping methods based on labeled, unlabeled, and training data.
result Stopping methods using unlabeled data are more effective.
Paper tackles privacy in active learning for sensitive data.
problem Privacy leak in active learning with sensitive data.
method Privacy-preserving active learning approach with quantifiable guarantees.
result Tradeoff between privacy, utility, and annotation budget demonstrated.
RAN model recognizes multiple activities from unlabeled sensor data.
problem Handling weakly labeled multi-activity data from wearable sensors.
method Recurrent Attention Networks (RAN) for sequential multi-activity recognition and localization.
result RAN model can infer multiple activities and determine activity locations from unlabeled data.
Active WeaSuL uses active learning to improve weak supervision for better model performance.
problem Limited labelled data in machine learning.
method Combines active learning with weak supervision to improve probabilistic labels.
result Active WeaSuL outperforms weak supervision and active learning with limited labelled data.
Active learning improves SR by proposing experiments in data-limited settings.
problem Efficiently gathering data for symbolic regression with physical constraints.
method Query by committee using the Pareto frontier of equations, with physical constraints.
result Reduces data required for SR and achieves state-of-the-art results.
ADS filters data points for efficient batch active learning.
problem Efficiently selecting data points for annotation in parallel settings.
method Active Data Shapley (ADS) using the Shapley value of data.
result Significantly increases efficiency of active learning by 6x.
Better use of unlabelled data improves Bayesian active learning models.
problem Neglecting unlabelled data harms predictive performance and data acquisition decisions.
method A simple framework for semi-supervised Bayesian active learning.
result The proposed framework produces better models than conventional approaches.
ALiPy simplifies active learning in Python.
problem Reducing labeling costs in supervised learning.
method Python toolbox for active learning.
result Facilitates evaluation and comparison of active learning methods.
A new AI framework optimizes expert labeling of unlabeled data.
problem Efficiently labeling unlabeled data for AI systems.
method Human-in-the-loop active learning framework with innovative query schemes.
result Higher accuracy and lower loss compared to other methods.
Active learning method improves AI performance by balancing exploration and exploitation.
problem Efficiently acquiring samples for supervised learning in streaming data.
method Ensemble active learning by contextual bandits.
result Improved AI modeling performance through better sample acquisition.
Active learning selects samples for labeling to build accurate models with minimal labeled data.
problem Costly acquisition of labeled data in supervised learning.
method Adaptive selection of unlabeled data samples for labeling.
result Efficient model building with minimal labeled data.
New proof shows neural networks can memorize training data with high accuracy.
problem Proving neural networks can memorize training data with high accuracy.
method Probabilistic construction exploiting sparsity.
result Proves neural networks with threshold or mixed threshold-ReLU activations can memorize training data.
Recovering edge activities from node activity data in temporal networks.
problem Recovering lost edge activity data from aggregated node activity data in temporal networks.
method Analyzing the relationship between edge activity and node activity data, using both theoretical and empirical methods to show recovery is possible and under what conditions.
result Recovery of edge activities from node activities is possible with surprising accuracy, even when network density increases.
Improved active learning for counterfactual learning from observational data.
problem Learning a classifier from observational data with selection bias.
method Active learning with a counterfactual risk minimizer, modifying both risk and active learning process.
result Statistically consistent and more label-efficient algorithm compared to prior work.
This paper studies activation sparsity in large language models, finding key trends and implications.
problem Activation sparsity in large language models (LLMs) can be improved for efficiency and interpretability.
method Proposes PPL-p% sparsity, analyzes trends with training data, width-depth ratio, and parameter scale. result ReLU is more efficient for sparsity than SiLU, and deeper architectures can improve sparsity.
Even though active learning forms an important pillar of machine learning, deep learning tools are not prevalent within it. Deep learning poses several difficulties when used in an active learning setting. First, active learning (AL) methods generally rely on being able to learn and update models from small amounts of …
Active inference uses machine learning to prioritize data labeling for more efficient statistical inference.
problem Efficiently collecting data points for statistical inference with limited labels.
method A machine learning-assisted approach that identifies uncertain data points for labeling.
result Achieves the same level of accuracy with fewer samples, resulting in smaller confidence intervals and more powerful p-values.
New active learning method uses combinatorial coverage to improve data transfer and reduce bias.
problem Inability to transfer sampled data to new models and sampling bias issues.
method Data-centric active learning methods utilizing combinatorial coverage.
result Sampling data with coverage leads to better data transfer and competitive sampling bias.
New method learns neural network activation functions from data.
problem Learning activation functions for neural networks.
method Model each neuron's activation function as a small neural network.
result Learned activation functions improve network performance.
This research improves neural network performance with adaptive activation functions in sparse data settings.
problem Limited data availability in scientific and engineering problems.
method Investigation of two types of adaptive activation functions with individual trainable parameters.
result Adaptive activation functions, especially with individual trainable parameters, enhance prediction accuracy and confidence in sparse data settings.
Unified study of active learning for deep neural networks.
problem Improving performance of deep neural networks through active learning.
method Investigation of incremental and cumulative training modes, model configurations, query strategies, and pseudo-labels.
result Proposed more efficient querying procedures and insights into active learning behavior.
Proposes privacy-preserving sensor data transformations to prevent user re-identification and sensitive activity inference.
problem Privacy threats from shared sensor data and potential user re-identification.
method Mechanisms to transform sensor data to eliminate patterns for re-identification and sensitive activity inference, while maintaining minor utility loss.
result Reduced user re-identification accuracy to random guess level and prevented inference of sensitive activities.
Proposes a graph-based method for active learning in regression.
problem Active learning for regression is understudied and faces challenges with noisy labels and parameter uncertainty.
method Formulates active regression as a bipartite graph optimization problem.
result Demonstrates the effectiveness of the proposed graph-based approach on benchmark data sets.
Bayesian batch active learning approximates model parameters efficiently.
problem High label acquisition cost for large-scale supervised models.
method Sparse subset approximation using Bayesian active learning.
result Efficient active learning at scale with diverse batches.
Active data collection improves convergence rates in operator learning.
problem Improving convergence rates in operator learning with linear target and stochastic input.
method Active data collection strategies with mean-zero stochastic process and continuous covariance kernels.
result Achieves arbitrarily fast error convergence rates with eigenvalue decay of covariance kernels.
New active learning strategy improves decision-making accuracy.
problem Maximizing decision-making accuracy in sequential data acquisition.
method Introduces a novel active learning criterion that maximizes expected information gain on the posterior decision distribution.
result Improved performance in decision-making accuracy compared to existing alternatives.
EmbraceNet fusion model for multi-sensor activity recognition.
problem Human activity recognition using multiple sensors is challenging.
method Independent processing of each sensor, feature fusion with EmbraceNet, post-processing, and additional processes.
result Improved performance in SHL recognition challenge.
Improved DNN robustness to adversarial attacks using data-dependent activation and total variation minimization.
problem Improving Deep Neural Network robustness to adversarial attacks.
method Data-dependent activation function and total variation minimization.
result Robust accuracy of adversarially trained ResNet20 increased from ~46% to ~69% under IFGSM attack.
Paper proposes a few-shot learning method for human activity recognition.
problem Efficiently recognize human activities with limited labeled data.
method Uses deep learning for feature extraction and knowledge transfer from existing models.
result Promising results show the proposed method's advantages over traditional approaches.
Efficient active learning method defends against malicious mislabeling and data poisoning attacks.
problem Malicious mislabeling and data poisoning attacks on deep neural networks.
method Adversarial retraining and active learning with random sampling strategy.
result The proposed method achieves 89% accuracy with only one-third of the labeled data, significantly outperforming the baseline method.
Paper presents a neural network for recognizing human activities from unlabeled sensor data.
problem Time-consuming annotation of sensor data for activity recognition.
method Attention-based convolutional neural network for weakly labeled data.
result Attention model improves accuracy in recognizing human activities.
FedMAX tackles activation divergence in FL, improving accuracy and efficiency.
problem Activation divergence in Federated Learning due to non-IID data.
method Introduced a prior based on maximum entropy to minimize information about per-device activation vectors and make similar classes more alike.
result Significantly more similar activation vectors across multiple devices, leading to better accuracy and efficiency.
CNNs classify human activities from IMU data.
problem Automatic identification of physical activities using motion sensors.
method Used Convolutional Neural Networks (CNNs) with raw IMU data.
result CNNs perform well in classifying 16 lower-limb activities.
Data-aware activation function customization reduces neural network error.
problem Current neural networks lack consideration for specific activation functions.
method Linear algebraic explanation and Diaconis-Shahshahani Approximation Theorem criteria for activation functions.
result Using an even activation function like seagull can reduce neural network error by orders of magnitude.
Active testing for large language models is made more efficient and accurate.
problem Efficient evaluation of large language models with limited labels.
method Cost-saving measures and in-context learning for constructing a surrogate model.
result Significantly more accurate evaluations of LLM performance compared to random data acquisition.
Bayesian approach improves deep learning efficiency.
problem Efficient training of deep learning models with limited labeled data.
method Combines active learning and data augmentation with Bayesian generative models.
result Improves training efficiency and classification accuracy compared to existing methods.
Deep belief network improves smartphone activity recognition.
problem Activity recognition on mobile devices.
method Categorization through deep belief network.
result 98.25% correct diagnosis in training data, 93.01% in test data.
This paper proposes a new method to select labeled data points using VAEs for active learning.
problem High cost of acquiring labels in supervised machine learning.
method Data-driven approach using Variational Autoencoders (VAEs) to select a diverse core-set in a low-dimensional latent space.
result Improvement in accuracy over related techniques, highlighting the representation power of generative modeling.
Paper improves anomaly detection using tree-based ensembles with active learning.
problem Configuring anomaly detectors with true labels to minimize false positives.
method Develops batch and streaming active learning algorithms for tree-based ensembles.
result Significantly more anomalies discovered with active learning compared to baselines.
Survey of active learning for data streams.
problem Efficiently labeling data points in real-time data streams.
method Review of active learning approaches for data streams.
result Overview of recent approaches for online active learning.
Bayesian active learning method improved for censored regression data.
problem Challenges in estimating BALD for censored regression data.
method Derived entropy and mutual information for censored distributions, developed C-BALD objective, proposed novel modelling approach. result Demonstrated C-BALD outperforms other methods in censored regression. Deep Auto-Set learns sets of activities from wearable sensor data.
problem Recognizing multiple activities simultaneously from sensor data.
method Deep auto-encoder-set network for set prediction.
result Significant improvement over baseline models in HAR datasets.
Active learning introduces bias; this paper fixes it.
problem Bias in active learning due to non-representative training data.
method Formalized bias, identified situations where it's harmful/helpful, introduced corrective weights.
result Corrective weights can improve active learning, especially with overparameterized models.
SparseSense improves HAR from sparse sensor data, outperforming state-of-the-art models.
problem Learning activity recognition from highly sparse sensor data streams.
method Set-based neural networks for end-to-end learning from sparse data.
result Significant performance improvements in HAR from passive sensor datasets.
Periodic activation functions improve neural network reliability and interpretability.
problem Neural networks reinforce hidden biases, making them unreliable and hard to interpret.
method Introduce periodic activation functions in Bayesian neural networks to establish a connection with stationary Gaussian process priors.
result Periodic activation functions, including sinusoidal, triangular, and ReLU, improve model performance and sensitivity to perturbations.
Two machine learning methods detect insider trading from investor activity data.
problem Detecting insider trading from trading activity data is challenging.
method Two unsupervised machine learning methods: clustering and group identification.
result Identifies potential insider trading rings around price sensitive events.
Online active regression algorithms minimize label queries for efficient data regression.
problem Efficiently predict data points with minimal label queries in an online setting.
method Proposed online algorithms for active regression under ℓ_p loss, achieving (1+ε)-approximation with minimal label queries.
result Achieves (1+ε)-approximation with only ε^(-1) d log(nκ) label queries, matching offline methods in performance.