A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Bayesian adaptive designs can be biased by active learning, especially with misspecified models.
PGAE uses predictions to guide active experimentation.
GeneDisco benchmarks experimental design for drug discovery.
We consider active learning with logged data, where labeled examples are drawn conditioned on a predetermined logging policy, and the goal is to learn a classifier on the entire population, not just conditioned on the logging policy. Prior work addresses this problem either when only logged data is available, or purely…
Active learning has shown to reduce the number of experiments needed to obtain high-confidence drug-target predictions. However, in order to actually save experiments using active learning, it is crucial to have a method to evaluate the quality of the current prediction and decide when to stop the experimentation proce…
Unified framework for hybrid learning and optimization via active inference.
Active Learning (AL) methods seek to improve classifier performance when labels are expensive or scarce. We consider two central questions: Where does AL work? How much does it help? To address these questions, a comprehensive experimental simulation study of Active Learning is presented. We consider a variety of tasks…
Neural networks struggle with periodic functions, a new activation fixes this.
Efficiently identifies key input variables for expensive functions using active learning.
Develops active learning for Jump Gaussian Process models.
New algorithm for adaptive experimental design in scientific settings.
Optimizes sampling for faster convergence in Bayesian experimental design and uncertainty quantification.
New method for selecting data points in deep learning models.
A new experimental design method for combinatorial interventions reduces complexity and improves accuracy.
Bayesian nonparametric model predicts user activity and intervention success.
We propose a new generic type of stochastic neurons, called -neurons, that considers activation functions based on Jackson's -derivatives with stochastic parameters . Our generalization of neural network architectures with -neurons is shown to be both scalable and very easy to implement. We demonstrate expe…
Active learning is an important technique to reduce the number of labeled examples in supervised learning. Active learning for binary classification has been well addressed in machine learning. However, active learning of the reject option classifier remains unaddressed. In this paper, we propose novel algorithms for a…
Bayesian model predicts online activity participation.
Active learning reduces SP calculations by 90%.
Traditionally, the automatic recognition of human activities is performed with supervised learning algorithms on limited sets of specific activities. This work proposes to recognize recurrent activity patterns, called routines, instead of precisely defined activities. The modeling of routines is defined as a metric lea…
Active inference selects actions to maximize information gain, aiding structure learning.
We study the activity, i.e., the number of transactions per unit time, of financial markets. Using the diffusion entropy technique we show that the autocorrelation of the activity is caused by the presence of peaks whose time distances are distributed following an asymptotic power law which ultimately recovers the Pois…
Training feedforward neural networks with standard logistic activations is considered difficult because of the intrinsic properties of these sigmoidal functions. This work aims at showing that these networks can be trained to achieve generalization performance comparable to those based on hyperbolic tangent activations…
Overfitting frequently occurs in deep learning. In this paper, we propose a novel regularization method called Drop-Activation to reduce overfitting and improve generalization. The key idea is to drop nonlinear activation functions by setting them to be identity functions randomly during training time. During testing, …
ALMAB-DC optimizes expensive black-box experiments using active learning and distributed computing.
Active learning (AL) repeatedly trains the classifier with the minimum labeling budget to improve the current classification model. The training process is usually supervised by an uncertainty evaluation strategy. However, the uncertainty evaluation always suffers from performance degeneration when the initial labeled …
ALINE optimizes Bayesian inference and data acquisition by strategically querying informative data.
Proposes a graph-based method for active learning in regression.
The internet activity records (IARs) of a mobile cellular network posses significant information which can be exploited to identify the network's efficacy and the mobile users' behavior. In this work, we extract useful information from the IAR data and identify a healthy predictability of spatio-temporal pattern within…
DABS uses a policy network to select experiments in high-dimensional design spaces.
ALPINE predicts links in networks by querying the most informative pairs.
We develop a new active learning algorithm for the streaming setting satisfying three important properties: 1) It provably works for any classifier representation and classification problem including those with severe noise. 2) It is efficiently implementable with an ERM oracle. 3) It is more aggressive than all previo…
BinaryDuo improves BNNs by coupling binary activations, outperforming state-of-the-art models.
New algorithm improves active learning in agnostic pool-based classification.
In training speech recognition systems, labeling audio clips can be expensive, and not all data is equally valuable. Active learning aims to label only the most informative samples to reduce cost. For speech recognition, confidence scores and other likelihood-based active learning methods have been shown to be effectiv…
The effectiveness of deep neural architectures has been widely supported in terms of both experimental and foundational principles. There is also clear evidence that the activation function (e.g. the rectifier and the LSTM units) plays a crucial role in the complexity of learning. Based on this remark, this paper discu…
We tested in a live setting the use of active learning for selecting text sentences for human annotations used in training a Thai segmentation machine learning model. In our study, two concurrent annotated samples were constructed, one through random sampling of sentences from a text corpus, and the other through model…
The most widely used activation functions in current deep feed-forward neural networks are rectified linear units (ReLU), and many alternatives have been successfully applied, as well. However, none of the alternatives have managed to consistently outperform the rest and there is no unified theory connecting properties…
We propose a novel active learning framework for activity recognition using wearable sensors. Our work is unique in that it takes physical and cognitive limitations of the oracle into account when selecting sensor data to be annotated by the oracle. Our approach is inspired by human-beings' limited capacity to respond …
Identifies learning rules from neural network observables.
In this paper we propose a multi-armed bandit inspired, pool based active learning algorithm for the problem of binary classification. By carefully constructing an analogy between active learning and multi-armed bandits, we utilize ideas such as lower confidence bounds, and self-concordant regularization from the multi…
AL methods show inconsistent performance gains over random sampling, highlighting variability in neural network-based approaches.
LCW reduces activation shift in neural networks, improving training efficiency and generalization.
New active learning methods for Gaussian process improve predictive modeling of composite fuselage.
AI-assisted framework detects and predicts rare extreme events.
A new method improves active learning for large batch sizes.
New method predicts activity coefficients for binary mixtures without using physical descriptors.
Data generation and labeling are usually an expensive part of learning for robotics. While active learning methods are commonly used to tackle the former problem, preference-based learning is a concept that attempts to solve the latter by querying users with preference questions. In this paper, we will develop a new al…