ALIS uses probabilistic sampling to minimize true loss in active learning.
problem Efficiently choosing data points to label in active learning.
method Proposes ALIS algorithm with optimal sampling distribution.
result Derives upper bounds on true loss for any sampling procedure.
Improved video tracking accuracy with active learning.
problem Efficiently predicting object matches in videos with active learning.
method Adversarial approach for active learning with structured prediction domains.
result Better accuracy and computational efficiency for object tracking.
This paper examines probabilistic sampling weighted by uncertainty in active learning.
problem Improving efficiency and effectiveness in active learning.
method Probabilistic sampling weighted by uncertainty, implemented in a single-pass streaming fashion.
result Using probabilistic weighting often benefits active learning, especially with biased initial labeled points.
Study efficient interactive learning for structured outputs with reliable computation.
problem Interactive learning with noisy labels and structured output spaces.
method Identify and utilize CRISPs (probabilistic models) that guarantee reliable and efficient computation of probabilistic quantities.
result CRISPs enable robust and efficient active and skeptical learning in large structured output spaces.
Probabilistic active meta-learning improves data efficiency in robotics.
problem Data-efficient learning in robotics where data collection is expensive.
method Conceptualizing meta-learning with a probabilistic latent variable model for sequential task selection.
result Improves data efficiency compared to baselines on simulated robotic experiments.
Adaptive batch sizes improve active learning efficiency and flexibility.
problem Fixed batch sizes in active learning are inefficient due to dynamic cost-speed trade-offs.
method Probabilistic Numerics framework that adaptively changes batch sizes based on integration error and precision objectives.
result Significant enhancement in learning efficiency and flexibility across various applications.
Active WeaSuL uses active learning to improve weak supervision for better model performance.
problem Limited labelled data in machine learning.
method Combines active learning with weak supervision to improve probabilistic labels.
result Active WeaSuL outperforms weak supervision and active learning with limited labelled data.
Deep learning models outperform classical methods in forecasting neural activity.
problem Improving forecasting of neural activity using deep learning models.
method Systematic evaluation of eight probabilistic deep learning models against classical statistical models and baseline methods.
result Several deep learning models consistently outperform classical approaches in forecasting neural activity.
Bayesian batch active learning approximates model parameters efficiently.
problem High label acquisition cost for large-scale supervised models.
method Sparse subset approximation using Bayesian active learning.
result Efficient active learning at scale with diverse batches.
SAMBA improves safe reinforcement learning with active exploration metrics.
problem Safe reinforcement learning in dynamic systems.
method Combines probabilistic modelling, information theory, and statistics. Uses novel metrics for out-of-sample Gaussian process evaluation.
result Orders of magnitude reduction in samples and violations compared to state-of-the-art methods.
Probabilistic methods improve SHM by learning from noisy, incomplete data.
problem Noisy and incomplete SHM data, lack of prior labels.
method Probabilistic algorithms for semi-supervised, active, and multi-task learning.
result Probabilistic methods enhance SHM by incorporating new data.
Active learning algorithms propose which unlabeled objects should be queried for their labels to improve a predictive model the most. We study active learners that minimize generalization bounds and uncover relationships between these bounds that lead to an improved approach to active learning. In particular we show th…
Annotating the right data for training deep neural networks is an important challenge. Active learning using uncertainty estimates from Bayesian Neural Networks (BNNs) could provide an effective solution to this. Despite being theoretically principled, BNNs require approximations to be applied to large-scale problems, …
Optimizes active learning for machine learning models with Bayesian approach.
problem Efficiently allocate labeling resources to train machine learning models.
method Directly optimizes misclassification error using a Bayesian approach with conjugate prior.
result Superior performance compared to state-of-the-art selection strategies.
PDBAL targets experiments for probabilistic models to maximize insights.
problem Designing experiments to yield valuable insights efficiently.
method Combines user-specified risk function with probabilistic model to adaptively choose designs.
result PDBAL consistently outperforms standard approaches in simulations and real-world drug screen data.
In this paper, we introduce Deep Probabilistic Ensembles (DPEs), a scalable technique that uses a regularized ensemble to approximate a deep Bayesian Neural Network (BNN). We do so by incorporating a KL divergence penalty term into the training objective of an ensemble, derived from the evidence lower bound used in var…
Meta-active learning optimizes control of safety-critical systems by efficiently learning dynamics and configurations.
problem Efficiently learning system dynamics and optimal configurations for safety-critical systems like deep brain stimulation.
method Meta-learning an acquisition function using LSTM, cast as meta-learning, with a mixed-integer linear program policy.
result Achieved a 46% increase in information gain and a 20% speedup in computation time over baselines.
Study on rich regime training in deep learning, finding active parameters in bottom layers.
problem Understanding the practical success of deep learning models.
method Empirical study on rich regime training with benchmark datasets, re-initialization analysis, and probabilistic Layer-Wise Sparse SGD.
result Probabilistic Layer-Wise Sparse SGD matches vanilla SGD's generalization performance with improved efficiency.
Scalable solver reduces PDE uncertainty with active learning.
problem High computational cost in solving PDEs.
method Stochastic dual descent and clustering-based active learning.
result Solver scales to large number of collocation points.
We consider the problem of learning the functions computing children from parents in a Structural Causal Model once the underlying causal graph has been identified. This is in some sense the second step after causal discovery. Taking a probabilistic approach to estimating these functions, we derive a natural myopic act…
Algorithm improves convergence in stochastic optimization problems.
problem Efficiently constructing pre-conditioners for noisy stochastic optimization.
method Iterative probabilistic inference algorithm using a Gaussian noise model.
result Empirically demonstrates improved convergence in stochastic optimization problems.
PUMA interprets metabolomics data to predict pathway activity and assign chemical identities.
problem Interpreting metabolomics data to determine biochemical pathway activities.
method Generative probabilistic modeling using stochastic sampling.
result PUMA predicts pathway activity and assigns chemical identities to metabolites.
CheXpert++ improves CheXpert's accuracy and usability for medical radiology reports.
problem Infeasibility of obtaining ground truth labels for medical data.
method BERT-based approximation of CheXpert, addressing speed, differentiability, and probabilistic output.
result Achieves 99.81% parity with CheXpert, significantly faster, differentiable, and probabilistic.
We propose a novel sampling framework for inference in probabilistic models: an active learning approach that converges more quickly (in wall-clock time) than Markov chain Monte Carlo (MCMC) benchmarks. The central challenge in probabilistic inference is numerical integration, to average over ensembles of models or unk…
In this paper, we propose an active learning algorithm and models which can gradually learn individual's preference through pairwise comparisons. The active learning scheme aims at finding individual's most preferred choice with minimized number of pairwise comparisons. The pairwise comparisons are encoded into probabi…
Active learning improves RS-IRL by querying expert demonstrations to uncover risk boundaries.
problem Efficient learning from expert demonstrations in risk-sensitive IRL.
method Probabilistic disturbance sampling scheme for active learning.
result Our approach accelerates RS-IRL convergence with lower variance and unbiased results.
Probabilistic ESI model improves brain activity pattern analysis.
problem Noise sensitivity and lack of time-varying pattern flexibility in traditional ESI methods.
method Hierarchical graph prior with spanning tree constraint and alternating convex search algorithm.
result Significant improvements in source localization performance, especially at high noise levels.
This review synthesizes uncertainty modeling in probabilistic image segmentation.
problem Relaxed Bayesian assumptions lead to missing uncertainty information in deep models.
method Standardizes theory, notation, and terminology for feature- and parameter-distribution modeling.
result Establishes a common framework for robust decision-making in segmentation tasks.
S4 learns new self-supervision automatically, improving accuracy with less human effort.
problem Lack of direct supervision in machine learning.
method Combines deep learning and probabilistic logic to automatically generate and verify new self-supervision.
result S4 can automatically propose accurate self-supervision, matching supervised methods with less human effort.
BLADE uses Bayesian methods to discover complex systems from scarce data.
problem Efficiently discovering governing equations of complex dynamical systems from limited data.
method Combines replica-exchange stochastic gradient Langevin Monte Carlo with active learning.
result Reduces measurement requirements by 60% for Lotka-Volterra and 40% for Burgers' equation.
Paper optimizes material microstructures with limited data using probabilistic methods.
problem Optimizing material properties with uncertain process-structure-property links.
method Flexible probabilistic formulation, data-driven surrogate, active learning.
result Significant improvement in accuracy with small training data.
Novel F2NARX model improves surrogate modeling for stochastic dynamical systems.
problem Challenges in constructing accurate and efficient surrogate models for stochastic dynamical systems.
method Function-on-Function Nonlinear AutoRegressive model with eXogenous inputs (F2NARX) combining PCA and Gaussian process regression.
result F2NARX outperforms state-of-the-art NARX models in efficiency and accuracy.
Bayesian optimization improves policy search in reinforcement learning.
problem Finding optimal policies with high variance estimates from random samples.
method Develops an algorithm combining Bayesian optimization and policy gradients.
result Improves sample complexity and reduces variance in empirical evaluations.
There is resurging interest, in statistics and machine learning, in solvers for ordinary differential equations (ODEs) that return probability measures instead of point estimates. Recently, Conrad et al. introduced a sampling-based class of methods that are 'well-calibrated' in a specific sense. But the computational c…
CAVs reveal latent concept distributions, but are vulnerable to adversarial attacks.
problem Understanding latent concept encodings in AI models.
method Probabilistic perspective on CAVs, deriving mean and covariance.
result CAVs can be adversarially manipulated, highlighting a vulnerability.
We explore xor function using copula representations and error surface projections.
problem The exclusive or (xor) function and its approximation problems.
method Probabilistic logic, associative copula functions, and comparison of error surfaces with different activation functions.
result Copula representations extend xor from Boolean to real values.
Discriminative learning machines often need a large set of labeled samples for training. Active learning (AL) settings assume that the learner has the freedom to ask an oracle to label its desired samples. Traditional AL algorithms heuristically choose query samples about which the current learner is uncertain. This st…
This work frames active inference through control as inference, offering robust control algorithms.
problem Active inference framework lacks practical sensorimotor control algorithms.
method Frame active inference through control as inference, presenting trajectory optimization as inference.
result AI may be framed as partially-observed CaI when the cost function is defined in observation states.
Active inference implemented for high-dimensional tasks shows efficient exploration and improved sample efficiency.
problem Achieving efficient exploration and learning in complex, uncertain environments.
method Active inference framework applied to high-dimensional tasks, with Bayesian evidence maximization.
result Order of magnitude increase in sample efficiency over model-free baselines.
Optimizes sampling for faster convergence in Bayesian experimental design and uncertainty quantification.
problem Efficiently selecting samples for faster convergence in Bayesian experimental design and uncertainty quantification.
method Output-weighted acquisition functions leveraging likelihood ratio to guide sampling towards relevant regions.
result Superiority of the proposed method in uncertainty quantification and rare event identification.
Unified framework for testing deep learning models with concept activation vectors.
problem Statistical instability and discontinuity in testing with concept activation vectors.
method Introducing α-TCAV, a generalized framework that replaces the indicator function with a parameterized smooth function.
result Unified probabilistic formulation that subsumes TCAV and Multi-TCAV, providing principled guidance on tuning the parameter.
PALS extends PAL for optimizing stochastic simulators efficiently.
problem Optimizing stochastic simulators with high output variance and expensive evaluations.
method Bayesian optimization with probabilistic models, extending PAL for stochastic settings.
result PALS outperforms other methods in optimizing stochastic simulators.
A novel probabilistic approach forecasts imbalance prices in Belgium.
problem Forecasting imbalance prices in short-term energy markets.
method Two-step approach: compute net regulation volume state transition probabilities, then infer imbalance prices.
result The probabilistic approach outperforms deterministic and Gaussian Process models.
New method avoids failures in physics-constrained systems using active learning.
problem Handling fatal failures in systems governed by physics constraints.
method Develops a novel active learning method that considers implicit physics constraints.
result Achieves zero-failure in composite fuselage assembly process without explicit failure regions.
Active learning selects optimal measurement times for inferring continuous paths from sparse data.
problem Inferring continuous probability paths from sparse snapshots in high-fidelity domains like single-cell biology.
method Extends active experimentation to the space of measures using Linearized Optimal Transport (LOT) for probabilistic surrogate modeling.
result Empirical results show that the proposed strategy outperforms uncertainty-agnostic baselines.
A new framework detects abnormal node-level communication activity in networks.
problem Detecting abnormal communication volume at node-level in communication networks.
method Probabilistic framework using clique streams and non-parametric regression.
result The proposed approach outperforms in real-world and synthetic data.
Proposes PKM for soft K-means clustering.
problem Soft K-means (m=1) unsolved since 1981.
method Probabilistic K-Means (PKM) via nonlinear programming.
result Proposed methods solve PKM efficiently.
Survey of methods to visualize neural network features.
problem Understanding neural network activation patterns.
method Activation Maximization and Feature Visualization via Optimization.
result Probabilistic interpretation of AM techniques.