Proposes an accuracy-preserving calibration method for DNNs.
problem Calibration of deep neural networks (DNNs) to measure prediction reliability.
method Uses Concrete distribution on the probability simplex to calibrate DNNs without accuracy loss.
result The proposed method outperforms previous methods in accuracy-preserving calibration tasks.
New scoring rules compare probabilistic top lists in classification.
problem Evaluation of probabilistic top lists in classification.
method Elicitability through symmetric proper scoring rules.
result Brier score provides a well-suited metric for comparison.
Improved deep probabilistic time series forecasting by learning error autocorrelation.
problem Simplification of time-independent error process and lack of serial correlation in existing models.
method Proposes a training method that incorporates error autocorrelation to enhance probabilistic forecasting accuracy.
result Improves predictive accuracy and uncertainty quantification across multiple datasets.
Study introduces TeMoP model for better stock market predictions.
problem Decreasing prediction errors and robustness across datasets in machine learning models.
method Probabilistic multiple lag order model based on trend encoding.
result TeMoP model outperforms machine learning models in accuracy and stability across different stock indexes.
New method stabilizes probabilistic ODE solvers for high accuracy.
problem Numerical instability in high-order ODE solvers.
method Accurate initialisation, coordinate change preconditioner, square-root implementation.
result Probabilistic ODE solvers can now achieve high order (up to 11) with stability.
S4 learns new self-supervision automatically, improving accuracy with less human effort.
problem Lack of direct supervision in machine learning.
method Combines deep learning and probabilistic logic to automatically generate and verify new self-supervision.
result S4 can automatically propose accurate self-supervision, matching supervised methods with less human effort.
Improved video tracking accuracy with active learning.
problem Efficiently predicting object matches in videos with active learning.
method Adversarial approach for active learning with structured prediction domains.
result Better accuracy and computational efficiency for object tracking.
VIR model improves regression accuracy and uncertainty estimation for imbalanced data.
problem Imbalanced regression datasets lead to poor model accuracy and uncertainty estimation.
method VIR model uses probabilistic smoothing and reweighting to estimate latent representations and uncertainty.
result VIR model outperforms state-of-the-art models in accuracy and uncertainty estimation.
Study compares deterministic and probabilistic ML for precise AM component dimensions.
problem Accurately estimate dimensions of additively manufactured parts with variability.
method Employed models integrating continuous and categorical factors, tested deterministic and probabilistic ML methods.
result Gaussian Process Regression and Bayesian Neural Networks provide strong predictive performance and uncertainty quantification.
BBNN improves neural network accuracy and uncertainty quantification.
problem Overfitting and lack of interpretability in probabilistic neural networks.
method Boosted Bayesian Neural Networks (BBNN) using Boosting Variational Inference (BVI).
result BBNN achieves ~5% higher accuracy and superior uncertainty quantification.
Improved GPS accuracy in urban areas.
problem Urban GPS inaccuracies due to environmental factors.
method Probabilistic model to learn and compensate for environmental biases.
result Localization error less than 10 meters in LTE networks.
In this paper, we propose a novel progressive parameter pruning method for Convolutional Neural Network acceleration, named Structured Probabilistic Pruning (SPP), which effectively prunes weights of convolutional layers in a probabilistic manner. Unlike existing deterministic pruning approaches, where unimportant weig…
Bayesian Neural Network improves calibration of deep probabilistic models.
problem Uncalibrated probabilities from deep neural networks limit their use in critical scenarios.
method Decoupled Bayesian Neural Network to map uncalibrated probabilities to calibrated ones.
result Our approach consistently improves calibration and provides more reliable probabilistic models.
New method improves forecast accuracy using CRPS for probabilistic predictions.
problem Improving forecast accuracy for probabilistic predictions, especially in the tails of distributions.
method Introduces a new weighting method for pointwise CRPS learning, optimizing across quantiles.
result Proposed fully adaptive Bernstein online aggregation (BOA) method for pointwise CRPS online learning has optimal convergence properties.
Probabilistic embeddings improve speaker diarization accuracy.
problem Improving speaker diarization accuracy using embeddings.
method Extracting x-vectors and precision matrices from speech segments, interfacing with PLDA model, applying agglomerative clustering, joint training of PLDA and extractor.
result Joint training of PLDA and probabilistic x-vector extractor yields accuracy gains.
Approximate probabilistic inference algorithms are central to many fields. Examples include sequential Monte Carlo inference in robotics, variational inference in machine learning, and Markov chain Monte Carlo inference in statistics. A key problem faced by practitioners is measuring the accuracy of an approximate infe…
SER tool predicts storage capacity risk with probabilistic accuracy.
problem Managing data storage growth to avoid financial losses.
method Stochastic Estimated Risk (SER) using Brownian motion with drift model.
result Probabilistic approach is more accurate for non-linear storage patterns.
Incorporating domain knowledge into the modeling process is an effective way to improve learning accuracy. However, as it is provided by humans, domain knowledge can only be specified with some degree of uncertainty. We propose to explicitly model such uncertainty through probabilistic constraints over the parameter sp…
Probabilistic techniques are central to data analysis, but different approaches can be difficult to apply, combine, and compare. This paper introduces composable generative population models (CGPMs), a computational abstraction that extends directed graphical models and can be used to describe and compose a broad class…
Develop a framework to evaluate the reliability of probabilistic emulation of physical systems.
problem Evaluating the reliability of probabilistic forecasts in physical systems.
method Developing a framework to assess the reliability of probabilistic emulation across diverse 2D spatiotemporal systems.
result CRPS-trained ensembles achieve more reliable uncertainties on single-step prediction and autoregressive rollouts.
Value selection reduces model size while maintaining accuracy.
problem Space efficiency in model size reduction.
method Two probabilistic methods based on information theory's metric: PVS and P + VS.
result Value selection achieves balance between accuracy and model size reduction.
Increasing availability of vehicle GPS data has created potentially transformative opportunities for traffic management, route planning and other location-based services. Critical to the utility of the data is their accuracy. Map-matching is the process of improving the accuracy by aligning GPS data with the road netwo…
CAMul forecasts with calibrated and accurate multi-view time-series data.
problem Combining diverse data sources for reliable time-series forecasting.
method CAMul integrates multi-modal data views dynamically, assigning importance based on context.
result CAMul outperforms state-of-the-art models by 25% in accuracy and calibration.
Hierarchical probabilistic models, such as mixture models, are used for cluster analysis. These models have two types of variables: observable and latent. In cluster analysis, the latent variable is estimated, and it is expected that additional information will improve the accuracy of the estimation of the latent varia…
Probabilistic solvers improve stability for stiff systems.
problem Performance penalties for small steps in stiff systems.
method Probabilistic exponential integrators that include fast linear dynamics in the prior.
result Proven L-stability and probabilistic error accounting.
ProFnet models HDFTS with neural networks, offering scalable probabilistic forecasts.
problem Modeling high-dimensional functional time series with nonlinear trends and high spatial dimensions.
method Integrates feedforward and deep neural networks with probabilistic modeling.
result Superior performance in forecasting Japan's mortality rates.
In many supervised learning tasks, the entities to be labeled are related to each other in complex ways and their labels are not independent. For example, in hypertext classification, the labels of linked pages are highly correlated. A standard approach is to classify each entity independently, ignoring the correlation…
The combination of a CNN detector and a search framework forms the basis for local object/pattern detection. To handle the waste of regional information and the defective compromise between efficiency and accuracy, this paper proposes a probabilistic model with a powerful search framework. By mapping an image into a pr…
UM trains a neural network to approximate marginal distributions in probabilistic programs.
problem High computational cost and lack of theoretical guarantees in inference methods for probabilistic programs.
method Combining samples from a probabilistic program prior with an augmentation method to train a neural network for any conditional marginal distribution.
result UM trains a single neural network to approximate any conditional marginal distribution, amortizing inference costs.
In this paper, we study statistical properties of semi-supervised learning, which is considered as an important problem in the community of machine learning. In the standard supervised learning, only the labeled data is observed. The classification and regression problems are formalized as the supervised learning. In s…
Paper optimizes demand aggregation for low-level electricity markets.
problem Accurate short-term load forecasting at low aggregation levels for market participants.
method Probabilistic portfolio optimization of residential households' demand using ARMA-GARCH models or KDE forecasts.
result Seasonal Residual approach outperforms others in accuracy and efficiency.
This paper introduces a new technique for quantifying the approximation error of a broad class of probabilistic inference programs, including ones based on both variational and Monte Carlo approaches. The key idea is to derive a subjective bound on the symmetrized KL divergence between the distribution achieved by an a…
Unified probabilistic gradient boosting for entire conditional distribution modeling.
problem Creating accurate probabilistic forecasts from regression tasks.
method Unified probabilistic gradient boosting framework using XGBoost and LightGBM, modeling conditional moments or CDF via Normalizing Flows.
result Achieves state-of-the-art forecast accuracy.
Improves interpretability of recurrent neural networks through probabilistic abstraction.
problem Limited interpretability of neural networks, especially recurrent ones.
method Proposes a probabilistic approach to extract automata from recurrent neural networks.
result Significantly improves accuracy and scalability of interpretability compared to existing methods.
Recent work used importance sampling ideas for better variational bounds on likelihoods. We clarify the applicability of these ideas to pure probabilistic inference, by showing the resulting Importance Weighted Variational Inference (IWVI) technique is an instance of augmented variational inference, thus identifying th…
Calibrated probabilistic solvers improve accuracy of ODE estimates.
problem Uncertainty in probabilistic ODE solutions is not well-calibrated for adaptive step sizes.
method Introduce and assess several calibration methods for probabilistic ODE solvers.
result Calibration methods interact efficiently with adaptive step-size selection, improving posteriors.
Boolean tensor decomposition approximates data of multi-way binary relationships as product of interpretable low-rank binary factors, following the rules of Boolean algebra. Here, we present its first probabilistic treatment. We facilitate scalable sampling-based posterior inference by exploitation of the combinatorial…
Bayesian approach models neurodegenerative diseases without clinical labels.
problem Personalized, predictive modeling of neurodegenerative diseases.
method Probabilistic programmed deep kernel learning combining Gaussian processes and neural networks.
result Surpasses deep learning in accuracy and timeliness of predicting neurodegeneration.
Stanza models complex time series with balance between traditional and deep learning approaches.
problem Capturing long-term structure in non-stationary time series.
method Nonlinear, non-stationary state space model.
result Achieves forecasting accuracy competitive with deep LSTMs, especially for multi-step ahead forecasting.
ProMoD models human race drivers with probabilistic movement primitives and neural networks.
problem Challenging task of modeling human driver behavior due to variability and complexity.
method Modular framework with Probabilistic Movement Primitives, clothoids, and neural networks.
result Significant advantages in imitation accuracy and robustness compared to other algorithms.
There is a widespread need for techniques that can discover structure from time series data. Recently introduced techniques such as Automatic Bayesian Covariance Discovery (ABCD) provide a way to find structure within a single time series by searching through a space of covariance kernels that is generated using a simp…
Reservoir computers and RNNs fall short of optimal prediction for stochastic PDFA.
problem Predicting stochastic processes generated by probabilistic deterministic finite-state automata.
method Generalized linear models, Reservoir computers, and Long Short-Term Memory (LSTM) RNNs were tested.
result Each method can fall short of maximal predictive accuracy by up to 50% after training.
Instead of requiring a domain expert to specify the probabilistic dependencies of the data, in this work we present an approach that uses the relational DB schema to automatically construct a Bayesian graphical model for a database. This resulting model contains customized distributions for columns, latent variables th…
FDN improves probabilistic regressors' adaptability to distribution shifts.
problem Overconfidence in modern probabilistic regressors under distribution shift.
method FDN uses input-conditioned distributions over network weights, trained with a Monte Carlo beta-ELBO objective.
result FDN produces predictive mixtures whose dispersion adapts to the input, providing shift-aware uncertainty.
This paper introduces a new learning rule for probabilistic SNNs that improves log-likelihood, accuracy, and calibration.
problem Training and inference of deterministic SNNs are constrained by their inability to generate multiple independent outputs.
method Introduces a generalized expectation-maximization (GEM) learning rule for probabilistic SNNs.
result The GEM-SNN learning rule leads to significant improvements in log-likelihood, accuracy, and calibration.
Probabilistic mixture models have been widely used for different machine learning and pattern recognition tasks such as clustering, dimensionality reduction, and classification. In this paper, we focus on trying to solve the most common challenges related to supervised learning algorithms by using mixture probability d…
Fast probabilistic option price predictions using modular Bayesian inference.
problem Accurate probabilistic predictions of future option prices.
method Modular approximate Bayesian inference framework that combines multiple data sources.
result Accurate probabilistic option-price predictions in realistic scenarios.
Neural network predicts daily power consumption with high accuracy.
problem Middle-term power consumption prediction in the energy sector.
method Incorporates trend, seasonality, and weather conditions in a shallow Neural Network.
result Excellent density forecast results on one-year test set.