Novel algorithm PSO improves density estimation for multimodal data.
problem Data log-density estimation for multimodal distributions.
method Probabilistic Surface Optimization (PSO) using virtual stochastic forces.
result PSO-LDE achieves superior log-density estimation accuracy.
Paper uses Gaussian processes and neural nets to model sub-km wind accurately.
problem Accurately modeling sub-kilometer surface wind for optimal decision-making.
method Integrates Gaussian processes and neural networks to model wind gusts at sub-kilometer resolution.
result Modeling covariance structure improves prediction quality and calibration.
Machine learning speeds up LSM parameter optimization and uncertainty quantification.
problem Optimizing and assessing uncertainty of LSM parameters.
method Combining MCMC with Gaussian process regression.
result 50,000 times faster than direct MCMC application.
We present and analyze a central cutting surface algorithm for general semi-infinite convex optimization problems, and use it to develop a novel algorithm for distributionally robust optimization problems in which the uncertainty set consists of probability distributions with given bounds on their moments. Moments of a…
Probabilistic proof of smooth boundaries in optimal stopping problems.
problem Continuous differentiability of time-dependent optimal boundaries in optimal stopping problems.
method Local probabilistic arguments for a wider range of conditions.
result First probabilistic proof of continuous differentiability under general conditions.
Introduces statistical optimal transport for probabilistic lectures.
problem No specific problem stated; focuses on introduction.
method Lecture-based introduction to statistical optimal transport.
result Provides an introduction to statistical optimal transport.
Probabilistic pseudo knots model uncertain knot diagrams.
problem Modeling knots with unresolved crossings.
method Assign probabilities to undetermined crossings; define probabilistic equivalence and extend classical knot invariants.
result Capture uncertainty in physical, biological, and computational contexts.
In this note, we extend an evolutionary stochastic portfolio optimization framework to include probabilistic constraints. Both the stochastic programming-based modeling environment as well as the evolutionary optimization environment are ideally suited for an integration of various types of probabilistic constraints. W…
Synthesizes static analysis for probabilistic programs.
problem Optimize learning process, verify models, improve programming interface.
method Organize and analyze static analysis techniques for probabilistic programming.
result Future directions for improvement in statistical machine learning.
Proposes VSGD optimizer combining probabilistic and gradient-based methods.
problem Uncertainty modeling in deep neural networks.
method Combines probabilistic and gradient-based approaches using SVI.
result VSGD outperforms Adam and SGD on image classification tasks.
A probability density function (pdf) encodes the entire stochastic knowledge about data distribution, where data may represent stochastic observations in robotics, transition state pairs in reinforcement learning or any other empirically acquired modality. Inferring data pdf is of prime importance, allowing to analyze …
Dynamic probabilistic forecasts guide optimal decisions in uncertain processes.
problem Optimal decision making in processes influenced by uncertain random factors.
method Stochastic models for probabilistic forecast evolution, calibrated from ensemble forecasts.
result Optimal decision strategies determined using dynamic probabilistic forecasts.
We provide a probabilistic approach to studying minimal surfaces in three-dimensional Euclidean space. Following a discussion of the basic relationship between Brownian motion on a surface and minimality of the surface, we introduce a way of coupling Brownian motions on two minimal surfaces. This coupling is then used …
We explore xor function using copula representations and error surface projections.
problem The exclusive or (xor) function and its approximation problems.
method Probabilistic logic, associative copula functions, and comparison of error surfaces with different activation functions.
result Copula representations extend xor from Boolean to real values.
Bayesian optimization uses shared latent variables for multiple systems.
problem Optimizing systems with limited data and unknown relationships.
method Shared latent variables, Bayesian inference, probabilistic metamodel.
result Performance improvement in zero-, one-, and few-shot settings.
We present the first general purpose framework for marginal maximum a posteriori estimation of probabilistic program variables. By using a series of code transformations, the evidence of any probabilistic program, and therefore of any graphical model, can be optimized with respect to an arbitrary subset of its sampled …
A deep learning method for probabilistic weather forecasting.
problem Probabilistic forecasting of weather.
method Two chained machine-learning steps: dimension reduction and density estimation using normalizing flows.
result The method produces accurate conditional forecast distributions for weather.
Unified approach for sequence design combining likelihood-free inference and black-box optimization.
problem Designing biological sequences efficiently and accurately.
method Unified probabilistic framework integrating likelihood-free inference and black-box optimization.
result Previous optimization methods can be adapted and new algorithms proposed within this framework.
We present a new algorithm for approximate inference in probabilistic programs, based on a stochastic gradient for variational programs. This method is efficient without restrictions on the probabilistic program; it is particularly practical for distributions which are not analytically tractable, including highly struc…
Unified approach to non-standard classification tasks.
problem Non-standard classification tasks like semi-supervised, positive-unlabelled, multi-positive-unlabelled and noisy-label learning.
method Probabilistic, unified approach training a classifier to predict label-distributions, then inferring class-distributions.
result Unified model for various non-standard classification tasks.
Bayesian optimization tackles expensive discrete and mixed parameter spaces.
problem Optimizing expensive functions with discrete and mixed parameters.
method Probabilistic reparameterization to maximize expectation of AF over continuous parameters.
result Our approach provably converges to a maximizer of the AF and enjoys the same regret bounds as standard BO.
We consider an original problem that arises from the issue of security analysis of a power system and that we name optimal discovery with probabilistic expert advice. We address it with an algorithm based on the optimistic paradigm and on the Good-Turing missing mass estimator. We prove two different regret bounds on t…
Probabilistic models predict neural network performance across varying hyperparameters.
problem Predicting neural network performance with different hyperparameters.
method Probabilistic models based on random forests and Bayesian recurrent neural networks.
result Models outperform state-of-the-art hyperparameter optimization methods.
In this paper, we propose a probabilistic optimization method, named probabilistic incremental proximal gradient (PIPG) method, by developing a probabilistic interpretation of the incremental proximal gradient algorithm. We explicitly model the update rules of the incremental proximal gradient method and develop a syst…
A deep learning method speeds up probabilistic optimal power flow calculations.
problem Efficiently solving large-scale nonlinear and nonconvex optimization problems in power systems.
method Developed a SDAE-based OPF using stacked denoising auto encoders to extract system correlations and calculate OPF solutions.
result The trained SDAE network can quickly compute OPF solutions for random system states without optimization.
Forward inference techniques such as sequential Monte Carlo and particle Markov chain Monte Carlo for probabilistic programming can be implemented in any programming language by creative use of standardized operating system functionality including processes, forking, mutexes, and shared memory. Exploiting this we have …
Autoencoders improve communication system performance by optimizing constellation geometry and probability.
problem Optimizing constellation geometry and probability for better communication system performance.
method Leveraging autoencoders to learn capacity-achieving symbol distributions and constellations.
result Learned constellations achieve information rates very close to capacity on AWGN channels and outperform existing methods on fading channels.
In deterministic optimization, line searches are a standard tool ensuring stability and efficiency. Where only stochastic gradients are available, no direct equivalent has so far been formulated, because uncertain gradients do not allow for a strict sequence of decisions collapsing the search space. We construct a prob…
In deterministic optimization, line searches are a standard tool ensuring stability and efficiency. Where only stochastic gradients are available, no direct equivalent has so far been formulated, because uncertain gradients do not allow for a strict sequence of decisions collapsing the search space. We construct a prob…
Transforms input design for probabilistic models into optimal control of a Hamiltonian system.
problem Designing inputs for probabilistic models with intractable posterior distributions.
method Representing posterior as Hamiltonian system trajectories, solving optimal control problem.
result Parameter posterior concentrates around true parameter values.
Develops a new approach to optimal control of stochastic systems.
problem Optimal control of stochastic nonlinear dynamical systems is challenging.
method Formulates optimal control as input estimation, using probabilistic inference and Expectation Maximization.
result Extracts time-varying linear Gaussian feedback controllers from the joint state-action distribution.
Optimal interbank lending scheme with probabilistic bank failure constraints.
problem Optimizing interbank lending in a network of interconnected banks with probabilistic constraints on failure.
method Derive a closed-form solution for an optimal control problem, compute systemic relevance parameters.
result General solution for interbank lending with probabilistic constraints for all banks.
Study probabilistic safety of BNNs under adversarial attacks.
problem Evaluate vulnerability of BNNs to adversarial attacks.
method Relaxation techniques from non-convex optimization to compute probabilistic safety bounds.
result Certify probabilistic safety of BNNs with millions of parameters.
Adaptive volatility method improves probabilistic financial forecasting.
problem Probabilistic forecasting in financial markets.
method Adapts classical time-varying volatility models with online stochastic optimization.
result Ranked 5th in M6 financial forecasting competition.
Solves optimal control with state constraints using probabilistic methods.
problem Optimal control of diffusion processes within state constraints.
method Probabilistic representation and optimal control under mild conditions.
result Explicit formulae for optimally controlled dynamics in examples.
New method SP-PPCA reduces outlier impact in PCA.
problem Outliers make standard PCA and PPCA less robust.
method Integrates self-paced learning into PPCA, using iterative optimization.
result SP-PPCA effectively reduces or eliminates outlier impact.
DYffusion improves diffusion models for spatiotemporal forecasting.
problem Challenges in generating stable and accurate forecasts for dynamic data.
method Leverages temporal dynamics in data, directly coupling it with diffusion steps.
result Improves computational efficiency and performs competitively on complex dynamics.
New scheme optimizes BMI through probabilistic and geometric shaping.
problem Optimizing bit-wise mutual information (BMI) for coded modulation.
method Joint optimization of BMI through probabilistic and geometric shaping.
result Joint optimization enables a continuum of constellation geometries and probability distributions.
Simple probabilistic solution for optimal liquidation with linear price impact.
problem Maximizing expected terminal wealth in a setup with quadratic transaction costs.
method Provided a simple probabilistic solution to the problem.
result Simple and probabilistic form of the solution not previously published.
Study Brownian loops on hyperbolic surfaces, linking to Selberg zeta function.
problem Understanding Brownian loops on hyperbolic surfaces and their relation to Selberg zeta function.
method Computed mass of loops and related to Selberg zeta function for geometrically finite surfaces.
result Relate total loop mass to Selberg zeta function, providing probabilistic interpretations of determinants.
A new probabilistic framework for optimal transport using collective graphical models.
problem Measuring similarity between probability distributions and histograms.
method Probabilistic Optimal Transport based on Collective Graphical Models.
result OT with entropic regularization is equivalent to maximizing a posterior probability of a CGM.
DALTON improves ODE parameter estimation by learning from noisy data.
problem High sensitivity to parameters in ODEs produces unreliable parameter estimates.
method Data-adaptive probabilistic likelihood approximation for ODEs.
result DALTON produces more accurate parameter estimates than existing methods.
New theorem connects probabilistic permanental point processes to Monge-Ampère equation.
problem Probabilistic interpretation of Monge-Ampère equation boundary value problem.
method Large deviation principles and optimal transport theory.
result Explicit rate function for permanental point processes large deviation.
Paper optimizes material microstructures with limited data using probabilistic methods.
problem Optimizing material properties with uncertain process-structure-property links.
method Flexible probabilistic formulation, data-driven surrogate, active learning.
result Significant improvement in accuracy with small training data.
We construct a path integral based on the coupling of the Liouville action and the Mabuchi K-energy on a one-dimensional complex manifold. To the best of our knowledge this is the first rigorous construction of such an object and this is done by means of probabilistic tools. Both functionals play an important role resp…
Probabilistic fair clustering tackles uncertain group membership.
problem Fair clustering with imperfect group membership.
method Probabilistic algorithms for metric graphs and metric membership.
result Approximation ratio guarantees for fair clustering.
New method for efficient probabilistic inference using masked language modeling.
problem Efficient posterior inference in probabilistic programs with many hyper-parameters.
method Formulate inference as masked language modeling, train a neural network to unmask random values.
result Foundation posterior for zero-shot inference and fine-tuning across a range of programs.
Solves probabilistic Lambert problem connecting astrodynamics with optimal mass transport.
problem Determining spacecraft velocity for given positions with probabilistic constraints.
method Generalized optimal mass transport (OMT) and Schrödinger bridge (SBP) connections.
result Existence and uniqueness of solution for probabilistic Lambert problem.