CMRFs extend PGMs for topological data, capturing both conditional and marginal dependencies.
problem Limited expressiveness of PGMs for topological data.
method Introducing Colored Markov Random Fields (CMRFs) that model Gaussian edge variables on topological spaces.
result CMRFs improve distributed estimation over physical networks compared to baselines.
QT improves inference in complex PGMs with hidden variables.
problem Intractable learning and prediction errors in undirected PGMs with hidden variables.
method Query training (QT) learns a worse model to improve marginal inference.
result QT produces better marginals for a given inference algorithm than the original model.
Paper tackles NP-hard multi-agent planning with reinforcement learning.
problem Solving NP-hard multi-agent, multi-task planning problems with time-dependent rewards.
method Developed a reinforcement learning framework using mean-field inference and auction-based selection.
result Achieved near-optimality and transferability in solving MRRC and IPMS problems.
Delta-AI speeds up inference in sparse PGMs by local credit assignment.
problem Efficient inference in sparse probabilistic graphical models.
method Local credit assignment in agent's policy learning objective.
result Trained sampler recovers marginals and conditional distributions.
Innovative PGMs match neural networks, revealing precise approximations during forward propagation.
problem Lack of precise semantics and probabilistic interpretation in neural networks.
method Constructing infinite tree-structured PGMs that correspond to neural networks.
result DNNs perform precise approximations of PGM inference during forward propagation.
Develops deep probabilistic graphical modeling for better flexibility and interpretability.
problem Lack of flexibility in probabilistic graphical models and interpretability in deep learning.
method Combines deep learning and probabilistic graphical modeling to create flexible models with interpretable latent structures.
result Solves problems in probabilistic topic models and introduces new learning algorithms.
Proposes SGM for modeling complex dependencies in high-dimensional systems.
problem Limited pairwise interactions in PGMs for high-dimensional systems.
method Simplicial Gaussian model (SGM) using discrete Hodge theory and independent random components.
result Maximum-likelihood inference algorithm for parameter recovery and conditional dependence structure.
PGMs and GNNs differ in capturing network data; PGMs outperform GNNs in noisy and heterophily scenarios.
problem Comparing PGMs and GNNs in network data.
method Link prediction task with synthetic and real networks; three experiments on input features, noise, and heterophily.
result PGMs outperform GNNs in noisy and heterophily scenarios.
We propose a new framework for how to use sequential Monte Carlo (SMC) algorithms for inference in probabilistic graphical models (PGM). Via a sequential decomposition of the PGM we find a sequence of auxiliary distributions defined on a monotonically increasing sequence of probability spaces. By targeting these auxili…
Probabilistic graphical models (PGMs) have become a popular tool for computational analysis of biological data in a variety of domains. But, what exactly are they and how do they work? How can we use PGMs to discover patterns that are biologically relevant? And to what extent can PGMs help us formulate new hypotheses t…
The paper examines geometric properties of a unique spacetime model.
problem Investigating the geometric properties of a point-like global monopole spacetime.
method Analyzing the spacetime's pseudosymmetry structures, energy-momentum tensor, and curvature properties.
result The point-like global monopole spacetime exhibits various pseudosymmetry structures and properties.
Hybrid framework combines PGMs and TNs for complex probabilistic modeling.
problem Combining quantum-like correlations into PGM models.
method Introducing decoherence to convert probabilistic TN models into PGMs.
result Hybrid models can represent and combine strengths of both PGMs and TNs.
A new approach reduces computational time in Bayesian Optimisation Algorithm (BOA).
problem Time-consuming PGM updates in BOA.
method Proposes FBOA, a new BOA-based optimisation approach that avoids frequent PGM updates.
result FBOA presents competitive results while significantly saving computational time.
In this paper, we discuss software design issues related to the development of parallel computational intelligence algorithms on multi-core CPUs, using the new Java 8 functional programming features. In particular, we focus on probabilistic graphical models (PGMs) and present the parallelisation of a collection of algo…
The thesis tackles structure learning and parameter estimation for PGMs using penalized maximum likelihood methods.
problem Recovering the true structure of probabilistic graphical models (PGMs) for decision-making and interpretation.
method Penalized maximum likelihood estimation with the LASSO penalty.
result The approach successfully recovers the true structure of PGMs, including Bayesian networks and continuous time Bayesian networks, for both complete and incomplete data.
Paper combines deterministic and stochastic inference methods for PGMs.
problem Combining biases from deterministic methods and high costs from Monte Carlo.
method Sequential Monte Carlo algorithm that uses output from deterministic approximations.
result Improves upon deterministic methods and Monte Carlo by reducing biases and computational costs.
NGRs merge sparse graph recovery with PGMs for efficient probabilistic inference.
problem Efficiently recover sparse graphs and learn distributions over variables.
method Integrates sparse graph recovery methods with PGMs using Graph-constrained path norm.
result NGRs can handle multimodal data and perform sparse graph recovery and probabilistic inference.
Conditional independence tests (CI tests) have received special attention lately in Machine Learning and Computational Intelligence related literature as an important indicator of the relationship among the variables used by their models. In the field of Probabilistic Graphical Models (PGM)--which includes Bayesian Net…
GINNs combine deep learning with PGMs for physics-based multiscale systems.
problem Intrinsic computational bottlenecks and lack of sufficient data for QoI estimation.
method Hybrid approach combining deep learning with probabilistic graphical models, informed by structured priors for CVs.
result GINNs produce tight confidence intervals for non-Gaussian QoIs.
PGMax automates PGM inference on GPUs, improving quality and speed.
problem Efficient inference in complex discrete PGMs.
method Factor graph specification and loopy belief propagation in JAX.
result Higher-quality inference with up to 3x speedups.
Bayesian inference of discrete component states in civil infrastructures using PGMs and GNNs.
problem Inferring discrete states of civil infrastructure components from measurable responses is an ill-posed inverse problem.
method The study proposes a novel Bayesian inversion paradigm based on Probabilistic Graphical Models (PGMs) and Graph Neural Networks (GNNs). PGMs are used to model the problem, with parameters learned from data and structural topology prior. Inference is accomplished by GNNs, and a graph property-based training strategy is developed.
result The proposed framework effectively solves the challenges of inferring the posterior PDF for discrete variables in high-dimensional problems.
The cumulative distribution network (CDN) is a recently developed class of probabilistic graphical models (PGMs) permitting a copula factorization, in which the CDF, rather than the density, is factored. Despite there being much recent interest within the machine learning community about copula representations, there h…
Efficient deep policy gradient method for continuous-time control problems.
problem Optimal control in continuous time with fine time discretization.
method Multi-scale deep policy gradient method with varying time discretization.
result Targeted efficiency in computational resources achieved through multi-scale approach.
Paper shows RL's policy gradient methods can be viewed as supervised learning problems.
problem Connecting RL and SL approaches.
method Proves PGM as supervised learning problem, replaces true labels with discounted rewards.
result PGM can be seen as supervised learning, emphasizing similarities.
In the context of dynamic emission tomography, the conventional processing pipeline consists of independent image reconstruction of single time frames, followed by the application of a suitable kinetic model to time activity curves (TACs) at the voxel or region-of-interest level. The relatively new field of 4D PET dire…
The dissertation investigates the application of Probabilistic Graphical Models (PGMs) in forecasting the price of Crude Oil. This research is important because crude oil plays a very pivotal role in the global economy hence is a very critical macroeconomic indicator of the industrial growth. Given the vast amount of m…
RPN unifies various models with a reconciled polynomial network.
problem Unifying diverse models for deep function learning.
method RPN disentangles functions into inner products of expansion and reconciliation functions.
result RPN accurately approximates underlying functions for data distributions.
SCL discovers compositional structures in analogical reasoning tasks.
problem Discovering compositional structures in analogical reasoning tasks like Raven's Progressive Matrices.
method Proposes Scattering Compositional Learner (SCL) that composes neural networks in sequence.
result Achieves state-of-the-art performance on RPM datasets with significant improvements.
A robust method for multiple kernel learning against adversarial inputs.
problem Certifiably robust learning against adversarial perturbations.
method Distributionally robust optimization with min-max formulation and debiasing techniques.
result The method achieves theoretical guarantees and generalization bounds.
Stein variational gradient descent (SVGD) is a recently proposed particle-based Bayesian inference method, which has attracted a lot of interest due to its remarkable approximation ability and particle efficiency compared to traditional variational inference and Markov Chain Monte Carlo methods. However, we observed th…
ARNe model excels in abstract visual reasoning tasks.
problem Abstract visual reasoning using attention mechanisms.
method Hybrid network architecture combining self-attention and relational reasoning.
result ARNe model surpasses WReN model by 11.28 ppt on PGM datasets.
MXGNet tackles visual reasoning tasks using graph neural networks.
problem Abstract reasoning, especially in the visual domain, is challenging for AI.
method Combines object-level representations, graph neural networks, and multiplex graphs.
result Achieves state-of-the-art accuracy on Euler Diagram Syllogisms and outperforms state-of-the-art models on RPM datasets.
uGLAD recovers sparse graphs from data using deep unrolled networks.
problem Sparse graph recovery from complex data.
method Optimizing deep unrolled networks to learn precision matrices.
result uGLAD outperforms existing algorithms in sparsity optimization and robustly handles missing data.
Combines neural networks and probabilistic graphical models for efficient higher-order inference.
problem Lack of efficient higher-order relational information in graph neural networks and probabilistic graphical models.
method Derives efficient approximate sum-product loopy belief propagation for higher-order PGMs, embeds into neural network, proposes methods for constructing higher-order factors.
result Substantially outperforms state-of-the-art k-order graph neural networks in molecular datasets.
Statistical physics tools are applied to reinforcement learning for new dynamic programming approaches.
problem Exploring connections between reinforcement learning and statistical physics.
method Constructing a partition function from trajectories in a Markov decision process and using it to derive a new Bellman equation.
result Policies derived from the partition function are entropy-aware and favor states with multiple outcomes.
DP synthetic data may inflate statistical test results, caution advised.
problem Inflated Type I errors in statistical tests on DP-synthetic data.
method Evaluation of Mann-Whitney U test, t-test, chi-squared test, and median test on DP-synthetic data generated from real-world and simulated datasets using various DP-synthetic data generation methods.
result A large portion of evaluation results showed inflated Type I errors, especially at low privacy levels.
This paper surveys various methods for dimensionality reduction and nearest neighbor search.
problem Efficiently reducing high-dimensional data to lower dimensions while preserving essential information.
method Linear and nonlinear random projections, including sparse random projections, random Fourier Features, and Random Kitchen Sinks.
result Various methods for dimensionality reduction and nearest neighbor search are explained and compared.
The paper studies how norms of random vectors are preserved by random projections.
problem Understanding how random matrix affects norms of random vectors.
method Proved the distribution of the norm of random vector is preserved by random projection.
result Random matrix preserves the distribution of the norm of random vectors with i.i.d. entries.
Orthogonal random features approximate a Bessel kernel, offering sharper bounds than random Fourier features.
problem Approximating Gaussian kernel efficiently for large datasets.
method Use of Haar orthogonal matrices to construct orthogonal random features and analyze their bias and variance.
result Orthogonal random features approximate a Bessel kernel, not the Gaussian kernel, with sharper bounds.
New methods improve prediction performance and reduce computation time in boosting and random forest models.
problem Improving prediction performance and reducing computation time in boosting and random forest models.
method Random tree depth injection approach for Boosting and Random Forests.
result The new methods can improve prediction performance and reduce computation time by up to 40%.
Proposes a method for modeling random objects in metric spaces using random effects.
problem Modeling random objects in non-Euclidean spaces with random effects.
method Nonlinear Fréchet-based algorithm for M-estimation.
result Consistent estimation of prediction target under random-effects formulation.
Enhances random forest performance with exogenous randomness.
problem Improving random forest performance through exogenous randomness.
method Developed non-asymptotic MSE expansions for individual trees and forests, identified two types of randomness, and conducted simulations.
result Exogenous randomness, particularly feature subsampling, reduces both bias and variance of random forests.
New random forest method provides optimal rates and confidence bands.
problem Improving random forest regression rates and constructing confidence bands.
method Proposed Ehrenfest centered purely random forests achieve optimal rates; used Gaussian approximation for supremum of empirical processes.
result Explicit asymptotic uniform confidence bands constructed for both random forest types.
Much is known about random right-angled Coxeter groups (i.e., right-angled Coxeter groups whose defining graphs are random graphs under the Erdös-Rényi model). In this paper, we extend this model to study random general Coxeter groups and give some results about random Coxeter groups, including some information about t…
Improved random forest proximities capture data geometry.
problem Inaccurate random forest proximities do not reflect learned data geometry.
method Introduce RF-GAP: Geometry- and Accuracy-Preserving proximities.
result RF-GAP improves geometric representation in tasks like data imputation.
Random subgroups of free groups are invariant only by inner automorphisms.
problem Understanding the structure of random subgroups in free groups.
method Analyzing splittings and automorphisms of random subgroups.
result Random subgroups of free groups are invariant only by inner automorphisms.
This work estimates edge weights of edge-reinforced random walks using observed data.
problem Statistical estimation of edge weights in edge-reinforced random walks.
method Proposes an estimator based on the generalized method of moments using the magic formula and hyperbolic Gaussian structure.
result Analyzes the sample complexity of the proposed estimator.
Paper proposes diagnostics for error and variance estimation in randomized matrix computations.
problem Safe use of randomized matrix algorithms in applications.
method Leave-one-out error estimator and jackknife resampling method.
result Provides rapid diagnostics to assess quality of randomized matrix computations.