DeepICMGP surrogate models multiple outputs efficiently.
problem Challenges in modeling dependencies between multiple outputs using traditional multi-output GPs.
method Introduces hierarchical coregionalization structures across layers in DGPs.
result Demonstrates competitive performance and active learning strategies.
This paper reviews challenges and methods for multi-output learning.
problem Challenges in multi-output learning due to the 4Vs of outputs.
method Review of different stages, paradigms, output structures, sub-problems, metrics, and methods.
result Comprehensive overview of multi-output learning challenges and solutions.
Extends multi-output Gaussian processes for heterogeneous outputs.
problem Handling multiple correlated outputs with varying likelihoods.
method Vector-valued Gaussian process prior, linear model of coregionalisation, tractable variational bounds.
result Model performs well on synthetic and real datasets.
This study compares multivariate vs univariate machine learning for multi-output regression.
problem When to use multivariate ensemble techniques over separate univariate models.
method Comparative analysis of different multivariate approaches for multi-output regression.
result Multivariate ensemble techniques outperform separate univariate models in simulations.
LLGP improves multi-output GP learning with reduced training time and improved model confidence.
problem Efficient multi-output Gaussian process learning with non-stationary cross-covariances.
method LLGP uses a common grid of inputs to induce structure in the LMC kernel, optimizing hyperparameters for multi-dimensional outputs and low-dimensional inputs.
result LLGP reduces training time and improves model confidence compared to existing multi-output GP methods.
Safe active learning for multi-output Gaussian processes reduces data acquisition costs and ensures safety.
problem Expensive data acquisition and safety concerns in multi-output regression problems.
method Proposes a safe active learning approach considering data informativeness and safety constraints.
result Improved convergence compared to competitors on simulated and real-world datasets.
Multi-output Gaussian processes (MOGP) are probability distributions over vector-valued functions, and have been previously used for multi-output regression and for multi-class classification. A less explored facet of the multi-output Gaussian process is that it can be used as a generative model for vector-valued rando…
Multi-Output Dependence (MOD) learning is a generalization of standard classification problems that allows for multiple outputs that are dependent on each other. A primary issue that arises in the context of MOD learning is that for any given input pattern there can be multiple correct output patterns. This changes the…
Wrapped loss function improves convergence and accuracy in multi-output models.
problem Nonconforming residual distributions in multi-output models.
method Proposes a 'Wrapped Loss Function' to regularize nonconforming residual distributions.
result Advanced properties of faster convergence, better accuracy, and improved handling of imbalanced data.
Unified study of nine multi-output conformal methods with generalized scores.
problem Challenges in extending conformal prediction to multi-output problems.
method Nine conformal methods with generalized multi-output conformity scores.
result Generalized scores ensure asymptotic conditional coverage and exact finite-sample marginal coverage.
Extends factorization machines and polynomial networks to multi-output problems.
problem Learning vector-valued functions for multi-class or multi-task problems.
method Convex formulation of a 3-way tensor with a conditional gradient algorithm.
result Achieves excellent accuracy with sparser models than existing methods.
Flexible neural likelihoods for multi-output Gaussian processes improve prediction quality.
problem Improving prediction quality in multi-output Gaussian process models.
method Constructing flexible likelihoods using neural networks and applying sparse variational inference.
result Neural likelihoods can improve prediction quality compared to simpler Gaussian process models.
New model predicts multiple outputs with missing labels.
problem Missing group labels in multi-output regression.
method Weakly-supervised multi-output model using correlated Gaussian processes.
result Model excels in multi-output settings with missing labels.
Enhances robustness of MOGP regression for multiple correlated outputs.
problem Model misspecification and outliers in MOGP regression.
method Extends RCGP framework to multi-output setting.
result Provable robust MOGP with joint correlation capture.
A new kernel for multi-output Gaussian processes reduces undesirable scale effects.
problem Predicting multiple output variables simultaneously with Gaussian processes.
method Design a new kernel (MOCSM) using convolution in the spectral domain to model cross channel dependencies.
result MOCSM kernel reduces undesirable scale effects compared to the Multi-Output Spectral Mixture kernel.
MOGPTK simplifies multi-channel data modeling with Gaussian processes.
problem Modeling multi-channel data efficiently and accurately.
method Python package with TensorFlow backend, supporting various GP kernels and parameter initialization strategies.
result Enables GPU-accelerated training and comprehensive GP modeling pipeline.
Paper introduces non-linear process convolutions for multi-output Gaussian processes.
problem Building accurate covariance functions for multi-output Gaussian processes.
method Volterra series for non-linearity, closed-form expressions for mean and covariance.
result Non-linear model outperforms classical process convolution in synthetic and real datasets.
Improves multi-output regression speed.
problem High computation time in multi-output relevance vector regression.
method Optimized algorithm reducing time complexity.
result Significantly faster computation time compared to existing methods.
Optimistic bounds for multi-output learning using self-bounding Lipschitz condition.
problem Learning vector-valued functions from supervised data.
method Introducing self-bounding Lipschitz condition and proving optimistic bounds using local Rademacher complexity and Srebro's inequality.
result Minimax optimal generalization bounds for multi-output learning, up to logarithmic factors.
MO-GP models fill gaps in biophysical data with across-domain info transfer.
problem Gap filling of biophysical parameters LAI and fAPAR over rice areas.
method Multi-output Gaussian Processes (MO-GP) based on Linear Model of Coregionalization (LMC).
result MO-GP models successfully predict biophysical variables even in high missing data regimes.
The paper develops exact and approximate conformal inference methods for multi-output regression.
problem Uncertainty quantification in multi-output regression predictions.
method Exact derivations and approximations of conformal inference p-values for linear multi-output predictors, and efficient methods for nonlinear predictors.
result Efficient methods for approximating conformal prediction regions for multi-output predictors, both linear and nonlinear.
New kernel models multi-output Gaussian processes accurately.
problem Challenges in modelling cross-covariances for multiple-output Gaussian processes.
method Replaced Gaussian components with block components of finite bandwidth in spectral mixture kernel.
result First multi-output generalization of spectral mixture kernel that can approximate any stationary multi-output kernel to arbitrary precision.
Optimal algorithms identify non-dominated arms in multi-output linear bandit models.
problem Identifying the Pareto Set in multi-output linear bandit models.
method Design-based algorithms for Pareto Set Identification (PSI) in a structured multi-output linear bandit model.
result Nearly optimal guarantees in both fixed-budget and fixed-confidence settings.
The paper explores dynamic ensembles for multi-step forecasting.
problem Lack of research on dynamic ensembles for multi-step forecasting.
method Extensive experiments with 3568 time series and an ensemble of 30 multi-output models.
result Dynamic ensembles based on arbitrating and windowing perform best.
The paper presents a novel approach to multi-output regression using probabilistic circuits.
problem Capturing correlations between multiple output dimensions in large-scale regression problems.
method Employing a mixture of single-output Gaussian process experts encoded via a probabilistic circuit.
result The method can capture correlations between output dimensions and often outperforms other approaches.
Paper introduces conformal prediction for reliable uncertainty quantification in landmark localization.
problem Systematic underestimation of total predictive uncertainty in landmark localization.
method Conformal prediction framework for multi-output regression, generating flexible prediction regions.
result Methods outperform existing approaches in validity and efficiency across 2D and 3D datasets.
New algorithm predicts multiple types of outputs with dependencies.
problem Predicting multiple diverse types of outputs.
method Problem transformation method combined with component-wise boosting.
result Sparse and interpretable learning of dependencies between targets.
New method improves calibration in multi-output probabilistic models.
problem Challenges in achieving multivariate calibration in multi-output regression.
method General regularization framework to enforce multivariate calibration during training for arbitrary pre-rank functions.
result Significant improvement in calibration across all pre-rank functions without sacrificing predictive accuracy.
This paper introduces a multi-output Gaussian process for censored data.
problem Modeling bias in censored data using correlations between multiple outputs.
method Heteroscedastic multi-output Gaussian process with input-dependent noise and variational inference.
result The model better estimates the true process under complex censoring dynamics.
Improved inference for heterogeneous multi-output Gaussian processes using natural gradient optimization.
problem Challenges in adaptive gradient optimization for multi-output Gaussian processes.
method Introducing a fully natural gradient scheme to overcome optimization issues.
result Better local optima solutions and higher test performance rates compared to adaptive gradient methods.
Scikit-multiflow is a Python framework for multi-output/stream data mining.
problem Handling multi-output/stream data efficiently.
method Multi-output/multi-label stream data mining framework with state-of-the-art methods.
result Enables democratization of stream learning research.
Unified framework for multi-output prediction using MV-TPR and MV-GPR.
problem Efficient multi-output prediction for complex distributions.
method Unified framework for multivariate Gaussian and Student-t processes.
result MV-TPR outperforms existing methods in multi-output prediction.
Enhances fairness in multi-output models using optimal transport.
problem Improving fairness in multi-output models like multi-task/multi-class classification and representation learning.
method Post-processing method using optimal transport mappings to move model outputs towards empirical Wasserstein barycenter.
result Demonstrates effectiveness of the proposed approach on multi-task/multi-class classification and representation learning tasks.
GPAR model uses Gaussian processes to efficiently model dependencies between multiple outputs.
problem Efficiently modeling dependencies between multiple outputs in a scalable manner.
method GPAR model decomposes the joint distribution over outputs using the product rule, each conditional modeled by a standard GP.
result GPAR outperforms existing GP models and achieves state-of-the-art performance on benchmarks.
Develops nonstationary MOGP kernels for better performance.
problem Limited applicability of existing MOGP kernels for nonstationary data.
method Harmonizable spectral mixture kernels for nonstationary MOGP.
result Automatic identification of nonstationary behavior in data.
The paper explores the identifiability and interpretability of Gaussian process models using different kernel structures.
problem Identifiability and interpretability issues in Gaussian process models.
method The paper examines both single-output and multi-output Gaussian process models using additive and multiplicative mixtures of Matérn kernels.
result The smoothness of a mixture of Matérn kernels is determined by the least smooth component, and none of the mixing weights or parameters are identifiable.
The study addresses negative transfer in multi-output Gaussian processes by proposing latent structures.
problem Negative transfer in multi-output Gaussian processes leading to decreased performance.
method Defining negative transfer, deriving conditions for avoiding it, proposing latent structures.
result Latent structures can avoid negative transfer and scale to large datasets.
A scalable MOGP model with stochastic variational inference for many outputs.
problem Efficiently modeling data from multiple sources with many outputs.
method Stochastic variational inference for Latent Variable MOGP (LV-MOGP).
result Computational complexity per iteration is independent of the number of outputs.
Proposes a deep tree-ensemble model for multi-output prediction.
problem Lack of efficient solutions for multi-output prediction.
method Integrates tree-embeddings into deep tree-ensembles for structured output prediction.
result Superior performance in multi-label classification and multi-target regression tasks.
GP-ALPS automatically selects latent processes for multi-output GPs.
problem Manual selection of latent processes in multi-output GPs is time-consuming and prone to biases.
method Developed a variational inference scheme to automatically choose latent processes.
result Demonstrated suitability of GP-ALPS in preliminary experiments.
A new method uses RBMs to handle incomplete multi-output data.
problem Handling incomplete multi-output data with dependencies between features and labels.
method Adapted RBM algorithm based on mean-field equations for joint imputation and classification.
result Efficiently solves problems with missing features and labels.
Proposes a method to improve multi-output Gaussian process for transfer learning.
problem Negative transfer and domain inconsistency in multi-output Gaussian process.
method Regularized MGP with convolution process and domain adaptation.
result Outperforms state-of-the-art benchmarks in simulation and real-world studies.
Brenier isotonic regression extends multi-output isotonic regression using optimal transport.
problem Enforcing cyclic monotonicity in multi-output regression.
method Leverage Kantorovich's optimal transport to find cyclically monotone couplings.
result Brenier isotonic regression outperforms baselines in probability calibration.
A new model captures dependencies and unique characteristics in multi-dimensional sequences.
problem Modeling high-dimensional sequential data with dependencies and unique characteristics.
method Collaborative multi-output Gaussian process dynamical system (CGPDS) with shared and private latent processes, using inducing points and stochastic variational inference.
result Captures dependencies and unique characteristics in multi-dimensional sequences.
Paper develops a probabilistic regressor chain method using Monte Carlo methods.
problem Improving multi-output regression with probabilistic chains.
method Develops a sequential Monte Carlo scheme for probabilistic regressor chains.
result Monte Carlo scheme for probabilistic regressor chains can be effective and useful.
This paper tackles federated learning for automatic latent variable selection in multi-output Gaussian processes.
problem Challenges in determining the adequate number of latent processes and relying on centralized learning for privacy and computational issues.
method Proposes a hierarchical model with spike-and-slab priors for automatic latent process selection and variational inference-based federated learning algorithm.
result Demonstrates the advantageous features of the proposed federated approach through simulations and real-world data.
Parallel gradient boosting speeds up multi-output regression.
problem Efficiently predicting entire conditional distributions.
method Modification of gradient boosting to use a common descent direction.
result Significantly faster and comparable performance to state-of-the-art boosting libraries.
Gaussian processes improve traffic speed data imputation from crowdsourced data.
problem Imputation of missing traffic speed data from crowdsourced sources.
method Multi-output Gaussian processes modeling spatial and temporal patterns.
result Significantly outperforms state-of-the-art imputation methods.