This paper reviews SDR methods for multivariate response regression.
problem Handling sufficient dimension reduction for multivariate response regression.
method Characterizes SDR estimators as inverse or forward regression methods.
result Pooled marginal, projective resampling, distance-based, ordinary least squares, partial least squares, and semiparametric SDR estimators are discussed.
Multivariate regression model is a natural generalization of the classical univari- ate regression model for fitting multiple responses. In this paper, we propose a high- dimensional multivariate conditional regression model for constructing sparse estimates of the multivariate regression coefficient matrix that accoun…
We consider the topic of multivariate regression on manifold-valued output, that is, for a multivariate observation, its output response lies on a manifold. Moreover, we propose a new regression model to deal with the presence of grossly corrupted manifold-valued responses, a bottleneck issue commonly encountered in pr…
ESRLCM clusters similar responses, more broadly than traditional models.
problem Clustering multivariate categorical data with common response patterns.
method Bayesian Equivalence Set Restricted Latent Class Model (ESRLCM).
result ESRLCM identifies clusters with similar item response probabilities.
Proposes a method to identify subgroup structure and estimate covariate effects for multivariate response data.
problem Identifying subgroup structure and estimating covariate effects in multivariate response data.
method Joint heterogeneity and reduced-rank learning framework using rank-constrained pairwise fusion penalization.
result Established the asymptotic properties of the estimators and proposed a predictive information criterion for rank selection.
Proposes mCS for multivariate selection with FDR control.
problem Selecting high-quality candidates from multivariate datasets.
method Introduces regional monotonicity and multivariate nonconformity scores.
result Significantly improves selection power with FDR control.
Research uses deep learning and copulas to predict multivariate survival data.
problem Handling right-censored and correlated multivariate survival data.
method Integrates deep learning, copula functions, and survival analysis. Uses copula-based activation functions to model nonlinear dependencies.
result Enhanced prediction accuracy for multivariate survival responses.
Aims to optimize complex multivariate systems with constraints.
problem Optimizing force-field systems in physics with large-scale simulations.
method Combines machine learning and experimental design to find feasible input combinations.
result Locates multiple good regions in the input space.
Develops a method for multivariate time series prediction intervals.
problem Uncertainty quantification in multivariate time series forecasting.
method Conformal prediction method for multivariate time series.
result Empirically demonstrates valid coverage of prediction regions.
In this paper, we consider a generalized multivariate regression problem where the responses are monotonic functions of linear transformations of predictors. We propose a semi-parametric algorithm based on the ordering of the responses which is invariant to the functional form of the transformation function. We prove t…
Post-detection analysis identifies responsible coordinates for multivariate change-points.
problem Identifying which coordinates in multivariate time series change after a detected change-point.
method Two-sample testing procedures with nonparametric tests for Type I error control.
result Strong performance of proposed post hoc statistical procedures.
A family of parsimonious Gaussian cluster-weighted models is presented. This family concerns a multivariate extension to cluster-weighted modelling that can account for correlations between multivariate responses. Parsimony is attained by constraining parts of an eigen-decomposition imposed on the component covariance …
Proposes SROF for row-wise fusion in federated learning for multivariate responses.
problem Heterogeneous client models with shared variable-level structure.
method Sparse Row-wise Fusion (SROF) regularizer and RowFed algorithm.
result Empirically shows consistent error reduction and stronger variable-level cluster recovery.
New method for multivariate distribution regression using NPT metric.
problem Regression with multivariate distributional responses and Euclidean predictors.
method Fréchet regression with nonparanormal transport (NPT) metric.
result Efficient estimation and granular interpretation of predictor effects.
This paper introduces a novel recalibration method for multivariate forecasts.
problem Multivariate calibration for potentially misspecified models.
method Local mappings between marginal probability integral transform values and observed space, using K-nearest neighbors or normalizing flows.
result Demonstrated effectiveness on currency exchange rate and childhood malnutrition data.
Bayesian approach for multivariate density regression of complex data.
problem Regression of multivariate density-valued responses on predictors.
method Bayesian inference using sliced Wasserstein barycenter and SW distance.
result Accurate fits and reliable predictions for complex data.
We propose a method for estimating coefficients in multivariate regression when there is a clustering structure to the response variables. The proposed method includes a fusion penalty, to shrink the difference in fitted values from responses in the same cluster, and an L1 penalty for simultaneous variable selection an…
CovRegRF estimates covariance matrix from covariates using random forests.
problem Estimating conditional covariances or correlations among multivariate responses.
method Random forest trees with a custom splitting rule to maximize covariance difference.
result Accurate covariance matrix estimates and controlled Type-1 error.
Extends online linear regression to handle multivariate data.
problem Hierarchical forecasting with multivariate responses.
method Introduces MultiVAW, extending Vovk-Azoury-Warmuth algorithm to multivariate setting.
result Achieves logarithmic regret in time for multivariate online linear regression.
Improves regression efficiency by separating material and immaterial parts of responses.
problem Improving estimation efficiency in nonlinear multivariate regressions.
method Kernel envelope (KENV) estimator for nonparametric response envelopes in reproducing kernel Hilbert space.
result KENV achieves lower in-sample prediction risk than kernel ridge regression in non-trivial immaterial components.
Develops a new multivariate regression model for complex outcomes.
problem Flexible, heterogeneous, and residual-dependent multivariate regression problems.
method MultiVCBART framework with Graphical Horseshoe priors.
result Empirically outperforms existing models on sparse, high-dimensional datasets.
Paper studies quantized LRMR with random dithering for correlated tasks.
problem Estimating coefficient matrix in quantized multivariate regression.
method Uniform quantization with random dithering, constrained and regularized Lasso estimators.
result Achieves minimax optimal rate with dithering, slightly worsens quantization effect.
Proposes MinPEN framework for estimating relationships in multivariate models.
problem Estimating relationships between multivariate outcomes in statistical learning.
method MinPEN framework using minimum function penalty for non-convex optimization.
result Theoretical and practical validation of MinPEN framework for multivariate models.
New framework for regression trees with multivariate response and dynamic mean vectors.
problem Characterizing and implementing regression trees for multivariate responses.
method High dimensional model with dynamic mean vectors over multi-dimensional change axes.
result Optimal rate of convergence and asymptotic valid confidence intervals for change points.
Bayesian method predicts runtime metrics for fog manufacturing.
problem Accurate prediction of runtime performance metrics in fog manufacturing.
method Bayesian sparse regression for multivariate mixed responses.
result Enhanced prediction and statistical inferences of runtime metrics.
Proposes a new method for multivariate functional regression.
problem Multivariate functional regression with complex relationships.
method Nested reduced-rank regularization (NRRR) approach.
result Consistent and effective in fitting multivariate functional regression models.
Constructs bivariate quantiles using vine copulas for multivariate analysis.
problem Need for research in multivariate quantiles, especially for bivariate responses.
method Constructs bivariate (conditional) quantiles using vine copula based bivariate regression model with a novel tree sequence graph structure.
result Avoids typical shortfalls of regression like transformations, interactions, collinearity, and quantile crossings.
Proposes a multivariate regression model for better analysis of multiple datasets.
problem Insufficient performance of single-dataset analysis in integrative studies.
method Sparse estimation for variable and group selection, alternating direction method of multipliers algorithm.
result Demonstrated improved performance through simulations and real data analysis.
New methods for selecting variables in complex biomedical data.
problem Selecting important variables in multivariate, functional, and complex biomedical data.
method Optimization-based variable selection methods for various regression models.
result Outperforms state-of-the-art methods in accuracy and speed.
This study compares multivariate vs univariate machine learning for multi-output regression.
problem When to use multivariate ensemble techniques over separate univariate models.
method Comparative analysis of different multivariate approaches for multi-output regression.
result Multivariate ensemble techniques outperform separate univariate models in simulations.
TSRGA scales multivariate linear regression for feature-distributed data.
problem Multivariate linear regression for feature-distributed data with high dimensions and many computing nodes.
method Two-stage relaxed greedy algorithm (TSRGA) for multivariate linear regression.
result TSRGA is highly scalable and can yield low-rank coefficient estimates.
Proposes MELODIC family for simultaneous binary logistic regression.
problem Simultaneous analysis of multiple binary response variables.
method Defines models in a reduced Euclidean space using a distance rule.
result Improves predictive accuracy through model interdependence.
Despite tremendous progress in outlier detection research in recent years, the majority of existing methods are designed only to detect unconditional outliers that correspond to unusual data patterns expressed in the joint space of all data attributes. Such methods are not applicable when we seek to detect conditional …
We present a new method for estimating multivariate, second-order stationary Gaussian Random Field (GRF) models based on the Sparse Precision matrix Selection (SPS) algorithm, proposed by Davanloo et al. (2015) for estimating scalar GRF models. Theoretical convergence rates for the estimated between-response covariance…
Extends multivariate regression for tensor-variate data, identifying brain regions and facial characteristics.
problem Challenges in fitting regression models with multivariate responses and covariates.
method Low-rank tensor formats on regression coefficients and tensor-variate normal distribution for errors.
result Maximum likelihood estimators for tensor-on-tensor regression via block-relaxation algorithms.
Neural optimal transport improves multivariate conformal prediction.
problem Multivariate quantile regression challenges and existing methods ignore joint distribution geometry.
method Combines neural optimal transport with amortized optimization for efficient training and faster inference.
result Constructs tighter and more informative predictive regions for multivariate conformal prediction.
A new random forest method for multivariate distributions.
problem Estimating complex multivariate distributions with heterogeneity.
method A novel splitting criterion based on MMD for multivariate responses.
result Estimates full conditional distribution for arbitrary targets.
Treatment effects can be estimated from observational data as the difference in potential outcomes. In this paper, we address the challenge of estimating the potential outcome when treatment-dose levels can vary continuously over time. Further, the outcome variable may not be measured at a regular frequency. Our propos…
Enhances Gaussian process models for handling variable error variances and multiple responses.
problem Limited ability of Gaussian process models to capture abrupt changes and heteroscedastic errors.
method Introduces a novel heteroscedastic Gaussian process (HeGP) framework coupled with variational inference and EM algorithm.
result Effective modeling of multivariate responses with varying error variances.
Demand response is designed to motivate electricity customers to modify their loads at critical time periods. The accurate estimation of impact of demand response signals to customers' consumption is central to any successful program. In practice, learning these response is nontrivial because operators can only send a …
The article introduces inferential moments for analyzing uncertain multivariable systems.
problem Handling inference tasks in uncertain multivariable systems.
method Bayesian inference and quantification of inferential moments.
result Quantification of inferential moments and their connection to mutual information.
We propose dimension reduction methods for sparse, high-dimensional multivariate response regression models. Both the number of responses and that of the predictors may exceed the sample size. Sometimes viewed as complementary, predictor selection and rank reduction are the most popular strategies for obtaining lower-d…
Optimizes minimum-volume prediction sets for multivariate regression.
problem Lack of efficient methods for multivariate conformal prediction.
method Optimization-driven framework for minimum-volume covering sets.
result Efficient and informative prediction sets with tight coverage.
In this paper, we investigate a multivariate multi-response (MVMR) linear regression problem, which contains multiple linear regression models with differently distributed design matrices, and different regression and output vectors. The goal is to recover the support union of all regression vectors using l1/l2-reg…
Improved robustness in multivariate regression and classification with DRO under Wasserstein metric.
problem Outliers in covariates and responses.
method Distributionally Robust Optimization (DRO) with Wasserstein metric ambiguity set and regularization.
result Significant improvement in predictive error and robustness.
A new measure of dependence for various data types.
problem Measuring dependence in multivariate, functional, and structured data.
method Combines local normalization with RKHS flexibility.
result Validates the measure's properties and competitive performance.
We consider the problem of multivariate regression in a setting where the relevant predictors could be shared among different responses. We propose an algorithm which decomposes the coefficient matrix into the product of a long matrix and a wide matrix, with an elastic net penalty on the former and an ℓ1 penalty …
We introduce a new regression framework, Gaussian process regression networks (GPRN), which combines the structural properties of Bayesian neural networks with the non-parametric flexibility of Gaussian processes. This model accommodates input dependent signal and noise correlations between multiple response variables,…