Shape-constrained symbolic regression improves model extrapolation with prior knowledge.
problem Improving model extrapolation with prior knowledge in symbolic regression.
method Shape-constrained symbolic regression using evolutionary algorithms with interval arithmetic.
result Models with shape constraints have improved extrapolation but lower accuracy on test sets.
We consider the problem of nonparametric regression under shape constraints. The main examples include isotonic regression (with respect to any partial order), unimodal/convex regression, additive shape-restricted regression, and constrained single index model. We review some of the theoretical properties of the least …
In this paper we develop the theory of parametric polynomial regression in Riemannian manifolds and Lie groups. We show application of Riemannian polynomial regression to shape analysis in Kendall shape space. Results are presented, showing the power of polynomial regression on the classic rat skull growth data of Book…
Functional BART adds shape priors to Bayesian tree regression for better curve fitting.
problem Regression with function-on-scalar data and shape constraints.
method Bayesian tree structure with spline representations, customized Bayesian backfitting algorithm, shape priors.
result Improved estimation and prediction accuracy with shape priors.
Active-set algorithm improves Cox regression for shape-restricted covariates.
problem Improving Cox regression for shape-restricted covariates.
method Shape-restricted inference using active-set optimization for spline basis expansion.
result Active-set algorithm produces accurate linear covariate effect estimates.
The paper improves GP regression for sparse sensor data in structural mode shape reconstruction.
problem Reconstructing full-field structural mode shapes from sparse sensor data.
method Physics-Constrained Single-Output Gaussian Process (CONS-SOGP) framework.
result The proposed method provides more accurate and reliable mode shapes.
SVarM uses varifold representations for shape classification and regression.
problem Challenges in analyzing geometric data due to non-Euclidean shape spaces.
method Develops a neural network-based framework for varifold representations of shapes.
result Demonstrates strong performance and robustness in shape classification and regression.
Paper tackles multivariate shape-constrained convex regression problems.
problem Fitting a convex function to data with component-wise monotonicity and uniform Lipschitz continuity.
method Least squares estimator via solving a constrained convex quadratic programming problem. Efficient algorithms designed: sGS-ADMM and pALM.
result Both proposed algorithms outperform state-of-the-art methods in numerical experiments.
New method groups similar functional covariates for better modeling.
problem Analyzing functional covariates with similar shapes.
method Coefficient shape alignment regularization approach.
result True grouping structure can be accurately identified under certain conditions.
Improves functional linear regression with shape transfer learning.
problem Data scarcity in functional linear models.
method Shape-based transfer learning from auxiliary to target domains.
result Enhances robustness and generalizability of functional linear models.
Deep model predicts shapes of curves with multiple covariates.
problem Predicting shapes of planar curves with various covariates.
method Deep learning model using complex-valued functions, conditional covariance smoother with modality-specific encoders.
result Model accurately predicts shapes of curves with multimodal covariates.
The paper uses 3D shapes to reveal sundial design adjustments based on latitude.
problem Identifying sundial design adjustments based on installation location.
method Shape analysis in a high-dimensional space, regression in shape space.
result Sundial design adjustments were latitude-dependent.
New algorithm broadens BART models applicability.
problem Limited applicability of Bayesian additive regression trees (BART) models due to conditional conjugacy.
method Introduces a reversible jump Markov chain Monte Carlo algorithm for generalized BART models.
result Extends BART models to arbitrary generalized BART models without conditional conjugacy.
Zero-shot learning (ZSL) can be defined by correctly solving a task where no training data is available, based on previous acquired knowledge from different, but related tasks. So far, this area has mostly drawn the attention from computer vision community where a new unseen image needs to be correctly classified, assu…
Paper tackles hard shape constraints in kernel machines.
problem Enforcing shape requirements in a hard fashion is challenging.
method Tightened second-order cone constrained reformulation for kernel machines.
result Performance guarantees and efficiency demonstrated in various applications.
Over-parameterized CNNs show U-shaped test risk with depth increase.
problem Understanding the impact of depth on test risk in over-parameterized CNNs.
method Empirical image classification experiments and linear regression framework.
result Test risk is U-shaped with increasing depth in over-parameterized CNNs.
We simplify complex regression coefficients using linearization and feature comparison.
problem Interpreting high-dimensional regression coefficients from nonlinear responses.
method Developed a linearization method to derive feature coefficients and compare them with regression coefficients.
result Shows how regression coefficients relate to linearized feature coefficients and how they change under regularization.
FineMorphs models smooth transformations for multivariate regression.
problem Efficiently modeling complex transformations for multivariate regression.
method Optimal control of affine and diffeomorphic transformations using smooth vector fields.
result FineMorphs can reduce dimensionality and adapt to large datasets.
Kernel methods have had great success in Statistics and Machine Learning. Despite their growing popularity, however, less effort has been drawn towards developing kernel based classification methods on Riemannian manifolds due to difficulty in dealing with non-Euclidean geometry. In this paper, motivated by the extrins…
NAMLSS models provide interpretable neural regression for location, scale, and shape.
problem Lack of interpretability in deep learning models for complex data distributions.
method Combines classical statistical methods with DNNs for distributional regression.
result Achieves visual interpretability and predictive power of deep learning models.
Two methods are proposed for high-dimensional shape-constrained regression and classification. These methods reshape pre-trained prediction rules to satisfy shape constraints like monotonicity and convexity. The first method can be applied to any pre-trained prediction rule, while the second method deals specifically w…
Proposes adaptive ridge regression for functional linear models with piecewise shapes.
problem Functional linear regression with unknown coefficient function.
method Adaptive piecewise function template with L2 penalization. result Improves predictive power and interpretability compared to standard methods.
Researchers develop a new method for analyzing shape changes in medical data.
problem Analyzing continuous transformations like shape changes in medical datasets.
method Geodesic regression using an affine connection setting on Lie groups.
result Efficient fixed point algorithm for computing geodesic relationships.
New method predicts y distributions from imperfect data.
problem Predicting y from imperfect data (discrete, truncated, censored).
method Optimal transformations to estimate p(y|x).
result Estimates location, scale, and shape of y distribution.
A new method for analyzing shapes and forms using additive models on manifolds.
problem Analyzing shapes and forms under geometric transformations.
method Extending generalized additive regression to models for shapes/forms using squared geodesic distance and Riemannian L2-Boosting algorithm. result Automated model selection and intuitive visualization of covariate effects in shape/form space.
2L-FUSE enhances feature sparsity through kernel learning.
problem Sparsity and feature selection in regression tasks.
method 2-Layered kernel machines for learning a shape matrix and feature direction identification.
result Minimal yet informative feature sets are identified without losing predictive performance.
Proposes a tuning-free dynamic pricing method for linear valuation models.
problem Dynamic pricing in linear valuation models with unknown market noise distribution.
method Shape-constrained isotonic regression under weaker Hölder continuity assumptions.
result Demonstrates lower empirical regret compared to existing methods.
Model predicts EMF of Ni-Mn-Ga MSMA, improved with GRNN.
problem Predicting the electromotive force (EMF) of Ni-Mn-Ga MSMA under various conditions.
method Developed a new constitutive model for Ni-Mn-Ga single crystals, incorporating magnetic easy axis offset. Used GRNN to enhance model predictions.
result GRNN improves model predictions of EMF, capturing more experimental features.
Unified understanding of neural representation similarity measures.
problem Fragmented research landscape of neural network similarity measures.
method Observation and exploration of connections between shape distances and normalized Bures similarity.
result Cosine of the Riemannian shape distance equals normalized Bures similarity.
Self-training in linear models shows a U-shaped test-risk curve due to signal forgetting and denoising.
problem Understanding the dynamics of iterative self-training in high-dimensional linear regression.
method Derivation of deterministic-equivalent recursions for prediction risk and effective noise, analysis of signal forgetting and denoising effects.
result An optimal early-stopping time is determined, and a U-shaped test-risk curve is observed.
New model captures complex relationships from experimental data.
problem Capturing intricate feature interactions in empirical data.
method Shape Arithmetic Expressions (SHAREs) combining GAMs and mathematical expressions.
result SHAREs model captures complex feature interactions.
New active learning methods for Gaussian process improve predictive modeling of composite fuselage.
problem Improving predictive modeling of composite fuselage with limited training samples and uncertainties.
method Proposed two new active learning algorithms for Gaussian process considering uncertainties.
result The proposed approach realizes better prediction performance for automatic shape control of composite fuselage.
Bayesian method selects important covariates in modal regression.
problem Bayesian modal regression with heavy-tailed responses.
method Expectation-maximization algorithm for parameter estimation; test statistic for variable selection.
result Efficacy of the proposed method in identifying important covariates.
In this paper, we study the modeling and the classification of functional data presenting regime changes over time. We propose a new model-based functional mixture discriminant analysis approach based on a specific hidden process regression model that governs the regime changes over time. Our approach is particularly a…
Diffusion models don't overfit, contrary to expectations.
problem Understanding generalization in diffusion models.
method Fundamental impossibility results and analysis of score matching.
result Diffusion models exhibit classical U-shaped loss curve, not double descent.
We present a new mixture model-based discriminant analysis approach for functional data using a specific hidden process regression model. The approach allows for fitting flexible curve-models to each class of complex-shaped curves presenting regime changes. The model parameters are learned by maximizing the observed-da…
In regression tasks, aleatoric uncertainty is commonly addressed by considering a parametric distribution of the output variable, which is based on strong assumptions such as symmetry, unimodality or by supposing a restricted shape. These assumptions are too limited in scenarios where complex shapes, strong skews or mu…
CRUDE calibrates regression uncertainty without assuming specific error distributions.
problem Uncalibrated uncertainty estimates in regression models, especially for modern predictive tasks.
method CRUDE assumes error distributions have a constant shape, shifted and scaled by predicted mean and standard deviation.
result CRUDE produces sharper, better calibrated, and more accurate uncertainty estimates than existing methods.
Brenier isotonic regression extends multi-output isotonic regression using optimal transport.
problem Enforcing cyclic monotonicity in multi-output regression.
method Leverage Kantorovich's optimal transport to find cyclically monotone couplings.
result Brenier isotonic regression outperforms baselines in probability calibration.
Optimal transport improves multivariate prediction uncertainty quantification.
problem Uncertainty quantification in multivariate learning tasks, especially in regression and classification.
method Introducing a novel Conformal Prediction procedure using optimal transport to handle multivariate score functions and construct flexible prediction regions.
result Ensures finite-sample, distribution-free coverage guarantees for multivariate prediction sets.
QABBA improves time series storage efficiency while preserving shape information.
problem Efficient storage and shape preservation of time series data.
method Quantized symbolic time series approximation (QABBA) using ABBA technique.
result QABBA achieves a new state-of-the-art on Monash regression dataset.
Optical scatterometry is a method to measure the size and shape of periodic micro- or nanostructures on surfaces. For this purpose the geometry parameters of the structures are obtained by reproducing experimental measurement results through numerical simulations. We compare the performance of Bayesian optimization to …
Over the last decades, the challenges in applied regression and in predictive modeling have been changing considerably: (1) More flexible model specifications are needed as big(ger) data become available, facilitated by more powerful computing infrastructure. (2) Full probabilistic modeling rather than predicting just …
Unified detector calibration and simulation using MLE from generative models.
problem Combining detector calibration and simulation using traditional methods.
method Maximum likelihood estimation from conditional generative models.
result Prior-independent and non-Gaussian resolutions possible.
Many datasets are in the form of tables of binned data. Performing regression on these data usually involves either reading off bin heights, ignoring data from neighbouring bins or interpolating between bins thus over or underestimating the true bin integrals. In this paper we propose an elegant method for performing G…
Estimation in generalized linear models (GLM) is complicated by the presence of constraints. One can handle constraints by maximizing a penalized log-likelihood. Penalties such as the lasso are effective in high dimensions, but often lead to unwanted shrinkage. This paper explores instead penalizing the squared distanc…
Isotonic regression is a standard problem in shape-constrained estimation where the goal is to estimate an unknown nondecreasing regression function f from independent pairs (xi,yi) where E[yi]=f(xi),i=1,…n. While this problem is well understood both statistically and computationally, much l…
Paper uses VAEs to control IVS features for financial modeling.
problem Generating realistic IVSs with desired characteristics.
method Variational autoencoder architecture with controllable latent variables.
result Controlled generation of IVSs with specified features.