New method corrects missing data bias in dimension reduction.
problem Missing data complicates high-dimensional data analysis.
method Developed a bias-corrected Gram matrix for heterogeneous missingness.
result Proposed method improves dimension reduction techniques significantly.
Consensus dimension reduction combines multiple visualizations to identify shared patterns.
problem Conflicting visualizations from different dimension reduction methods.
method Multi-view learning to identify stable patterns across multiple views.
result Consensus visualization effectively identifies shared low-dimensional data structure.
Unified neural network for linear and nonlinear dimension reduction.
problem Efficiently perform linear and nonlinear sufficient dimension reduction.
method Belted and Ensembled Neural Network (BENN) framework.
result Unified framework for both linear and nonlinear dimension reduction.
POTD estimates SDR subspace using optimal transport for binary response.
problem Insufficient performance of existing SDR methods for categorical responses.
method Principal optimal transport direction (POTD) using optimal transport coupling.
result POTD exclusively estimates SDR subspace for error-free class labels.
We consider dimension reduction for solutions of the Kähler-Ricci flow with nonegative bisectional curvature. When the complex dimension n=2, we prove an optimal dimension reduction theorem for complete translating Kähler-Ricci solitons with nonnegative bisectional curvature. We also prove a general dimension reducti…
Enhances SDR via Hellinger correlation for better data dependency understanding.
problem Improving sufficient dimension reduction in single-index models.
method Developed a new method using Hellinger correlation for detecting the dimension reduction subspace.
result Significantly enhances and outperforms existing SDR methods through deeper data dependency understanding.
Dimension reduction is the process of embedding high-dimensional data into a lower dimensional space to facilitate its analysis. In the Euclidean setting, one fundamental technique for dimension reduction is to apply a random linear map to the data. This dimension reduction procedure succeeds when it preserves certain …
PSMM method optimizes matrix sufficient dimension reduction.
problem Feature matrices with row- and column-wise interpretations require efficient dimension reduction.
method PSMM method converts matrix problem into classification problems using rank-1 normal matrix.
result PSMM outperforms existing methods and provides strong interpretability.
Scalability of statistical estimators is of increasing importance in modern applications and dimension reduction is often used to extract relevant information from data. A variety of popular dimension reduction approaches can be framed as symmetric generalized eigendecomposition problems. In this paper we outline how t…
Survey of SDR methods for high-dimensional regression and embedding.
problem Reducing dimensionality in high-dimensional data.
method Involves both statistical and machine learning approaches, covering inverse and forward regression methods.
result Supervised Kernel Dimension Reduction is equivalent to supervised PCA.
New neural network method simplifies high-dimensional data.
problem Scalability issues in nonlinear sufficient dimension reduction.
method Stochastic neural network with adaptive gradient algorithm.
result Proposed method outperforms existing methods on large-scale data.
A method, due to Élie Cartan, is used to give an algebraic classification of the non-reductive homogeneous pseudo-Riemannian manifolds of dimension four. Only one case with Lorentz signature can be Einstein without having constant curvature, and two cases with (2,2) signature are Einstein of which one is Ricci-flat. If…
The study reveals how synaptic correlations promote dimension reduction in neural networks.
problem Understanding how synaptic correlations affect neural correlations and dimension reduction in deep neural networks.
method A simplified model of dimension reduction considering pairwise correlations among synapses, using mathematical self-consistency for both binary and continuous synapses.
result Weakly-correlated synapses encourage dimension reduction compared to orthogonal synapses, and they also slow down the decorrelation process.
This paper reviews and compares supervised linear dimension-reduction techniques.
problem Lack of information in the response during unsupervised PCA reduces predictive performance.
method Review and comparison of supervised linear dimension-reduction techniques.
result PLS and LSPCA consistently outperform other techniques in simulations.
This paper addresses overfitting in dimension reduction methods by calibrating hyperparameters considering noise.
problem Overfitting in dimension reduction methods, especially t-SNE and UMAP, when data contains noise.
method Present a framework to calibrate hyperparameters in the presence of noise for t-SNE and UMAP.
result Recommended hyperparameter values for t-SNE and UMAP are too small and overfit the noise.
In statistical learning, high covariate dimensionality poses challenges for robust prediction and inference. To address this challenge, supervised dimension reduction is often performed, where dependence on the outcome is maximized for a selected covariate subspace with smaller dimensionality. Prevalent dimension reduc…
We consider an enlarged dimension reduction space in functional inverse regression. Our operator and functional analysis based approach facilitates a compact and rigorous formulation of the functional inverse regression problem. It also enables us to expand the possible space where the dimension reduction functions bel…
In the covariate shift learning scenario, the training and test covariate distributions differ, so that a predictor's average loss over the training and test distributions also differ. In this work, we explore the potential of extreme dimension reduction, i.e. to very low dimensions, in improving the performance of imp…
Theory of symplectic reduction in infinite dimensions developed.
problem Challenges in symplectic reduction in infinite dimensions.
method Normal form of momentum map for infinite-dimensional equivariant maps.
result Theory of singular symplectic reduction in infinite dimensions.
Paper uses non-linear dimension reduction for better economic forecasting.
problem Analyzing economic effects of shocks in large datasets.
method Non-linear dimension reduction in factor-augmented vector autoregressions.
result Non-linear dimension reduction techniques improve forecasting, especially in volatile data.
Study extends Kobayashi's method to non-reductive subgroups for homogeneous spaces.
problem Existence of compact Clifford-Klein forms in homogeneous spaces.
method Extend Kobayashi's method to non-reductive subgroups and compare Cartan projections and non-compact dimensions.
result Examples of homogeneous spaces without compact Clifford-Klein forms.
New algorithm balances spatial data approximation and prediction accuracy.
problem Lack of methods considering spatial correlation and downstream modeling in dimension reduction.
method Formalizes approximation and modeling utility as metrics, proposes a balanced algorithm.
result Optimal trade-off between approximation accuracy and downstream modeling utility.
In this paper, we propose a novel lower dimensional representation of a shape sequence. The proposed dimension reduction is invertible and computationally more efficient in comparison to other related works. Theoretically, the differential geometry tools such as moving frame and parallel transportation are successfully…
Paper compares dimension reduction methods using topological analysis on EEG data.
problem Comparing dimension reduction methods on EEG data.
method Topological data analysis, including persistent homology, Wasserstein distance, and hypothesis tests.
result Different dimension reduction methods show significant qualitative differences across topological homologies.
The study proves a rigidity theorem for compact manifolds with boundary.
problem Rigidity of compact manifolds with boundary in low dimensions.
method Dimension reduction argument for mean curvature, extending Schoen-Yau's for scalar curvature.
result Sharp spherical radius rigidity and best NNSC fill-in in terms of mean curvature.
We discuss Poincaré duality complexes X and the question whether or not their Spivak normal fibration admits a reduction to a vector bundle in the case where the dimension of X is at most 4. We show that in dimensions less than 4 such a reduction always exists, and in dimension 4 such a reduction exists provided X is o…
Two methods preserve tensor structure for reduced dimensionality in tensor regression.
problem Reducing dimensionality of tensor predictors for improved interpretation and accuracy.
method Developed two tensor dimension reduction methods using Tucker and CP decompositions.
result Substantial improvement in accuracy over existing methods in simulations and applications.
UMAP (Uniform Manifold Approximation and Projection) is a novel manifold learning technique for dimension reduction. UMAP is constructed from a theoretical framework based in Riemannian geometry and algebraic topology. The result is a practical scalable algorithm that applies to real world data. The UMAP algorithm is c…
Sliced inverse regression (SIR) is a pioneer tool for supervised dimension reduction. It identifies the effective dimension reduction space, the subspace of significant factors with intrinsic lower dimensionality. In this paper, we propose to refine the SIR algorithm through an overlapping slicing scheme. The new algor…
This research shows that steady solitons in higher dimensions always reduce at infinity.
problem Characterizing steady solitons with nonnegative sectional curvature in higher dimensions.
method Dimension reduction analysis and tangent flow classification.
result Steady solitons in higher dimensions always reduce at infinity.
Rdimtools simplifies DR and IDE for high-dimensional data analysis.
problem Discovering patterns in complex high-dimensional data.
method Provides an R package with 133 DR and 17 IDE algorithms.
result Facilitates geometric understanding of high-dimensional data.
Simplified proof for dimension reduction of polygonal curves.
problem Preserving the continuous Fréchet distance of polygonal curves.
method Sparse oblivious subspace embeddings for generalized dissimilarity measures.
result Generalized dimension reduction technique works for various distance measures.
Modern techniques simplify complex high-dimensional data.
problem Complex, high-dimensional data.
method Unsupervised dimension reduction techniques.
result Simplified representation of high-dimensional data.
A review of contrastive dimension reduction methods for treatment vs control studies.
problem Traditional dimension reduction techniques fail to isolate treatment-specific signals.
method Systematic overview and taxonomy of CDR methods.
result Unified framework for CDR methods and applications.
Modified relative universality for unbiasedness and consistency in dimension reduction.
problem Gap in proof of unbiasedness and Fisher consistency in relative universality.
method Modified definition of relative universality using ǫ-measurability.
result Established unbiasedness and Fisher consistency rigorously.
Improves MARS for nonparametric multivariate regression with dimension reduction.
problem High number of basis functions in MARS for high-order interactions.
method Linear combinations of covariates for dimension reduction, facilitating gradient calculation and eigen-analysis for estimation.
result Asymptotic theory and numerical studies show improved performance over MARS.
t-SNE loses important features in data visualization.
problem t-SNE's loss of important features in data visualization.
method Established mathematical framework to understand t-SNE's loss in different scenarios.
result t-SNE loses important features of data in various scenarios.
Study on instantons over product manifolds with a codimension-4 form.
problem Characterize dimension reduction for moduli spaces of generalized ASD instantons.
method Integrability results for families of connections, topological criteria, and explicit descriptions of moduli spaces.
result Complete characterization of dimension reduction for moduli spaces of generalized ASD instantons.
Develops a new method for nonlinear dimension reduction using random features.
problem Statistical challenges in generalizing Gaussian process-based latent variable models to non-Gaussian data.
method Random feature latent variable models (RFLVMs) that approximate nonlinear relationships with linear functions of random features.
result RFLVMs produce comparable results to state-of-the-art methods on various data types.
Proposes an online method for high-dimensional streaming data.
problem Increasing variable dimensions with sample size in online kernel sliced inverse regression.
method Introduces approximate linear dependence condition and dictionary variable sets to address the problem. Transforms into online generalized eigen-decomposition problem and uses stochastic optimization for updates.
result Achieves close performance to batch processing kernel sliced inverse regression.
New algorithms for clustering and dimension reduction using relative von Neumann entropy.
problem Clustering and dimension reduction for complex data sets.
method Construct graphs from data points, select graph maximizing relative von Neumann entropy, use eigenvectors for dimension reduction.
result Outperforms existing methods on non-trivial data sets.
Proposes a deep learning method for effective data representation.
problem Constructing effective data representations for prediction.
method A deep dimension reduction approach to learning representations with sufficiency, low dimensionality, and disentanglement.
result The proposed deep nonparametric representation is consistent and performs better than existing methods.
New method estimates Gaussian vector functions more efficiently.
problem Estimating functions of Gaussian vectors with high dimensions.
method Combines randomized dimension reduction and PCA.
result Algorithm outperforms Monte Carlo method by a factor of d.
This paper reviews SDR methods for multivariate response regression.
problem Handling sufficient dimension reduction for multivariate response regression.
method Characterizes SDR estimators as inverse or forward regression methods.
result Pooled marginal, projective resampling, distance-based, ordinary least squares, partial least squares, and semiparametric SDR estimators are discussed.
Dimension reduction of multivariate data supervised by auxiliary information is considered. A series of basis for dimension reduction is obtained as minimizers of a novel criterion. The proposed method is akin to continuum regression, and the resulting basis is called continuum directions. With a presence of binary sup…
A new method for classifying naturally reductive spaces is presented. This method relies on the structure theory of naturally reductive spaces developed in \cite{Storm2018a} and the new construction of naturally reductive spaces in \cite{Storm2018}. We obtain the classification of all naturally reductive spaces in dime…
RMFGP combines multi-fidelity models for efficient uncertainty quantification.
problem Efficiently infer quantities of interest with limited high-fidelity data.
method Rotated multi-fidelity Gaussian process with dimension reduction and Bayesian active learning.
result RMFGP model improves accuracy and efficiency in high-dimensional problems.
New method for reducing dimensions of distributional data.
problem Nonlinear sufficient dimension reduction for distribution-on-distribution regression.
method Building universal kernels on metric spaces to characterize conditional independence.
result Method outperforms competing methods in synthetic and real data applications.