Proposes FOAGP for efficient orthogonal effect decomposition of black-box computer experiments.
problem Challenges in sensitivity analysis of black-box computer experiments with complex, nonlinear functional outputs.
method Functional-output orthogonal additive Gaussian process (FOAGP) with conditional orthogonality constraint.
result Demonstrates effectiveness in orthogonal effect decomposition and variance decomposition through simulations and real-world application.
PROD method improves high-dimensional regression by handling strong correlations.
problem Violation of Irrepresentable Condition in LASSO for high-dimensional data.
method PROD procedure based on orthogonal decomposition of design matrix.
result PROD enhances performance of high-dimensional penalized regression.
The paper shows how gradient flow on over-parametrized tensor decomposition behaves like deflation.
problem Understanding the training dynamics of gradient flow on tensor decomposition.
method Empirical observation and mathematical proof of gradient flow dynamics for orthogonally decomposable tensors.
result Gradient flow dynamics for orthogonally decomposable tensors follows a tensor deflation process, recovering all tensor components.
In this paper, we study the nonnegative tensor data and propose an orthogonal nonnegative Tucker decomposition (ONTD). We discuss some properties of ONTD and develop a convex relaxation algorithm of the augmented Lagrangian function to solve the optimization problem. The convergence of the algorithm is given. We employ…
Decomposing tensors into orthogonal factors is a well-known task in statistics, machine learning, and signal processing. We study orthogonal outer product decompositions where the factors in the summands in the decomposition are required to be orthogonal across summands, by relating this orthogonal decomposition to the…
TreeHFD algorithm explains tree ensemble models through hierarchical orthogonality.
problem Difficulty in explaining black-box tree ensemble models.
method TreeHFD algorithm using hierarchical orthogonality constraints.
result TreeHFD estimates Hoeffding decomposition from data samples.
The paper explores geometric decompositions for Ricci tensors and their applications.
problem Understanding Ricci tensors on compact Riemannian manifolds.
method Utilizes Berger-Ebin and York L2-orthogonal decompositions. result New insights into Ricci almost solitons and harmonic maps.
We construct a decomposition of the identity operator on a Riemannian manifold M as a sum of smooth orthogonal projections subordinate to an open cover of M. This extends a decomposition of the real line by smooth orthogonal projection due to Coifman, Meyer and Auscher, Weiss, Wickerhauser, and a similar decomposit…
We provide a unified view of additive explanations for dependent inputs.
problem Challenges in obtaining a tractable representation and estimating the decomposition for dependent inputs.
method Combining Hilbert space methods with generalized functional ANOVA, we build an explicit decomposition Riesz Basis.
result Proposed a simple yet powerful algorithm to estimate the decomposition from data.
Enhances Gaussian processes with spherical features for better scalability and flexibility.
problem Lack of representation learning in Gaussian processes compared to deep neural networks.
method Introduces spherical inter-domain features to improve GP approximation and scalability.
result The method alleviates limitations and improves scalability compared to alternative strategies.
Parsimonious Dynamic Mode Decomposition selects sparse modes robustly.
problem Manual tuning of sparsity parameters in traditional DMD.
method Time-delay embedding and Orthogonal Matching Pursuit.
result Autonomously determines optimally sparse subset of modes.
Existing feature selection methods fail to properly account for interactions between features when evaluating feature subsets. In this paper, we attempt to remedy this issue by using orthogonal variance decomposition to evaluate features. The orthogonality of the decomposition allows us to directly calculate the total …
Inverted file and asymmetric distance computation (IVFADC) have been successfully applied to approximate nearest neighbor search and subsequently maximum inner product search. In such a framework, vector quantization is used for coarse partitioning while product quantization is used for quantizing residuals. In the ori…
The paper extends orthogonal decomposition results to hermitian Higgs bundles.
problem Classical propositions on holomorphic vector bundles do not always extend to Higgs bundles.
method The approach involves extending propositions on orthogonal decompositions and the second fundamental form to hermitian Higgs bundles.
result Extended propositions concerning orthogonal decompositions and the second fundamental form have applications in Higgs bundles.
Optimizing over the set of orthogonal matrices is a central component in problems like sparse-PCA or tensor decomposition. Unfortunately, such optimization is hard since simple operations on orthogonal matrices easily break orthogonality, and correcting orthogonality usually costs a large amount of computation. Here we…
We present an algorithm for the decomposition of periodic financial return data into orthogonal factors of expected return and "systemic", "productive", and "nonproductive" risk. Generally, when the number of funds does not exceed the number of periods, the expected return of a portfolio is an affine function of its pr…
New algorithms improve tensor CP decomposition under mild conditions.
problem Improving tensor CP decomposition with theoretical guarantees under mild incoherence conditions.
method Composite PCA and Concurrent Orthogonalization algorithms.
result Theoretical guarantees and practical superiority over existing methods.
New scalable GP approximation using Fourier series decomposition.
problem Scalability and accuracy in Gaussian process approximations.
method Harmonic kernel decomposition (HKD) to decompose kernels orthogonally.
result Significantly outperforms standard variational methods in scalability and accuracy.
New method preserves topology in Hodge decomposition for scalar and vector fields.
problem Topology-preserving Hodge decomposition on manifolds with boundaries.
method Comprehensive 5-component decomposition in Eulerian representation.
result Effective numerical experiments validate the method's accuracy and orthogonality.
Study optimizes estimation of orthogonal and rotation matrices from noisy data.
problem Estimating orthogonal and rotation matrices from noisy data.
method Iterative polar decomposition algorithm initialized by spectral methods.
result Algorithm achieves optimal error rate of $(1+o(1)) rac{σ^2 d(d-1)}{2np}$.
TGCCA analyzes higher-order tensors using orthogonal rank-R CP decomposition.
problem Handling higher-order structures in multi-block data analysis.
method Tensor Generalized Canonical Correlation Analysis (TGCCA) with orthogonal rank-R CP decomposition.
result TGCCA outperforms state-of-the-art methods on simulated and real data.
New theory shows EDMD works well in chaotic systems.
problem Uncertainty in EDMD's properties in chaos.
method Developed rigorous theory of EDMD on chaotic maps using OPUC and transfer operator methods.
result EDMD converges to correct limits in chaotic systems with small polynomial dictionaries.
New method for interpreting complex ML models.
problem Interpreting complex black-box ML models.
method Functional decomposition of black-box predictions into simpler subfunctions.
result Main effects provide insights into feature contributions and interactions.
Paper uses sparse learning to estimate quasi-potential and drift components in stochastic systems.
problem Estimating quasi-potential and drift components in stochastic systems.
method Sparse identification of non-linear dynamics (SINDy) combined with action minimization methods.
result Evaluation of quasi-potential landscape from a single trajectory.
Deterministic bounds for tensor singular values and vectors, differing from matrix cases.
problem Spectral learning of higher-order orthogonally decomposable tensors.
method Deterministic perturbation bounds for singular values and vectors of orthogonally decomposable tensors.
result Perturbation affects each essential singular value/vector in isolation, independent of multiplicity and distance from other singular values.
Proposes a new method for analyzing multimodal neuroimaging data.
problem Combining interpretability and flexibility in multimodal data analysis.
method Orthogonalized kernel debiased machine learning approach.
result Established consistency and asymptotic normality of the estimated primary parameter.
STRIDE improves explainable AI by efficiently decomposing feature interactions without subset enumeration.
problem Lack of expressive power and high computational cost in existing XAI frameworks.
method STRIDE uses a functional decomposition approach in RKHS, avoiding subset enumeration and focusing on orthogonal components.
result STRIDE achieves a 3.0 times speedup over TreeSHAP and a high R^2 of 0.93 for feature reconstruction.
DeepBlip estimates treatment effects over time using neural networks.
problem Estimating treatment effects over time with interpretable blip effects.
method DeepBlip uses a novel double optimization trick to enable simultaneous learning of blip functions with sequential neural networks.
result DeepBlip achieves state-of-the-art performance across various clinical datasets.
We present an algebraic investigation of generalized and equiaffine curvature tensors in a given pseudo-Euclidean vector space and study different orthogonal, irreducible decompositions in analogy to the known decomposition of algebraic curvature tensors. We apply the decomposition results to characterize geometric pro…
Unified model explains volatility memory in stocks and forex.
problem Understanding the components of volatility memory in financial markets.
method Developed a three-dimensional decomposition of volatility memory into level, shape, and tempo.
result Unified model shows that volatility memory is state-dependent, with different gates prevailing in equities and forex.
We orthogonalize the NSS model to condition and diagnose its ill-conditioned parameters.
problem The ill-conditioning of the NSS model's design matrix.
method Exact orthogonal reparametrization via QR decomposition.
result Orthogonalization isolates the conditioning structure and maintains fit uncertainty.
SOFARI improves inference on multi-task learning latent factors.
problem Challenges in precise inference on multi-task learning latent factor matrices.
method High-dimensional manifold-based Neyman near-orthogonality inference on Stiefel manifold structure.
result Easy-to-use bias-corrected estimators for latent factor vectors and singular values with asymptotic normal distributions.
It is well known that the curvature tensor of a pseudo-Riemannian manifold can be decomposed with respect to the pseudo-orthogonal group into the sum of the Weyl conformal curvature tensor, the traceless part of the Ricci tensor and of the scalar curvature. A similar decomposition with respect to the pseudo-unitary gro…
Proposes a novel method to cluster individuals based on treatment effects.
problem Identifying subpopulations with different treatment responses.
method Clusters individuals using a learned kernel derived from causal forests, revealing latent subgroup structures.
result Captures meaningful treatment effect heterogeneity through kernelized clustering.
Revisits CP tensor decomposition for noisy, non-orthogonal data.
problem Statistical optimality and convergence of ALS in noisy, non-orthogonal, higher-rank settings.
method Statistical analysis and TASD method for initialization.
result ALS with TASD achieves optimal error in rank-one setting within one or two iterations.
We analyze stochastic gradient descent for optimizing non-convex functions. In many cases for non-convex functions the goal is to find a reasonable local minimum, and the main concern is that gradient updates are trapped in saddle points. In this paper we identify strict saddle property for non-convex problem that allo…
DONUT improves treatment effect estimation by enforcing orthogonality constraints.
problem Estimating treatment effects from observational data is challenging due to unobserved outcomes.
method DONUT uses a regularization framework that formalizes unconfoundedness as orthogonality, leading to deep orthogonal networks.
result DONUT outperforms state-of-the-art methods in estimating average treatment effects.
Tensor CANDECOMP/PARAFAC (CP) decomposition is an important tool that solves a wide class of machine learning problems. Existing popular approaches recover components one by one, not necessarily in the order of larger components first. Recently developed simultaneous power method obtains only a high probability recover…
Spectral learning extends matrix methods to tensors for better latent variable modeling.
problem Limitations of matrix-based spectral methods in capturing non-Gaussian data.
method Extend spectral decomposition to tensor-based methods for higher-order moments.
result Tensor decomposition can identify latent effects missed by matrix methods.
The Temperley-Lieb algebra is a fundamental component of SU(2) topological quantum field theories. We construct chain complexes corresponding to minimal idempotents in the Temperley-Lieb algebra. Our results apply to the framework which determines Khovanov homology. Consequences of our work include semi-orthogonal deco…
Many modern big data applications feature large scale in both numbers of responses and predictors. Better statistical efficiency and scientific insights can be enabled by understanding the large-scale response-predictor association network structures via layers of sparse latent factors ranked by importance. Yet sparsit…
The paper proposes and discusses semiorthogonal decompositions for moduli spaces of vector bundles.
problem Decompositions of moduli spaces of vector bundles with fixed determinant of odd degree.
method Semiorthogonal decompositions, Grothendieck ring of varieties, mirror symmetry, graph potentials, Fukaya category.
result Evidence for a conjectural semiorthogonal decomposition of moduli spaces of rank 2 bundles with odd determinant.
Paper proposes a new optimization framework for learning eigenfunctions of operators.
problem Computing eigenvalue decomposition of high-dimensional operators.
method Operator SVD with Neural Networks via Nested Low-Rank Approximation.
result Proposed method efficiently learns top-L singular values and functions in the correct order.
A new method quickly identifies key variables and interactions.
problem Identifying key variables and interactions in high-dimensional data.
method Kernel trick for sparse orthogonal decomposition in O(# covariates) time.
result Outperforms existing methods for large, high-dimensional data sets.
The paper decomposes spacelike hypersurface properties for general relativistic vacuum equations.
problem Analyzing properties of spacelike hypersurfaces in general relativity.
method Used L2-orthogonal decomposition and Ahlfors Laplacian. result Decomposed the second fundamental form of spacelike hypersurfaces.
New algorithms solve tensor problems with random components using SDP.
problem Exact tensor nuclear norm, decomposition, and completion for random tensors.
method Degree-4 Sum of Squares (SOS) semidefinite programs.
result Exact solutions for tensor nuclear norm, decomposition, and completion with random asymmetric components.
Corrected whitening restores orthogonality in high-dimensional spherical Gaussian mixtures.
problem In high-dimensional data, standard whitening fails to preserve orthogonality of mixture means.
method Derived exact limits for whitened means dot products using random matrix theory, constructed a corrected whitening matrix.
result Corrected whitening allows for improved estimation of spherical Gaussian mixtures in the large-dimensional regime.
The paper characterizes harmonic maps and studies their properties on Riemannian manifolds.
problem Characterizing and analyzing harmonic maps between Riemannian manifolds.
method Analytic and geometric methods, including L2-orthogonal decomposition and energy density analysis.
result A criterion for harmonic submersions and diffeomorphisms, and new results linking harmonic symmetric bilinear forms and metrics.