Non-orthogonal joint diagonalization (NJD) free of prewhitening has been widely studied in the context of blind source separation (BSS) and array signal processing, etc. However, NJD is used to retrieve the jointly diagonalizable structure for a single set of target matrices which are mostly formulized with a single da…
New probabilistic CCA extensions with moment matching for multi-view models.
problem Estimating multi-view models with identifiability guarantees.
method Moment matching techniques, generalized covariance matrices, non-orthogonal joint diagonalization.
result Improved sample complexity and simplified algorithms.
New method improves Pham's algorithm for joint diagonalization.
problem Optimizing joint diagonalization of matrices for statistical learning.
method Quasi-Newton method for Pham's diagonalization criterion.
result Proposed method outperforms Pham's algorithm in experiments.
This paper solves matrix blind joint block diagonalization with noise.
problem Identifying the diagonalizer and block diagonal structure of matrices under noise.
method Bi-block diagonalization method.
result The method can identify the exact solution under certain conditions.
Revisits CP tensor decomposition for noisy, non-orthogonal data.
problem Statistical optimality and convergence of ALS in noisy, non-orthogonal, higher-rank settings.
method Statistical analysis and TASD method for initialization.
result ALS with TASD achieves optimal error in rank-one setting within one or two iterations.
Tensor factorization arises in many machine learning applications, such knowledge base modeling and parameter estimation in latent variable models. However, numerical methods for tensor factorization have not reached the level of maturity of matrix factorization methods. In this paper, we propose a new method for CP te…
The Shapley value theory is used for risk allocation in non-orthogonal risk factors.
problem Risk allocation among non-orthogonal risk factors in financial portfolios.
method Using Shapley value from cooperative game theory to allocate risk contributions.
result Explicit formulas and numerical algorithms for calculating risk allocations are derived.
We consider moment matching techniques for estimation in Latent Dirichlet Allocation (LDA). By drawing explicit links between LDA and discrete versions of independent component analysis (ICA), we first derive a new set of cumulant-based tensors, with an improved sample complexity. Moreover, we reuse standard ICA techni…
New algorithms learn sparse set functions in non-orthogonal Fourier bases.
problem Learning sparse set functions in non-orthogonal Fourier bases.
method Novel algorithms using non-orthogonal Fourier transforms.
result At most nk−klog2k+k queries for k non-zero Fourier coefficients. Paper optimizes tensor deflation for non-orthogonal signals.
problem Recovering low-rank signals from noisy tensors with correlated components.
method Developed an asymptotic analysis and optimized deflation procedure using random tensor theory.
result Proposed an efficient tensor deflation algorithm that optimizes a parameter introduced in the deflation mechanism.
Transformers learn to recall with non-orthogonal embeddings in realistic settings.
problem Understanding how transformers store and retrieve knowledge in practical scenarios.
method Analyzing a single-layer transformer with random embeddings trained on a token-retrieval task.
result Explicit formulas for the model's storage capacity reveal a multiplicative dependence on sample size, embedding dimension, and sequence length.
Improved spectral methods of moments for robust latent variable model learning.
problem Limited robustness of spectral methods of moments to model misspecification.
method Hierarchical approach using approximate joint diagonalization instead of tensor decomposition.
result Our method outperforms previous tensor decomposition methods in speed and model quality.
A new method uses machine learning to optimize user pairing and association in multicell NOMA networks.
problem Optimizing user pairing and association in multicell non-orthogonal multiple access (NOMA) systems.
method Formulated as a combinatorial optimization problem, solved using a Pointer Network (PtrNet) trained with deep reinforcement learning.
result Achieves near-optimal performance in terms of aggregate data rate, outperforming random heuristics by up to 30%.
Recently, there has been a trend to combine independent component analysis and canonical polyadic decomposition (ICA-CPD) for an enhanced robustness for the computation of CPD, and ICA-CPD could be further converted into CPD of a 5th-order partially symmetric tensor, by calculating the eigenmatrices of the 4th-order cu…
Framework for incomplete multi-view learning improves efficiency and clustering accuracy.
problem Incomplete representation in multi-view data.
method Joint Embedding Learning and Low-Rank Approximation (JELLA) framework.
result Improves efficiency and clustering accuracy in incomplete multi-view data.
Paper improves feature selection accuracy using transfer learning.
problem Improving feature selection accuracy in information criteria-based methods.
method Proposes TLCp, a transfer learning procedure based on Mallows' Cp.
result TLCp outperforms conventional Cp in accuracy and stability.
Develops large-sample theory for non-stationary source separation.
problem Lack of large-sample results for non-stationary source separation methods.
method Large-sample theory for NSS-JD method under specific assumptions.
result Consistency of unmixing estimator and its convergence to Gaussian distribution.
Quantum circuits learn to classify non-orthogonal quantum states.
problem Classifying non-orthogonal quantum states is crucial in quantum information.
method Trained quantum circuits using Adam optimization to discover parameters of unknown POVMs.
result Shallow quantum circuits can learn to discriminate among various quantum states with comparable performance to optimal POVMs.
Joint learning framework for clustering and graph construction.
problem Graph construction not fitting clustering requirements.
method Joint learning framework to learn graph and clustering simultaneously.
result Improved clustering accuracy on 10 datasets.
Paper proposes a method to recover point configurations from noisy distance data.
problem Recovering point configurations from noisy distance data.
method Robust Euclidean Distance Geometry via Dual Basis (RoDEoDB) algorithm.
result Exact recovery guarantees for point configuration and Gram matrix under mild conditions.
A new method predicts electron density accurately from atom-centered models.
problem Predicting electron density accurately from atom-centered models.
method Gradient-based approach to minimize loss function in an optimized sparse feature space.
result Extremely accurate predictions of electron density and total energies.
Paper introduces regularization for multi-head attention to spot keywords.
problem Redundancy in multi-head attention leads to lack of rich information.
method Regularization technique to enforce orthogonality between attention heads.
result Significant improvement in keyword spotting performance.
A fair PCA method using JEVD ensures balanced data representation.
problem PCA's bias in data with demographic characteristics.
method Joint Eigenvalue Decomposition (JEVD) for fair PCA.
result JEVD optimally balances fairness and PCA's data structure.
Bayesian hyperprior stabilizes image restoration for noisy and missing data.
problem Stability and adaptability in image restoration for noisy and missing data.
method Proposes a hyperprior approach to stabilize Bayesian image restoration.
result Effective restoration of high dynamic range images from a single sensor.
This paper investigates the use of multiple directions of stratification as a variance reduction technique for Monte Carlo simulations of path-dependent options driven by Gaussian vectors. The precision of the method depends on the choice of the directions of stratification and the allocation rule within each strata. S…
Quantizes Toda systems using geometric methods.
problem Quantizing Toda systems with geometric quantization.
method Geometric quantization of Toda systems as a coadjoint orbit of a group of matrices.
result Found unitary and non-unitary finite dimensional quantum Hilbert spaces.
The study finds resonance points in polarised curves with polynomial conserved quantities.
problem Finding resonance points in polarised curves with polynomial conserved quantities.
method Using the non-orthogonality assumption on the conserved quantity, the study deduces the existence of resonance points.
result Every finite type polarised curve in the conformal 2-sphere with a polynomial conserved quantity admits a resonance point.
In the first quarter of 2006 Chicago Board Options Exchange (CBOE) introduced, as one of the listed products, options on its implied volatility index (VIX). This created the challenge of developing a pricing framework that can simultaneously handle European options, forward-starts, options on the realized variance and …
We introduce a general framework for estimation of inverse covariance, or precision, matrices from heterogeneous populations. The proposed framework uses a Laplacian shrinkage penalty to encourage similarity among estimates from disparate, but related, subpopulations, while allowing for differences among matrices. We p…
We explore the connection between two problems that have arisen independently in the signal processing and related fields: the estimation of the geometric mean of a set of symmetric positive definite (SPD) matrices and their approximate joint diagonalization (AJD). Today there is a considerable interest in estimating t…
Researchers find non-diagonal Einstein metrics in various signatures.
problem Finding non-diagonal four-dimensional cohomogeneity-one Einstein metrics in different signatures.
method Explicitly seeking and constructing new examples of non-diagonal Einstein metrics, particularly in neutral signature.
result Construct new examples of neutral signature non-diagonal Bianchi type VIII Einstein metrics with self-dual Weyl tensor.
Diagonalizes metrics of 3D Lorentzian manifolds.
problem Diagonalizing metrics of 3D Lorentzian manifolds.
method Applying the technique of moving frames.
result Every smooth Lorentzian 3-manifold admits an atlas with a diagonal metric.
Study Ricci vector fields on 2D space with diagonal metrics.
problem Understanding Ricci vector fields on 2D space with specific metrics.
method Examined Ricci vector fields on R2 with a diagonal metric. result Characterized Ricci vector fields on R2 with a diagonal metric. Develops a novel stochastic algorithm for diagonal estimation of large matrices.
problem Efficient diagonal estimation for large or implicit matrices.
method Adaptive parameter selection in a stochastic algorithm.
result Lower bound on random query vectors needed for estimation.
Proposes a method to predict responses from covariates over time.
problem Predicting responses from covariates with changing conditional distributions over time.
method Invariant Subspace Decomposition (ISD) framework that splits the conditional distribution into time-invariant and time-dependent components.
result The decomposition can be used for zero-shot and time-adaptation prediction tasks.
Octagon map accelerates diagonal changes algorithm.
problem Improving the efficiency of diagonal changes algorithm.
method Octagon Farey map as an acceleration.
result Octagon map accelerates diagonal changes algorithm.
New diagonal knots found with non-torus structure.
problem Identifying knots with diagonal grid diagrams.
method Analysis of knots represented by diagonal grid diagrams.
result All diagonal knots are positive, and a new non-torus example is found.
Study finds symmetries in a special 3D space with a diagonal metric.
problem Identifying symmetries in a specific 3D space.
method Determining Killing vector fields on a diagonal metric in R3. result Killing vector fields on the space R3 with a diagonal metric have been identified. We use mathematical induction to prove that the horizontal composition in the class of coherently diagonal complexes is indeed a binary operation. That is to say, the embedding of two coherently diagonal complexes in an alternating planar diagram produces a coherently diagonal complex.
Quaternionic Brownian motion on flag manifold linked to sphere diffusion.
problem Modeling quaternionic stochastic areas on quaternionic flag manifolds.
method Relating quaternionic Brownian motion to symplectic Brownian motion and using radial dynamics.
result Quaternionic stochastic areas follow a multivariate normal distribution.
Proposes a new algorithm to estimate invariant subspaces across multilayer networks.
problem Estimating invariant subspaces across heterogeneous multiple networks.
method Bias-corrected joint spectral embedding algorithm that recursively calibrates diagonal bias and iteratively updates the subspace estimator.
result Established entrywise subspace perturbation bound and entrywise eigenvector central limit theorem for the algorithm.
Equal diagonal energies proven on Liouville surfaces.
problem Diagonal energies on Liouville surfaces.
method Analyzing parameter curves and rectangles on Liouville surfaces.
result Diagonal energies are equal in n-dimensional Liouville manifolds.
Echo state network (ESN) is viewed as a temporal non-orthogonal expansion with pseudo-random parameters. Such expansions naturally give rise to regressors of various relevance to a teacher output. We illustrate that often only a certain amount of the generated echo-regressors effectively explain the variance of the tea…
New method tests independence using ROC analysis and bipartite ranking.
problem Testing independence of two random variables with unknown marginals.
method Nonparametric framework based on ROC analysis and bipartite ranking.
result The method detects small departures from independence in high dimensions.
Diagonal linear networks converge to lasso regularization path during training.
problem Understanding the regularization behavior of diagonal linear networks.
method Analyzing the training trajectory of diagonal linear networks and comparing it to the lasso regularization path.
result The training trajectory of diagonal linear networks is closely related to the lasso regularization path.
Diagonal RNNs improve music modeling performance and speed.
problem Improving symbolic music modeling efficiency and accuracy.
method Introduced diagonal recurrent matrices in RNNs for music modeling.
result Diagonal RNNs achieve better test likelihood and faster convergence.
Develops a new method to compute risk-sharing allocations using Laplace transforms.
problem Complex integrals in computing conditional mean risk-sharing allocations.
method Uses Laplace-Stieltjes transforms to compute risk-sharing allocations from joint transforms.
result Provides closed-form or semi-analytic solutions for a broad class of distributions.
We show that a basis of a semisimple Lie algebra of compact type, for which any diagonal left-invariant metric has a diagonal Ricci tensor, is characterized by the Lie algebraic condition of being "nice". Namely, the bracket of any two basis elements is a multiple of another basis element. This extends the work of Laur…