Tensor CANDECOMP/PARAFAC (CP) decomposition is an important tool that solves a wide class of machine learning problems. Existing popular approaches recover components one by one, not necessarily in the order of larger components first. Recently developed simultaneous power method obtains only a high probability recover…
Proposes a Gaussian process for Koopman mode decomposition.
problem Estimating Koopman mode decomposition quantities and latent variables.
method Unsupervised Gaussian process for simultaneous estimation.
result Efficient parameter estimation through low-rank approximations.
Extends effect variable concept to finite states for web search evaluation.
problem Finding effect of variant variables in changes of observable variables.
method Theoretical analysis and simultaneous distribution decomposition.
result States of extreme effect variable are minimally affected by variant and highly different in observable variable.
New method decomposes profits and losses continuously, avoiding discrete reporting issues.
problem Analyzing profits and losses at discrete dates ignores detailed paths.
method Constructs a large class of continuous-time decompositions using extended Itô's formula.
result Identifies a preferred decomposition from exactness, symmetry, and normalization axioms.
In the recent paper \cite{DESZ}, the notion of Yg,ξ-submartingale processes has been introduced. Within a jump-diffusion model, we prove here that a process X which satisfies the simultaneous YQ,g,ξ -submartingale property under a suitable family of equivalent probability measur…
Proposes joint LCA for multiview data to identify shared and view-specific components.
problem Extracting shared components sequentially from multiview data.
method Formulates a matrix decomposition model with joint and individual structures, proposes a penalty term objective function, and employs a refitting procedure.
result Achieves simultaneous estimation and rank selection for cross covariance.
Paper compresses RNNs using HT decomposition for better performance.
problem Large model sizes of RNNs in sequence analysis.
method Hierarchical Tucker (HT) tensor decomposition for model compression.
result HT-LSTM achieves better compression and accuracy than state-of-the-art methods.
The paper analyzes stability and asymptotic behavior of hedging strategies in binomial and trinomial models.
problem Stability and asymptotic analysis of hedging strategies in incomplete financial models.
method Discrete-time Föllmer-Schweizer decomposition, perturbation analysis, and asymptotic approximation.
result Explicit formulas for leading order correction terms in asymptotic analysis.
Meta-graph is currently the most powerful tool for similarity search on heterogeneous information networks,where a meta-graph is a composition of meta-paths that captures the complex structural information. However, current relevance computing based on meta-graph only considers the complex structural information, but i…
Revisits CP tensor decomposition for noisy, non-orthogonal data.
problem Statistical optimality and convergence of ALS in noisy, non-orthogonal, higher-rank settings.
method Statistical analysis and TASD method for initialization.
result ALS with TASD achieves optimal error in rank-one setting within one or two iterations.
We propose a heterogeneous simultaneous graphical dynamic linear model (H-SGDLM), which extends the standard SGDLM framework to incorporate a heterogeneous autoregressive realised volatility (HAR-RV) model. This novel approach creates a GPU-scalable multivariate volatility estimator, which decomposes multiple time seri…
In tensor completion tasks, the traditional low-rank tensor decomposition models suffer from the laborious model selection problem due to their high model sensitivity. In particular, for tensor ring (TR) decomposition, the number of model possibilities grows exponentially with the tensor order, which makes it rather ch…
In this paper we study the problem of learning the weights of a deep convolutional neural network. We consider a network where convolutions are carried out over non-overlapping patches with a single kernel in each layer. We develop an algorithm for simultaneously learning all the kernels from the training data. Our app…
Post-hoc model-agnostic interpretation methods such as partial dependence plots can be employed to interpret complex machine learning models. While these interpretation methods can be applied regardless of model complexity, they can produce misleading and verbose results if the model is too complex, especially w.r.t. f…
The paper explores the tradeoffs between fairness measures in machine learning.
problem The challenge of achieving all three fairness notions simultaneously in machine learning models.
method The approach uses partial information decomposition (PID) to analyze the relationships between fairness measures.
result Identifies the regions where fairness measures overlap and disagree, revealing potential tradeoffs.
New method extracts joint and individual signals from multi-view data.
problem Extract joint and individual signals from multi-view data.
method Double-matched matrix decomposition with optimization and iterative algorithm.
result Superior signal estimation performance compared to single-matching methods.
We propose a greedy variational method for decomposing a non-negative multivariate signal as a weighted sum of Gaussians, which, borrowing the terminology from statistics, we refer to as a Gaussian mixture model. Notably, our method has the following features: (1) It accepts multivariate signals, i.e. sampled multivari…
Non-orthogonal joint diagonalization (NJD) free of prewhitening has been widely studied in the context of blind source separation (BSS) and array signal processing, etc. However, NJD is used to retrieve the jointly diagonalizable structure for a single set of target matrices which are mostly formulized with a single da…
Paper proposes a new method for training diffusion models using Markov operators.
problem Training efficiency and accuracy in diffusion models.
method Operator-informed score matching using spectral decomposition of Markov operators.
result Improved score matching for both low and high-dimensional distributions.
In this paper, we study on knots and closed incompressible surfaces in the 3-sphere via Morse functions. We show that both of knots and closed incompressible surfaces can be isotoped into a "related Morse position" simultaneously. As an application, we have following results. *Smallness of Montesinos tangles with lengt…
The paper studies maps in the Heisenberg group and their images, called Rickman rugs.
problem Understanding maps and their images in the Heisenberg group.
method Analyzes maps f:WoH, where H is the first Heisenberg group and W is a vertical subgroup. result Rickman rugs in the Heisenberg group admit a corona decomposition by intrinsic bilipschitz graphs.
BIDIFAC+ factorizes linked matrices for cancer studies.
problem Integrating multiple omics platforms across various cancer types.
method Flexible approach to simultaneous factorization and decomposition of linked matrices using BIDIFAC+.
result Identifies shared and specific modes of variability across multiple omics platforms and cancer types.
GroSS enables efficient search for grouped convolutional architectures.
problem Training grouped convolutional architectures efficiently and effectively.
method GroSS: Group-Size Series Decomposition for Grouped Architecture Search.
result Simultaneous training of differing numbers of groups within a single layer and all possible combinations between layers.
New algorithms improve tensor CP decomposition under mild conditions.
problem Improving tensor CP decomposition with theoretical guarantees under mild incoherence conditions.
method Composite PCA and Concurrent Orthogonalization algorithms.
result Theoretical guarantees and practical superiority over existing methods.
A fair PCA method using JEVD ensures balanced data representation.
problem PCA's bias in data with demographic characteristics.
method Joint Eigenvalue Decomposition (JEVD) for fair PCA.
result JEVD optimally balances fairness and PCA's data structure.
Deep learning models can have low bias and variance, contrary to classical theory.
problem Understanding the performance of deep learning models at high complexity.
method Developed a fine-grained bias-variance decomposition for random feature kernel regression, analyzing the effects of sampling, initialization, and labels.
result The variance terms exhibit non-monotonic behavior and can diverge at the interpolation boundary, even in the absence of label noise.
Modeling dependent defaults with multivariate Cox processes.
problem Capturing dependence in default times.
method Multivariate generalized Cox process with càdlàg, increasing processes.
result Closed-form expressions for joint survival probabilities.
New method evaluates multiple social disparities using machine learning.
problem Reduction of educational disparities across multiple dimensions.
method Triply-Robust Machine Learning Approach for Causal Decomposition Analysis.
result Simultaneous interventions across multiple domains reduce disparities.
Unified model for signed networks separates balance and anomaly effects.
problem Ignoring sign information in signed networks leads to inaccurate analysis.
method Low rank plus sparse matrix decomposition with regularized formulation.
result The model accurately detects communities and anomalies in signed networks.
Many advanced Learning from Demonstration (LfD) methods consider the decomposition of complex, real-world tasks into simpler sub-tasks. By reusing the corresponding sub-policies within and between tasks, they provide training data for each policy from different high-level tasks and compose them to perform novel ones. E…
Paper introduces an unsupervised tensor-based anomaly detection method for spatiotemporal data.
problem Challenges in detecting anomalies in spatiotemporal data, especially in urban traffic monitoring and medical imaging.
method Formulates anomaly detection as a regularized robust low-rank + sparse tensor decomposition, incorporating spatiotemporal smoothness and local dependencies.
result Demonstrates improved anomaly detection performance on both synthetic and real data.
Dictionary learning is a cutting-edge area in imaging processing, that has recently led to state-of-the-art results in many signal processing tasks. The idea is to conduct a linear decomposition of a signal using a few atoms of a learned and usually over-completed dictionary instead of a pre-defined basis. Determining …
This work gives a simultaneous analysis of both the ordinary least squares estimator and the ridge regression estimator in the random design setting under mild assumptions on the covariate/response distributions. In particular, the analysis provides sharp results on the ``out-of-sample'' prediction error, as opposed to…
A new method tackles Bayesian inverse problems with complex PDEs.
problem Bayesian inverse problems with expensive forward model evaluations and high-dimensional priors.
method Domain-decomposed variational auto-encoder Markov chain Monte Carlo (DD-VAE-MCMC) method.
result The method efficiently solves Bayesian inverse problems in parallel and low-dimensional latent spaces.
Paper identifies sparse structures and communities in heterogeneous graphical models.
problem Detecting community structures in graphical models.
method Novel decomposition into sparse and low-rank parts, three-stage estimation procedure.
result Consistent model selection for adaptive ℓ1 penalized estimator. Explicit encoding of group actions in deep features makes it possible for convolutional neural networks (CNNs) to handle global deformations of images, which is critical to success in many vision tasks. This paper proposes to decompose the convolutional filters over joint steerable bases across the space and the group …
Bayesian Empirical Bayes extends EB to complex structures using probabilistic symmetry.
problem Improving simultaneous inference in complex settings like arrays and graphs.
method Generalized empirical Bayes approach based on probabilistic symmetry.
result BEB outperforms existing methods in denoising arrays and spatial data.
Developed Taylor series for muscle-finger system analysis.
problem Understanding the complex relationship between muscle activity and finger movement.
method Used Dendrite Net to develop Taylor series and construct relation spectrum.
result Found muscle synergy and coupling in hand movement.
In this work, we consider Corporate Governance (CG) ties among companies from a multiple network perspective. Such a structure naturally arises from the close interrelation between the Shareholding Network (SH) and the Board of Directors network (BD). In order to capture the simultaneous effects of both networks on CG,…
Two methods extend multivariate Kelly optimization to large problem sizes.
problem Optimizing wealth growth in multiple simultaneous bets.
method Integral transform for independent bets and decomposition-based approach.
result Scaling laws reveal subproblem size vs. solution accuracy.
Link's sphere number equals its bridge number.
problem Determining the minimum number of generators for a link's fundamental group.
method Using meridional presentations with embedded two-spheres in fixed diagrams.
result The minimum number of generators equals the bridge number.
Proposes a new graph trend filtering model for inhomogeneous graph signals.
problem Estimating piecewise smooth signals over a graph with varying smoothness levels.
method Introduces a l2,0 norm penalized Graph Trend Filtering (GTF) model and two solution methods: spectral decomposition and simulated annealing.
result The GTF model performs better than existing approaches in denoising, support recovery, and semi-supervised classification.
MOSAIC detects change points in dynamic networks with low-rank and sparse changes.
problem Detecting change points in dynamic networks with specific structural properties.
method Eigen-decomposition-based test with screened signals and residual-based adjustment.
result MOSAIC achieves minimax-optimal detection and testing rates.
In this paper, we analyze the fundamental conditions for low-rank tensor completion given the separation or tensor-train (TT) rank, i.e., ranks of unfoldings. We exploit the algebraic structure of the TT decomposition to obtain the deterministic necessary and sufficient conditions on the locations of the samples to ens…
This work is motivated by multimodality breast cancer imaging data, which is quite challenging in that the signals of discrete tumor-associated microvesicles (TMVs) are randomly distributed with heterogeneous patterns. This imposes a significant challenge for conventional imaging regression and dimension reduction mode…
Study on lengths of random multicurves on hyperbolic surfaces.
problem Distribution of lengths of random multicurves on closed hyperbolic surfaces.
method Using Margulis' thesis and Mirzakhani's equidistribution theorem for horospheres.
result Distribution of lengths admits a polynomial density, with coefficients expressible in terms of intersection numbers of psi-classes.
A new method quickly identifies key variables and interactions.
problem Identifying key variables and interactions in high-dimensional data.
method Kernel trick for sparse orthogonal decomposition in O(# covariates) time.
result Outperforms existing methods for large, high-dimensional data sets.
A new method for analyzing multi-source, multi-way data reduces dimensionality and reveals shared and individual structures.
problem Analyzing multi-source, multi-way data from different high-throughput technologies.
method Multiple Linked Tensor Factorization (MULTIFAC) extending CP decomposition with L2 penalties and EM algorithm for incomplete data.
result MULTIFAC approximates underlying signal, identifies shared and unshared structures, and imputes missing data.