Defines and proves properties of weighted renormalized volume coefficients.
problem None explicitly stated; focuses on mathematical definitions and proofs.
method Defines weighted renormalized volume coefficients and proves their variational nature and polynomial representation.
result Weighted renormalized volume coefficients are variational and can be expressed as polynomials of specific tensors.
New method improves tensor completion by selectively preserving important elements.
problem Recovering corrupted high-dimensional tensor data with missing entries and noise.
method Tensor weighted correlated total variation (TWCTV) regularizer with ADMM algorithm.
result Superior performance in image completion, denoising, and background subtraction tasks.
We introduce a weighted de Rham operator which acts on arbitrary tensor fields by considering their structure as r-fold forms. We can thereby define associated superpotentials for all tensor fields in all dimensions and, from any of these superpotentials, we deduce in a straightforward and natural manner the existence …
RWTNs improve NTN performance in SRL tasks.
problem Improving NTN performance in SRL tasks.
method Randomly weighted, untrained tensors in NTN encoder network.
result RWTNs outperform LTNs in SII tasks.
The article recovers tensor fields from partial data using weighted divergent ray transforms.
problem Recovering tensor fields from partial data.
method Weighted divergent ray transforms, unique continuation property of fractional Laplacian, explicit reconstruction formulas.
result Recovery of symmetric m-tensor fields and unique continuation for vector fields and symmetric 2-tensor fields. We introduce a new parameterization method for deep learning layers using spectral tensor train decomposition.
problem Efficiency and stability in deep learning models with weight matrix compression.
method Spectral Tensor Train Parameterization (STTP) of weight matrices.
result Improved compression and training stability in neural networks.
We construct a natural framed weight system on chord diagrams from the curvature tensor of any pseudo-Riemannian symmetric space. These weight systems are of Lie algebra type and realized by the action of the holonomy Lie algebra on a tangent space. Among the Lie algebra weight systems, they are exactly characterized b…
New method calculates Ricci curvature from distances between weighted volumes.
problem Calculating Ricci curvature for weighted Riemannian manifolds.
method Asymptotic retrieval of generalized Ricci tensor from scaled metric derivatives of Wasserstein 1-distances.
result Limiting coarse curvature of random graphs converges to generalized Ricci tensor.
Study classifies Einstein spaces and warped products in weighted geometry.
problem Characterizing geometric structures of weighted Einstein spaces.
method Complete local classification of weighted Einstein spaces with harmonic Weyl tensor.
result Spaces decompose into Einstein or specific warped products.
A new kernel improves tensor classification accuracy and reduces computation time.
problem Challenges in classifying high-dimensional tensor data.
method Proposes a weighted subspace exponential kernel based on Tucker decomposition.
result The new kernel outperforms existing methods in accuracy and computational efficiency.
Low-rank structure emerges in neural networks during learning.
problem Understanding the evolution of synaptic connectivity over learning.
method Investigated the rank of 3-tensor formed by weight matrices throughout learning.
result Inferred weights are low-tensor-rank and evolve in a fixed low-dimensional subspace.
Study compares spectral properties of a specific tensor in geometry.
problem Comparing spectral properties of a specific tensor in geometry.
method Diameter and global weighted volume comparison with a positive lower bound on the N-Bakry-Emery Ricci tensor. result Established diameter and volume comparisons for tensors with positive lower bounds.
We compute all 2-covariant tensors naturally constructed from a semiriemannian metric which are divergence-free and have weight greater than -2. As a consequence, it follows a characterization of the Einstein tensor as the only, up to a constant factor, 2-covariant tensor naturally constructed from a semiriemannian met…
Tensor decomposition methods are popular tools for learning latent variables given only lower-order moments of the data. However, the standard assumption is that we have sufficient data to estimate these moments to high accuracy. In this work, we consider the case in which certain dimensions of the data are not always …
SPIDER uses deep neural networks for streaming tensor factorization.
problem Lack of effective approach for deep tensor factorization of streaming data.
method Bayesian neural networks with spike-and-slab prior, Taylor expansions, moment matching, and EPI framework.
result Effective incremental updates for latent factors and NN weights.
This paper finds a new way to compress CNN weights, improving on pruning and quantization.
problem Improving performance and storage efficiency of CNNs.
method Identifying and exploiting repeated patterns in CNN weight tensors, using Huffman coding and block sparse matrix formats.
result Achieved compaction ratios of 1.4x to 3.1x in addition to pruning and quantization.
New estimator for tensor weights with improved bias.
problem Estimating tensor weights from noisy data.
method Random matrix theory and KKT conditions.
result Asymptotically unbiased estimator for tensor rank.
A new tensor ring mixture model improves density estimation efficiency.
problem Efficient probability density estimation in statistical machine learning.
method Tensor ring decomposition with mixture model for adaptive weights.
result Enhanced expressive capability and flexibility in density estimation.
Scalable and robust TR decomposition for large-scale data with missing entries and outliers.
problem Handling large-scale tensor data with missing entries and outliers.
method Auto-weighted steepest descent method for missing entries and outliers identification, FGMC and RStS strategies.
result Outperforms existing TR decomposition methods in the presence of outliers and runs faster than robust tensor completion algorithms.
Introduces nondecreasing rank for matrices and tensors, developing methods and applications.
problem Finding low-rank approximations for matrices and tensors with monotonic constraints.
method Developed a variant of hierarchical alternating least squares algorithm for finding low ND rank approximations.
result Low ND rank factorizations can be found and interpreted for real-world datasets.
The Ricci tensor (Ric) is fundamental to Einstein's geometric theory of gravitation. The 3-dimensional Ric of a spacelike surface vanishes at the moment of time symmetry for vacuum spacetimes. The 4-dimensional Ric is the Einstein tensor for such spacetimes. More recently the Ric was used by Hamilton to define a non-li…
The aim of this note is to study the measure-valued Ricci tensor on smooth metric measure space with boundary, which is a generalization of Bakry-Emery's modified Ricci tensor on weighted Riemannian manifold. As an application, we offer a new approach to study curvature-dimension condition of smooth metric measure spac…
Model for material elasticity and plasticity using networks.
problem Understanding the elasticity and plasticity of materials.
method Developed a mathematical model based on networks, defining tension tensor for periodic graphs.
result The model explains elasticity and plasticity through local moves on graphs.
We first give a constructive answer to the attenuated tensor tomography problem on simple surfaces. We then use this result to propose two approaches to produce vector-valued integral transforms which are fully injective over tensor fields. The first approach is by construction of appropriate weights which vary along t…
A new RNN architecture reduces model size and improves performance.
problem Overparameterization and resource limitations in RNNs.
method Jointly encodes weight matrices using tensor-train factorization.
result Reduces model size by several orders of magnitude without sacrificing performance.
The popular Alternating Least Squares (ALS) algorithm for tensor decomposition is efficient and easy to implement, but often converges to poor local optima---particularly when the weights of the factors are non-uniform. We propose a modification of the ALS approach that is as efficient as standard ALS, but provably rec…
Minimizing the nuclear norm of a matrix has been shown to be very efficient in reconstructing a low-rank sampled matrix. Furthermore, minimizing the sum of nuclear norms of matricizations of a tensor has been shown to be very efficient in recovering a low-Tucker-rank sampled tensor. In this paper, we propose to recover…
We establish connections between the problem of learning a two-layer neural network and tensor decomposition. We consider a model with feature vectors x∈Rd, r hidden units with weights {wi}1≤i≤r and output y∈R, i.e., $y=\sum_{i=1}^r σ( \boldsymbol w_i…
Paper proposes a new method for exact recovery in robust tensor principal component analysis.
problem Exact recovery of low-rank and sparse components in tensors.
method Proposes a new method based on tensor-tensor product and t-SVD to solve a convex optimization problem.
result Exact recovery achieved in a deterministic fashion without randomness assumptions.
New method estimates tensors from noisy data with missing entries.
problem Tensor estimation from noisy observations with missing entries.
method Sign series representation for tensor completion, addressing low- and high-rank signals.
result Excess risk bounds, estimation error rates, and sample complexities established.
Study Gaussian-process limits of neural networks using tensor programs.
problem Understanding the behavior of neural networks as they approach infinite width.
method Quantitative analysis through tensor programs and Wasserstein distance.
result Explicit finite-width error bounds, showing convergence to Gaussian-process limits.
Gradient estimate for harmonic functions with boundary condition proved.
problem Proving gradient estimates for harmonic functions with boundary conditions.
method Using weighted f-harmonic functions and infinite dimensional Bakry-Emery Ricci tensor. result Gradient estimates for positive f-harmonic functions with Dirichlet boundary condition. Tensor regression networks achieve high compression rate of neural networks while having slight impact on performances. They do so by imposing low tensor rank structure on the weight matrices of fully connected layers. In recent years, tensor regression networks have been investigated from the perspective of their comp…
The paper develops concentration inequalities for structured random data, extending beyond independent terms.
problem Developing concentration inequalities for structured weighted sums of random data, including tensors and matrix-valued data.
method The paper develops Hoeffding and Bernstein bounds for structured weighted sums under exchangeability, extending beyond the classical framework of independent terms.
result The paper develops a sharper concentration bound for combinatorial sums of matrix arrays.
Study isotropic solutions in smooth metric measure spaces with vacuum Einstein equations.
problem Investigate isotropic solutions in smooth metric measure spaces under vacuum Einstein field equations.
method Define a weighted Einstein tensor and associated vacuum field equations. Analyze solutions for different spacetime types.
result Isotropic solutions have nilpotent Ricci operator and specific forms in 2- and 3-step nilpotent manifolds.
The study analyzes XRP transaction networks to understand market dynamics.
problem Understanding market dynamics of XRP through transaction data.
method Weekly weighted directed networks are embedded into a vector space using network embedding techniques. A correlation tensor is calculated and analyzed using singular value decomposition.
result The correlation tensor provides insights into the system's behavior and dependence on model parameters.
Inverts rank m symmetric tensor fields using line integrals.
problem Recovering symmetric tensor fields from line integrals.
method Computes normal operator and presents inversion formula.
result Recovering rank m tensor fields from data (Nm0f,…,Nmmf). Paper proves Koszul duality for weighted A-infinity algebras.
problem Koszul duality for weighted A-infinity algebras.
method Constructs new box tensor product for weighted A-infinity bimodules and verifies correspondence between maps and bimodules.
result Proves Koszul duality result between weighted A-infinity algebras.
TF-Coder simplifies tensor manipulation programming in TensorFlow.
problem Difficulty in programming with TensorFlow due to steep learning curve.
method Bottom-up weighted enumerative search with value-based pruning and type/value filtering.
result Solves 63 out of 70 real-world tasks within 5 minutes.
A novel Laplace-approximated Bayesian Tensor Network Kernel Machine (LA-TNKM) provides principled uncertainty estimates.
problem How to provide principled uncertainty estimates for tensor network kernel machines.
method Employing a linearized Laplace approximation for Bayesian inference.
result Consistently matches or surpasses Gaussian Processes and BNNs across diverse UCI regression benchmarks.
In this paper, we study stable weighted minimal hypersurfaces in manifolds with nonnegative Bakry-Emery Ricci curvature. We will give some geometric and topological applications. In particular, we give some partial classification of complete 3-manifolds with nonnegative Bakry-Emery Ricci curvature assuming that f is …
In this paper we study the problem of learning the weights of a deep convolutional neural network. We consider a network where convolutions are carried out over non-overlapping patches with a single kernel in each layer. We develop an algorithm for simultaneously learning all the kernels from the training data. Our app…
Paper proposes a transfer learning framework for tensor Gaussian graphical models.
problem Pooling heterogeneous tensor data for improved estimation and variable selection.
method Transfer learning framework that uses data-adaptive weights from auxiliary domains.
result Significant improvement in estimation errors and variable selection consistency.
We construct a series of conformally invariant differential operators acting on weighted trace-free symmetric 2-tensors by a method similar to Graham-Jenne-Mason-Sparling's. For compact conformal manifolds of dimension even and greater than or equal to four with vanishing ambient obstruction tensor, one of these operat…
Efficiently fine-tunes patient-independent seizure detection models with tensor kernel machine.
problem Improving seizure detection accuracy for wearable devices.
method Transfer learning with tensor kernel machine using canonical polyadic decomposition.
result Patient fine-tuned model achieves high performance with smaller model size.
Marginal Structural Models (MSM) are the most popular models for causal inference from time-series observational data. However, they have two main drawbacks: (a) they do not capture subject heterogeneity, and (b) they only consider fixed time intervals and do not scale gracefully with longer intervals. In this work, we…
We prove the existence and the uniqueness of a conformally equivariant symbol calculus and quantization on any conformally flat pseudo-Riemannian manifold $(M,\rg)$. In other words, we establish a canonical isomorphism between the spaces of polynomials on T∗M and of differential operators on tensor densities over $M…
Bilinear MLPs offer a new way to interpret deep learning models without complex nonlinearities.
problem Lack of mechanistic understanding in how MLPs compute.
method Introduced bilinear MLPs without element-wise nonlinearities, analyzed their weights using tensor and eigendecomposition.
result Bilinear MLPs provide interpretable weight structures and enable adversarial attacks and overfitting analysis.