New method learns compressed transforms with flexible displacement operators.
problem Efficiently representing and learning shift-invariant patterns in neural networks.
method Explicitly learns over displacement operators and low-rank components in LDR matrices.
result Reduces sample complexity and improves model accuracy with fewer parameters.
Recently low displacement rank (LDR) matrices, or so-called structured matrices, have been proposed to compress large-scale neural networks. Empirical results have shown that neural networks with weight matrices of LDR matrices, referred as LDR neural networks, can achieve significant reduction in space and computation…
PIE-PINN estimates elastic properties from noisy, low-res displacement data.
problem Estimating heterogeneous elastic properties from low-resolution, noisy data.
method Probabilistic Physics-Informed Neural Network (PIE-PINN) framework combining B-spline and hierarchical scale model.
result Robust estimation of Young's modulus and Poisson's ratio from noisy, low-resolution displacement data.
We propose a scheme for recycling Gaussian random vectors into structured matrices to approximate various kernel functions in sublinear time via random embeddings. Our framework includes the Fastfood construction as a special case, but also extends to Circulant, Toeplitz and Hankel matrices, and the broader family of s…
New framework uses symmetry-based matrices for efficient, flexible NNs.
problem Designing neural networks with relaxed equivariance.
method Symmetry-based structured matrices, Group Matrices (GMs).
result GMs enable competitive performance with fewer parameters.
We consider the task of building compact deep learning pipelines suitable for deployment on storage and power constrained mobile devices. We propose a unified framework to learn a broad family of structured parameter matrices that are characterized by the notion of low displacement rank. Our structured transforms admit…
New algorithm detects anomalies by forcing samples to displace mass in low-density regions.
problem Detecting anomalies in datasets.
method Mass Repulsing Optimal Transport (MROT) approach.
result Our algorithm improves anomaly detection over existing methods.
New learning algorithm improves neural network generalization.
problem High generalization performance despite over-parameterization.
method Viewed neural networks as dynamical systems, analyzing transport map efficiency.
result Found a low kinetic energy bias in network displacements, linked to generalization.
We solve a version of the optimal trade execution problem when the mid asset price follows a displaced diffusion. Optimal strategies in the adapted class under various risk criteria, namely value-at-risk, expected shortfall and a new criterion called "squared asset expectation" (SAE), related to a version of the cost v…
In this paper we prove the Conley conjecture and the almost existence theorem in a neighborhood of a closed nowhere coisotropic submanifold under certain natural assumptions on the ambient symplectic manifold. Essential to the proofs is a displacement principle for such submanifolds. Namely, we show that a topologicall…
New displacement technique vanishes bounded cohomology in all degrees.
problem Vanishing of bounded cohomology in all positive degrees and dual separable coefficients.
method Introducing the property of commuting cyclic conjugates as a new displacement technique.
result Vanishes bounded cohomology in all positive degrees and all dual separable coefficients.
A new method uses Gaussian Processes for feature-based nonrigid image registration.
problem Estimating dense displacement fields for nonrigid image registration.
method Using Gaussian Processes to estimate both dense displacement field and uncertainty map.
result GP-based interpolation performs similarly to state-of-the-art B-spline interpolation.
Nonnegative sectional curvature linked to matrix displacement convexity.
problem Nonnegative sectional curvature in Riemannian manifolds.
method Matrix displacement convexity as a criterion for nonnegative sectional curvature.
result Entropy functional matrix displacement convexity implies nonnegative sectional curvature.
We define the symplectic displacement energy of a non-empty subset of a compact symplectic manifold as the infimum of the Hofer-like norm [5] of symplectic diffeomorphisms that displace the set. We show that this energy (like the usual displacement energy defined using Hamiltonian diffeomorphisms) is a strictly positiv…
The Homogeneity Conjecture explores if constant displacement isometries imply homogeneous spaces.
problem Whether constant displacement isometries on a manifold imply its homogeneity.
method Survey and verification of cases, including new results.
result New results and open problems suggested.
This paper optimizes functions of probability measures using particle gradient descent for displacement convex functions.
problem Optimizing functions of probability measures with displacement convex properties.
method Particle gradient descent applied to displacement convex functions with theoretical guarantees.
result Finite number of particles and computations are sufficient to find optimal solutions for displacement convex functions.
Minimal displacement set in weakly systolic complexes is systolic and embeds isometrically.
problem Structure of minimal displacement set in weakly systolic complexes.
method Investigation of minimal displacement set properties and embeddings.
result Minimal displacement set is systolic and embeds isometrically into the complex.
The paper describes correlations of spectra for higher rank Anosov representations.
problem Understanding correlations of spectra for Anosov representations of higher rank groups.
method Relates correlation problem to counting projections in truncated hypertubes.
result Extends previous work on rank one representations to higher rank.
Deep learning speeds up pressure prediction in carbon storage reservoirs.
problem Accurately forecasting reservoir pressure in geologic carbon storage projects with sparse well data.
method Combining InSAR surface displacement data with deep learning and data assimilation techniques.
result Workflow can predict reservoir pressure with high efficiency and uncertainty quantification.
We discuss in this article a property of action of groups by isometries called "well displacing". An action is said to be well displacing, if the displacement function is equivalent to the the displacement function for the action on the Cayley graph. We relate this property with the fact that orbit maps are quasi-isome…
Study correlations of spectral lengths and displacements in higher rank groups.
problem Analyzing correlations of spectral lengths and displacements in higher rank groups.
method Study Jordan and Cartan projections in tubes of Anosov subgroups of semisimple real algebraic groups.
result Prove existence of δ_ρ(\mathsf{v}) such that correlations of spectral lengths and displacements follow specific exponential growth patterns.
This paper explores the possibility that asset prices, especially those traded in large volume on public exchanges, might comply with specific physical laws of motion and probability. The paper first examines the basic dynamics of asset price displacement and finds one can model this dynamic as a harmonic oscillator at…
Paper proposes a method for estimating complex low-rank matrices from phase-only measurements.
problem Estimating complex low-rank matrices from magnitude-only measurements.
method A hierarchical prior model with a Gaussian-Wishart distribution is used to promote low-rankness. A variational EM algorithm is developed to solve the problem.
result The proposed method is less sensitive to initialization and performs well with random initialization.
Alexandrov spaces with non-negative curvature are characterized by the matrix displacement convexity of an entropy tensor.
problem Characterizing non-negative curvature in Alexandrov spaces
method Constructing a parallel trivialization of the entropy tensor
result The entropy tensor is matrix displacement convex on Alexandrov spaces
Rank-one measurements limit feasible sets for low-rank PSD matrices.
problem Feasibility of PSD matrices under rank-one measurements.
method Characterization of feasible sets for PSD matrices given rank-one projections.
result Radius of feasible sets determines singleton solution sets for low-rank matrices.
In this article we study the Hamiltonian non-displaceability of Gauss images of isoparametric hypersurfaces in the spheres as Lagrangian submanifolds embedded in complex hyperquadrics.
FedLoRU improves FL efficiency by using low-rank updates.
problem Communication inefficiency and performance reduction in Federated Learning.
method Proposes FedLoRU, a low-rank update framework for FL, which reduces communication costs while maintaining performance.
result FedLoRU achieves convergence rates similar to FedAvg and is robust to heterogeneous and large numbers of clients.
In this paper we use Floer theory to study topological restrictions on Lagrangian embeddings in closed symplectic manifolds. One of the phenomena arising from our results is ``homological rigidity'' of Lagrangian submanifolds. Namely, in certain symplectic manifolds, conditions on low dimensional topological invariants…
Low-rank modeling generally refers to a class of methods that solve problems by representing variables of interest as low-rank matrices. It has achieved great success in various fields including computer vision, data mining, signal processing and bioinformatics. Recently, much progress has been made in theories, algori…
New method solves nonsmooth low-rank matrix optimization problems efficiently.
problem Nonsmooth and low-rank matrix optimization problems in statistics and machine learning.
method Low-rank Extragradient Method with warm-start initialization.
result The extragradient method converges to an optimal solution with rate O(1/t) and requires only two low-rank SVDs per iteration. New curvature measure for optimal transport with specific cost function.
problem Optimal transport with specific cost function.
method Proposed generalized curvature measure.
result Non-negativity of the generalized curvature implies displacement convexity.
SGD with mini-batches can solve convex low-rank matrix problems efficiently.
problem Solving large-scale convex low-rank matrix problems efficiently.
method Stochastic Gradient Descent with mini-batches and low-rank projections.
result SGD with mini-batches produces low-rank iterates with high probability.
New spectral methods improve matrix estimation in RL with low-rank structure.
problem Estimating matrices with low-rank structure in reinforcement learning.
method Spectral-based matrix estimation approaches.
result Spectral methods efficiently recover singular subspaces and minimize entry-wise error.
Proposes tensor Q-rank for better tensor rank recovery in complex data.
problem Improving tensor rank recovery for complex data with low sampling rate.
method Introduces tensor Q-rank and two selection methods for Q, proposing VMTQN and MOTQN models. result Demonstrates superior performance in tensor completion problems compared to TNN-based methods.
Improved rank aggregation via spectral method reduces sample complexity.
problem Ranking items from pairwise comparisons with corrupted data.
method Spectral ranking algorithms based on unnormalized and normalized data matrices.
result Sharper ℓ∞-norm perturbation bound and error bound on maximum displacement for each item. The paper proposes a model to learn motion perception in V1 using vector and matrix representations.
problem Motion perception in primary visual cortex (V1).
method Coupling vector representations of local contents and matrix representations of local pixel displacements.
result The model can learn Gabor-like filter pairs and infer local motions.
Training models to prefer certain responses can unintentionally shift probability to harmful ones.
problem Likelihood displacement in DPO models, leading to unintended unalignment.
method Characterized and mitigated likelihood displacement using CHES score.
result Training models to prefer certain responses can unintentionally shift probability mass to harmful responses.
The paper proposes using low rank assumption to improve causal structure learning in DAGs.
problem Challenges in learning causal structures in high-dimensional, non-sparse DAGs.
method Exploits low rank assumption of DAG adjacency matrix to adapt causal structure learning methods.
result Maximum rank is highly related to hubs, suggesting low rank for scale-free networks.
The paper analyzes how low-rank layers in neural networks improve generalization.
problem Understanding how low-rank layers affect generalization in neural networks.
method Applying Maurer's chain rule for Gaussian complexity to analyze rank and spectral norm constraints.
result Deep networks with low-rank layers achieve better generalization than those with full-rank layers.
Paper proposes a new technique to compress CNNs while maintaining accuracy.
problem CNNs struggle with traditional low-rank approximation methods, leading to degraded accuracy.
method Introduces a training technique that finds a flat minimum in low-rank approximation without a decomposed structure.
result CNN models can be compressed with higher accuracy and lower computation than conventional methods.
We prove that the displacement energy of a stable coisotropic submanifold is bounded away from zero if the ambient symplectic manifold is closed, rational and satisfies a mild topological condition.
Sparse elasticity reconstruction from local displacements reduces error.
problem Reconstructing elasticity from limited data.
method Sparse elasticity reconstruction theory, local clustering, alternating optimization.
result Higher spatial resolution elasticity distribution estimation.
Novel method for efficient low-rank matrix estimation and bandit algorithms.
problem Low-rank matrix estimation and bandit problems.
method LowPopArt method for low-rank matrix estimation and novel experimental design criterion.
result Improved recovery guarantees and regret bounds for low-rank bandit algorithms.
Algorithm recovers multiple low-rank matrices from unlabeled data.
problem Learning mixtures of low-rank models from unlabelled data.
method Three-stage meta-algorithm that copes with non-convexity and noise.
result Near-optimal sample and computational complexities under Gaussian designs.
This work introduces methods to compute optimal Monge maps and learn elastic costs for efficient data mapping.
problem Efficiently mapping one probability distribution to another using elastic costs.
method Proposes numerical methods to compute optimal Monge maps and a learning loss for parameterized regularizers.
result Proves the optimality of computed Monge maps and learns the parameters of elastic costs.
Paper improves MVSC using tensor low-rank modeling.
problem Improving multi-view spectral clustering.
method Structured tensor low-rank norm for MVSC optimization.
result Proposed method outperforms state-of-the-art methods.
Derives smooth homogeneous structures for low-rank tensors.
problem Understanding the geometry of low-rank tensors.
method Analyzes sets of fixed CP, multilinear, and TT rank tensors to derive smooth homogeneous manifolds.
result Derives Riemannian metrics with complete geodesics.
The null energy condition is characterized via convexity of entropy in Lorentzian manifolds.
problem Characterizing the null energy condition in Lorentzian manifolds.
method Characterization via convexity of the relative entropy along displacement interpolations on null hypersurfaces.
result The null energy condition is characterized in terms of convexity of the relative entropy.