arXiv research

Improved machine learning with reduced tensor rank constraints and dropout.

The problem of low-rank approximation with convex constraints, which appears in data analysis, system identification, model order reduction, low-order controller design and low-complexity modelling is considered. Given a matrix, the objective is to find a low-rank approximation that meets rank and convex constraints, w…

New algorithm tackles low-rank constraints in optimal transport problems.

Most learning methods with rank or sparsity constraints use convex relaxations, which lead to optimization with the nuclear norm or the $\ell_1$-norm. However, several important learning applications cannot benefit from this approach as they feature these convex norms as constraints in addition to the non-convex rank a…

We consider the problem of noisy 1-bit matrix completion under an exact rank constraint on the true underlying matrix $M^*$. Instead of observing a subset of the noisy continuous-valued entries of a matrix $M^*$, we observe a subset of noisy 1-bit (or binary) measurements generated according to a probabilistic model. W…

This paper proposes a mechanism to produce equivalent Lipschitz surrogates for zero-norm and rank optimization problems by means of the global exact penalty for their equivalent mathematical programs with an equilibrium constraint (MPECs). Specifically, we reformulate these combinatorial problems as equivalent MPECs by…

Minimizing the rank of a matrix subject to constraints is a challenging problem that arises in many applications in control theory, machine learning, and discrete geometry. This class of optimization problems, known as rank minimization, is NP-HARD, and for most practical problems there are no efficient algorithms that…

Paper improves MVSC using tensor low-rank modeling.

Extends RRR to capture nonlinear interactions in multi-response regression.

Algorithm samples fair rankings to ensure individual fairness while maintaining group fairness.

New algorithm improves deep learning models' robustness without sacrificing accuracy.

Paper develops compact formulations for optimization problems with rank-one convex functions and indicator variables.

We analyze the local convergence of proximal splitting algorithms to solve optimization problems that are convex besides a rank constraint. For this, we show conditions under which the proximal operator of a function involving the rank constraint is locally identical to the proximal operator of its convex envelope, hen…

Introduces nondecreasing rank for matrices and tensors, developing methods and applications.

Paper proposes a new algorithm for graph learning with covariance constraints.

Recovery of low-rank matrices has recently seen significant activity in many areas of science and engineering, motivated by recent theoretical results for exact reconstruction guarantees and interesting practical applications. A number of methods have been developed for this recovery problem. However, a principled meth…

Optimization problems with rank constraints appear in many diverse fields such as control, machine learning and image analysis. Since the rank constraint is non-convex, these problems are often approximately solved via convex relaxations. Nuclear norm regularization is the prevailing convexifying technique for dealing …

Many applications require recovering a matrix of minimal rank within an affine constraint set, with matrix completion a notable special case. Because the problem is NP-hard in general, it is common to replace the matrix rank with the nuclear norm, which acts as a convenient convex surrogate. While elegant theoretical c…

Proposes a new method to optimize treatment allocation with budget constraints.

Classifies links with small Khovanov homology ranks.

Study consumption-investment problem in markets with rank-based returns.

We construct a sequence of primitive-stable representations of free groups into PSL(2,C) whose ranks go to infinity, but whose images are discrete with quotient manifolds that converge geometrically to a knot complement. In particular this implies that the rank and geometry of the image of a primitive-stable representa…

New approach to convex hulls for low-rank problems.

Proposes a new model for image restoration combining deep learning and total variation.

The paper tackles fairness in scoring functions for binary classification.

Proposes a new method for rank-consistent ordinal regression without weight-sharing constraints.

Paper introduces GAMs for interpretable learning-to-rank models.

New framework for fair ranking with noisy protected attributes.

New metrics improve landing algorithms for orthogonality constraints.

Improved unsupervised probing for ranking tasks using Contrast-Consistent Ranking.

We explore the algebraic structure of the solution space of convex optimization problem Constrained Minimum Trace Factor Analysis (CMTFA), when the population covariance matrix $Σ_x$ has an additional latent graphical constraint, namely, a latent star topology. In particular, we have shown that CMTFA can have either a …

Low-rank inducing unitarily invariant norms have been introduced to convexify problems with low-rank/sparsity constraint. They are the convex envelope of a unitary invariant norm and the indicator function of an upper bounding rank constraint. The most well-known member of this family is the so-called nuclear norm. To …

Develops TOFU for tensor bandits with low-rank structure.

Multi-view spectral clustering, which aims at yielding an agreement or consensus data objects grouping across multi-views with their graph laplacian matrices, is a fundamental clustering problem. Among the existing methods, Low-Rank Representation (LRR) based method is quite superior in terms of its effectiveness, intu…

New ranking system balances fairness and user utility.

This paper proposes robust matrix variate regression models with rank constraints and vector regularization.

A new algorithm solves constrained optimization problems with stochastic gradients.

This work investigates implicit bias in multiclass separable data using a novel geometry-aware optimizer.

DNN-based cross-modal retrieval has become a research hotspot, by which users can search results across various modalities like image and text. However, existing methods mainly focus on the pairwise correlation and reconstruction error of labeled data. They ignore the semantically similar and dissimilar constraints bet…

Motivated by an application in computational biology, we consider low-rank matrix factorization with $\{0,1\}$-constraints on one of the factors and optionally convex constraints on the second one. In addition to the non-convexity shared with other matrix factorization schemes, our problem is further complicated by a c…

PLUMAGE improves large model training efficiency and stability.

We study the projected gradient descent method on low-rank matrix problems with a strongly convex objective. We use the Burer-Monteiro factorization approach to implicitly enforce low-rankness; such factorization introduces non-convexity in the objective. We focus on constraint sets that include both positive semi-defi…

New framework solves low-rank optimization problems to certifiable optimality.

While implicit feedback (e.g., clicks, dwell times, etc.) is an abundant and attractive source of data for learning to rank, it can produce unfair ranking policies for both exogenous and endogenous reasons. Exogenous reasons typically manifest themselves as biases in the training data, which then get reflected in the l…

Analyzes learning dynamics of RNNs under locality constraints.

Study algebraic invariants from lightning self-attention models.

We consider whether algorithmic choices in over-parameterized linear matrix factorization introduce implicit regularization. We focus on noiseless matrix sensing over rank-$r$ positive semi-definite (PSD) matrices in $\mathbb{R}^{n \times n}$, with a sensing mechanism that satisfies restricted isometry properties (RIP)…

Proposes a low-rank bilinear pooling model for link prediction in knowledge graphs.