Polynomial-time algorithms improve on isotonic matrix estimation with unknown permutations.
problem Estimating a bivariate isotonic matrix with unknown permutations from noisy observations.
method Design and analysis of polynomial-time algorithms.
result Minimax optimal, computationally efficient estimation achievable in certain settings.
Consider a noisy linear observation model with an unknown permutation, based on observing y = Π ∗ A x ∗ + w y = Π^* A x^* + w y = Π ∗ A x ∗ + w , where x ∗ ∈ R d x^* \in \mathbb{R}^d x ∗ ∈ R d is an unknown vector, Π ∗ Π^* Π ∗ is an unknown n × n n \times n n × n permutation matrix, and w ∈ R n w \in \mathbb{R}^n w ∈ R n is additive Gaussian noise. We analyze the problem of permutation recovery in a …
We tackle tensor denoising with unknown permutations, achieving optimal recovery with polynomial estimators.
problem Structured tensor denoising with unknown permutations in recommendation systems, neuroimaging, etc.
method Developed a constrained least-squares estimator in a block-wise polynomial family.
result Achieved the minimax error bound with polynomial estimators of degree up to ( m − 2 ) ( m + 1 ) / 2 (m-2)(m+1)/2 ( m − 2 ) ( m + 1 ) /2 . Estimates isotonic functions under unknown permutations, achieving optimal statistical and computational efficiency.
problem Estimating isotonic functions with unknown permutations in multiway comparison data.
method Mirsky partition estimator for minimax optimal and adaptive estimation.
result Achieves optimal worst-case statistical performance and computational efficiency.
This paper tackles permutation recovery in unlabeled sensing from multiple measurement vectors.
problem Permutation recovery in unlabeled sensing from multiple measurement vectors.
method The paper studies the case of multiple noisy measurement vectors (MMVs) resulting from a common permutation and proposes computational schemes for permutation recovery.
result A large stable rank of the signal significantly reduces the required signal-to-noise ratio (SNR) for permutation recovery, and the problem can be solved efficiently using ADMM.
We shrink confidence sets for equivalent discrete distributions using permutation equivalence.
problem Building high-probability confidence sets for equivalent discrete distributions.
method Exploiting permutation-equivalence to refine confidence sets.
result Confidence sets shrink at asymptotic rates of O ( 1 / ∑ k ∈ K n k ) O(1/\sqrt{\sum_{k\in \mathcal K} n_k}) O ( 1/ ∑ k ∈ K n k ) and O ( 1 / max k ∈ K n k ) O(1/\max_{k\in K} n_{k}) O ( 1/ max k ∈ K n k ) . We tackle permutation in linear regression with a new inference framework.
problem Statistical investigation of permutation in linear regression models.
method Localization step followed by conditional Monte Carlo test and coefficient inference.
result Valid statistical inference procedures for permutation and regression coefficients.
Novel algorithm estimates local permutations in unlabeled multi-view sensing.
problem Estimating local permutations in unlabeled multi-view sensing.
method Graph alignment and Gromov-Wasserstein alignment exploiting multiple views.
result The proposed algorithm is scalable and applicable to challenging SNR regimes.
Method estimates treatment effects in dyadic data with unknown confounders.
problem Estimating treatment effects in dyadic data with unobserved confounders.
method Neighborhood kernel smoothing method for graphon estimation.
result Derives rate of convergence for estimator and demonstrates test size control.
Faster rates achieved for estimating permutation-based matrices.
problem Estimating a bivariate isotonic matrix with unknown permutations.
method Polynomial-time algorithm for noisy observations of a subset of entries.
result Efficient estimation at rate O ~ ( n − 3 / 4 ) \widetilde{\mathcal O}(n^{-3/4}) O ( n − 3/4 ) . A new method resolves permutation issues in shuffled linear regression for large-scale applications.
problem Estimating latent features through linear transformation with unknown permutations.
method Spectral matching method to align spectral components of measurement and feature covariances.
result Achieves accurate estimates in shuffled LS and LASSO settings with sufficient samples.
Study aggregation of statistical evidence under unknown dependence using group-invariance.
problem Aggregating statistical evidence under unknown and complex dependence structures.
method Develops a framework using group-invariance and permutation-based constructions to aggregate evidence across transformed datasets.
result Shows uniform improvement in critical values for single-batch aggregation over deterministic calibrations, adapting to unknown dependence structures.
The paper explores Guichard nets and their dual properties.
problem Understanding Guichard nets and their dual systems.
method Introduced Combescure transformations and Bäcklund-type transformations.
result Permutability theorem for dual systems of Guichard nets.
A new method handles mismatched data in multivariate regression.
problem Handling mismatched data in multivariate linear regression.
method Two-stage approach: first stage estimates parameters, second stage estimates permutation.
result Permutation recovery conditions become less stringent with increasing number of responses.
Study recovers spike order in noisy tensor estimation without SNR assumptions.
problem Estimating multiple signal vectors from noisy tensor observations.
method Gradient flow optimization of a nonconvex function.
result Determines sample complexity for efficient permutation recovery.
New method uses exponential family priors to handle shuffled data problems.
problem Handling mismatch errors in record linkage of two data files.
method Flexible exponential family prior on the permutation group for regularization.
result The proposed method outperforms competing methods in synthetic and real data.
Active seriation recovers item order from noisy pairwise similarity measurements.
problem Recovering an unknown item ordering from noisy pairwise similarity measurements.
method Proposes an active seriation algorithm that provably recovers the latent ordering with high probability.
result Establishes optimal performance guarantees for successful recovery under a uniform separation condition.
Matching correlated VAR time series databases by recovering matching permutations.
problem Matching perturbed and permuted correlated VAR time series.
method Probabilistic framework modeling, maximum likelihood estimator (MLE), linear assignment, convex relaxations.
result Recovery guarantees for perfect or partial recovery of matching permutations, thresholds for σ σ σ . New SSL methods reduce sample complexity for nonparametric multiclass classification.
problem Sample complexity in nonparametric semi-supervised learning.
method Assumptions on mixture models and permutation learning.
result Near-optimal classifier with few labeled samples possible.
The paper explores how low-degree polynomials can detect shuffled linear regression models.
problem Detecting multivariate shuffled linear regression models from independent Gaussian random matrices.
method Investigates the effectiveness of low-degree polynomial algorithms for distinguishing the model from independent Gaussian random matrices.
result Establishes a phase transition phenomenon in the performance of low-degree polynomial algorithms for distinguishing the model.
New algorithm recovers matrices with unknown correspondences.
problem Recovering matrices from observations with unknown correspondences.
method Solves a nuclear norm minimization problem via proximal gradient with a Max-Oracle.
result Achieves state-of-the-art performance and high accuracy in recovering ground-truth correspondences.
This paper addresses the general problem of modelling and learning rank data with ties. We propose a probabilistic generative model, that models the process as permutations over partitions. This results in super-exponential combinatorial state space with unknown numbers of partitions and unknown ordering among them. We…
Many machine learning problems can be characterized by mutual contamination models. In these problems, one observes several random samples from different convex combinations of a set of unknown base distributions. It is of interest to decontaminate mutual contamination models, i.e., to recover the base distributions ei…
Paper tackles sparse recovery with shuffled labels, establishing statistical and computational limits.
problem Sparse recovery with shuffled labels, focusing on permutation matrix and sparse signal reconstruction.
method Statistical and computational analysis, including minimax lower bounds and exhaustive-search based estimator.
result Established statistical and computational limits for correct recovery of permutation matrix and support set.
Paper develops new conformal prediction methods for sum or average of unknown labels.
problem Uncertainty quantification in joint distributions of random variables.
method Introduces novel conformal prediction methods for sum or average of unknown labels.
result Validates the proposed method for sum or average of unknown labels under permutation invariant assumptions.
Paper studies vertex correspondence recovery in correlated graphs with node features.
problem Recovering hidden vertex correspondence between two correlated graphs with observed edge weights and node features.
method Introduced featured correlated Gaussian Wigner model and proposed QPAlign algorithm for quadratic programming relaxation.
result Characterized optimal information-theoretic thresholds for exact and partial recovery of latent mapping.
Algorithm recovers permutations of high-dimensional Gaussian vectors with constant correlation.
problem Recovering permutations of high-dimensional Gaussian vectors with constant correlation.
method Computing and comparing weighted counts of specially chosen wide trees.
result Polynomial-time algorithm for exact recovery at constant correlation.
Stochastic EM for shuffled linear regression improves parameter accuracy and robustness.
problem Inference in linear regression with unknown feature-label order.
method Stochastic EM approach treating permutation as latent variable.
result Stochastic EM outperforms hard EM on partially shuffled datasets.
Paper tackles non-stationary kernelized bandits with near-optimal algorithm.
problem Minimizing regret in a time-varying reward function.
method Near-optimal algorithm with a novel restarting phased elimination with random permutation (R-PERP).
result Regret upper bound matches the lower bound, making the algorithm near-optimal.
Model learns set representations through optimized permutations.
problem Challenges in learning set representations due to permutation-invariance.
method Proposes a Permutation-Optimisation module to learn set permutations.
result Achieves state-of-the-art results on various set learning tasks.
The paper improves Fisher-Pitman tests for Poisson mixtures, detecting autism-related genes.
problem Detecting differentially expressed genes between autism and control subjects.
method Nonparametric Poisson mixtures and Fisher-Pitman permutation tests.
result The tests reveal genes missed by common methods, demonstrating rate optimality.
C-OPH improves One Permutation Hashing by using a shorter circulant permutation.
problem Improving the accuracy of One Permutation Hashing (OPH) for Jaccard similarity estimation.
method Develops a new densification method using a shorter circulant permutation.
result Achieves the smallest estimation variance for Jaccard similarity.
Cheap permutation tests speed up distribution testing without sacrificing accuracy.
problem Efficiently testing distribution differences and independence.
method Group datapoints into bins and permute only these bins, using stored sufficient statistics.
result Cheap permutation tests maintain the accuracy and optimality of standard tests but are significantly faster.
Random permutations can offer faster convergence than with-replacement sampling for some functions.
problem Understanding when and how random permutations outperform with-replacement sampling in SGD convergence.
method Analyzing convergence rates for different function classes (1D strongly convex, general strongly convex, quadratic strongly convex).
result The optimal convergence gap between random and permutation-based SGD varies from exponential to nonexistent, depending on the function class.
We solve continuous-time latent SDE identifiability using diffusion shifts.
problem Identifiability of latent SDEs in continuous-time time series.
method Environment-induced shifts in diffusion covariance for additive-noise latent SDEs.
result Two diagonal diffusion regimes with distinct variance ratios identify latent coordinates up to permutation and scaling.
Permutations linked to knots and links, with unknots counted by Schröder numbers.
problem Understanding permutations as knots and links.
method Using grid diagrams and Bennequin's inequality.
result Permutations corresponding to unknots and links are counted by Schröder numbers.
Regularizes RNNs to be invariant to input order.
problem Making RNNs invariant to input order.
method Stochastic regularization to enforce permutation invariance.
result Improves model performance on permutation invariant tasks.
The paper proposes an efficient estimator for linear regression with shuffled labels.
problem Linear regression with shuffled labels, focusing on sensing results and corresponding information.
method A one-step estimator to reconstruct ( Π , B ) (\mathbf Π, \mathbf B) ( Π , B ) from Y \mathbf Y Y and X \mathbf X X . result Sufficient conditions for correct permutation recovery under different regimes of signal-to-noise ratio (snr).
Permutability of surface transforms yields discrete analogs.
problem Discretization of smooth surfaces with specific properties.
method Permutability of transforms of smooth surfaces.
result Discrete surfaces with discrete analogs of original properties.
Janossy pooling averages permutation-sensitive functions over all sequences to create invariant functions.
problem Creating deep, invariant functions for variable-size inputs.
method Janossy pooling: average permutation-sensitive functions over all reorderings.
result Improved performance over state-of-the-art methods.
AutoShuffleNet learns permutation matrices in CNNs for improved accuracy.
problem Manual design of channel shuffling in ShuffleNet.
method Learning permutation matrices via an exact Lipschitz continuous penalty in deep learning.
result Improved classification accuracies on CIFAR-10 and ImageNet datasets.
Dynamic systems linked to infinite permutation matrices.
problem Dynamic equivalence of control systems.
method Association of infinite permutation matrices.
result Relationship between dynamic equivalences and permutation matrices.
A new permutation method improves two-sample testing power.
problem Two-sample testing with improved power and validity.
method Structured block-restricted cross-swaps.
result Block-restricted permutations achieve higher power than full permutations.
Recently, the method of b-bit minwise hashing has been applied to large-scale linear learning and sublinear time near-neighbor search. The major drawback of minwise hashing is the expensive preprocessing cost, as the method requires applying (e.g.,) k=200 to 500 permutations on the data. The testing time can also be ex…
New link topology connects permutation discrepancies to Diaconis-Graham inequalities.
problem Characterize permutations for which Diaconis-Graham inequalities hold with equality.
method Relate permutation discrepancies to the Euler characteristic of their associated links.
result Permutation discrepancies are directly related to the Euler characteristic of their associated links.
The paper uses permutation representations to visualize group extensions and subgroups.
problem Visualizing and understanding group extensions and subgroups.
method Developing metaphoric rope-thread diagrams to represent semi-direct products and their constituents.
result Injective homomorphisms into semi-direct products are established.
Given a knot complement X and its p-fold cyclic cover X_p, we identify twisted polynomials associated to 1-dimensional linear representations of the fundamental group of X_p with twisted polynomials associated to related p-dimensional linear representations of the fundamental group of X. This provides a simpler and fas…
New method tackles linear regression without correspondences using algebraic geometry.
problem Performing linear regression on datasets with unknown correspondences.
method Algebraic-geometric approach using symmetric polynomials.
result Polynomial system of equations with at most n! roots, leading to a working solution.