Improved clustering algorithm for large datasets.
problem Finding alternative partitions in large datasets.
method Iterative Spectral Method (ISM) for alternative clustering.
result Significantly improved scalability and computation time.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,181 papers · 148 categories
Trend · papers per month
48 results for “alternating iterative algorithm”
Derivative-free Alternating Projection Algorithms for General Nonconvex-Concave Minimax Problemsmath.OC
New algorithms solve complex minimax problems without needing derivatives.
problem Solving nonconvex-concave minimax problems efficiently.
method Zeroth-order alternating and proximal gradient algorithms.
result Iteration complexity and function value estimation bounds established.
New algorithm solves minimax games with linear constraints.
problem Nonconvex minimax games with coupled linear constraints.
method Primal-dual alternating proximal gradient (PDAPG) algorithm.
result Achieves ε-stationary solution within O(ε^(-2)) iterations for strongly concave settings.
Efficient algorithm for orthogonal canonical correlation analysis (OCCA).
problem Solving the OCCA problem with orthogonality constraints.
method Sub-maximization problem with self-consistent-field (SCF) iteration for trace-fractional structure and orthogonal linear projections.
result Proposed algorithm converges globally to a KKT point and is more efficient.
Paper proposes algorithms for solving nonconvex-nonconcave problems with complexity guarantees.
problem Nonconvex-nonconcave minimax problems with PL condition.
method Zeroth-order AGDA and VRAGDA algorithms.
result Iteration complexities for obtaining ε-stationary points.
New convergence analysis for Lasso l1 reweighting improves practical performance.
problem Theoretical convergence of Lasso l1 reweighting methods is limited.
method Biconvex analysis for an alternated convex search.
result Numerical convergence of the algorithm sequence for practical purposes.
Unified approach to dynamic programming improves reinforcement learning performance.
problem Improving approximate dynamic programming for broader reinforcement learning applications.
method Proposes Generalized Value Iteration (GVI) and its approximated version, Approximate GVI (AGVI), unifying value iteration, advantage learning, and dynamic policy programming.
result Demonstrates performance guarantees for AGVI, including those for existing algorithms.
We propose two new alternating direction methods to solve "fully" nonsmooth constrained convex problems. Our algorithms have the best known worst-case iteration-complexity guarantee under mild assumptions for both the objective residual and feasibility gap. Through theoretical analysis, we show how to update all the al…
Alternating Minimization is a widely used and empirically successful heuristic for matrix completion and related low-rank optimization problems. Theoretical guarantees for Alternating Minimization have been hard to come by and are still poorly understood. This is in part because the heuristic is iterative and non-conve…
LocalKMeans parallelizes Lloyd's algorithm for distributed data.
problem Efficiently clustering data across multiple machines.
method Parallel local iterations with synchronization every L steps.
result Higher required signal-to-noise ratio due to local steps.
A meta-learning approach improves the performance of alternating minimization for non-convex optimization problems.
problem Optimizing non-convex problems with multiple variables using alternating minimization.
method Meta-learning based alternating minimization (MLAM) to replace handcrafted updating rules.
result The proposed MLAM method outperforms traditional AM-based methods in various non-convex optimization problems.
Gaussian graphical models are of great interest in statistical learning. Because the conditional independencies between different nodes correspond to zero entries in the inverse covariance matrix of the Gaussian distribution, one can learn the structure of the graph by estimating a sparse inverse covariance matrix from…
Dual Policy Iteration combines fast and slow policies for better reinforcement learning performance.
problem Improving reinforcement learning algorithms for practical applications.
method Alternates between a fast, reactive policy and a slow, non-reactive policy, optimizing both under each other's supervision.
result Demonstrates improved performance on various continuous control Markov Decision Processes.
The paper shows exchanging estimates over networks is effective for learning sparse signals.
problem Learning sparse signals over networks with limited communication.
method Iterative algorithm exchanging intermediate estimates over a network, with theoretical and simulation analysis.
result The iterative algorithm provides competitive performance in learning sparse signals.
We consider factoring low-rank tensors in the presence of outlying slabs. This problem is important in practice, because data collected in many real-world applications, such as speech, fluorescence, and some social network data, fit this paradigm. Prior work tackles this problem by iteratively selecting a fixed number …
Iterated Amplification uses subproblem solutions to build training signals for complex tasks.
problem Learning complex tasks when humans can't directly evaluate performance.
method Progressively builds training signal by combining solutions to easier subproblems.
result Efficiently learns complex behaviors in algorithmic environments.
The paper analyzes convergence properties of NGA and PAMe for -norm PCA.
problem Finite-step convergence of -norm PCA algorithms.
method Conditional subgradient and alternating maximization interpretations of NGA, and PAMe with extrapolation.
result Iterative points of modified NGA and PAMe remain constant after finitely many steps under certain conditions.
Support vector machines (SVMs) are an important tool in modern data analysis. Traditionally, support vector machines have been fitted via quadratic programming, either using purpose-built or off-the-shelf algorithms. We present an alternative approach to SVM fitting via the majorization--minimization (MM) paradigm. Alg…
New algorithms improve convergence of minimax optimization.
problem Minimax optimization convergence issues in nonconvex problems.
method Established new convergence results for two single-loop algorithms.
result Improved convergence rates for minimax optimization.
Study dynamics of alternating minimization for bilinear regression under large system limits.
problem Understanding the time evolution of alternating minimization for bilinear regression.
method Replica method applied to a multi-temperature glassy system.
result Dynamics of alternating minimization can be described by a two-dimensional discrete stochastic process.
This paper proposes an alternating back-propagation algorithm for learning the generator network model. The model is a non-linear generalization of factor analysis. In this model, the mapping from the continuous latent factors to the observed signal is parametrized by a convolutional neural network. The alternating bac…
New approach uses hinge loss for iterative regularization in classification.
problem Improving classification accuracy through regularization.
method Develops an iterative regularization approach based on hinge loss.
result Proves convergence and rates of convergence for classification.
A faster algorithm for ranking from pairwise comparisons.
problem Efficiently ranking individuals or objects from pairwise comparisons.
method An alternative and simpler iterative algorithm for ranking that converges faster.
result The new algorithm is over 100 times faster in some cases.
New algorithm solves nonconvex problems efficiently.
problem Nonconvex and nonsmooth problems in signal processing and machine learning.
method Reweighted Alternating Direction Method of Multipliers with linearization.
result The algorithm globally converges to a critical point.
Improved ADMM for convex distributed learning with differential privacy.
problem Privacy concerns in distributed learning with sensitive data.
method Approximate multi-step ADMM with calibrated noise.
result Higher utility and error bounds asymptotic to state-of-the-art.
AM converges super-linearly for solving mixed linear regression problems.
problem Learning linear regressors from unlabeled observations in multiple linear regression models.
method Alternating Minimization (AM) algorithm, which alternates between label estimation and regression solving.
result AM converges super-linearly in certain parameter regimes, requiring only O(log log(1/ε)) iterations to achieve an error of ε.
ScaledGD improves gradient descent for ill-conditioned low-rank matrix estimation.
problem Efficiently solving ill-conditioned low-rank matrix estimation problems.
method Scaled Gradient Descent (ScaledGD) with adaptive pre-conditioners.
result Linear convergence rate independent of condition number, low per-iteration cost.
Two algorithms solve nonconvex minimax problems with linear constraints, achieving complexity guarantees.
problem Nonconvex minimax problems with coupled linear constraints.
method Zeroth-order primal-dual alternating projected gradient (ZO-PDAPG) and zeroth-order regularized momentum primal-dual projected gradient (ZO-RMPDPG) algorithms.
result Iteration complexity guarantees for solving nonconvex-(strongly) concave minimax problems with coupled linear constraints.
Paper develops efficient AltMin algorithm for SRPCP robust matrix recovery.
problem SRPCP model robust matrix recovery with universal penalty parameter.
method Tuning-free alternating minimization (AltMin) algorithm with closed-form subproblems.
result Efficient AltMin algorithm confirms robustness and efficiency.
Federated learning is protected against adversarial attacks with residual-based reweighting.
problem Adversarial attacks on federated learning's aggregation process.
method Residual-based reweighting combined with iteratively reweighted least squares.
result Our aggregation algorithm outperforms other methods in label-flipping and backdoor attacks.
We present a technique for significantly speeding up Alternating Least Squares (ALS) and Gradient Descent (GD), two widely used algorithms for tensor factorization. By exploiting properties of the Khatri-Rao product, we show how to efficiently address a computationally challenging sub-step of both algorithms. Our algor…
SWCCA identifies specific subsets of samples for better correlation analysis.
problem Identify specific subsets of samples contributing to correlation between two data matrices.
method Proposes SWCCA with weights to regularize different samples, solves using alternating iterative algorithm.
result Demonstrates effectiveness and superiority over related methods on synthetic and real-world data.
New algorithm improves convergence rates for convex optimization problems.
problem Convex optimization problems with noisy stochastic data.
method Stochastic proximal point algorithm with weak linear regularity condition.
result Achieves $\mathcal{O}\left(\frac{1}{k}
ight)$ convergence rate for SPP.
Stochastic algorithm achieves sublinear convergence for bi-objective optimization.
problem Optimizing two conflicting functions using gradient or subgradient descent.
method Stochastic alternating algorithm with varying steps for each objective.
result Achieves sublinear convergence rate of O(1/T) under strong convexity.
Paper introduces ZOO-ADMM for online optimization with reduced gradient calculations.
problem Developing an efficient online optimization method for complex structured regularizers.
method Zeroth-order online alternating direction method of multipliers (ZOO-ADMM) with gradient-free operation and minibatch strategies.
result Improved convergence rate for ZOO-ADMM compared to first-order gradient-based methods.
Algorithm recovers factors of rank-1 matrices from noisy measurements.
problem Estimating factors of a rank-1 matrix from nonlinearly transformed and noisy measurements.
method Alternating minimization with random initialization and analysis of empirical error recursion.
result Algorithm converges geometrically fast from random initialization, with sharp guarantees.
New method speeds up Gaussian process training and inference for large datasets.
problem Training and inference in Gaussian processes are computationally expensive for large datasets.
method Iterative alternating projection method that accesses subblocks of the kernel matrix, reducing time and space complexity.
result Empirically, the method accelerates GP training and inference by up to 72x compared to conjugate gradients.
Guaranteed Simultaneous Asymmetric Tensor Decomposition via Orthogonalized Alternating Least Squaresstat.ML
New method guarantees simultaneous decomposition of tensor components.
problem Existing methods fail to recover all tensor components simultaneously.
method S-ASI method using slicing initialization and subspace iterations.
result Guaranteed recovery of top r components simultaneously for symmetric tensors.
Improved neural network training with ADMM for hardware compatibility.
problem Training scalable and parallelizable neural networks.
method Alternating Direction Method of Multipliers (ADMM) combined with iterative least-square methods.
result Achieved significant accuracy improvements over SGD and Adam.
A new iterative algorithm improves RFDA for high-dimensional data.
problem High-dimensional data challenges conventional FDA and RFDA.
method Iterative sketching-based algorithm with accuracy guarantees.
result Accurate approximations can be achieved with smaller sample sizes.
Q-learning for average cost MDPs gets a concentration bound.
problem Finding bounds for Q-learning in average cost MDPs.
method Derives a concentration bound using shortest path problem equivalence.
result Numerical comparison with relative value iteration shows the bound's effectiveness.
Sparse Generalized Canonical Correlation Analysis: Distributed Alternating Iteration based Approachcs.LG
Proposes GCCA for detecting latent relations in multiview data with sparse structures.
problem Sparse CCA limitations for multiple datasets.
method Developed a GCCA algorithm based on distributed alternating iteration approach.
result Demonstrated effectiveness on synthetic and real-world datasets.
Paper proposes an efficient algorithm for clustering with sparse feature selection.
problem Estimating labels and sparse weights in unsupervised clustering.
method Alternating minimization of Frobenius norm criterion with K-sparse algorithm.
result Significantly improves clustering results on single-cell RNA sequencing datasets.
Inference of stochastic time series with missing dataphysics.data-an
Method infers dynamics from incomplete time series data.
problem Challenges in inferring stochastic dynamics from time series with missing data.
method Expectation Maximization (EM) algorithm that iterates between E-step and M-step.
result The EM algorithm effectively recovers missing data points and infers underlying network models from real neuronal activities.
Maximum likelihood inference for high-dimensional problems with multiaffine variable relationsstat.ML
A novel AIRLS algorithm for multiaffine variable relations in high-dimensional problems.
problem Challenges in Maximum Likelihood Estimation in high-dimensional settings with complex variable relations.
method Proposes an Alternating and Iteratively-Reweighted Least Squares (AIRLS) algorithm for multiaffine variable relations.
result Proves convergence for problems with Generalized Normal Distributions and shows empirically super-linear convergence rate.
Multi-Rank Sparse and Functional PCA: Manifold Optimization and Iterative Deflation Techniquesstat.ML
Improved estimation of multiple principal components using manifold optimization and iterative deflation techniques.
problem Estimating multiple principal components efficiently and orthogonally.
method Extended SFPCA using manifold optimization and iterative deflation techniques.
result Alternative deflation schemes improve signal extraction and component estimation.
Paper proposes a distributed sampling method for Bayesian inference.
problem Privacy and communication constraints in spatially distributed datasets.
method Alternating Direction Method of Multipliers for distributed sampling.
result Algorithm converges to target distribution in Wasserstein distance.
New method learns collective variables using autoencoders for molecular simulations.
problem Learning low-dimensional slow degrees of freedom (collective variables) for molecular simulations.
method Iterative method involving CV learning with autoencoders and reweighting scheme.
result Achieves convergence of learned collective variables.