Study of cyclic pursuit on compact manifolds, conjecturing finite or convergent loops.
problem Understanding the behavior of cyclic pursuit on compact manifolds.
method Analyzing Riemannian manifolds with positive injectivity radius, focusing on nonpositively curved compact manifolds.
result The conjecture that piecewise geodesic loops either collapse or converge to a closed geodesic is valid for nonpositively curved compact manifolds.
Thompson Sampling improves pursuit-evasion coordination.
problem Optimizing pursuer behavior to capture an evader efficiently.
method Variant of Thompson Sampling applied to pursuit-evasion problems.
result Thompson Sampling reduces time-to-capture significantly.
Unified analysis of matching pursuit and coordinate descent methods.
problem Optimization of linear spaces using first-order methods.
method Unified analysis of matching pursuit and coordinate descent, providing rates for smooth and strongly convex objectives.
result Unified analysis leading to tightest known rates for steepest coordinate descent and accelerated convergence for matching pursuit.
Isometry pursuit identifies orthonormal submatrices from wide matrices.
problem Identifying isometric embeddings from wide matrices.
method A convex algorithm combining normalization and multitask basis pursuit.
result The method identifies isometric embeddings from interpretable dictionaries.
Unified view on matching pursuit and Frank-Wolfe algorithms with improved convergence rates.
problem Improving convergence rates for matching pursuit and Frank-Wolfe algorithms.
method Unified optimization perspective leading to explicit convergence rates.
result Sublinear (1/t) convergence for general smooth objectives and linear convergence for strongly convex objectives. A new algorithm improves SSC clustering accuracy with low complexity.
problem Sparse Subspace Clustering accuracy loss in time efficiency.
method Active Orthogonal Matching Pursuit (Active OMP-SSC) for improved clustering accuracy.
result Improves clustering accuracy of OMP-SSC with low computational complexity.
Study of pursuit-evasion game on sphere and its relation to planar Apollonius circle.
problem Analyzing pursuit-evasion game on a sphere and its properties.
method Extending classical planar pursuit-evasion game to spherical geometry, studying equilibrium intercept points and their relation to Apollonius domain.
result Condition for intercept point to belong to Apollonius domain on sphere, analogous to planar game.
New algorithms separate singing voices from accompaniment using complex and quaternionic principal component pursuit.
problem Separating singing voices from instrumental accompaniment using phase information.
method Extended principal component pursuit to complex and quaternionic cases, developed new proximity operators, applied inexact augmented Lagrange multiplier algorithm.
result Phase information improves singing voice separation.
This paper closes the gap on matching pursuit's convergence rate.
problem Improving the understanding of matching pursuit's convergence rate.
method Constructing a worst case dictionary to analyze matching pursuit's performance.
result Sharp characterization of matching pursuit's convergence rate as n−α, with α≈0.182. New algorithm combines gradient and coordinate descent steps for faster convergence.
problem Optimizing smooth convex functions over atom-spans.
method Blended matching pursuit combining coordinate descent and gradient descent.
result Derives linear convergence rates for non-strongly convex functions.
Generative ML learns optimal pursuit trajectories in pursuit-evasion games.
problem Optimizing Blue's pursuit trajectory to intercept Red in a game of pursuit-evasion.
method Applying generative machine learning to learn optimal action policies for Blue.
result Generative ML models can learn relevant representations for pursuit-evasion dynamics.
The paper finds non-Gaussian directions in high-dimensional data using Wasserstein distance.
problem Locating interesting non-Gaussian features in high-dimensional data.
method Projection pursuit using 2-Wasserstein distance to maximize the difference from Gaussian.
result Statistical guarantees for accurately approximating an unknown low-dimensional non-Gaussian subspace.
The paper compares PCA and PP for scRNA sequencing data.
problem Limitations of PCA in scRNA sequencing data.
method Applied PCA and PP (using negative Shannon's entropy) on scRNA sequencing data.
result PP outperforms PCA in scRNA sequencing data.
In this correspondence, we obtain exact recovery conditions for regularized modified basis pursuit (reg-mod-BP) and discuss when the obtained conditions are weaker than those for modified-CS or for basis pursuit (BP). The discussion is also supported by simulation comparisons. Reg-mod-BP provides a solution to the spar…
Insurance firms use RL to optimize customer offers for desired target portfolios.
problem Optimizing insurance offers to achieve a desired customer portfolio.
method Developed a novel reinforcement learning algorithm.
result The RL algorithm outperforms traditional methods in a synthetic market.
Enhances projection pursuit tree classifier with visual diagnostics for better multi-class classification.
problem Rigidity of original algorithm limits performance in complex high-dimensional classification problems.
method Allowing more splits and flexible class groupings in projection pursuit computation, and developing visual diagnostics.
result Demonstrates enhanced classifier performs as intended through interactive visual diagnostics.
This paper proposes an active sampling method for meta-learning using MDPs.
problem Exploiting relationships between tasks and classes in meta-learning.
method Formulates the problem as a MDP, uses UCB, Gittins Index, and linear programming solutions.
result Significant reductions in sample complexity for active selection schemes.
PPF uses projections to improve classification accuracy.
problem Improving classification accuracy in multi-class problems.
method PPF constructs trees using projections of variables, enhancing traditional random forest.
result PPF outperforms traditional random forest in multi-class problems.
Paper extends principal component pursuit to hypercomplex numbers for improved audio data analysis.
problem Improving robust principal component analysis for audio data.
method Extends principal component pursuit to polar n-complex and n-bicomplex numbers, deriving proximity operators for ℓ1- and trace-norm regularizers. result Our approach outperforms tensor robust principal component analysis on audio data.
Product models of low dimensional experts are a powerful way to avoid the curse of dimensionality. We present the ``under-complete product of experts' (UPoE), where each expert models a one dimensional projection of the data. The UPoE is fully tractable and may be interpreted as a parametric probabilistic model for pro…
Paper proposes an accelerated algorithm for sparse subspace clustering.
problem Inefficient and inaccurate subspace clustering methods.
method Accelerated orthogonal least-squares for sparse subspace clustering.
result The proposed method is more accurate and efficient than existing methods.
Orthogonal Matching Pursuit (OMP) has long been considered a powerful heuristic for attacking compressive sensing problems; however, its theoretical development is, unfortunately, somewhat lacking. This paper presents an improved Restricted Isometry Property (RIP) based performance guarantee for T-sparse signal reconst…
Sharp results link DLN gradient flow to basis pursuit optimization and GHA phase transitions.
problem Understanding implicit regularization in Diagonal Linear Networks.
method Sharp convergence bounds and characterization of ℓ1 minimizers. result Gradient flow of DLNs with tiny initialization approximates minimizers of basis pursuit optimization problem.
Paper proposes a novel approach to density ratio estimation using projection pursuit.
problem Density ratio estimation challenges in high dimensions and model misspecification.
method The approach uses projection pursuit to approximate density ratios, addressing high dimensionality and model flexibility issues.
result The proposed estimator is consistent and converges at a certain rate, outperforming existing methods in experiments.
The problem of pursuing a moving target is always one of the main topics in navigation. In the literatures, there are two well-known algorithms called Pure Pursuit and Pure Rendezvous navigation in the 3-dimensional space R3. In this paper, these two methods are combined to introduce a novel family of pursu…
A geometric approach to differential game theory is illustrated. The parallel pursuit is considered as a two-player zero-sum differential game. The optimal strategies of each player is designed based on Riemann-Finsler geometry. Our approach incorporates a closed loop optimal control and the presentation is familiar wi…
Projection pursuit model improves Gaussian process regression for high-dimensional data.
problem Scalability issues with traditional Gaussian process models in high dimensions.
method Additive Gaussian process regression with dimension expansion and gradient descent.
result The proposed method approximates more complex functions and outperforms traditional models.
Improved SSC clustering with reduced computation time and accuracy.
problem Heavy computational burden in Sparse Subspace Clustering.
method RCOMP-SSC algorithm that restricts connections during OMP iterations.
result Improved clustering accuracy with reduced computational time.
New pursuit algorithm for ML-CSC model with improved stability and dictionary learning.
problem Lack of exact pursuit algorithms and conditions for non-empty model in ML-CSC.
method Projection approach for pursuit algorithm, stability bounds, practical alternatives, online dictionary learning.
result Sound pursuit algorithm and practical dictionary learning for ML-CSC model.
OOMP selects features online for sparse linear regression.
problem Feature selection in high-dimensional sparse linear models.
method Online algorithm that alternates between feature selection and coefficient estimation.
result Theoretical guarantees and computational complexity analysis of OOMP.
A framework for efficiently solving structured matrix factorization problems.
problem Efficiently representing real-world data with structured vectors.
method Generalized greedy pursuit framework and atomic power method for non-convex subproblems.
result Linear convergence for approximation over arbitrary dictionaries.
Paper proposes PPMM for fast estimation of large-scale OTM.
problem Estimation of large-scale optimal transport maps (OTM) is challenging due to the curse of dimensionality.
method Combines projection pursuit regression and sufficient dimension reduction to adaptively select projection directions.
result PPMM consistently estimates the most informative projection direction and weakly converges to the target OTM.
Lower bounds show OLS outperforms basis pursuit in overparameterized linear regression.
problem Excess risk of sparse interpolating procedures in overparameterized linear regression.
method Proved lower bounds on excess risk for OLS and basis pursuit.
result Excess risk of basis pursuit can converge at an exponentially slower rate than OLS.
We introduce a new convex formulation for stable principal component pursuit (SPCP) to decompose noisy signals into low-rank and sparse representations. For numerical solutions of our SPCP formulation, we first develop a convex variational framework and then accelerate it with quasi-Newton methods. We show, via synthet…
Paper develops efficient AltMin algorithm for SRPCP robust matrix recovery.
problem SRPCP model robust matrix recovery with universal penalty parameter.
method Tuning-free alternating minimization (AltMin) algorithm with closed-form subproblems.
result Efficient AltMin algorithm confirms robustness and efficiency.
New technique RRT improves OMP performance without knowing sparsity or noise.
problem Recovering sparse high-dimensional vectors without knowing sparsity or noise statistics.
method Residual ratio thresholding (RRT) to operate OMP without a priori knowledge.
result RRT achieves comparable performance to OMP with known statistics.
Paper proves noise-tolerant SSC using greedy methods under coherence conditions.
problem Proving noise-tolerant SSC using greedy methods under coherence conditions.
method Derives coherence-based sufficient conditions for correct neighbor identification using MP/OMP in the presence of bounded noise.
result MP/OMP succeed in identifying correct neighbors under certain noise levels, leading to higher clustering accuracy.
A novel PP algorithm using GMMs and GAs for detecting informative structures.
problem Detecting informative structures in multivariate datasets.
method Gaussian mixture models (GMMs) and Genetic Algorithms (GAs) for optimal projection.
result The approach effectively detects informative structures in multivariate datasets.
Matching Pursuit LASSIn Part I \cite{TanPMLPart1}, a Matching Pursuit LASSO ({MPL}) algorithm has been presented for solving large-scale sparse recovery (SR) problems. In this paper, we present a subspace search to further improve the performance of MPL, and then continue to address another major challenge of SR -- bat…
UAVs use RL to outperform a greedy shooter in 2D engagements.
problem Optimizing UAV pursuit-evasion strategies in 2D environments.
method Reinforcement learning applied to a greedy shooter strategy in a 2D aerial engagement.
result Deep Q-learning UAV outperforms greedy shooter UAV in simulations.
New multi-layer algorithm improves CNN performance.
problem Efficiently modeling and processing information with parsimonious representations.
method Generalized Basis Pursuit to multi-layer setting, proposing ML-ISTA and ML-FISTA algorithms.
result Nested first order algorithms converge to solve the multi-layer problem.
This paper introduces 'General Cyclical Training' for neural networks.
problem Improving training efficiency and performance of neural networks.
method Cyclical training phases with varying hyperparameters, batch sizes, loss functions, and data augmentation.
result Cyclical weight decay, softmax temperature, and gradient clipping enhance model accuracy.
Paper analyzes and improves subspace clustering algorithms for noisy data.
problem Efficiently clustering data points in high-dimensional spaces with noise.
method Introduces SSC-MP and SSC-OMP algorithms using matching pursuit and orthogonal matching pursuit.
result Both algorithms succeed in noisy data and intersecting subspaces, with robust performance.
New RGraSP framework for efficient non-convex optimization.
problem Large-scale non-convex sparsity-constrained optimization problems.
method Relaxed gradient support pursuit with semi-stochastic gradient hard thresholding.
result Our algorithms converge faster with lower per-iteration cost.
The paper generalizes cyclic metrics in homogeneous Finsler geometry.
problem Understanding cyclic metrics in homogeneous Finsler spaces.
method Generalization of cyclic metrics, proving conditions for symmetry, and constructing cyclic metrics.
result A Finsler cyclic Lie group with an Abelian Lie algebra.
Paper analyzes and improves GPSP algorithm for block sparse signal recovery.
problem Recovering block sparse signals from noisy data.
method Group Projected Subspace Pursuit (GPSP) with convergence analysis and feature selection criteria.
result GPSP exactly recovers true block sparse signals under certain conditions.
DeepMP improves non-negative sparse recovery performance.
problem Recovering non-negative sparse signals with high coherence.
method Reformulated non-negative matching pursuit as a deep neural network.
result DeepMP yields significant improvement in exact recovery performance.
Characterizes non-degenerate cyclic metric Lie algebras.
problem Understanding the structure of non-solvable cyclic metric Lie algebras.
method Using sufficient conditions, cyclic quadruples, and double extension method.
result Complete characterization of non-degenerate cyclic metric Lie algebras.