The paper explores properties of projections and gradient methods in hyperbolic space forms.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
The Prescriptive Canvas improves business outcomes by directly prescribing actions based on predictions.
The Frank-Wolfe (FW) algorithm has been widely used in solving nuclear norm constrained problems, since it does not require projections. However, FW often yields high rank intermediate iterates, which can be very expensive in time and space costs for large problems. To address this issue, we propose a rank-drop method …
Method recovers particle orientations from cryo-EM projections.
We show that any nontrivial reduced knot projection can be obtained from a trefoil projection by a finite sequence of half-twisted splice operations and their inverses such that the result of each step in the sequence is reduced.
Aggregates predictions from multiple regression models using random projections and kernel methods.
The paper develops a method for optimal projection selection in high-dimensional classification.
The study improves prediction regions for hierarchical data using a projection step.
Efficiently projects points onto polytopes, especially useful in web-scale applications.
In this paper we introduce a projection method for the space of probability distributions based on the differential geometric approach to statistics. This method is based on a direct L2 metric as opposed to the usual Hellinger distance and the related Fisher Information metric. We explain how this apparatus can be used…
In a linear stochastic bandit model, each arm is a vector in an Euclidean space and the observed return at each time step is an unknown linear function of the chosen arm at that time step. In this paper, we investigate the problem of learning the best arm in a linear stochastic bandit model, where each arm's expected r…
Conditional gradients constitute a class of projection-free first-order algorithms for smooth convex optimization. As such, they are frequently used in solving smooth convex optimization problems over polytopes, for which the computational cost of orthogonal projections would be prohibitive. However, they do not enjoy …
The paper develops a method for forecasting power consumption at various levels of aggregation.
SPGD improves adversarial training efficiency and accuracy.
A new method improves stochastic gradient descent for faster and more efficient estimation.
K-means is a classical clustering algorithm with wide applications. However, soft K-means, or fuzzy c-means at m=1, remains unsolved since 1981. To address this challenging open problem, we propose a novel clustering model, i.e. Probabilistic K-Means (PKM), which is also a nonlinear programming model constrained on lin…
This paper deals with sparse feature selection and grouping for classification and regression. The classification or regression problems under consideration consists in minimizing a convex empirical risk function subject to an constraint, a pairwise constraint, or a pairwise constraint. …
Synthetic construction of Hopf fibration in 4D space.
We show how to efficiently project a vector onto the top principal components of a matrix, without explicitly computing these components. Specifically, we introduce an iterative algorithm that provably computes the projection using few calls to any black-box routine for ridge regression. By avoiding explicit principal …
A vector field on a Kähler manifold is called c-projective if its flow preserves the J-planar curves. We give a complete local classification of Kähler real 4-dimensional manifolds that admit an essential c-projective vector field. An important technical step is a local description of 4-dimensional c-projectively equiv…
This paper deals with unsupervised clustering with feature selection. The problem is to estimate both labels and a sparse projection matrix of weights. To address this combinatorial non-convex problem maintaining a strict control on the sparsity of the matrix of weights, we propose an alternating minimization of the Fr…
We develop a projected Nesterov's proximal-gradient (PNPG) approach for sparse signal reconstruction that combines adaptive step size with Nesterov's momentum acceleration. The objective function that we wish to minimize is the sum of a convex differentiable data-fidelity (negative log-likelihood (NLL)) term and a conv…
New method improves model risk prediction using cross-audit projection.
Project fair estimators while maintaining accuracy.
The paper analyzes convergence properties of NGA and PAMe for -norm PCA.
With increasing concerns about security, the need for highly secure physical biometrics-based authentication systems utilizing \emph{cancelable biometric} technologies is on the rise. Because the problem of cancelable template generation deals with the trade-off between template security and matching performance, many …
Field canals improvement projects (FCIPs) are one of the ambitious projects constructed to save fresh water. To finance this project, Conceptual cost models are important to accurately predict preliminary costs at the early stages of the project. The first step is to develop a conceptual cost model to identify key cost…
In this article we use the "escape from subvarieties lemma" introduced by Eskin--Mozes--Oh to prove finite step rigidity results for the Jordan-Lyapunov projection spectra of Hitchin representations and the Margulis-Smilga invariant spectra of some special Margulis-Smilga spacetimes. In the process, we also prove a sim…
New convergence results for NGVI with various step sizes and sample sizes.
In this paper, auto-associative models are proposed as candidates to the generalization of Principal Component Analysis. We show that these models are dedicated to the approximation of the dataset by a manifold. Here, the word "manifold" refers to the topology properties of the structure. The approximating manifold is …
RPE detects anomalies robustly in time-series data.
Researchers characterize a specific type of projective variety based on its tangents.
We show that a simple randomized sketch of the matrix multiplicative weight (MMW) update enjoys (in expectation) the same regret bounds as MMW, up to a small constant factor. Unlike MMW, where every step requires full matrix exponentiation, our steps require only a single product of the form , which the Lanczos …
Improved neural network training in low-dimensional random bases.
New method clusters high-dimensional data with anisotropic noise.
The method of random projections has become a standard tool for machine learning, data mining, and search with massive data at Web scale. The effective use of random projections requires efficient coding schemes for quantizing (real-valued) projected data into integers. In this paper, we focus on a simple 2-bit coding …
We explore a new approach for training neural networks where all loss functions are replaced by hard constraints. The same approach is very successful in phase retrieval, where signals are reconstructed from magnitude constraints and general characteristics (sparsity, support, etc.). Instead of taking gradient steps, t…
Decentralized optimization on dynamic manifolds with improved regret bound.
This paper discusses predictive inference and feature selection for generalized linear models with scarce but high-dimensional data. We argue that in many cases one can benefit from a decision theoretically justified two-stage approach: first, construct a possibly non-sparse model that predicts well, and then find a mi…
Paper tackles catastrophic overfitting in single-step adversarial training.
A novel optimisation framework through quadratic nonlinear projection is introduced for credit portfolio when the portfolio risk is measured by Conditional Value-at-Risk (CVaR). The whole optimisation procedure to search toward the optimal portfolio state is conducted by a series of single-step optimisations under the …
Stochastic approximation algorithms show exponential progress bounds.
We study the problem of programmatic reinforcement learning, in which policies are represented as short programs in a symbolic language. Programmatic policies can be more interpretable, generalizable, and amenable to formal verification than neural policies; however, designing rigorous learning approaches for such poli…
Paper proposes PPMM for fast estimation of large-scale OTM.
Complex projective varieties are quotients of polydiscs under specific group actions.
Diverse projection ensembles improve distributional reinforcement learning.
The paper examines how well node similarities are preserved by random projections in graph embeddings.
The paper uses Seshadri constants to construct symplectic ellipsoid embeddings.