Let X be a geodesic metric space. Gromov proved that there exists k>0 such that if every sufficiently large triangle T satisfies the Rips condition with constant k times pr(T), where pr(T) is the perimeter T, then X is hyperbolic. We give an elementary proof of this fact, also giving an estimate for k. We also show tha…
The ROC curve is widely used to assess the quality of prediction/classification/ranking algorithms, and its properties have been extensively studied. The precision-recall (PR) curve has become the de facto replacement for the ROC curve in the presence of imbalance, namely where one class is far more likely than the oth…
We consider d-dimensional linear stochastic approximation algorithms (LSAs) with a constant step-size and the so called Polyak-Ruppert (PR) averaging of iterates. LSAs are widely applied in machine learning and reinforcement learning (RL), where the aim is to compute an appropriate θ∗∈Rd (that is a…
TD(0) with Polyak-Ruppert averaging achieves robust and fast convergence rates
problem TD(0) learning under Markovian sampling
method Polyak-Ruppert averaging with a single stepsize
result Simultaneous high-probability convergence guarantees for TD(0) iterates and PR average
We study the triple $(G,π,\prs)$ where G is a connected and simply connected Lie group, π and $\prs$ are, respectively, a multiplicative Poisson tensor and a left invariant Riemannian metric on G such that the necessary conditions, introduced by Hawkins, to the existence of a non commutative deformation (in the d…
When sufficient labeled data are available, classical criteria based on Receiver Operating Characteristic (ROC) or Precision-Recall (PR) curves can be used to compare the performance of un-supervised anomaly detection algorithms. However , in many situations, few or no data are labeled. This calls for alternative crite…
Solves a challenging problem in imaging and communication.
problem Simultaneous source separation and phase retrieval.
method Uses deep generative models to constrain the search space.
result Demonstrates solving a highly under-determined, non-convex problem.
In this note we prove that, for a vector bundle E over a manifold M, a Dorfman bracket on TM⊕E∗ anchored by prTM and with E a vector bundle over M, is equivalent to a lift from Γ(TM⊕E∗) to linear sections of TE⊕T∗E→E, that intertwines the given Dorfman bracket w…
Classifies solutions to vacuum weighted Einstein equations on pr-waves.
problem Classifying solutions to vacuum weighted Einstein field equations on pr-waves.
method Classifying solutions using smooth metric measure spacetimes of dimension 4.
result Provides examples of solutions with special geometric properties.
Study finds differences in LTs across tasks and architectures, proposing a consensus-based method for generating refined lottery tickets.
problem Understanding the variability and uniqueness of Lottery Tickets across different image classification tasks and architectures.
method 28 combinations of image classification tasks and architectures, iterative pruning techniques, consensus-based method for generating refined lottery tickets.
result Disproves the uniqueness of Lottery Tickets and connects emergent mask structure to the choice of pruning.
Proposes MCC-F1 curve for better binary classification evaluation.
problem Misleading performance evaluations with ROC and PR curves for imbalanced data.
method Introduces MCC-F1 curve combining MCC and F1 score.
result MCC-F1 curve provides clearer classifier differentiation.
The broad set of deep generative models (DGMs) has achieved remarkable advances. However, it is often difficult to incorporate rich structured domain knowledge with the end-to-end DGMs. Posterior regularization (PR) offers a principled framework to impose structured constraints on probabilistic models, but has limited …
PRS improves rejection sampling by learning better proposals.
problem High rejection rate in traditional rejection sampling.
method PRS uses a kernel estimator to learn better sampling proposals.
result PRS guarantees a low number of accepted samples.
Geometric analysis of ROC and PR curves for binary classification.
problem Understanding classifier behavior and selection of optimal operating points.
method Geometric perspective on ROC and PR curves, focusing on the composition function G. result Many binary classification metrics are functions of G=Fp∘Fn−1, facilitating better classifier optimization. A garland based on a manifold P is a finite set of manifolds homeomorphic to P with some of them glued together at marked points. Fix a manifold M and consider a space $\NN$ of all smooth mappings of garlands based on P into M. We construct operations ∙ and [−,−] on the bordism groups $\bor_*(\NN)$ …
Steinhaus conjectured that every closed oriented C1-curve has a pair of anti-parallel tangents. Porter disproved the conjecture by showing that there exist curves with no anti-parallel tangents. Colin Adams rised the question of whether there exists a nontrivial knot in R3 which has no parallel or antiparallel t…
In this paper we define a Poincaré-Reidemeister scalar product on the determinant line of the cohomology of any flat vector bundle over a closed orientable odd-dimensional manifold. It is a combinatorial "torsion-type" invariant which refines the PR-metric, introduced earlier by the first author, and contains an additi…
New metrics fail adversarial tests, with some more robust than others.
problem Evaluation metrics for time-series anomaly detection were improved but not fully robust.
method Adversarial stress-testing of 12 adopted metrics on real benchmarks.
result Some metrics are more robust than others, with ROC-based metrics being gamed more often.
In this article we revisit the definition of Precision-Recall (PR) curves for generative models proposed by Sajjadi et al. (arXiv:1806.00035). Rather than providing a scalar for generative quality, PR curves distinguish mode-collapse (poor recall) and bad quality (poor precision). We first generalize their formulation …
PR-GNN identifies salient brain regions for ASD biomarkers.
problem Identifying brain regions associated with neurological disorders.
method Pooling Regularized Graph Neural Network (PR-GNN) with novel salient region selection.
result PR-GNN outperforms baseline methods in ASD classification accuracy.
The paper explores CR structures and their leaf spaces in semi-Riemannian manifolds.
problem Classifying CR structures and their leaf spaces.
method Using unit tangent bundles and dynamical Legendrian contact structures.
result New examples of 2-nondegenerate CR structures are provided.
Correction for Error estimates for binomial approximations of game options [math.PR/0607123]
Unified four trade-off curves for assessing generative model proximity.
problem Quantitative assessment of proximity between two probability distributions.
method Unified four existing curves: PR, Lorenz, ROC, and Rényi divergence frontiers.
result Explicit relationship between PR and Lorenz curves with domain adaptation bounds.
New method detects inconsistencies in AHP matrices using triadic preference reversals.
problem Challenges in assessing consistency in AHP pairwise comparison matrices.
method Triadic preference reversals to detect inconsistencies between pairs of elements.
result 97% accuracy in detecting inconsistencies, significantly surpassing traditional methods.
The paper tackles performative risk optimization under weak convexity assumptions.
problem Optimizing performative risk in a closed-loop prediction system with weak convexity.
method Relaxing convexity assumptions to maintain optimization feasibility.
result Iterative optimization methods remain applicable even with weakened convexity conditions.
New PSDMF algorithms derived from PR and ARM methods.
problem Positive semidefinite matrix factorization (PSDMF) challenges.
method Design PSDMF algorithms based on phase retrieval (PR) and affine rank minimization (ARM) methods.
result New PSDMF algorithms inherit numerical properties from PR and ARM methods.
Develops new approach to recover CR structures from their Levi foliations.
problem Recovering CR structures from their Levi foliations for nonregular symbols.
method Reduction to dynamical Legendrian contact structure on leaf space.
result New geometric interpretation of CR prolongation conditions.
DCC separates marginal estimation from dependence modeling for improved classification accuracy.
problem Classifying with strong dependence between features.
method Deep Copula Classifier using neural copula densities.
result Achieves excess-risk O(n−r/(2r+d)) for r-smooth copulas. Optimal spectral initializers impact phase retrieval phase transitions.
problem Understanding the limits of phase retrieval algorithms.
method Developed Random duality theory (RDT) to characterize optimal spectral initializers.
result Optimal spectral initializers can fall into flat regions of the phase retrieval manifold, making phase retrieval difficult.
Study symplectic embeddings of 4-manifolds using Lefschetz fibrations.
problem Proper symplectic and iso-symplectic embeddings of 4-manifolds in 6-manifolds.
method Use Lefschetz fibrations to study symplectic embeddings.
result Closed orientable smooth 4-manifolds admitting Lefschetz fibrations over CP^1 can be embedded symplectically in (CP^1 × CP^1 × CP^1, ω_pr).
We propose a general technique for improving alternating optimization (AO) of nonconvex functions. Starting from the solution given by AO, we conduct another sequence of searches over subspaces that are both meaningful to the optimization problem at hand and different from those used by AO. To demonstrate the utility o…
We study two-layer belief networks of binary random variables in which the conditional probabilities Pr[childlparents] depend monotonically on weighted sums of the parents. In large networks where exact probabilistic inference is intractable, we show how to compute upper and lower bounds on many probabilities of intere…
New method detects global factors near BBP phase transition in high-dimensional data.
problem Detecting the number of global factors in noisy high-dimensional correlation matrices.
method Iterative Global Factor (IGF) algorithm combining adaptive edge recalibration and PR delocalization filter.
result IGF algorithm successfully detects global factors near BBP transition, improving over eigenvalue-only methods.
Assessing the performance of a learned model is a crucial part of machine learning. However, in some domains only positive and unlabeled examples are available, which prohibits the use of most standard evaluation metrics. We propose an approach to estimate any metric based on contingency tables, including ROC and PR cu…
We construct new knot polynomials. Let V be the standard solid torus in 3-space and let pr be its standard projection onto an annulus. Let M be the space of all smooth oriented knots in V such that the restriction of pr is an immersion (e.g. regular diagrams of a classical knot in the complement of its meridi…
Study evaluates machine learning methods for large-scale network reliability, revealing ANN's and PR's performance.
problem Tackles the NP-hard problem of approximating binary-state network reliability for large-scale systems.
method Compares 20 machine learning methods across three reliability regimes and evaluates their performance on large-scale networks.
result Large-scale networks with arc reliability ≥ 0.9 exhibit near-unity system reliability, enabling computational simplifications.
This work improves understanding of projection robust optimal transport distances.
problem Understanding the behavior of minimum Wasserstein estimators in high-dimensional and misspecified models.
method Adopting projection robust (PR) optimal transport, establishing statistical properties, proposing IPRW distance, and providing asymptotic guarantees.
result Established fundamental statistical properties and proposed new distances that outperform Wasserstein distances empirically.
The paper analyzes the performance of constant step-size stochastic approximation algorithms.
problem Approximating solutions to root finding problems in optimization and machine learning.
method Examines stochastic approximation algorithms with constant step-size, proving convergence and analyzing the limiting behavior of averaged estimates.
result The Polyak-Ruppert-style averaged estimates converge to the true solution with optimal covariance, providing insights for practitioners.
Persistence diagrams from random matrices follow RMT universality, offering a new spectral diagnostic.
problem Understanding spectral properties of random matrices using topological data analysis.
method Applying Morse theory to persistence diagrams of quadratic forms restricted to unit spheres.
result Persistence entropy outperforms traditional level spacing ratios in discriminating random matrix ensembles.
Paper introduces SCI to distinguish market signals from coordination.
problem Unclear signals in prediction markets.
method Formalizes SCI, introduces weighted and time-varying extensions.
result Discriminates between market signals and coordination.
Estimates roughness of financial volatility paths using horizontal visibility graphs.
problem Estimating roughness in financial volatility models.
method Introduces L+(t) for first-passage horizons, treating uncensored observations as first-passage times.
result Estimates roughness through a single tail exponent θ, separating rough Bergomi volatility from classical models.
Noisy PN learning is the problem of binary classification when training examples may be mislabeled (flipped) uniformly with noise rate rho1 for positive examples and rho0 for negative examples. We propose Rank Pruning (RP) to solve noisy PN learning and the open problem of estimating the noise rates, i.e. the fraction …
Method calculates d-invariants for a family of Brieskorn spheres.
problem Computing d-invariants for infinite families of Brieskorn spheres. method Effective method for simultaneous computation of d-invariants. result Computes d-invariants for infinite families of Brieskorn spheres. A new method avoids saddle points in Newton's method.
problem Avoiding saddle points in optimization problems.
method New Q-Newton's method with specific update rule.
result The method guarantees convergence to a critical point that is not a saddle point.
Paper analyzes LSA algorithm bias and error bounds with RR extrapolation.
problem Analyzing bias and high-order error bounds of LSA with Markovian noise.
method Polyak-Ruppert averaging, linearization, Richardson-Romberg extrapolation.
result RR extrapolation effectively cancels the leading bias term.
A new method for nonparametric regression using mesh-based solutions.
problem Estimating regression functions non-parametrically with computational tractability.
method Mesh-based approximate solution (MBS) for penalized regression problems.
result MBS transforms NPR to a discrete convex minimization problem, making it computationally feasible.
Recently, deep learning approaches with various network architectures have achieved significant performance improvement over existing iterative reconstruction methods in various imaging problems. However, it is still unclear why these deep learning architectures work for specific inverse problems. To address these issu…
Enhances clinical trial predictions by quantifying uncertainty.
problem Uncertainty in medical diagnosis and drug discovery predictions.
method Selective classification integrated with Hierarchical Interaction Network (HINT).
result Significant improvement in PR-AUC, F1, ROC-AUC, and overall accuracy.