New estimators reduce computation for Kendall's tau and conditional Kendall's tau matrices under structural assumptions.
problem Efficient estimation of Kendall's tau and conditional Kendall's tau matrices for large dimensions.
method Averaging pairwise estimates over blocks or conditional estimates, exploiting structural assumptions.
result Improved estimators with reduced computational cost and similar error level.
We show how the problem of estimating conditional Kendall's tau can be rewritten as a classification task. Conditional Kendall's tau is a conditional dependence parameter that is a characteristic of a given pair of random variables. The goal is to predict whether the pair is concordant (value of 1) or discordant (val…
New tests for conditional copulas based on decision trees.
problem Testing constancy of conditional dependence structure given conditioning events.
method Data-driven decision trees to maximize differences in conditional Kendall's tau.
result Asymptotic distributions of test statistics under the null hypothesis.
This paper proposes a new class of copulas which characterize the set of all twice continuously differentiable copulas. We show that our proposed new class of copulas is a new generalized copula family that include not only asymmetric copulas but also all smooth copula families available in the current literature. Spea…
Correlation matrices play a key role in many multivariate methods (e.g., graphical model estimation and factor analysis). The current state-of-the-art in estimating large correlation matrices focuses on the use of Pearson's sample correlation matrix. Although Pearson's sample correlation matrix enjoys various good prop…
Epilepsy is an important public health issue. An appropriate epileptiform discharge pattern detection of this neurological disease is a typical problem in biomedical engineering. In this paper, a new method is proposed for spike-and-wave discharge pattern detection based on Kendall's Tau-b coefficient. The proposed app…
Copula Discrepancy benchmarks sample dependence structure against known families.
problem Benchmarking sample dependence structure against known families.
method Copula Discrepancy (CD) statistic comparing target Kendall's tau with fitted parameter.
result CD reliably separates on-target and off-target copulas.
High-dimensional data models, often with low sample size, abound in many interdisciplinary studies, genomics and large biological systems being most noteworthy. The conventional assumption of multinormality or linearity of regression may not be plausible for such models which are likely to be statistically complex due …
We study the adaptive estimation of copula correlation matrix Σ for the semi-parametric elliptical copula model. In this context, the correlations are connected to Kendall's tau through a sine function transformation. Hence, a natural estimate for Σ is the plug-in estimator Σ^ with Kendall's tau statistic. We …
Framework clusters noisy MTS with robust fuzzy clustering, improving accuracy over existing methods.
problem Challenges in clustering multivariate time series due to non-stationary dependencies, noise, and state boundaries.
method Spectral fuzzy clustering using Kendall's tau-based canonical coherence for frequency-specific monotonic relationships.
result Framework outperforms existing methods in clustering noisy, high-dimensional MTS.
This study examines local co-movements in energy, agriculture, and metal markets using copulas.
problem Identifying local dependencies and asymmetries in energy, agriculture, and metal markets.
method Non-parametric mixture copula and copula-based local Kendall's tau approach.
result Increased co-movements in extreme situations, asymmetric local dependence, and diversification potential.
Proposes Isometric Graph Neural Networks to preserve graph distances.
problem Lack of faithful distance representation in graph neural networks.
method Introduces a new technique to modify GNNs' input space and loss function.
result Significant improvement in reflecting graph distances, as measured by KT.
New analysis shows interpretability doesn't guarantee steering utility in LLMs.
problem Does higher interpretability lead to better steering utility in large language models?
method Trained 90 SAEs across three LLMs, evaluated interpretability and steering utility, used Kendall's rank coefficients for analysis.
result Interpretability is only weakly associated with steering utility, and features selected by Delta Token Confidence improve steering performance.
Network analysis reveals changing cryptocurrency market leaders.
problem Understanding evolving cryptocurrency market leaders and their influence.
method Hourly-resolution data and Kendall's Tau correlation for network analysis.
result Pearson's correlation underestimates market dynamics; FTT and FTX were key during the 2021 bull run.
A new class of bivariate distributions is introduced that extends the Generalized Marshall-Olkin distributions of Li and Pellerey (2011). Their dependence structure is studied through the analysis of the copula functions that they induce. These copulas, that include as special cases the Generalized Marshall-Olkin copul…
We formulate coherence modeling as a regression task and propose two novel methods to combine techniques from our setup with pairwise approaches. The first of our methods is a model that we call "first-next," which operates similarly to selection sorting but conditions decision-making on information about already-sorte…
We propose a semiparametric approach, named nonparanormal skeptic, for estimating high dimensional undirected graphical models. In terms of modeling, we consider the nonparanormal family proposed by Liu et al (2009). In terms of estimation, we exploit nonparametric rank-based correlation coefficient estimators includin…
An investigation is presented of how a comprehensive choice of five most important measures of concordance (namely Spearman's rho, Kendall's tau, Gini's gamma, Blomqvist's beta, and their weaker counterpart Spearman's footrule) relate to non-exchangeability, i.e., asymmetry on copulas. Besides these results, the method…
Standardizes weighted ranking correlation coefficients to maintain zero expected value.
problem Measuring correlation between weighted rankings of items.
method Develops a standardization function g(·) that transforms coefficients to zero expected value under randomness.
result A general standardization function g(Γ) that preserves the domain [-1,1] and reduces to the identity for coefficients already satisfying zero-expected-value property.
New findings challenge the importance of forecast accuracy in battery storage optimization, highlighting the role of rank correlation instead.
problem The challenge of optimizing battery storage dispatch decisions in multi-market electricity trading using forecast accuracy metrics.
method A hierarchical three-layer optimization system trading in multiple markets (FCR, aFRR, day-ahead, intraday) with real market data.
result Rank correlation (Kendall tau) is a better predictor of intraday dispatch value than forecast accuracy (MAE), with a threshold of tau around 0.85-0.95 capturing up to 97-100% of perfect-foresight revenue.
Copula is a powerful tool to model multivariate data. We propose the modelling of intraday financial returns of multiple assets through copula. The problem originates due to the asynchronous nature of intraday financial data. We propose a consistent estimator of the correlation coefficient in case of Elliptical copula …
An investigation is presented of how a comprehensive choice of four most important measures of concordance (namely Spearman's rho, Kendall's tau, Spearman's footrule, and Gini's gamma) relate to the fifth one, i.e., the Blomqvist's beta. In order to work out these results we present a novel method of estimating the val…
Within the context of risk integration, we introduce in risk measurement stochastic holding period (SHP) models. This is done in order to obtain a `liquidity-adjusted risk measure' characterized by the absence of a fixed time horizon. The underlying assumption is that - due to changes on market liquidity conditions - o…
This paper presents performance analysis of hybrid model comprise of concordance and Genetic Programming (GP) to forecast financial market with some existing models. This scheme can be used for in depth analysis of stock market. Different measures of concordances such as Kendalls Tau, Ginis Mean Difference, Spearmans R…
We extend the recently introduced theory of Lovasz-Bregman (LB) divergences (Iyer & Bilmes 2012) in several ways. We show that they represent a distortion between a "score" and an "ordering", thus providing a new view of rank aggregation and order based clustering with interesting connections to web ranking. We show ho…
IGNIS uses neural networks to estimate copula parameters robustly.
problem Pathological properties of Archimedean copulas make traditional estimators brittle.
method Unified neural estimation framework with multi-input architecture and softplus output layer.
result Accurate and stable estimates for real-world datasets.
We propose a novel class of time-varying nonparanormal graphical models, which allows us to model high dimensional heavy-tailed systems and the evolution of their latent network structures. Under this model, we develop statistical tests for presence of edges both locally at a fixed index value and globally over a range…
We find all m-spin structures on Klein surfaces of genus larger than one. An m-spin structure on a Riemann surface P is a complex line bundle on P whose m-th tensor power is the cotangent bundle of P. A Klein surface can be described by a pair (P,tau), where P is a Riemann surface and tau is an anti-holomorphic involut…
Training autoregressive models to better predict under the test metric, instead of maximizing the likelihood, has been reported to be beneficial in several use cases but brings additional complications, which prevent wider adoption. In this paper, we follow the learning-to-search approach (Daumé III et al., 2009; Leblo…
Nonparametric correlations such as Spearman's rank correlation and Kendall's tau correlation are widely applied in scientific and engineering fields. This paper investigates the problem of computing nonparametric correlations on the fly for streaming data. Standard batch algorithms are generally too slow to handle real…
Kendall transformation converts continuous data into categorical vectors for robust information theory.
problem Handling small number of observations and preserving ranking in continuous data.
method Kendall transformation converts ordered features into categorical vectors of pairwise order relations.
result Kendall transformation makes information theory methods applicable to continuous data robustly.
In this paper, we propose a semiparametric approach, named nonparanormal skeptic, for efficiently and robustly estimating high dimensional undirected graphical models. To achieve modeling flexibility, we consider Gaussian Copula graphical models (or the nonparanormal) as proposed by Liu et al. (2009). To achieve estima…
New algorithm ranks players from partial comparisons with optimal rate.
problem Ranking players from partial pairwise comparisons.
method Divide-and-conquer approach, local MLE within groups.
result Optimal ranking algorithm with minimax rate.
Invariants found for tau-symmetric bihamiltonian systems.
problem Understanding symmetries in bihamiltonian systems.
method Proof of infinite Virasoro symmetries for tau-symmetric bihamiltonian deformations.
result Infinite set of Virasoro symmetries for tau-symmetric bihamiltonian systems.
There has been an increasing interest in testing the equality of large Pearson's correlation matrices. However, in many applications it is more important to test the equality of large rank-based correlation matrices since they are more robust to outliers and nonlinearity. Unlike the Pearson's case, testing the equality…
Python tools for 3D shape analysis on Kendall's space.
problem Lack of practical utilities for advanced 3D shape analysis.
method Developed Python tools for 3D shape analysis on Kendall's 3D Shape Space.
result Efficient, accessible software solutions for researchers.
This paper studies a stylized, yet natural, learning-to-rank problem and points out the critical incorrectness of a widely used nearest neighbor algorithm. We consider a model with n agents (users) {xi}i∈[n] and m alternatives (items) {yj}j∈[m], each of which is associated with a latent feat…
Paper proves BGW tau-function can be represented as Q-polynomials.
problem Enumerative geometric interpretations of BGW tau-function.
method Proves BGW tau-functions are hypergeometric tau functions of BKP hierarchy.
result Original BGW tau-function can be represented as a linear combination of Schur Q-polynomials.
Super tau-covers extend bihamiltonian hierarchies' symmetries.
problem Extending symmetries of bihamiltonian hierarchies.
method Constructing super tau-covers for bihamiltonian integrable hierarchies.
result Symmetries of bihamiltonian hierarchies extended to super tau-covers.
This paper fills in local bounds for Spearman's footrule and Gini's gamma measures of association.
problem Local bounds for bivariate copulas with respect to Spearman's footrule and Gini's gamma measures.
method Computing quasi-copulas that are not copulas for certain values of the measures.
result Presented local bounds for Spearman's footrule and Gini's gamma measures.
We present a stochastic analysis of a data set consisiting of 10^6 quotes of the US Doller - German Mark exchange rate. Evidence is given that the price changes x(tau) upon different delay times tau can be described as a Markov process evolving in tau. Thus, the tau-dependence of the probability density function (pdf) …
Constructs integrable hierarchies for generalized Frobenius manifolds with non-flat unity.
problem Integrable hierarchies for generalized Frobenius manifolds with non-flat unity.
method Constructs a bihamiltonian integrable hierarchy of hydrodynamic type.
result Integrable hierarchy possesses Virasoro symmetries and a tau structure.
Proves a formula for Kontsevich-Witten tau-function using Schur Q-polynomials.
problem Proving the Kontsevich-Witten tau-function formula.
method Directly shows Q-polynomial expansion satisfies Virasoro constraints.
result Direct proof of the formula without matrix model.
We propose new positive definite kernels for permutations. First we introduce a weighted version of the Kendall kernel, which allows to weight unequally the contributions of different item pairs in the permutations depending on their ranks. Like the Kendall kernel, we show that the weighted version is invariant to rela…
Improved portfolio optimization using Kendall-like correlation coefficients.
problem Accurate estimation of eigenvectors in data-poor regimes for portfolio optimization.
method Developed generalized correlation coefficients based on Kendall's rank correlation.
result Markowitz portfolios with lower out-of-sample risk using these coefficients.
There is a general method for constructing a soliton hierarchy from a splitting of a loop group as a positive and a negative sub-groups together with a commuting linearly independent sequence in the positive Lie subalgebra. Many known soliton hierarchies can be constructed this way. The formal inverse scattering associ…
We use grid diagrams to investigate the Ozsvath-Szabo concordance invariant tau, and to prove that |tau(K_1)-tau(K_2)|<=g, whenever there is a genus g knot cobordism joining K_1 to K_2. This leads to an entirely grid diagram-based proof of Kronheimer-Mrowka's theorem, formerly known as the Milnor conjecture.
A new algorithm for parallel transport on shape spaces is presented and compared to existing methods.
problem Statistical analysis of shape data, especially in time series and optimization.
method Pole ladder algorithm for parallel transport on Kendall shape spaces, compared to integration methods.
result The pole ladder algorithm is a more efficient method for parallel transport.