The adjusted Rand index (ARI) is commonly used in cluster analysis to measure the degree of agreement between two data partitions. Since its introduction, exploring the situations of extreme agreement and disagreement under different circumstances has been a subject of interest, in order to achieve a better understandi…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “Adjusted Rand Index”
Proposes new random models for fuzzy clustering similarity measures.
problem Challenges in choosing a random model for fuzzy clustering similarity measures.
method Introduces three intuitive and explainable random models for fuzzy clusterings.
result Each random model has distinct behavior, emphasizing the importance of accurate model selection.
The misclassification error distance and the adjusted Rand index are two of the most commonly used criteria to evaluate the performance of clustering algorithms. This paper provides an in-depth comparison of the two criteria, aimed to better understand exactly what they measure, their properties and their differences. …
Meta-learning neural networks for better clustering representations.
problem Improving clustering performance with appropriate representations.
method Meta-learning method that trains neural networks for representations using VB inference with an infinite Gaussian mixture model.
result The method achieves higher clustering performance than existing methods.
In unsupervised machine learning, agreement between partitions is commonly assessed with so-called external validity indices. Researchers tend to use and report indices that quantify agreement between two partitions for all clusters simultaneously. Commonly used examples are the Rand index and the adjusted Rand index. …
The goal of lifetime clustering is to develop an inductive model that maps subjects into clusters according to their underlying (unobserved) lifetime distribution. We introduce a neural-network based lifetime clustering model that can find cluster assignments by directly maximizing the divergence between the empiri…
Paper addresses xVA models for market-implied skew and smile.
problem Capturing market-implied skew and smile in xVA calculations.
method Developed a state-dependent SDE combining Hull-White models with RAnD technique.
result Demonstrated significant effect of skew and smile on xVA calculations.
Adjusted for chance measures are widely used to compare partitions/clusterings of the same data set. In particular, the Adjusted Rand Index (ARI) based on pair-counting, and the Adjusted Mutual Information (AMI) based on Shannon information theory are very popular in the clustering community. Nonetheless it is an open …
The main goal of this study is to extract a set of brain networks in multiple time-resolutions to analyze the connectivity patterns among the anatomic regions for a given cognitive task. We suggest a deep architecture which learns the natural groupings of the connectivity patterns of human brain in multiple time-resolu…
A new measure DCSI quantifies separability for density-based clustering.
problem Quantifying meaningful clusters in data sets.
method Developed a new separability measure DCSI based on separation and connectedness.
result Correctly identifies touching or overlapping classes that do not correspond to meaningful density-based clusters.
A system is presented that segments, clusters and predicts musical audio in an unsupervised manner, adjusting the number of (timbre) clusters instantaneously to the audio input. A sequence learning algorithm adapts its structure to a dynamically changing clustering tree. The flow of the system is as follows: 1) segment…
In mixture model-based clustering applications, it is common to fit several models from a family and report clustering results from only the `best' one. In such circumstances, selection of this best model is achieved using a model selection criterion, most often the Bayesian information criterion. Rather than throw awa…
A new measure normalizes clustering accuracy to evaluate algorithms better.
problem Evaluation of clustering algorithms is challenging due to limitations of existing measures.
method Proposes a new, normalised clustering accuracy measure.
result The new measure identifies worst-case scenarios and is more interpretable.
CDL index improves clustering validation for non-convex data.
problem Selecting clustering algorithms and hyperparameters without labeled data.
method CDL uses compactness, centers, and covariances to compute a probabilistic description length bound.
result CDL outperforms conventional CVIs on synthetic and image benchmarks.
Study EM and GD for clustering with penalties for misspecification and high dimensions.
problem Clustering with misspecification and high-dimensional data.
method Model-based Gaussian Mixture Models, EM algorithm, GD optimization with AD, penalized likelihood.
result GD outperforms EM on high-dimensional data but both have poor cluster interpretation.
A new clustering framework optimizes customer search data for personalized travel recommendations.
problem Personalized travel recommendations based on customer search data.
method Multi-objective optimization-based clustering ensemble framework.
result Optimizes diversity in clustering ensemble search space and automatically determines the number of clusters.
Unified framework for comparing clusterings from information-theoretic and pair-counting perspectives.
problem Divergent evaluations of unsupervised models due to different clustering similarity measures.
method Developed an analytical framework that unifies pair-counting and information-theoretic clustering similarity measures.
result Unified framework clarifies when and why the two regimes diverge and provides a principled basis for selecting and interpreting clustering similarity measures.
STICC clusters geographic objects considering both spatial contiguity and attributes.
problem Discovering repeated geographic patterns with spatial contiguity.
method Spatial Toeplitz Inverse Covariance-Based Clustering (STICC) method.
result STICC significantly outperforms baseline methods in adjusted rand index and macro-F1 score.
Mixtures of Unigrams are one of the simplest and most efficient tools for clustering textual data, as they assume that documents related to the same topic have similar distributions of terms, naturally described by Multinomials. When the classification task is particularly challenging, such as when the document-term ma…
Study compares clustering methods for mixed-type data.
problem Challenges in clustering mixed-type data.
method Distance-based (k-prototypes, PDQ, convex k-means), probabilistic (KAY-means, MBNs, LCM).
result KAMILA, LCM, and k-prototypes perform best.
KLD token adjusts supply based on macroeconomic debt index, creating deflationary effect.
problem Managing deflationary pressures in digital assets.
method Debt-indexed supply adjustments linked to macroeconomic data.
result Deflationary mechanism strengthens as debt rises.
This paper identifies and analyzes biases in risk-adjusted index weighting methods, affecting social welfare and market fairness.
problem Biases in risk-adjusted index weighting methods lead to tracking errors and fraud in indices and ETFs.
method Characterizes and analyzes the biases and adverse effects of risk-adjusted index weighting methods.
result These biases reduce social welfare and can enable harmful arbitrage activities.
New star-shaped acceptability indexes generalize existing methods.
problem Generalizing existing acceptability measures.
method Characterizing acceptability indexes through star-shaped risk measures and sets.
result Introducing concrete examples linked to various financial measures.
New method approximates M-estimator and predictions without solving fixed-point equations.
problem Characterize behavior of M-estimator and predictions in single index models.
method Develops data-driven observable adjustments to proximal operators.
result Empirical distributions of M-estimator and predictions are approximated without solving fixed-point equations.
New metric improves clustering in persistent homology.
problem Improving clustering accuracy in persistent homology.
method Defined a new non-archimedean cophenetic metric.
result Cophenetic metric enhances clustering quality and inter-relations.
New k-means method handles random data better than traditional techniques.
problem Limitations of traditional clustering methods in random data.
method Probabilistic metric space with random normed k-means (RNKM).
result RNKM outperforms traditional methods in complex clustering scenarios.
Paper introduces Arte-Blue Chip Index for diversifying portfolios with art investments.
problem Evaluating blue-chip art as a viable asset class for diversification.
method Developed Arte-Blue Chip Index tracking top-performing artists over 24 years.
result 20% allocation of blue-chip art in a diversified portfolio increases risk-adjusted returns by 20%.
The study of genetic variants can help find correlating population groups to identify cohorts that are predisposed to common diseases and explain differences in disease susceptibility and how patients react to drugs. Machine learning algorithms are increasingly being applied to identify interacting GVs to understand th…
Randomizes AD models for better option pricing.
problem Inconsistent option pricing with affine models.
method Randomization of AD models with exogenous stochasticity.
result RAnD models allow for better calibration and consistent pricing.
Visual summarization of clinical data collected on patients contained within the electronic health record (EHR) may enable precise and rapid triage at the time of patient presentation to an emergency department (ED). The triage process is critical in the appropriate allocation of resources and in anticipating eventual …
The paper investigates how irrelevant features affect clustering performance.
problem The challenge of identifying relevant features in unsupervised clustering tasks.
method Investigation of clustering performance with added irrelevant features.
result Different types of irrelevant features impact clustering outcomes differently.
New method clusters matrix-valued data by latent variables.
problem Clustering matrix-valued data with hidden structure.
method Latent variable model with hierarchical clustering.
result Algorithm attains clustering consistency in high dimensions.
We consider the problem of pricing derivatives written on some industrial loss index via utility indifference pricing. The industrial loss index is modelled by a compound Poisson process and the insurer can adjust her portfolio by choosing the risk loading, which in turn determines the demand. We compute the price of a…
It has been noticed that some external CVIs exhibit a preferential bias towards a larger or smaller number of clusters which is monotonic (directly or inversely) in the number of clusters in candidate partitions. This type of bias is caused by the functional form of the CVI model. For example, the popular Rand index (R…
Exchange Traded Funds (ETFs) have been gaining increasing popularity in the investment community as is evidenced by the high growth both in the number of ETFs and their net assets since 2000. As ETFs are in nature similar to index mutual funds, in this paper we examined if this growing demand for ETFs can be explained …
The Hype Index measures media attention to equities using NLP.
problem Quantifying media attention to equities for volatility analysis.
method Constructs News Count-Based and Capitalization Adjusted Hype Indices using NLP.
result The Hype Index family provides valuable tools for stock volatility analysis.
Unsupervised image segmentation aims at clustering the set of pixels of an image into spatially homogeneous regions. We introduce here a class of Bayesian nonparametric models to address this problem. These models are based on a combination of a Potts-like spatial smoothness component and a prior on partitions which is…
Study examines volatility-based strategy for Chinese ETF options, improving returns in volatile markets.
problem Lack of effective trading strategies in volatile Chinese equity markets.
method Volatility forecasting using GARCH models to dynamically adjust positions and exposures.
result Dynamic adjustment of positions and exposures enhances returns in volatile markets.
This paper proposes a Lasso-type estimator for a high-dimensional sparse parameter identified by a single index conditional moment restriction (CMR). In addition to this parameter, the moment function can also depend on a nuisance function, such as the propensity score or the conditional choice probability, which we es…
Sentiment analysis of DAX40 stocks improves performance by 5.38% annually.
problem Creating a more responsive stock market index using sentiment analysis.
method Extract sentiment from news articles, adjust index weights based on sentiment, compare performance to existing indices.
result Sentiment index outperforms DAX40 by 7.51% annually, adjusted for costs.
The MAXFLAT low-pass filter improves factor adjustment for better portfolio performance in China's stock market.
problem Improving factor adjustment for better portfolio performance in China's stock market.
method Using MAXFLAT low-pass volatility model to adjust factors and construct portfolios.
result Adjusted factors by MAXFLAT volatility model show better performance in both large and small cap universes.
Enhanced indexation uses equity and index options for better performance.
problem Improving portfolio performance through enhanced indexation.
method Integrating index options into an enhanced indexation strategy based on second-order stochastic dominance.
result Introducing option strategies in enhanced indexation leads to improved out-of-sample performance.
A Volume-Price-Adjusted MACD Trading Strategy with Sensitivity Calibration for U.S. Equity Indicesq-fin.TR
Study improves MACD trading strategy with volume and price adjustments.
problem Signal lag and false signals in traditional MACD trading rules.
method Develops VP-MACD framework with sensitivity calibration.
result Proposed framework outperforms baseline MACD in profitability and risk-adjusted return.
The paper introduces mortgage-rate-adjusted home prices to help buyers and adjust housing indices.
problem Impact of mortgage rates on home prices and property purchase decisions.
method Derives mortgage-rate-adjusted 'effective price' and constructs a price-mortgage rate neutrality line.
result Mortgage rates significantly affect home prices over long periods but not during the pandemic.
We note a simple mechanism that may at least partially resolve several outstanding economic puzzles, including why the cyclically adjusted price to earnings ratio of the S&P 500 index has been oddly high for the past two decades, why gains to capital have outpaced gains to wages, and the persistence of the equity premi…
DOPE efficiently estimates ATE with complex covariates.
problem Efficient estimation of ATE from complex covariates.
method Proposed DOPE framework for efficient adjustment.
result DOPE retains efficiency even with highly predictive covariates.
Two types of zeroth-order stochastic algorithms have recently been designed for nonconvex optimization respectively based on the first-order techniques SVRG and SARAH/SPIDER. This paper addresses several important issues that are still open in these methods. First, all existing SVRG-type zeroth-order algorithms suffer …
Paper defines and proves a new analytic index for Fredholm operators.
problem Defining the analytic index rigorously for families of Fredholm operators.
method Based on Segal's ideas, new definition under weaker continuity assumptions.
result New definition agrees with Atiyah-Singer index when applicable.