Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

17335066 · May 202619922001200920172026
48 results for Jaccard index

This short article aims at demonstrate that the Intersection over Union (or Jaccard index) is not a submodular function. This mistake has been made in an article which is cited and used as a foundation in another article. The Intersection of Union is widely used in machine learning as a cost function especially for imb…

2018-09-03abs ↗pdf ↗

This project explores several Machine Learning methods to predict movie genres based on plot summaries. Naive Bayes, Word2Vec+XGBoost and Recurrent Neural Networks are used for text classification, while K-binary transformation, rank method and probabilistic classification with learned probability threshold are employe…

2018-01-15abs ↗pdf ↗

The minimization of loss functions is the heart and soul of Machine Learning. In this paper, we propose an off-the-shelf optimization approach that can minimize virtually any non-differentiable and non-decomposable loss function (e.g. Miss-classification Rate, AUC, F1, Jaccard Index, Mathew Correlation Coefficient, etc…

2019-05-24abs ↗pdf ↗

Proposes a new network to improve nuclei segmentation in histopathology images.

problem Challenges in separating overlapped nuclei in histopathology images.
method Introduces a bending loss regularized network to minimize contour points with large curvatures.
result Outperforms six state-of-the-art approaches on five quantitative metrics.

Extends Tanimoto kernel to real-valued functions.

problem Measuring similarity between real-valued functions.
method Unified representation of real-valued functions via sets, derived general form of the kernel, explicit feature representation, and smooth approximation.
result General Tanimoto kernel for real-valued functions.

It has been noticed that some external CVIs exhibit a preferential bias towards a larger or smaller number of clusters which is monotonic (directly or inversely) in the number of clusters in candidate partitions. This type of bias is caused by the functional form of the CVI model. For example, the popular Rand index (R…

2016-06-17abs ↗pdf ↗

C-MinHash reduces the number of permutations needed for MinHash from thousands to just two.

problem Approximating Jaccard similarity in large binary datasets using many permutations.
method Initial permutation followed by circulant shifting of a second permutation to generate hashes.
result C-MinHash achieves unbiased Jaccard similarity estimation with uniformly smaller variance.

Efficient methods for sparse random projections improve classification accuracy in very high-dimensional data.

problem Handling very high-dimensional sparse data efficiently.
method Non-iterative and iterative classification methods using sparse random projections and Jaccard kernel.
result Non-iterative methods yield larger, more accurate models than iterative methods.

JORC-UMAP improves UMAP by incorporating geometric and topological priors.

problem UMAP's local Euclidean distance assumption fails to capture intrinsic manifold geometry, leading to topological tearing and structural collapse.
method JORC-UMAP introduces Ollivier-Ricci curvature as a geometric prior and Jaccard similarity as a topological prior to reinforce edges and reduce redundant links.
result JORC-UMAP reduces tearing and collapse more effectively than standard UMAP and other DR methods, as measured by SVM accuracy and triplet preservation scores.

Conformal prediction fails under severe feature turnover in COVID-19 supply chain tasks.

problem Dealing with distribution shift in conformal prediction models.
method Using COVID-19 as a natural experiment across 8 supply chain tasks, analyzing SHAP explanations.
result Coverage drops vary widely (0% to 86.7%) and correlate with single-feature dependence.

CNN automates vitiligo lesion segmentation quickly and accurately.

problem Manual segmentation of vitiligo lesions is time-consuming and inconsistent.
method U-Net architecture with modified contracting path, followed by watershed algorithm refinement.
result CNN achieves 73.6% Jaccard Index, significantly outperforming state-of-the-art methods.

New algorithms optimize metrics for binary classification with class imbalance.

problem Optimizing metrics like Fβ, AM, Jaccard for imbalanced classes.
method Reformulates metric optimization as cost-sensitive learning, using surrogate loss functions.
result METRO algorithms provide strong theoretical guarantees and outperform baselines.

This study examined how the correlation and network structure of 30 global indices and 145 local Korean indices belonging to the KOSPI 200 have changed during the 13-year period, 2000-2012. The correlations among the indices were calculated. The results showed that although the average correlations of the global indice…

2014-02-07abs ↗pdf ↗

Confidence intervals improve evaluation of binary prediction rules in data mining.

problem Uncertainty in performance measures estimation from finite datasets.
method Asymptotic normal approximations for confidence intervals, with a blurring correction.
result Improved finite sample coverage probabilities and general performance measures inference.

Develops algorithms for optimizing multi-label metrics with provable guarantees.

problem Optimizing complex multi-label metrics like F-measure and Jaccard index.
method Principled learning algorithms based on H-consistency for generalized metrics.
result Provable HH-consistency bounds for multi-label metric optimization.

C-OPH improves One Permutation Hashing by using a shorter circulant permutation.

problem Improving the accuracy of One Permutation Hashing (OPH) for Jaccard similarity estimation.
method Develops a new densification method using a shorter circulant permutation.
result Achieves the smallest estimation variance for Jaccard similarity.

The automatic digitizing of paper maps is a significant and challenging task for both academia and industry. As an important procedure of map digitizing, the semantic segmentation section mainly relies on manual visual interpretation with low efficiency. In this study, we select urban planning maps as a representative …

2018-09-28abs ↗pdf ↗

Quantum Clustering is a powerful method to detect clusters in data with mixed density. However, it is very sensitive to a length parameter that is inherent to the Schrödinger equation. In addition, linking data points into clusters requires local estimates of covariance that are also controlled by length parameters. Th…

2019-02-14abs ↗pdf ↗

This study presents a multimodal machine learning model to predict ICD-10 diagnostic codes. We developed separate machine learning models that can handle data from different modalities, including unstructured text, semi-structured text and structured tabular data. We further employed an ensemble method to integrate all…

2018-10-31abs ↗pdf ↗

New STH distance finds patterns in event timeseries without resampling.

problem Lack of efficient analysis methods for event and state timeseries.
method Define STE-ts, propose STH, leveraging both time and state duration.
result Improved precision and computation time compared to resampled metrics.

Paper proposes a feature-wise change detection method for improving indoor positioning accuracy.

problem Improving the quality of reference fingerprint maps in indoor positioning systems.
method Inspired by RANSAC, the paper uses resampling of features to estimate intermediate locations and identifies candidate locations using MJI.
result The approach improves positioning accuracy by 20% and achieves 90% change detection accuracy.

We propose a new class of metrics on sets, vectors, and functions that can be used in various stages of data mining, including exploratory data analysis, learning, and result interpretation. These new distance functions unify and generalize some of the popular metrics, such as the Jaccard and bag distances on sets, Man…

2016-03-22abs ↗pdf ↗

Study on symmetric operators on non-compact manifolds, focusing on their index modulo 2.

problem Investigating elliptic operators with a specific symmetry and their index modulo 2.
method Analysis of Callias-type operators on non-compact manifolds, establishing mod 2 versions of index theorems.
result Established mod 2 versions of the Gromov-Lawson relative index theorem, Callias index theorem, and Boutet de Monvel's index theorem for Toeplitz operators.

New index formula connects numerical and KK-theoretic indices.

problem Equivariant index for proper group actions on manifolds.
method Developed a trace on group conjugacy classes to relate numerical and KK-theoretic indices.
result Shows that numerical index equals KK-theoretic index under certain conditions.

The p-index improves investment performance for NYSE stocks but not for SSE stocks.

problem Improving investment performance for stocks using the p-index.
method Comparing different p-ratio strategies and empirical efficient frontiers for SSE and NYSE stocks.
result The p-index enhances investment performance for NYSE stocks but not for SSE stocks.

Study Whittle index learning algorithms for restless bandits with constant stepsizes.

problem Optimizing decisions in restless multi-armed bandits with constant stepsizes.
method Developed Q-learning algorithms with constant stepsizes for index learning in restless bandits, extending to DQN and function approximations.
result The algorithms learn the Whittle index effectively.

We study bounded pseudoconvex domains in complex Euclidean space. We define an index associated to the boundary and show this new index is equivalent to the Diederich-Fornæss index defined in 1977. This connects the Diederich-Fornæss index to boundary conditions and refines the Levi pseudoconvexity. We also prove the $…

2017-01-01abs ↗pdf ↗