Visualizes classification accuracy and label bias in neural nets and trees.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Extends Fisher's Discriminant Analysis for interval-valued data.
Efficient medoid-based Silhouette method speeds up clustering evaluation.
A new medoid-based Silhouette method selects optimal cluster numbers efficiently.
In this work, we introduce a deep-structured conditional random field (DS-CRF) model for the purpose of state-based object silhouette tracking. The proposed DS-CRF model consists of a series of state layers, where each state layer spatially characterizes the object silhouette at a particular point in time. The interact…
Automate residual plot assessment with R package and Shiny application
This research optimizes Andrews plots for better visual clarity in high-dimensional data.
New method estimates causal effects in complex spaces using topological structures.
3D filament plots visualize curves in datasets, avoiding visual clutter.
TDA improves FX clustering quality over traditional methods.
In practical applications of machine learning, it is necessary to look beyond standard metrics such as test accuracy in order to validate various qualitative properties of a model. Partial dependence plots (PDP), including instance-specific PDPs (i.e., ICE plots), have been widely used as a visual tool to understand or…
Used to investigate the presence of distinctive recurrent behaviours in natural processes, the recurrence plots can be applied to the analysis of economic data, and, in particular, to the characterization of exchange rates of currencies too. In this paper, we will show that these plots are able to characterize the peri…
One aim of data mining is the identification of interesting structures in data. For better analytical results, the basic properties of an empirical distribution, such as skewness and eventual clipping, i.e. hard limits in value ranges, need to be assessed. Of particular interest is the question of whether the data orig…
Pareto distributions, and power laws in general, have demonstrated to be very useful models to describe very different phenomena, from physics to finance. In recent years, the econophysical literature has proposed a large amount of papers and models justifying the presence of power laws in economic data. Most of the ti…
Paper exposes vulnerabilities in interpreting machine learning models using adversarial attacks on PD plots.
Introduces PIT-plot for prioritizing projects based on their impact.
Charts are an excellent way to convey patterns and trends in data, but they do not facilitate further modeling of the data or close inspection of individual data points. We present a fully automated system for extracting the numerical values of data points from images of scatter plots. We use deep learning techniques t…
The paper challenges the validity of cluster validity measures in unsupervised learning.
PLOT uses optimal transport to find neural site handles for causal abstraction.
Develops Austen plots for assessing bias from unobserved confounding in observational studies.
The shape of an object is an important characteristic for many vision problems such as segmentation, detection and tracking. Being independent of appearance, it is possible to generalize to a large range of objects from only small amounts of data. However, shapes represented as silhouette images are challenging to mode…
Interpreting a nonparametric regression model with many predictors is known to be a challenging problem. There has been renewed interest in this topic due to the extensive use of machine learning algorithms and the difficulty in understanding and explaining their input-output relationships. This paper develops a unifie…
Plots show miscalibration directly as slopes of secant lines.
Computer vision model automates residual plot assessment for diagnosing model assumptions.
Study predicts synchronization state of financial time series using cross-recurrence plots.
A new method detects interactions in machine learning models.
Deep Learning has managed to push boundaries in a wide variety of tasks. One area of interest is to tackle problems in reasoning and understanding, with an aim to emulate human intelligence. In this work, we describe a deep learning model that addresses the reasoning task of question-answering on categorical plots. We …
The Average Silhouette Width (ASW; Rousseeuw (1987)) is a popular cluster validation index to estimate the number of clusters. Here we address the question whether it also is suitable as a general objective function to be optimized for finding a clustering. We will propose two algorithms (the standard version OSil and …
KM-GPT automates IPD reconstruction from KM plots with high accuracy and scalability.
The size distribution of land plots is a result of land allocation processes in the past. In the absence of regulation this is a Markov process leading an equilibrium described by a probabilistic equation used commonly in the insurance and financial mathematics. We support this claim by analyzing the distribution of tw…
The paper investigates how irrelevant features affect clustering performance.
The paper contains a short review of techniques examining regional wealth inequalities based on recently published research work but is also presenting unpublished features. The data pertains to Italy (IT), over the period 2007-2011: the number of cities in regions, the number of inhabitants in cities and in regions, a…
This text discusses several popular explanatory methods that go beyond the error measurements and plots traditionally used to assess machine learning models. Some of the explanatory methods are accepted tools of the trade while others are rigorously derived and backed by long-standing theory. The methods, decision tree…
This paper compares imputation and direct parameter estimation methods for missing data in correlation matrix visualization.
Study compares Bitcoin and Ethereum tail behavior using Q-Q plots.
Recently, our group has published two papers that have received some attention in the finance community. One is about the profitability of trend following strategies over 200 years, the second is about the correlation between the profitability of "Risk Premia" and their skewness. In this short note, we present two addi…
We propose a procedure for supervised classification that is based on potential functions. The potential of a class is defined as a kernel density estimate multiplied by the class's prior probability. The method transforms the data to a potential-potential (pot-pot) plot, where each data point is mapped to a vector of …
A new method clusters malware data more effectively.
According to the Loss Distribution Approach, the operational risk of a bank is determined as 99.9% quantile of the respective loss distribution, covering unexpected severe events. The 99.9% quantile can be considered a tail event. As supported by the Pickands-Balkema-de Haan Theorem, tail events exceeding some high thr…
Obesity is an important concern in public health, and Body Mass Index is one of the useful (and proliferant) measures. We use Convolutional Neural Networks to determine Body Mass Index from photographs in a study with 161 participants. Low data, a common problem in medicine, is addressed by reducing the information in …
Develops exact and invariant study-based decompositions for network meta-analysis.
A phase plot of the oil economy is built using the literature data of world oil production, price, and EROEI (Energy Returned on Energy Invested). An analogy between the oil economy and the Benard convection is proposed; some methods of interpretation and forecast of the system behavior are also shown based on "phase p…
A unified clustering approach that can estimate number of clusters and produce clustering against this number simultaneously is proposed. Average silhouette width (ASW) is a widely used standard cluster quality index. A distance based objective function that optimizes ASW for clustering is defined. The proposed algorit…
Study tests rough fractional volatility model across different time scales, revealing new volatility patterns.
Proposes DISCO, the first CVI for density-based clustering with noise.
Equal-volume polygons are obtained from adequate discretizations of curves in 3-space, contained or not in surfaces. In this paper we explore the similarities of these polygons with the affine arc-length parameterized smooth curves to develop a theory of discrete affine invariants. Besides obtaining discrete affine inv…
New approach predicts stock price synchronization using RNNs and LSTMs.
SHAP explains boosted trees with additively modeled features.