arXiv research

Algorithm extracts non-monotonic rules from statistical models using HUIM.

A new framework for mining high utility patterns in interval-based sequences.

The problem of finding itemsets that are statistically significantly enriched in a class of transactions is complicated by the need to correct for multiple hypothesis testing. Pruning untestable hypotheses was recently proposed as a strategy for this task of significant itemset mining. It was shown to lead to greater s…

CICLAD efficiently mines frequent closed itemsets from data streams with minimal memory usage.

Frequent Itemsets (FIs) mining is a fundamental primitive in data mining. It requires to identify all itemsets appearing in at least a fraction $θ$ of a transactional dataset $\mathcal{D}$. Often though, the ultimate goal of mining $\mathcal{D}$ is not an analysis of the dataset \emph{per se}, but the understanding of …

Proposes SCR-Apriori for efficient mining of SCR-patterns.

A new method for selecting high quality itemsets from a large collection.

Mining itemsets that are the most interesting under a statistical model of the underlying data is a commonly used and well-studied technique for exploratory data analysis, with the most recent interestingness models exhibiting state of the art performance. Continuing this highly promising line of work, we propose the f…

Assessing the quality of discovered results is an important open problem in data mining. Such assessment is particularly vital when mining itemsets, since commonly many of the discovered patterns can be easily explained by background knowledge. The simplest approach to screen uninteresting patterns is to compare the ob…

We present a novel algorithm, Westfall-Young light, for detecting patterns, such as itemsets and subgraphs, which are statistically significantly enriched in one of two classes. Our method corrects rigorously for multiple hypothesis testing and correlations between patterns through the Westfall-Young permutation proced…

This paper introduces the combinatorial Boolean model (CBM), which is defined as the class of linear combinations of conjunctions of Boolean attributes. This paper addresses the issue of learning CBM from labeled data. CBM is of high knowledge interpretability but naïve learning of it requires exponentially large compu…

In binary-transaction data-mining, traditional frequent itemset mining often produces results which are not straightforward to interpret. To overcome this problem, probability models are often used to produce more compact and conclusive results, albeit with some loss of accuracy. Bayesian statistics have been widely us…

The problem of multiple hypothesis testing arises when there are more than one hypothesis to be tested simultaneously for statistical significance. This is a very common situation in many data mining applications. For instance, assessing simultaneously the significance of all frequent itemsets of a single dataset entai…

Significant pattern mining, the problem of finding itemsets that are significantly enriched in one class of objects, is statistically challenging, as the large space of candidate patterns leads to an enormous multiple testing problem. Recently, the concept of testability was proposed as one approach to correct for mult…

In this article, we focus on distributed Apriori-based frequent itemsets mining. We present a new distributed approach which takes into account inherent characteristics of this algorithm. We study the distribution aspect of this algorithm and give a comparison of the proposed approach with a classical Apriori-like dist…

Pattern sampling has been proposed as a potential solution to the infamous pattern explosion. Instead of enumerating all patterns that satisfy the constraints, individual patterns are sampled proportional to a given quality measure. Several sampling algorithms have been proposed, but each of them has its limitations wh…

Method detects interactions for better CTR prediction.

We consider the problem of defining the significance of an itemset. We say that the itemset is significant if we are surprised by its frequency when compared to the frequencies of its sub-itemsets. In other words, we estimate the frequency of the itemset from the frequencies of its sub-itemsets and compute the deviatio…

OMBA learns product and user representations for better online market basket analysis.

FSR efficiently discovers significant patterns with few resampled datasets.

This study analyzes wireless network data using classification techniques.

DiPriMe forests use private medians to create balanced tree splits for privacy-protected data.

Proposes a new method for finding frequent closed patterns in transaction bases.

The paper corrects Bayesian neural network approximations to improve decision quality.

Data-driven anomaly detection methods suffer from the drawback of detecting all instances that are statistically rare, irrespective of whether the detected instances have real-world significance or not. In this paper, we are interested in the problem of specifically detecting anomalous instances that are known to have …

Scales gradual pattern discovery from imprecise data.

Privacy-preserving boosting algorithm for machine learning.

Bayesian method helps decision-makers find preferred solutions in multi-objective optimization.

This paper creates a tagging system for paintings using historical descriptions.

Game-theoretic analysis of mining gaps in blockchain systems.

Alpha-GPT mines new trading signals with human-AI interaction.

The paper explores how mining costs, rewards, and blockchain security are interconnected.

Data preprocessing improves data quality for robust data mining.

This paper categorizes and analyzes existing outlying aspect mining methods.

Game theory shows miners' hardware improvements don't centralize mining.

DataLearner simplifies data mining on Android devices.

This paper analyzes the profitability of selfish mining on blockchain, considering the risk of ruin.

Agricultural research has been profited by technical advances such as automation, data mining. Today, data mining is used in a vast areas and many off-the-shelf data mining system products and domain specific data mining application soft wares are available, but data mining in agricultural soil datasets is a relatively…

This paper tracks coin circulation in Bitcoin to identify miners and analyze mining pool structures.

We argue that the estimation of mutual information between high dimensional continuous random variables can be achieved by gradient descent over neural networks. We present a Mutual Information Neural Estimator (MINE) that is linearly scalable in dimensionality as well as in sample size, trainable through back-prop, an…

Study shows Bitcoin mining with surplus electricity can boost KEPCO's financial stability.

The problem of frequent pattern mining has been studied quite extensively for various types of data, including sets, sequences, and graphs. Somewhat surprisingly, another important type of data, namely rank data, has received very little attention in data mining so far. In this paper, we therefore addresses the problem…

Data mining enhances a heuristic for the Minimum Latency Problem.

Safe Pattern Pruning reduces pattern explosion in predictive pattern mining.

This document describes an approach to the problem of predicting dangerous seismic events in active coal mines up to 8 hours in advance. It was developed as a part of the AAIA'16 Data Mining Challenge: Predicting Dangerous Seismic Events in Active Coal Mines. The solutions presented consist of ensembles of various pred…

In January 3, 2009, Satoshi Nakamoto gave rise to the "Bitcoin Block Chain" creating the first block of the chain hashing on his computers central processing unit (CPU). Since then, the hash calculations to mine Bitcoin have been getting more and more complex, and consequently the mining hardware evolved to adapt to th…

MotiFiesta learns network motifs efficiently.

Study shows Bitcoin security tied to mining rewards and prices.