Mining significant association rules from uncertain data

Anshu Zhang, Wenzhong Shi, Geoffrey I. Webb

    Research output: Contribution to journalArticleResearchpeer-review

    15 Citations (Scopus)


    In association rule mining, the trade-off between avoiding harmful spurious rules and preserving authentic ones is an ever critical barrier to obtaining reliable and useful results. The statistically sound technique for evaluating statistical significance of association rules is superior in preventing spurious rules, yet can also cause severe loss of true rules in presence of data error. This study presents a new and improved method for statistical test on association rules with uncertain erroneous data. An original mathematical model was established to describe data error propagation through computational procedures of the statistical test. Based on the error model, a scheme combining analytic and simulative processes was designed to correct the statistical test for distortions caused by data error. Experiments on both synthetic and real-world data show that the method significantly recovers the loss in true rules (reduces type-2 error) due to data error occurring in original statistically sound method. Meanwhile, the new method maintains effective control over the familywise error rate, which is the distinctive advantage of the original statistically sound technique. Furthermore, the method is robust against inaccurate data error probability information and situations not fulfilling the commonly accepted assumption on independent error probabilities of different data items. The method is particularly effective for rules which were most practically meaningful yet sensitive to data error. The method proves promising in enhancing values of association rule mining results and helping users make correct decisions.

    Original languageEnglish
    Pages (from-to)928-963
    Number of pages36
    JournalData Mining and Knowledge Discovery
    Issue number4
    Publication statusPublished - 1 Jul 2016


    • Pattern discovery
    • Association rules
    • Statistical evaluation
    • Uncertain data

    Cite this