A machine learning approach to link prediction for interlinked documents

Milly Kc, Rowena Chau, Markus Hagenbuchner, Ah Chung Tsoi, Vincent Lee

    Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

    6 Citations (Scopus)

    Abstract

    This paper provides an explanation to how a recently developed machine learning approach, namely the Probability Measure Graph Self-Organizing Map (PM-GraphSOM) can be used for the generation of links between referenced or otherwise interlinked documents. This new generation of SOM models are capable of projecting generic graph structured data onto a fixed sized display space. Such a mechanism is normally used for dimension reduction, visualization, or clustering purposes. This paper shows that the PM-GraphSOM training algorithm "inadvertently" encodes relations that exist between the atomic elements in a graph. If the nodes in the graph represent documents, and the links in the graph represent the reference (or hyperlink) structure of the documents, then it is possible to obtain a set of links for a test document whose link structure is unknown. A significant finding of this paper is that the described approach is scalable in that links can be extracted in linear time. It will also be shown that the proposed approach is capable of predicting the pages which would be linked to a new document, and is capable of predicting the links to other documents from a given test document. The approach is applied to web pages from Wikipedia, a relatively large XML text database consisting of many referenced documents.

    Original languageEnglish
    Title of host publicationFocused Retrieval and Evaluation - 8th International Workshop of the Initiative for the Evaluation of XML Retrieval, INEX 2009, Revised and Selected Papers
    PublisherSpringer
    Pages342-354
    Number of pages13
    ISBN (Print)3642145558, 9783642145551
    DOIs
    Publication statusPublished - 2010
    Event8th International Workshop of the Initiative for the Evaluation of XML Retrieval, INEX 2009 - Brisbane, QLD, Australia
    Duration: 7 Dec 20099 Dec 2009

    Publication series

    NameLecture Notes in Computer Science
    PublisherSpringer
    Volume6203
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349

    Conference

    Conference8th International Workshop of the Initiative for the Evaluation of XML Retrieval, INEX 2009
    Country/TerritoryAustralia
    CityBrisbane, QLD
    Period7/12/099/12/09

    Cite this