TY - GEN
T1 - A machine learning approach to link prediction for interlinked documents
AU - Kc, Milly
AU - Chau, Rowena
AU - Hagenbuchner, Markus
AU - Tsoi, Ah Chung
AU - Lee, Vincent
PY - 2010
Y1 - 2010
N2 - This paper provides an explanation to how a recently developed machine learning approach, namely the Probability Measure Graph Self-Organizing Map (PM-GraphSOM) can be used for the generation of links between referenced or otherwise interlinked documents. This new generation of SOM models are capable of projecting generic graph structured data onto a fixed sized display space. Such a mechanism is normally used for dimension reduction, visualization, or clustering purposes. This paper shows that the PM-GraphSOM training algorithm "inadvertently" encodes relations that exist between the atomic elements in a graph. If the nodes in the graph represent documents, and the links in the graph represent the reference (or hyperlink) structure of the documents, then it is possible to obtain a set of links for a test document whose link structure is unknown. A significant finding of this paper is that the described approach is scalable in that links can be extracted in linear time. It will also be shown that the proposed approach is capable of predicting the pages which would be linked to a new document, and is capable of predicting the links to other documents from a given test document. The approach is applied to web pages from Wikipedia, a relatively large XML text database consisting of many referenced documents.
AB - This paper provides an explanation to how a recently developed machine learning approach, namely the Probability Measure Graph Self-Organizing Map (PM-GraphSOM) can be used for the generation of links between referenced or otherwise interlinked documents. This new generation of SOM models are capable of projecting generic graph structured data onto a fixed sized display space. Such a mechanism is normally used for dimension reduction, visualization, or clustering purposes. This paper shows that the PM-GraphSOM training algorithm "inadvertently" encodes relations that exist between the atomic elements in a graph. If the nodes in the graph represent documents, and the links in the graph represent the reference (or hyperlink) structure of the documents, then it is possible to obtain a set of links for a test document whose link structure is unknown. A significant finding of this paper is that the described approach is scalable in that links can be extracted in linear time. It will also be shown that the proposed approach is capable of predicting the pages which would be linked to a new document, and is capable of predicting the links to other documents from a given test document. The approach is applied to web pages from Wikipedia, a relatively large XML text database consisting of many referenced documents.
UR - http://www.scopus.com/inward/record.url?scp=77955313484&partnerID=8YFLogxK
U2 - 10.1007/978-3-642-14556-8_34
DO - 10.1007/978-3-642-14556-8_34
M3 - Conference Paper
AN - SCOPUS:77955313484
SN - 3642145558
SN - 9783642145551
T3 - Lecture Notes in Computer Science
SP - 342
EP - 354
BT - Focused Retrieval and Evaluation - 8th International Workshop of the Initiative for the Evaluation of XML Retrieval, INEX 2009, Revised and Selected Papers
PB - Springer
T2 - 8th International Workshop of the Initiative for the Evaluation of XML Retrieval, INEX 2009
Y2 - 7 December 2009 through 9 December 2009
ER -