Learning accurate low-dimensional embeddings for a network is a crucial task as it facilitates many network analytics tasks. Moreover, the trained embeddings often require a significant amount of space to store, making storage and processing a challenge, especially as large-scale networks become more prevalent. In this paper, we present a novel semi-supervised network embedding and compression method, SNEQ, that is competitive with state-of-art embedding methods while being far more space- and time-efficient. SNEQ incorporates a novel quantisation method based on a self-attention layer that is trained in an end-to-end fashion, which is able to dramatically compress the size of the trained embeddings, thus reduces storage footprint and accelerates retrieval speed. Our evaluation on four real-world networks of diverse characteristics shows that SNEQ outperforms a number of state-of-the-art embedding methods in link prediction, node classification and node recommendation. Moreover, the quantised embedding shows a great advantage in terms of storage and time compared with continuous embeddings as well as hashing methods.
|Title of host publication
|Proceedings of The Thirty-Fourth AAAI Conference on Artificial Intelligence
|Vincent Conitzer, Fei Sha
|Place of Publication
|Palo Alto CA USA
|Association for the Advancement of Artificial Intelligence (AAAI)
|Number of pages
|Published - 2020
|AAAI Conference on Artificial Intelligence 2020 - New York, United States of America
Duration: 7 Feb 2020 → 12 Feb 2020
Conference number: 34th
|AAAI Conference on Artificial Intelligence
|AAAI Conference on Artificial Intelligence 2020
|United States of America
|7/02/20 → 12/02/20
|The Thirty-Fourth AAAI Conference on Artificial Intelligence was held on February 7–12, 2020 in New York, New York, USA. The surge in public interest in AI technologies, which we have witnessed over the past few years, continued to accelerate in 2019–2020, with the societal and economic impact of AI becoming a central point of public and government discussion worldwide. AAAI-20 saw submissions and attendance numbers that were records in the history of the AAAI series of conferences and continued its tradition of attracting top-quality papers from all areas of AI. We were excited to see increases in submissions across almost all areas.
The AAAI-20 program consisted of a core technical program of original research presentations, including a special track on AI for social impact and a sister conference track. It additionally featured a broad range of tutorials, workshops, invited talks, panels, student abstracts, a debate, and presentations by senior members. The program was rounded out by technical demonstrations, exhibits, an AI job fair, the AI in Practice program, a student outreach program, and a game night. The conference also continued its tradition of colocating with the long-running IAAI conference and the EAAI symposium, as well as the newer conference on AI, Ethics, and Society.