A hybrid missing data imputation method for constructing city mobility indices

Sanaz Nikfalazar, Chung-Hsing Yeh, Susan Elizabeth Bedingfield, Hadi Akbarzadeh Khorshidi

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

Abstract

An effective missing data imputation method is essential for data mining and knowledge discovery from a comprehensive database with missing values. This paper proposes a new hybrid imputation method to effectively deal with the missing data issue of the Mobility in Cities Database (MCD) to construct city mobility indices. The hybrid method integrates the advantages of decision trees and fuzzy clustering into an iterative algorithm for missing data imputation. Extensive experiments conducted on the MCD and three commonly used datasets demonstrate that the hybrid method outperforms other existing effective imputation methods. With the MCD’s missing values imputed by the hybrid method, and using factor analysis and principal component analysis, this paper constructs city mobility indices for 63 cities in the MCD based on the novel concept of city mobility supply and demand. The city mobility indices constructed under a hierarchical structure of mobility supply and demand indicators represent substantial city mobility knowledge discovered from mining the MCD. The proposed hybrid method represents a significant contribution to missing data imputation research.

Original languageEnglish
Title of host publicationData Mining - 16th Australasian Conference, AusDM 2018 Bahrurst, NSW, Australia, November 28–30, 2018 Revised Selected Papers
EditorsRafiqul Islam, Yun Sing Koh, Yanchang Zhao, Graco Warwick, David Stirling, Chang-Tsun Li, Zahidul Islam
Place of PublicationSingapore Singapore
PublisherSpringer
Pages135-148
Number of pages14
ISBN (Electronic)9789811366611
ISBN (Print)9789811366604
DOIs
Publication statusPublished - 2019
EventAustralasian Data Mining Conference 2018 - Bathurst, Australia
Duration: 28 Nov 201830 Nov 2018
Conference number: 16th
https://web.archive.org/web/20181122224709/https://ausdm18.ausdm.org/
https://dblp.org/db/conf/ausdm/ausdm2018.html (Proceedings)

Publication series

NameCommunications in Computer and Information Science
PublisherSpringer
Volume996
ISSN (Print)1865-0929
ISSN (Electronic)1865-0937

Conference

ConferenceAustralasian Data Mining Conference 2018
Abbreviated titleAusDM 2018
CountryAustralia
CityBathurst
Period28/11/1830/11/18
Internet address

Keywords

  • City mobility index
  • Decision tree
  • Factor analysis
  • Iterative fuzzy clustering
  • Missing data imputation
  • Principal component analysis

Cite this