Collaborative and privacy-preserving estimation of IP address space utilisation

Sebastian Zander, Lachlan L. H. Andrew, Grenville Armitage

    Research output: Contribution to journalArticleResearchpeer-review

    Abstract

    Exhaustion of the IPv4 address space is driving mitigation technologies, such as carrier-grade NAT or IPv6. Understanding this driver requires knowing how much allocated IPv4 space is actively used over time – a non-trivial goal due to privacy concerns and practical measurement challenges. To address this gap we present a collaborative and privacy-preserving capture-recapture (CR) technique for estimating IP address space utilisation. Public and private datasets of IP addresses observed by multiple independent collaborators can be combined for CR analysis, without any individual collaborator's privately observed addresses leaking to the others. We show that CR estimation is much more accurate than assuming all used addresses are observed, and that our scheme scales well to datasets of over a billion addresses across several collaborators. We estimate that 1.2 billion IPv4 addresses and 6.5 million /24 subnets were actively used at the end of 2014, and also analyse address usage depending on RIR and country.

    Original languageEnglish
    Pages (from-to)56-70
    Number of pages15
    JournalComputer Networks
    Volume119
    DOIs
    Publication statusPublished - 4 Jun 2017

    Keywords

    • Actively used IPv4 space
    • Privacy-preserving capture-recapture

    Cite this

    Zander, Sebastian ; Andrew, Lachlan L. H. ; Armitage, Grenville. / Collaborative and privacy-preserving estimation of IP address space utilisation. In: Computer Networks. 2017 ; Vol. 119. pp. 56-70.
    @article{49ee81b2668249a2beeaf11c77876c10,
    title = "Collaborative and privacy-preserving estimation of IP address space utilisation",
    abstract = "Exhaustion of the IPv4 address space is driving mitigation technologies, such as carrier-grade NAT or IPv6. Understanding this driver requires knowing how much allocated IPv4 space is actively used over time – a non-trivial goal due to privacy concerns and practical measurement challenges. To address this gap we present a collaborative and privacy-preserving capture-recapture (CR) technique for estimating IP address space utilisation. Public and private datasets of IP addresses observed by multiple independent collaborators can be combined for CR analysis, without any individual collaborator's privately observed addresses leaking to the others. We show that CR estimation is much more accurate than assuming all used addresses are observed, and that our scheme scales well to datasets of over a billion addresses across several collaborators. We estimate that 1.2 billion IPv4 addresses and 6.5 million /24 subnets were actively used at the end of 2014, and also analyse address usage depending on RIR and country.",
    keywords = "Actively used IPv4 space, Privacy-preserving capture-recapture",
    author = "Sebastian Zander and Andrew, {Lachlan L. H.} and Grenville Armitage",
    year = "2017",
    month = "6",
    day = "4",
    doi = "10.1016/j.comnet.2017.03.010",
    language = "English",
    volume = "119",
    pages = "56--70",
    journal = "Computer Networks",
    issn = "1389-1286",
    publisher = "Elsevier",

    }

    Collaborative and privacy-preserving estimation of IP address space utilisation. / Zander, Sebastian; Andrew, Lachlan L. H.; Armitage, Grenville.

    In: Computer Networks, Vol. 119, 04.06.2017, p. 56-70.

    Research output: Contribution to journalArticleResearchpeer-review

    TY - JOUR

    T1 - Collaborative and privacy-preserving estimation of IP address space utilisation

    AU - Zander, Sebastian

    AU - Andrew, Lachlan L. H.

    AU - Armitage, Grenville

    PY - 2017/6/4

    Y1 - 2017/6/4

    N2 - Exhaustion of the IPv4 address space is driving mitigation technologies, such as carrier-grade NAT or IPv6. Understanding this driver requires knowing how much allocated IPv4 space is actively used over time – a non-trivial goal due to privacy concerns and practical measurement challenges. To address this gap we present a collaborative and privacy-preserving capture-recapture (CR) technique for estimating IP address space utilisation. Public and private datasets of IP addresses observed by multiple independent collaborators can be combined for CR analysis, without any individual collaborator's privately observed addresses leaking to the others. We show that CR estimation is much more accurate than assuming all used addresses are observed, and that our scheme scales well to datasets of over a billion addresses across several collaborators. We estimate that 1.2 billion IPv4 addresses and 6.5 million /24 subnets were actively used at the end of 2014, and also analyse address usage depending on RIR and country.

    AB - Exhaustion of the IPv4 address space is driving mitigation technologies, such as carrier-grade NAT or IPv6. Understanding this driver requires knowing how much allocated IPv4 space is actively used over time – a non-trivial goal due to privacy concerns and practical measurement challenges. To address this gap we present a collaborative and privacy-preserving capture-recapture (CR) technique for estimating IP address space utilisation. Public and private datasets of IP addresses observed by multiple independent collaborators can be combined for CR analysis, without any individual collaborator's privately observed addresses leaking to the others. We show that CR estimation is much more accurate than assuming all used addresses are observed, and that our scheme scales well to datasets of over a billion addresses across several collaborators. We estimate that 1.2 billion IPv4 addresses and 6.5 million /24 subnets were actively used at the end of 2014, and also analyse address usage depending on RIR and country.

    KW - Actively used IPv4 space

    KW - Privacy-preserving capture-recapture

    UR - http://www.scopus.com/inward/record.url?scp=85016000342&partnerID=8YFLogxK

    U2 - 10.1016/j.comnet.2017.03.010

    DO - 10.1016/j.comnet.2017.03.010

    M3 - Article

    VL - 119

    SP - 56

    EP - 70

    JO - Computer Networks

    JF - Computer Networks

    SN - 1389-1286

    ER -