Message length formulation of Support Vector Machines for binary classification - a preliminary scheme

Lara Kornienko, David L Dowe, David W Albrecht

    Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

    6 Citations (Scopus)


    This paper presents a preliminary attempt at performing extrinsic binary classification by reformulating the Support Vector Machine (SVM) approach in a Bayesian Message Length framework. The reformulation uses the Minimum Message Length (MML) principle as a way of costing each hyperplane via a two-part message. This message defines a separating hyperplane. The length of this message is used as an objective function for a search through the hypothesis space of possible hyperplanes used to dichotomise a set of data points.

    Two preliminary MML implementations are presented here, which difier in the (Bayesian) coding schemes used and the search procedures. The generalisation ability of these two reformulations on both artificial and real data sets are compared against current implementations of Support Vector Machines - namely SVM light, the Lagrangian Support Vector Machine and SMOBR. It was found that, in general, all implementations improved as the size of the data sets increased. The MML implementations tended to perform best on the inseparable data sets and the real data set. Our preliminary MML scheme showed itself to be a strong competitor against the classical SVM, despite inefficiencies in the current scheme
    Original languageEnglish
    Title of host publicationAI 2002: Advances in Artificial Intelligence
    Subtitle of host publication15th Australian Joint Conference on Artificial Intelligence Canberra, Australia, December 2-6, 2002 Proceedings
    EditorsBob McKay, John Slaney
    Place of PublicationBerlin Germany
    Number of pages12
    ISBN (Print)3540001972
    Publication statusPublished - 2002
    EventAustralasian Joint Conference on Artificial Intelligence 2002 - Canberra, Australia
    Duration: 2 Dec 20026 Dec 2002
    Conference number: 15th (Proceedings)

    Publication series

    NameLecture Notes in Computer Science
    ISSN (Print)0302-9743


    ConferenceAustralasian Joint Conference on Artificial Intelligence 2002
    Abbreviated titleAI 2002
    Internet address

    Cite this