Modelling local deep convolutional neural network features to improve fine-grained image classification

Zongyuan Ge, Chris McCool, Conrad Sanderson, Peter Corke

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

29 Citations (Scopus)


We propose a local modelling approach using deep convolutional neural networks (CNNs) for fine-grained image classification. Recently, deep CNNs trained from large datasets have considerably improved the performance of object recognition. However, to date there has been limited work using these deep CNNs as local feature extractors. This partly stems from CNNs having internal representations which are high dimensional, thereby making such representations difficult to model using stochastic models. To overcome this issue, we propose to reduce the dimensionality of one of the internal fully connected layers, in conjunction with layer-restricted retraining to avoid retraining the entire network. The distribution of low-dimensional features obtained from the modified layer is then modelled using a Gaussian mixture model. Comparative experiments show that considerable performance improvements can be achieved on the challenging Fish and UEC FOOD-100 datasets.

Original languageEnglish
Title of host publication2015 IEEE International Conference on Image Processing (ICIP 2015)
EditorsFabrice Labeau, Jean-Philippe Thiran
Place of PublicationPiscataway NJ USA
PublisherIEEE, Institute of Electrical and Electronics Engineers
Number of pages5
ISBN (Electronic)9781479983391
ISBN (Print)9781479983407
Publication statusPublished - 9 Dec 2015
Externally publishedYes
EventIEEE International Conference on Image Processing 2015 - Quebec City, Canada
Duration: 27 Sept 201530 Sept 2015
Conference number: 22nd (Proceedings)


ConferenceIEEE International Conference on Image Processing 2015
Abbreviated titleICIP 2015
CityQuebec City
Internet address


  • deep convolutional neural networks
  • fine-grained classification
  • Gaussian mixture models
  • session variation modelling

Cite this