Gallery D.C. auto-created GUI component gallery for design search and knowledge discovery

Sidong Feng, Chunyang Chen, Zhenchang Xing

Research output: Chapter in Book/Report/Conference proceedingConference PaperOther

6 Citations (Scopus)


GUI design is an integral part of software development. The process of designing a mobile application typically starts with the ideation and inspiration search from existing designs. However, existing information-retrieval based, and database-query based methods cannot efficiently gain inspirations in three requirements: design practicality, design granularity and design knowledge discovery. In this paper we propose a web application, called Gallery D.C. that aims to facilitate the process of user interface design through real world GUI component search. Gallery D.C. indexes GUI compo-nent designs using reverse engineering and deep learning based computer vision techniques on millions of real world applications. To perform an advanced design search and knowledge discovery, our approach extracts information about size, color, component type, and text information to help designers explore multi-faceted design space and distill higher-order of design knowledge. Gallery D.C. is well received via an informal evaluation with 7 professional designers.Web Link: Video Link:

Original languageEnglish
Title of host publicationProceedings - 2022 ACM/IEEE 44th International Conference on Software Engineering
Subtitle of host publicationCompanion Proceedings, ICSE-Companion 2022
EditorsMatthew B. Dwyer
Place of PublicationNew York NY USA
PublisherAssociation for Computing Machinery (ACM)
Number of pages5
ISBN (Electronic)9781665495981
ISBN (Print)9781665495998
Publication statusPublished - 2022
EventInternational Conference on Software Engineering 2022: Software Engineering in Society - Pittsburgh, United States of America
Duration: 22 May 202227 May 2022
Conference number: 44th (Proceedings) (Website)

Publication series

NameProceedings - International Conference on Software Engineering
PublisherAssociation for Computing Machinery (ACM)
ISSN (Print)0270-5257


ConferenceInternational Conference on Software Engineering 2022
Abbreviated titleICSE-SEIS 2022
Country/TerritoryUnited States of America
Internet address


  • • Software and its engineering;

Cite this