Amodal intra-class instance segmentation: Synthetic datasets and benchmark

Jiayang Ao, Qiuhong Ke, Krista A. Ehinger

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

Abstract

Images of realistic scenes often contain intra-class objects that are heavily occluded from each other, making the amodal perception task that requires parsing the occluded parts of the objects challenging. Although important for downstream tasks such as robotic grasping systems, the lack of large-scale amodal datasets with detailed annotations makes it difficult to model intra-class occlusions explicitly. This paper introduces two new amodal datasets for image amodal completion tasks, which contain a total of over 267K images of intra-class occlusion scenarios, annotated with multiple masks, amodal bounding boxes, dual order relations and full appearance for instances and background. We also present a point-supervised scheme with layer priors for amodal instance segmentation specifically designed for intra-class occlusion scenarios1. Experiments show that our weakly supervised approach outperforms the SOTA fully supervised methods, while our layer priors design exhibits remarkable performance improvements in the case of intra-class occlusion in both synthetic and real images.

Original languageEnglish
Title of host publicationProceedings - 2024 IEEE Winter Conference on Applications of Computer Vision, WACV 2024
EditorsEric Mortensen
Place of PublicationPiscataway NJ USA
PublisherIEEE, Institute of Electrical and Electronics Engineers
Pages280-289
Number of pages10
ISBN (Electronic)9798350318920
ISBN (Print)9798350318937
DOIs
Publication statusPublished - 2024
EventIEEE Winter Conference on Applications of Computer Vision 2024 - Waikoloa, United States of America
Duration: 4 Jan 20248 Jan 2024
https://wacv2024.thecvf.com/ (Website)
https://ieeexplore.ieee.org/xpl/conhome/10483279/proceeding (Proceedings)

Conference

ConferenceIEEE Winter Conference on Applications of Computer Vision 2024
Abbreviated titleWACV 2024
Country/TerritoryUnited States of America
CityWaikoloa
Period4/01/248/01/24
Internet address

Keywords

  • Algorithms
  • Datasets and evaluations
  • Image recognition and understanding

Cite this