Wordfence: text detection in natural images with border awareness

Andrei Polzounov, Artsiom Ablavatski, Sergio Escalera, Shijian Lu, Jianfei Cai

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

11 Citations (Scopus)


In recent years, text recognition has achieved remarkable success in recognizing scanned document text. However, word recognition in natural images is still an open problem, which generally requires time consuming post-processing steps. We present a novel architecture for individual word detection in scene images based on semantic segmentation. Our contributions are twofold: the concept of WordFence, which detects border areas surrounding each individual word and a novel pixelwise weighted softmax loss function which penalizes background and emphasizes small text regions. WordFence ensures that each word is detected individually, and the new loss function provides a strong training signal to both text and word border localization. The proposed technique avoids intensive post-processing, producing an end-to-end word detection system. We achieve superior localization recall on common benchmark datasets - 92% recall on ICDAR11 and ICDAR13 and 63% recall on SVT. Furthermore, our end-to-end word recognition system achieves state-of-the-art 86% F-Score on ICDAR13.

Original languageEnglish
Title of host publication2017 IEEE International Conference on Image Processing - Proceedings
EditorsJiebo Luo, Wenjun Zeng, Yu-Jin Zhang
Place of PublicationPiscataway NJ USA
PublisherIEEE, Institute of Electrical and Electronics Engineers
Number of pages5
ISBN (Electronic)9781509021758, 9781509021741
ISBN (Print)9781509021765
Publication statusPublished - 2017
Externally publishedYes
EventIEEE International Conference on Image Processing 2017 - China National Convention Center (CNCC), Beijing, China
Duration: 17 Sept 201720 Sept 2017
Conference number: 24th
https://ieeexplore.ieee.org/xpl/conhome/8267582/proceeding (Proceedings)


ConferenceIEEE International Conference on Image Processing 2017
Abbreviated titleICIP 2017
Internet address


  • CNN
  • Segmentation
  • Word detection

Cite this