Arbitrarily-oriented multi-lingual text detection in video

Vijeta Khare, Palaiahnakote Shivakumara, Raveendran Paramesran, Michael Blumenstein

Research output: Contribution to journalArticleResearchpeer-review

22 Citations (Scopus)


Text detection in arbitrarily-oriented multi-lingual video is an emerging area of research because it plays a vital role for developing real-time indexing and retrieval systems. In this paper, we propose to explore moments for identifying text candidates. We introduce a novel idea for determining automatic windows to extract moments for tackling multi-font and multi-sized text in video based on stroke width information. The temporal information is explored to find deviations between moving and non-moving pixels in successive frames iteratively, which results in static clusters containing caption text and dynamic clusters containing scene text, as well as background pixels. The gradient directions of pixels in static and dynamic clusters are analyzed to identify the potential text candidates. Furthermore, boundary growing is proposed that expands the boundary of potential text candidates until it finds neighbor components based on the nearest neighbor criterion. This process outputs text lines appearing in the video. Experimental results on standard video data, namely, ICDAR 2013, ICDAR 2015, YVT videos and on our own English and Multi-lingual videos demonstrate that the proposed method outperforms the state-of-the-art methods.

Original languageEnglish
Pages (from-to)16625-16655
Number of pages31
JournalMultimedia Tools and Applications
Issue number15
Publication statusPublished - 1 Aug 2017
Externally publishedYes


  • Arbitrarily-oriented text detection
  • Caption text
  • Higher order moments
  • Multi-lingual text detection
  • Region growing
  • Stroke width distance, dynamic window

Cite this