Fast and robust perspective rectification of document images on a smartphone

This paper presents a perspective rectification framework for mobile device that is fast and robust to recovering the fronto-parallel view of perspectively distorted document images. The conventional approaches is too heavy to be implemented on a mobile device. In addition, they fails to reject the false case of the perspective rectification. To ameliorate such problems, the proposed framework is designed to pursue a fast and robust algorithm to detect horizontal and vertical vanishing points efficiently and robustly. Then, perspective rectification is performed using both horizontal and vertical vanishing points. In addition, the proposed framework has an adaptive scheme to detect the false case of the perspective rectification and skip the procedure without using the vertical vanishing point. Note that, the proposed framework is designed for consumer application so that bad results are rejected before they are shown for users. We demonstrate the performance of the proposed framework on various challenging examples to confirm that the proposed system is fast and robust in rectifying the perspectively distorted images.