Attention and Language Ensemble for Scene Text Recognition with Convolutional Sequence Modeling

Recent dominant approaches for scene text recognition are mainly based on convolutional neural network (CNN) and recurrent neural network (RNN), where the CNN processes images and the RNN generates character sequences. Different from these methods, we propose an attention-based architecture1 which is completely based on CNNs. The distinctive characteristics of our method include: (1) the method follows encoder-decoder architecture, in which the encoder is a two-dimensional residual CNN and the decoder is a deep one-dimensional CNN. (2) An attention module that captures visual cues, and a language module that models linguistic rules are designed equally in the decoder. Therefore the attention and language can be viewed as an ensemble to boost predictions jointly. (3) Instead of using a single loss from language aspect, multiple losses from attention and language are accumulated for training the networks in an end-to-end way. We conduct experiments on standard datasets for scene text recognition, including Street View Text, IIIT5K and ICDAR datasets. The experimental results show our CNN-based method has achieved state-of-the-art performance on several benchmark datasets, even without the use of RNN.

论文下载

论文地址：https://dl.acm.org/doi/pdf/10.1145/3240508.3240571

算法链接

算法：
https://marketplace.huaweicloud.com/markets/aihub/modelhub/detail/?id=5686e7e3-19ee-4991-adcd-29fd73b4090b

算法指南

算法指南：https://bbs.huaweicloud.com/forum/forum.php?mod=viewthread&tid=92736&page=1&extra=#pid537546

论文精读