Home   >   CSC-OpenAccess Library   >    Manuscript Information
Full Text Available

(327.29KB)
This is an Open Access publication published under CSC-OpenAccess Policy.
Publications from CSC-OpenAccess Library are being accessed from over 74 countries worldwide.
Design and Development of a 2D-Convolution CNN model for Recognition of Handwritten Gurumukhi and Devanagari Characters
Indu Chhabra, Sushil Kumar Narang
Pages - 72 - 82     |    Revised - 30-09-2018     |    Published - 31-10-2018
Volume - 12   Issue - 3    |    Publication Date - October 2018  Table of Contents
MORE INFORMATION
KEYWORDS
Handwritten Character Recognition, Neural Network, Deep Learning, Convolution Neural Network.
ABSTRACT
Owing to the innumerable appearances due to different writers, their writing styles, technical environment differences and noise, the handwritten character recognition has always been one of the most challenging task in pattern recognition. The emergence of deep learning has provided a new direction to break the limits of decades old traditional methods. There exist many scripts in the world which are being used by millions of people. Handwritten character recognition studies of several of these scripts are found in the literature. Different hand-crafted feature sets have been used in these recognition studies. Feature based approaches derive important properties from the test patterns and employ them in a more sophisticated classification model. Feature extraction using Zernike moment and Polar harmonic transformation techniques was also performed and a moderate classification accuracy was also achieved. The problems faced while using these techniques led us to use CNN based recognition approach which is capable of learning the feature vector from the training character image samples in an unsupervised manner in the sense that no hand-crafting is employed to determine the feature vector. This paper presents a deep learning paradigm using a Convolution Neural Network (CNN) which is implemented for handwritten Gurumukhi and devanagari character recognition (HGDCR). In the present experiment, the training of a 34-layer CNN for a 35 class self-generated handwritten Gurumukhi and 60 class (50 alphabet and 10 digits) handwritten Devanagari character dataset was performed on a GPU (Graphic Processing Unit) machine. The experiment resulted with an average recognition accuracy of more than 92% in case of Handwritten Gurumukhi Character dataset and 97.25% in case of Handwritten Devanagari Character dataset. It was also concluded that the training and classification through our network design performed about 10 times faster than on a moderately fast CPU. The advantage of this framework is proved by the experimental results.
1 Google Scholar 
2 BibSonomy 
3 Doc Player 
4 Scribd 
5 SlideShare 
1 R. Plamondon and S. N. Srihari, "On-Line and off-line handwritten recognition: A comprehensive survey", IEEE Trans on PAMI, Vol.22, pp.62-84, 2000.
2 C. Kan and M. D. Srinath, "Invariant character recognition with Zernike and orthogonal Fourier-Mellin moments," Pattern recognition, 35(1), pp.143-154, 2002.
3 S.O. Belkasim, M. Shridhar and M. Ahmadi, "Pattern recognition with moment invariants: A comparative study and new results," Pattern recognition, 24(12), pp.1117-1138, 1991.
4 A. Majumdar and A. Bhattacharya, "A Comparative Study in Wavelets, Curvelets and Contourlets as Feature Sets for Pattern Recognition," International Arab Journal of Information Technology (IAJIT), 6(1), 2009.
5 P. T. Yap, X. Jiang and A. C. Kot, "Two-dimensional polar harmonic transforms for invariant image representation," IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(7), pp.1259-1270, 2010.
6 T. V. Hoang and S. Tabbone, "Generic polar harmonic transforms for invariant image representation," Image and Vision Computing, 32(8), pp.497-509, 2014.
7 I. Chhabra and S. Narang, "Applying Polar Harmonic Transform for feature extraction from a two-dimensional Handwritten Character Image", in Proc. of Twenty First International Conference of FIM on interdisciplinary Mathematics, Statistics and Computational Techniques IMSCT-2012-FIM XXI, Panjab University, Chandigarh, Dec. 2012.
8 C. Singh and I. Chhabra, "Recognition System: A Knowledge Based Neural Approach", in Proc. of International Conference on Speech and Language Technology, New Delhi, Nov. 2004.
9 Y. LeCun, L. Bottou, Y. Bengio and P. Haffner, "Gradient-based learning applied to document recognition," in Proc. of the IEEE, 86(11), 1998, pp.2278-2324.
10 I. Arel, D. C. Rose and T. P. Karnowski, "Deep machine learning-a new frontier in artificial intelligence research," IEEE computational intelligence magazine, 5(4), pp.13-18, 2010.
11 J. Schmidhuber, "Deep learning in neural networks: An overview," Neural networks, 61, pp.85-117, 2015.
12 L. Chen, S. Wang, W. Fan, J. Sun and S. Naoi, "Beyond human recognition: A CNN-based framework for handwritten character recognition," In Proc. IEEE 3rd Asian Conference on Pattern Recognition (ACPR), 2015, pp. 695-699.
13 D. S. Maitra, U. Bhattacharya and S. K. Parui, "CNN based common approach to handwritten character recognition of multiple scripts," In Proc. IEEE 13th International Conference on Document Analysis and Recognition (ICDAR), 2015, pp.1021-1025.
14 R. B. Marimont and M. B. Shapiro, "Nearest neighbour searches and the curse of dimensionality," IMA Journal of Applied Mathematics, 24(1), pp.59-70, 1979.
15 G. S. Lehal and C. Singh, "A Gurmukhi script recognition system," In Proc. IEEE 15th International Conference on Pattern Recognition, 2000, Vol. 2, pp.557-560.
16 S. Arora, D. Bhattacharjee, M. Nasipuri, D. K. Basu, M. Kundu and L. Malik, "Study of different features on handwritten Devnagari character," in Proc. IEEE 2nd International Conference on Emerging Trends in Engineering and Technology (ICETET), 2009, pp.929-933.
17 P. Kasza, "Pseudo-Zernike Moments for Feature Extraction and Chinese Character Recognition," In Proc. IEEE second International Conference on Computer Automation and Engineering, 2009.
18 K. C. Leung and C. H. Leung, "Recognition of handwritten Chinese characters by critical region analysis," Pattern Recognition, 43(3), pp.949-961, 2010.
19 M. Lin, Q. Chen and S. Yan, "Network in network," arXiv preprint arXiv:1312.4400, 2013.
20 S. S. Ahranjany, F. Razzazi and M. H. Ghassemian, "A very high accuracy handwritten character recognition system for Farsi/Arabic digits using Convolutional Neural Networks," In Proc. IEEE Fifth International Conference on Bio-Inspired Computing: Theories and Applications (BIC-TA), 2010, pp. 1585-1592.
21 M. Wu and L. Chen, "Image recognition based on deep learning," In Proc. IEEE Chinese Automation Congress (CAC), 2015, pp. 542-546.
22 G. E. Hinton, S. Osindero and Y. W. Teh, "A fast learning algorithm for deep belief nets," Neural computation, 18(7), pp.1527-1554, 2006.
23 Z. Zhong, L. Jin and Z. Xie, "High performance offline handwritten chinese character recognition using googlenet and directional feature maps," In Proc. IEEE 13th International Conference on Document Analysis and Recognition (ICDAR), 2015, pp. 846-850.
24 M. Elleuch, R. Maalej and M. Kherallah, "A new design based-SVM of the CNN classifier architecture with dropout for offline Arabic handwritten recognition," Procedia Computer Science, 80, pp.1712-1723, 2016.
25 I. Chhabra and C. Singh, "Integration of Structural and Statistical Information for the Recognition of Gurmukhi Script," in Proc. International Conference on Applied Computing, Algarve, Portugal, Feb 2005.
26 V. J. Dongre and V. H. Mankar, "Development of comprehensive devnagari numeral and character database for offline handwritten character recognition," Applied Computational Intelligence and Soft Computing, pp.29, 2012.
27 S. Ioffe and C. Szegedy, "Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift," in Proc. 32nd International Conference on Machine Learning (ICML'15), pp. 448-456, 2015.
28 H. N. Mhaskar and C. A. Micchelli, "How to choose an activation function," In Advances in Neural Information Processing Systems, pp. 319-326, 1994.
29 D. Scherer, A. Müller and S. Behnke, "Evaluation of pooling operations in convolutional architectures for object recognition," In Proc. Artificial Neural Networks-ICANN, 2010, pp. 92-101.
30 N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever and R. Salakhutdinov, "Dropout: a simple way to prevent neural networks from overfitting," The Journal of Machine Learning Research, 15(1), pp.1929-1958, 2014.
31 N. Ketkar, "Introduction to keras," In Deep Learning with Python, Apress, Berkeley, CA, 2017, pp. 97-111.
Dr. Indu Chhabra
Department of Computer Science and Applications, Panjab University, Chandigarh - India
chhabra_i@rediffmail.com
Mr. Sushil Kumar Narang
Punjab University, Chandigarh - India