Home   >   CSC-OpenAccess Library   >    Manuscript Information
Full Text Available

(4.14MB)
This is an Open Access publication published under CSC-OpenAccess Policy.
Development of Sign Signal Translation System Based on Altera’s FPGA DE2 Board
Kuo Chue Neo, Haidi Ibrahim, Wan Mohd Yusof Rahiman Wan Abdul Aziz
Pages - 101 - 114     |    Revised - 01-11-2011     |    Published - 15-12-2011
Volume - 2   Issue - 3    |    Publication Date - November / December 2011  Table of Contents
MORE INFORMATION
KEYWORDS
Sign signal translation system, FPGA, Altera DE2 board, Mathematical Morphology
ABSTRACT
The main aim of this paper is to build a system that is capable of detecting and recognizing the hand gesture in an image captured by using a camera. The system is built based on Altera’s FPGA DE2 board, which contains a Nios II soft core processor. Image processing techniques and a simple but effective algorithm are implemented to achieve this purpose. Image processing techniques are used to smooth the image in order to ease the subsequent processes in translating the hand sign signal. The algorithm is built for translating the numerical hand sign signal and the result are displayed on the seven segment display. Altera’s Quartus II, SOPC Builder and Nios II EDS software are used to construct the system. By using SOPC Builder, the related components on the DE2 board can be interconnected easily and orderly compared to traditional method that requires lengthy source code and time consuming. Quartus II is used to compile and download the design to the DE2 board. Then, under Nios II EDS, C programming language is used to code the hand sign translation algorithm. Being able to recognize the hand sign signal from images can helps human in controlling a robot and other applications which require only a simple set of instructions provided a CMOS sensor is included in the system.
CITED BY (0)  
1 CiteSeerX
2 Scribd
3 SlideShare
4 PdfSR
1 M. Shirvaikar, and T. Bushnaq, “A comparison between DSP and FPGA platforms for realtime imaging applications”, in Real-Time Image and Video Processing 2009, San Jose, CA,USA, 2009, pp. 724406.
2 S. Asona, T. Maruyama, and Y. Yamaguchi. “Performance comparison of FPGA, GPU and CPU in image processing”, in Field Programmable Logic and Applications (FPL 2009),2009, pp. 126-131.
3 M. Mohandes, S. I. Quadri, and M. D. King. “Arabic sign language recognition an image based approack”, in 21st International Conference on Advanced Information Networking and Applications Workshops, 2007 (AINAW’07), 2007, pp. 272-276.
4 M. P. Paulraj, S. Yaacob, H. Desa, and W. Majid. “Gesture recognition system for Kod Tangan Bahasa Melayu (KTBM) using neural network”, in 5th International Colloquium on Signal Processing and Its Applications (CSPA 2009), 2009, pp. 19-22.
5 M. P. Paulraj, S. Yaacob, M. S. Zanar Azalan, and R. Palaniappan. “A phoneme based sign language recognition system using skin color segmentation”, in 6th International Colloquium on Signal Processing and Its Applications (CSPA 2010), 2010, pp. 1-5.
6 W. K. Chung, W. Xinyu, and Y. Xu. “A realtime hand gesture recognition based on Haar wavelet representation”, in Proceedings of the 2008 IEEE International Conference on Robotics and Biomimetics, Washington, DC, USA, 2008, pp. 336-341.
7 Y. Shi, and T. Tsui. “An FPGAbased smart camera for gesture recognition in HCI applications”, in Computer Vision-ACCV 2007, 2007, pp. 718-727.
8 A. Malima, E. Ozgur, and M. Cetin. “A fast algorithm for vision-based hand gesture recognition for robot control”, in 14th IEEE Signal Processing and Communications Applications, 2006, pp. 1-4.
9 I. K. Park, J. H. Kim, and K. S. Hong. “An implementation of an FPGA-based embedded gesture recognizer using a data glove”, in Proceedings of the 2nd International Conference on Ubiquitous Information Management and Communication (ICUIMC’08), 2008.
10 S. J. Wang, D. C. Zhang, C. C. Jia, N. Zhang, C. G. Zhou, and L. B. Zhang. “A sign language recognition based on tensor”, in Second International Conference on Multimedia and Information Technology (MMIT), 2010, pp. 192-195.
11 V. Bonato, A. K. Sanches, M. M. Fernandes, J. M. P. Cardoso, E. D. V. Simoes, and E.Marques. “A real time gesture recognition system for mobile robots”, in ICINCO 2004,2004, pp. 207-214.
Mr. Kuo Chue Neo
- Malaysia
Dr. Haidi Ibrahim
Universiti Sains Malaysia - Malaysia
haidi_ibrahim@ieee.org
Dr. Wan Mohd Yusof Rahiman Wan Abdul Aziz
- Malaysia