Home   >   CSC-OpenAccess Library   >    Manuscript Information
Full Text Available

(558.7KB)
This is an Open Access publication published under CSC-OpenAccess Policy.
3D Human Hand Posture Reconstruction Using a Single 2D Image
Mahdi Vaezi, Mohammad Ali Nekouie
Pages - 83 - 94     |    Revised - 31-01-2011     |    Published - 08-02-2011
Volume - 1   Issue - 4    |    Publication Date - January / February 2011  Table of Contents
MORE INFORMATION
KEYWORDS
3D hand posture estimation, machine vision, Gesture recognition, Model-based approach, color image
ABSTRACT
Passive sensing of the 3D geometric posture of the human hand has been studied extensively over the past decade. However, these research efforts have been hampered by the computational complexity caused by inverse kinematics and 3D reconstruction. In this paper, our objective focuses on 3D hand posture estimation based on a single 2D image with aim of robotic applications. We introduce the human hand model with 27 degrees of freedom (DOFs) and analyze some of its constraints to reduce the DOFs without any significant degradation of performance. A novel algorithm to estimate the 3D hand posture from eight 2D projected feature points is proposed. Experimental results using real images confirm that our algorithm gives good estimates of the 3D hand pose. Keywords: 3D hand posture estimation; Model-based approach; Gesture recognition; human- computer interface; machine vision.
CITED BY (3)  
1 Tzionas, D., Ballan, L., Srikantha, A., Aponte, P., Pollefeys, M., & Gall, J. (2015). Capturing Hands in Action using Discriminative Salient Points and Physics Simulation. arXiv preprint arXiv:1506.02178.
2 Tzionas, D., Srikantha, A., Aponte, P., & Gall, J. (2014). Capturing hand motion with an RGB-D sensor, fusing a generative model with salient points. In Pattern Recognition (pp. 277-289). Springer International Publishing.
3 Ma Ying Hung, Yang Jiawei, Hui Lei put, & Li Ye. (2012). A novel hand movement tracking system. Xi'an University of Electronic Science and Technology, 39 (1), 79-85.
1 Google Scholar
2 CiteSeerX
3 refSeek
4 Scribd
5 SlideShare
6 PdfSR
1 J.Triesch, C.Vonder Malsburg. “A Gesture Interface for Human-Robot Interaction”. The Proceedings of FG'98, Nara, Japan: 2-12, 1998.
2 A.F.Bobick, A.D.Wilson. “A State-Based Approach to the Representation And Recognition Of Gesture”. IEEE Transactions on Pattern Analysis And Machine Intelligence 19 (12), 1997
3 T.J.Darrel, A.Pentland. “Attention-Driven Expression and Gesture Analysis In An Interactive Environment”. First International Conference on Automatic Face and Gesture Recognition, 1995.
4 N.Shimada, Y.Shirai, J.Miura. “Hand Gesture Estimation and Model Refinement Using Monocular Camera Ambiguity Limitation By Inequality Constraints”. Second International Conference On Automatic Face And Gesture Recognition, IEEE Computer Society Press, Los Alamitos, CA, 1998.
5 V.I.Pavlovic, R.Sharma, T.S.Huang. “Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review”. IEEE Transactions on Pattern Analysis and Machine Intelligence 19 (7), 1997.
6 T.E.Starner. “Unencumbered Virtual Environments”. PhD Thesis, MIT Media Arts and Sciences Section, USA, 1993.
7 J.S.Kim, W.Jang, Z.Bien. “A Dynamic Gesture Recognition System for the Korean Sign Language (KSL)”. IEEE Transactions On System, Man, And Cybernetics 26 (2), 1996.
8 S.Tamura, S.Kawasaki. “Recognition Of Sign Language Motion Images”. Pattern Recognition 21 (4): 343-353, 1998
9 J.Lee, T.L.Knuii. “Model-Based Analysis Of Hand Posture”. IEEE Computer Graphics and Application: 77-86, 1995.
10 C.C.Lien, C.L.Huang. “Model-Based Articulated Hand Motion Tracking for Gesture Recognition”. Image And Vision Computing 16: 121-134, 1998.
11 J.M.Rehg, T.Kanade. “Visual Tracking Of High DOF Articulated Structures: An Application To Human Hand Tracking”. ECCV94: B35-B46, 1994.
12 C.C.Chang, W.H.Tsai. “Model-Based Analysis Of Hand Gestures From Single Images Without Using Marked Gloves Or Attaching Marks On Hands”, Fourth Asian Conference On Computer Vision, 2000.
13 C.S.Chua, H.Y.Guan, Y.K.Ho. “Model-Based Finger Posture Estimation”. Fourth Asian Conference on Computer Vision, Taipei, Taiwan, 2000.
14 H.Y.Guan, C.S.Chua, Y.K.Ho. “Hand Posture Estimation from 2D Monocular Image”. Second International Conference On 3-D Digital Imaging And Modeling, Ottawa, Canada, 1999.
15 H.Rijpkema, M.Girard. “Computer Animation Of Knowledge-Based Human Grasping”. IEEE Computer Graphics And Application 25 (4): 339-348, 1991.
16 J.M.Kuch, T.S.Huang. “Vision Based Hand Modeling And Tracking For Virtual Teleconferencing And Telecollaboration”, ICCV95: 666-671, 1995.
17 J.Lee, T.L.Kunii. “Constraint-Based Hand Animation, Models and Techniques in Computer Animation”. IEEE Computer Graphics and Application, 1993.
18 A.Hubertus, G.Medioni. “Detection of Intensity Changes with Sub Pixel Accuracy Using Laplacian-Gaussian Masks”. IEEE Transactions on Pattern Analysis And Machine Intelligence 8 (5), 1986.
19 F.Mokhtarian, A.Mackworth. “Scale-Based Description And Recognition Of Planar Curves And Two Dimensional Shapes”. IEEE Transactions On Pattern Analysis And Machine Intelligence 8 (1), 1986.
20 Ho,Yeong Khein. “Model-Based 3D Hand Posture Estimation From A Single 2D Image”. Msc Thesis, Nanyang Technological University In Signgapor, 2001.
21 M.Veber, T.Bajd, M. Munih. “Assessing Joint Angles In Human Hand Via Optical Tracking Device And Calibrating Instrumented Glove”. Springer Science+Business Media: 1-13, 2007.
22 E.P.Pitarch. “Virtual Human Hand: Grasping Strategy And Simulation”. Phd Thesis, Universitat Polit`Ecnica De Catalunya, 2007.
23 P.Smagt, G.Stillfried. “Using MRI Data to Compute A Hand Kinematic Model”. Institute Of Robotics and Mechatronics, German Aerospace Center: 1-10, 2010.
24 S.Cobos. “Efficient Human Hand Kinematics for Manipulation Tasks”. IEEE/RSJ International Conference on Intelligent Robots and Systems, 2008.
Mr. Mahdi Vaezi
science and research branch of islamic azad university - Iran
m.vaezi7777@gmail.com
Dr. Mohammad Ali Nekouie
KNT technical university - Iran