Home   >   CSC-OpenAccess Library   >    Manuscript Information
Full Text Available

This is an Open Access publication published under CSC-OpenAccess Policy.
Semantic Gap in CBIR: Automatic Objects Spatial relationships Semantic Extraction and Representation
Hui Hui Wang, Dzulkifli Mohamad, N. A. Ismail
Pages - 192 - 204     |    Revised - 30-06-2010     |    Published - 10-08-2010
Volume - 4   Issue - 3    |    Publication Date - July 2010  Table of Contents
Semantic Gap, Objects Spatial Relationships semantic, Automatic Image Semantic Extraction, Image Retrieval
The explosive growth of image data leads to the need of research and development of Image retrieval. Image retrieval researches are moving from keyword, to low level features and to semantic features. Drive towards semantic features is due to the problem of the keywords which can be very subjective and time consuming while low level features cannot always describe high level concepts in the users’ mind. This paper is proposed a novel technique for objects spatial relationships semantics extraction and representation among objects exists in images. All objects are identified based on low level features extraction integrated with proposed line detection techniques. Objects are represented using a Minimum Bound Region (MBR) with a reference coordinate. The reference coordinate is used to compute the spatial relation among objects. There are 8 spatial relationship concepts are determined: “Front”, “Back”, “Right”, “Left”, “Right-Front”, “Left-Front”, “Right-Back”, “Left-Back” concept. The user query in text form is automatically translated to semantic meaning and representation. Besides, the image similarity of objects spatial relationships semantic has been proposed.
CITED BY (2)  
1 Abdulbaqi, h. a., sulong, g., & hashem, s. h. (2014). a sketch based image retrieval: a review of literature. journal of theoretical and applied information technology, 63(1).
2 Kyriazos, G. K., Gerostathopoulos, I. T., Kolias, V. D., Stoitsis, J. S., & Nikita, K. S. (2011, August). A semantically-aided approach for online annotation and retrieval of medical images. In Engineering in Medicine and Biology Society, EMBC, 2011 Annual International Conference of the IEEE (pp. 2372-2375). IEEE.
1 Google Scholar
2 Academic Index
3 refSeek
5 Socol@r
6 Bielefeld Academic Search Engine (BASE)
7 Scribd
8 WorldCat
1 A. Rosenfeld. “Picture processing by computer”. ACM Computing Surveys, 1(3):147-176, 1969.
2 H. Tamura and S. Mori. “A data management system for manipulating large images”. In Proceedings of Workshop on Picture Data Description and Management, pages 45-54, Chicago, Illinois, USA, April 1977
3 Ying Liu, Dengsheng Zhang, Guojun Lu, Wei-Ying M. “A survey of content-based image retrieval with high-level semantics”. Pattern Recognition, 40(1):262 – 282, 2007
4 R.Datta, D.Joshi, J.Li, J.Z.Wang. “Image Retrieval: Ideas, Inuences, and Trends of the New Age”. ACM Transactions on Computing Surveys, 40(2), 2008
5 Hui Hui Wang, Dzulkifli Mohamad, N.A.Ismail. “Image Retrieval: Techniques, challenge and Trend”. In International conference on Machine Vision, Image processing and Pattern Analysis, Bangkok, 2009
6 Hui Hui Wang, Dzulkifli Mohamad, N.A.Ismail. “Towards Semantic Based Image Retrieval : A Review”. In The 2nd International Conference on Digital Image Processing (ICDIP 2010), Singapore,2010.Proceedings of SPIE, Vol 7546, 2010
7 C.Y.Chang, H.Y.Wang, C.F.Li. “Semantic analysis of real world images using support vector machine”. Expert systems with application : An international journal, 36(7):10560-10569, 2009
8 Najlae Idrissi. “Bridging the Semantic Gap for Texture-based Image Retrieval and Navigation”, Journal Of Multimedia, 4(5):277-283, October 2009
9 M. L. Kherfi, D. Ziou, and A. Benard. “Image retrieval from the World Wide Web: Issues, techniques and systems”. ACM Computing Surveys, 36(1):35-67, 2004
10 A. W. M. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain. “Content-based image retrieval at the end of the early years”. In IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(12):1349-1380, December 2000.
11 Zurina Muda, Paul H. Lewis, Terry R. Payne, Mark J. Weal. “Enhanced Image Annotations Based on Spatial Information Extraction and Ontologies”. In Proceedings of the IEEE International Conference on Signal and Image Processing Application, ICSIPA 2009
12 Haiying Guan, Sameer Antani, L. Rodney Long, and George R. Thomas. “Bridging the semantic gap using rnaking SVM for image retrieval”. In Proceedings of the sixth IEEE international Conference on Symposium on Biomedical Imaging: From Nano to Macro, USA 2009.
13 Zhao and Grosky “Bridging the semantic gap in Image retrieval”. Idea Group Publishing Series, Book Chapter 2, pp 14-36 (2002)
14 Wikipedia, http://wikipedia.org. Accessed at June 2010
15 Travel Photography and Professional Stock Phtography-lonely Planet Images, http://www.lonelyplanetimages.com. Accessed at June 2010
16 Photoblog-Your Life in Photos, http://www.photoblog.com. Accessed at June 2010
17 Photo Blogging made Easy-fotopages, http://www.fotopages.com. Accessed at June 2010
18 Inote : Image Annotation in Java, http://www.iath.virginia.edu/inote/. Accessed at June 2010
19 Facebook, http://www.facebook.com. Accessed at June 2010
20 Bradshaw B. “Semantic based image retrieval: A probabilistic approach”. In Proceedings of the Eight ACM International Conference on Multimedia, United States, 2000
21 Y. Mori, H. Takahashi, and R. Oka. “Image-to-word transformation based on dividing and vector quantizing images with words”. In Proceedings of the First International Workshop on Multimedia Intelligent Storage and Retrieval Management, 1999
22 P Duygulu, K Barnard, N de Fretias, and D Forsyth. “Object recognition as machine translation: Learning a lexicon for a fixed image vocabulary”. In Proceedings of the European Conference on Computer Vision, pages 97–112, 2002
23 Jeon,J.,Laverenko,V.,Manmatha, R “ Automatic image annotation and retrieval using cross-media relevance models". In:Proceedings of international ACM Conference on Research and Development in Information Retrieval, 2003
24 Lavrenko,V., Manmatha,R.,Jeon,J:”A model for learning the semantic of pictures”. In proceeding of Advances in Neural Information Processing Systems, NIPS, 2003
25 Mittal A, Cheong LF. “Framework for synthesizing semantic-level indexes”. Multimedia Tools and Applications 20(2):135–158.2003
26 L. Hollink, G. Nguyen, G. Schreiber, J. Wielemaker, and B. Wielinga, "Adding spatial semantics to image annotations," In 4th International Workshop on Knowledge Markup and Semantic Annotation, 2004
27 Belkhatir M. “An operational model based on knowledge representation for querying the image content with concepts and relations”. Multimed Tools Application, 43:1–23. Springerlink Netherlands, 2009
28 Jian Hu, Gang Wang, Fred Lochovsky, Jian-Tao Sun, Zheng Chen. “Understanding User’s Query Intent with Wikipedia”. Proceedings of the 18th international conference on World wide web. ACM. 2009
29 E. Chang, K. Goh, G. Sychay, G. Wu, CBSA: CBSA: “Content-based Soft Annotation for Multimodal Image Retrieval using Bayes Point Machines”, In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR ), pp. 26-38, 2003.
30 Hong Fu. “Attention driven image interpretation, annotation and retrieval”. PhD thesis. The Hong Kong Polytechnic University. 2006
Mr. Hui Hui Wang
- Malaysia
Mr. Dzulkifli Mohamad
- Malaysia
Mr. N. A. Ismail
- Malaysia