Home   >   CSC-OpenAccess Library   >    Manuscript Information
Full Text Available

This is an Open Access publication published under CSC-OpenAccess Policy.
Publications from CSC-OpenAccess Library are being accessed from over 74 countries worldwide.
Novel Hybrid Approach to Visual Concept Detection Using Image Annotation
Sanjay M. Patil, Kishor K. Bhoyar
Pages - 1 - 12     |    Revised - 31-12-2018     |    Published - 01-02-2019
Volume - 13   Issue - 1    |    Publication Date - February 2019  Table of Contents
Image Concept Detection, Low-level Features, Tags, Weighted Features.
Millions of images are being uploaded on the internet without proper description (tags) about these images. Image retrieval based on image tagging approach is much faster than Content Based Image Retrieval (CBIR) approach but requires an entire image collection to be manually annotated with proper tags. This requires a lot of human efforts and time, and hence not feasible for huge image collections. An efficient method is necessary for automatically tagging such a vast collection of images. We propose a novel image tagging method, which automatically tags any image with its concept. Our unique approach to solve this problem involves manual tagging of small exemplar image set and low-level feature extraction of all the images, hence called a hybrid approach. This approach can be used to tag a large image dataset from manually tagged small image dataset. The experiments are performed on Wang's Corel Dataset. In the comparative study, it is found that, the proposed concept detection system based on this novel tagging approach has much less time complexity of classification step, and results in significant improvement in accuracy as compared to the other tagging approaches found in the literature. This approach may be used as faster alternative to the typical Content Based Image Retrieval (CBIR) approach for domain specific applications.
1 Google Scholar 
2 refSeek 
3 Doc Player 
4 Scribd 
5 SlideShare 
1 P.G. Foschi, D. Kolippakkam, H. Liu and A. Mandvikar, "Feature Extraction for Image Mining", Proc. in Int. workshop on Multimedia Information System, 2002, pp. 103-109.
2 M. Wang and X. Hua, "Active Learning in Multimedia Annotation and Retrieval: A Survey", ACM Transactions on Intelligent Systems and Tech., 2011.
3 M.I. Mandel, R. Pascanu, D. Eck, Y.Bengio, L. M. Aiello, R. Schifanella, and F. Menczer, "Contextual Tag Inference", ACM Trans. on Multimedia Computing, Communications and Applications, 2011.
4 M. Naphade and J. R. Smith, "On the Detection of Semantic Concepts at TRECVID", Proc. of the 12th Annual ACM Int. Conf. on Multimedia, New York, USA, 2004, pp.660-667.
5 R. Min and H.D. Cheng, "Effective Image Retrieval using Dominant Color Descriptor and Fuzzy Support Vector Machine", Pattern Recognition, Vol.42, No.1, Jan.2009, pp. 147-157.
6 Y. Yang, Y. Gao, H. Zhang, J. Shao and T. S. Chua, "Image Tagging with Social Assistance", Proceedings of International Conference on Multimedia Retrieval, ICMR'14,Glasgow,United Kingdom, Apr. 2014.
7 S. Papadopoulos, C. Sagonas, L. KompatsiarisI and A. Vakali, "Semi-supervised Concept Detection by Learning the Structure of Similarity Graphs", Advances in Multimedia Modeling, Lecture Notes in Computer Science, Vol. 7732, Springer, Berlin, 2013.
8 C. Krishna Mohan and B. Yegnanarayana, "Classification of sport videos using Edge Based Features and Autoassociative Neural Network Models", SIViP, Vol.4, No. 1, Mar. 2010, pp. 61-73.
9 L. Feng and B. Bhanu, "Semantic Concept Co-Occurrence Patterns for Image Annotation and Retrieval", IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol.38, No. 4. Apr. 2016.
10 P. Koniusz, F. Yan, P.Gosselin and K. Mikolajczyk, "Higher-order Occurrence Pooling for Bags-of-Words: Visual Concept Detection", IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 39, No. 2, 2016.
11 T. Tsirelis and A. Delopoulos, "Automatic Ground-truth Image Generation from user Tags", 12th International Workshop on Image Analysis for Multimedia Interactive Services, 2011.
12 X. Li, "Tag Relevance Fusion for Social Image Retrieval", Multimedia Systems, Vol.23, No. 1, Feb. 2017, pp 29-40.
13 A. Elmoataz, F. Nouboud, O. Lézoray and D. Mammass, "Editorial of the Special Issue on Advances in Low-Level Image Representations for Processing and Analysis", SIViP, March 2016, Vol.10, Issue 3, pp. 421-422.
14 P. Shrivastava, K.K. Bhoyar and A.S. Zadgaonkar, "Image Classification Using Fusion of Holistic Visual Descriptions", Int. Jour. Image, Graphics and Signal Processing, 2016, pp.47-57.
15 M.J. Swain and D.H. Ballard, "Color Indexing", Int. Jour. of Computer Vision, Vol. 7, Issue 1, 16- 21, Nov.1991, pp. 11-32.
16 G.V. Sangamnerkar and K.K. Bhoyar, "A Neural Network Color Classifier in HSV Color Space", Int. Conf. on Industrial Automation and Comp., 12-13th Apr. 2014.
17 Z.C. Lipton, C. Elkan and B. Naryanaswamy , "Optimal Thresholding of Classifiers to Maximize F1 Measure", Calders T., Esposito F., Hüllermeier E., Meo R. (eds) Machine Learning and Knowledge Discovery in Databases. ECML PKDD 2014. Lecture Notes in Computer Science, Vol. 8725. Springer, Berlin, Heidelberg.
18 E.Guldogan and M.Gabbouj, "Feature Selection for Content Based Image Retrieval", SIViP, Vol. 2, No. 3, Sep. 2008, pp. 241-250.
19 D. Gupta, A.K. Singh., D. Kumari and Raina, "Hybrid Feature Based Natural Scene Classification using Neural Network", Int. Jour. of Computer Apps., 2012, pp. 48-52.
20 N. Ali, K.B. Bajwa, R. Sablatnig, Z. Mehmood, "Image Retrieval by Addition of Spatial information based on Histograms of Triangular Region", Computer and Electrical Engineering., Vol. 54, Aug. 2016, pp. 539-550.
21 Z. Mehmood, F.Abbas, T. Mahmood, M.Arshad Javid, A. Rehman, "Content-Based Image Retrieval Based on Visual Words Fusion versus Features Fusion of Local and Global Features", Arabian Jour. for Science and Engineering, Jan. 2018.
22 N. Zhou, W.K. Cheun g, G. Qiu, and X. Xue, "A Hybrid Probabilistic Model for Unified Collaborative and Content-Based Image Tagging", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 33, NO. 7, Jul. 2011.
23 R.Hong, M.Wang, Y.Gao, D.Tao, X. Li, and X.Wu, "Image Annotation By Multiple-Instance Learning With Discriminative Feature Mapping and Selection", IEEE Transactions On Cybernetics, Vol. 44, No. 5, May 2014.
24 J.Kim, B.S.Kim and S.Savarese, "Comparing Image Classification Methods: K-Nearest-Neighbor and Support-Vector-Machines", Proceedings of the 6th WSEAS international conference on Computer Engineering and Applications, USA, Jan. 25-27, 2012.
Mr. Sanjay M. Patil
Research Scholar, Department of Computer Technology, Yeshwantrao Chavan College of Engineering, Nagpur, 441110, India - India
Mr. Kishor K. Bhoyar
Professor, Department of Information Technology, Yeshwantrao Chavan College of Engineering, Nagpur, 441110, India - India