10Jul 2018

A NEW WEIGHTING SCHEME FOR CONTENT-BASED IMAGE RETRIEVAL IN THE MULTIMODAL INFORMATION SPACES.

  • Lebanese International University, Beirut, Lebanon.
Crossref Cited-by Linking logo
  • Abstract
  • Keywords
  • References
  • Cite This Article as
  • Corresponding Author

In content based image retrieval, many researchers have worked to improve image retrieval results. Many papers where written to address that problem in many ways. Most papers have worked with how to represent the image in order to find a match to it. Some worked in representing the image using Scale-invariant feature transform (SIFT) descriptors other using Speeded up Robust Features (SURF) or representing it as a set of visual words or many other representations. But all these methods relied purely on representing the image visually without any reference to the semantic of the image. Our object was to introduce the image semantics to the retrieval by combining textual annotation with the visual representation to give a refined representation of the image that will improve retrieval results. This report is divided mainly into two parts. In the first part we introduce a literature review about content based image retrieval and annotation based image retrieval. In the second part, we introduced our own methodology and backed it up with tests and results. Our approach is evaluated over 14 categories with each containing example image(s) and annotation statements.

1. Zhou, Xiang Sean, and Thomas S. Huang. "Unifying keywords and visual contents in image retrieval." Multimedia, IEEE 9.2 (2002): 23-33. 2. Inoue, Masashi. "On the need for annotation-based image retrieval. ?Proceedings of the Workshop on Information Retrieval in Context (IRiX), Sheffield, UK. 2004. 3. Inoue, Masashi, and Naonori Ueda. "Retrieving slightly annotated images." 4. Tirilly, Pierre, Vincent Claveau, and Patrick Gros. "Language modeling for bag-of-visual words image categorization." Proceedings of the 2008 international conference on Content-based image and video retrieval. ACM, 2008. 5. Elsayad, Ismail, et al. "A new spatial weighting scheme for bag-of-visual-words." Content-Based Multimedia Indexing (CBMI), 2010 International Workshop on. IEEE, 2010. 6. Bosch, Anna, Xavier Mu?oz, and Robert Mart?. "Which is the best way to organize/classify images by content?." Image and vision computing 25.6 (2007): 778-791. 7. Zhao, Rong, and William I. Grosky. "Narrowing the semantic gap-improved text-based web document retrieval using visual features." Multimedia, IEEE Transactions on 4.2 (2002): 189-200. 8. Sikka, Karan, et al. "Exploring bag of words architectures in the facial expression domain." European Conference on Computer Vision. Springer, Berlin, Heidelberg, 2012. 9. Zheng, Liang, and Shengjin Wang. "Visual phraselet: Refining spatial constraints for large scale image search." IEEE Signal Processing Letters 20.4 (2013): 391-394. 10. Escalante, Hugo Jair, et al. "Evolving weighting schemes for the Bag of Visual Words." Neural Computing and Applications 28.5 (2017): 925-939. 11. B. Thomee, E.M. Bakker, and M.S. Lew, "TOP-SURF: a visual words toolkit", in Proceedings of the 18th ACM International Conference on Multimedia, pp. 1473-1476, Firenze, Italy, 2010. 12. George A. Miller, ?WordNet: A Lexical Database for English?Communications of the ACM Vol. 38, No. 11: 39-41. 1995 13. Griffin, Gregory, Alex Holub, and Pietro Perona. "Caltech-256 object category dataset." (2007).

[Ismail El Sayad, Samih Abdul-Nabi, Hussien Kassem, Georges Moubarak and Ahmad Saleh. (2018); A NEW WEIGHTING SCHEME FOR CONTENT-BASED IMAGE RETRIEVAL IN THE MULTIMODAL INFORMATION SPACES. Int. J. of Adv. Res. 6 (Jul). 104-114] (ISSN 2320-5407). www.journalijar.com

Ismail El Sayad
Lebanese International University

DOI:

Article DOI: 10.21474/IJAR01/7342      
DOI URL: http://dx.doi.org/10.21474/IJAR01/7342

Download Full Paper

Download PDF No. of Downloads: 8 | No. of Views: 55