吉林大学学报(理学版)

• 计算机科学 • 上一篇    下一篇

一种新的基于稀疏编码Hash的跨模多媒体数据检索算法

谭涛, 谭乐婷, 贺春林   

  1. 西华师范大学 计算机学院, 四川 南充 637002
  • 收稿日期:2016-06-14 出版日期:2017-03-26 发布日期:2017-03-24
  • 通讯作者: 谭涛 E-mail:tantao99132@163.com

A New Cross Modal Multimedia Data RetrievalAlgorithm Based on Sparse Coding Hash

TAN Tao, TAN Leting, HE Chunlin   

  1. School of Computer, China West Normal University, Nanchong 637002, Sichuan Province, China
  • Received:2016-06-14 Online:2017-03-26 Published:2017-03-24
  • Contact: TAN Tao E-mail:tantao99132@163.com

摘要: 针对现有跨模Hash检索方法不能有效消除不同模态数据间语义差异的问题, 提出一种新的基于稀疏编码Hash的检索方法, 解决了图像低层视觉特征和高层语义之间的语义差异, 改善了跨模检索的效果. 使用稀疏编码进行跨模相似性检索, 首先使用稀疏编码获取图像与文本的显著特征和隐含概念, 然后将学习到的隐含语义特征映射到共同的抽象空间中, 再通过迭代机制找到多模态数据特征表示间的相关性, 最后通过高层语义抽象空间的量化得到统一的Hash编码.

关键词: 跨模检索, 稀疏编码, 多媒体数据, 隐含语义

Abstract: Aiming at the problem that the existing cross modal Has h retrieval method could not effectively eliminate the semantic differences betw een the different modal data, we proposed a new retrieval method based on spar se coding Hash. The semantic differences between the lowlevel visual featur es and highlevel semantics were solved, and the effect of cross modal retr ieval was improved. Cross modal similarity retrieval by using sparse coding. Firstly, we used sparse coding to obtain salient features and implicit concepts of images and texts. Secondly, we mapped the latent semantic f eatures of learning to a common abstract space, and then we found correlation between features of the multimodal data by the iterative mechanism . Finally, we obtained the uniform Hash coding by the quantization of highleve l semantic abstract space.

Key words: latent concept; multimedia data, cross modal retrieval, sparse coding

中图分类号: 

  • TP39