Searchable Encrypted Image Retrieval Based on Multi-Feature Adaptive Late-Fusion

• DOI: 10.3390/math8061019
• Publication Date: 2020-06-23T08:51:16Z
• Authors: Wentao Ma; Jiaohua Qin; Xuyu Xiang; Yun Tan; Zhibin He
• Keywords: multi-feature adaptive late-fusion; QA1-939; 0202 electrical engineering, electronic engineering, information engineering; convolutional neural network; 02 engineering and technology; searchable encryption; Mathematics

Recently, searchable encrypted image retrieval in a cloud environment has been widely studied. However, the inappropriate encryption mechanism and single feature description make it hard to achieve the expected effects. Therefore, a major challenge of encrypted image retrieval is how to extract and fuse multiple efficient features to improve performance. Towards this end, this paper proposes a searchable encrypted image retrieval based on multi-feature adaptive late-fusion in a cloud environment. Firstly, the image encryption is completed by designing the encryption function in an RGB color channel, bit plane and pixel position of the image. Secondly, the encrypted images are uploaded to the cloud server and the convolutional neural network (CNN) is fine-tuned to build a semantic feature extractor. Then, low-level features and semantic features are extracted. Finally, the similarity score curves of each feature are calculated, and adaptive late-fusion is performed by the area under the curve. A large number of experiments on public dateset are used to validate the effectiveness of our method.