Robust Deep Hashing Against Adversarial Attacks through Self-Supervised Semantic Consistency Optimization

Authors

  • Warren Jacobs Department of Electrical Engineering and Computer Science, University of Kansas, Lawrence, KS, USA.
  • Ranfei Meng Department of Computer Science, Colorado State University, Fort Collins, CO, USA.

Keywords:

deep hashing, adversarial robustness, self-supervised learning, semantic consistency, image retrieval, system security, fairness, sociotechnical infrastructure

Abstract

Deep hashing has become a cornerstone of large-scale multimedia retrieval, enabling compact binary representations that support rapid similarity search in high-dimensional spaces. Despite their efficiency, deep hashing systems exhibit pronounced vulnerability to adversarial perturbations, where visually imperceptible modifications can catastrophically alter hash codes and thus the entire retrieval outcome. This paper presents a system-oriented investigation into robust deep hashing through self-supervised semantic consistency optimization. We argue that adversarial robustness in hashing must be addressed not as an isolated algorithmic tweak but as a system-level property encompassing representation design, training methodology, deployment infrastructure, and governance. We introduce a conceptual framework that couples self-supervised learning principles with consistency enforcement across multiple semantically equivalent views of the input, thereby steering the hash function toward invariant and semantically stable regions of the embedding space without relying on explicit adversarial training or labeled data. The paper analyzes structural trade-offs among hash length, code balance, retrieval speed, storage cost, energy footprint, and robustness margins. Beyond technical performance, we examine sociotechnical dimensions such as fairness in retrieval outcomes across demographic subgroups, the sustainability implications of adversarial defense strategies, and the regulatory requirements emerging from high-stakes deployment contexts. Cross-domain comparisons with perceptual hashing, blockchain-anchored integrity schemes, and large-scale cloud indexing architectures enrich the discussion. By positioning robust deep hashing within a broader infrastructure and policy landscape, we provide actionable insights for designing retrieval systems that are not only accurate and fast but also trustworthy, equitable, and resilient under active adversarial environments.

References

1. Wang, J., Zhang, T., Song, J., Sebe, N., & Shen, H. T. (2017). A survey on learning to hash. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40(4), 769-790.

2. Cao, Z., Long, M., Wang, J., & Yu, P. S. (2017). HashNet: Deep learning to hash by continuation. In Proceedings of the IEEE International Conference on Computer Vision (ICCV) (pp. 5608-5617).

3. Bai, J., Chen, B., Li, Y., Wu, D., Guo, W., & Xia, S. T. (2020). Adversarial attack on deep hashing. In Proceedings of the AAAI Conference on Artificial Intelligence (pp. 10417-10424).

4. Madry, A., Makelov, A., Schmidt, L., Tsipras, D., & Vladu, A. (2018). Towards deep learning models resistant to adversarial attacks. In International Conference on Learning Representations (ICLR).

5. Chen, T., Kornblith, S., Norouzi, M., & Hinton, G. (2020). A simple framework for contrastive learning of visual representations. In International Conference on Machine Learning (ICML) (pp. 1597-1607).

6. He, K., Fan, H., Wu, Y., Xie, S., & Girshick, R. (2020). Momentum contrast for unsupervised visual representation learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 9729-9738).

7. Grill, J. B., Strub, F., Altché, F., Tallec, C., Richemond, P. H., Buchatskaya, E., ... & Valko, M. (2020). Bootstrap your own latent: A new approach to self-supervised learning. Advances in Neural Information Processing Systems (NeurIPS).

8. Hu, Z., Yang, E., Li, W., & Liu, H. (2021). Self-supervised deep hashing with pseudo labels for image retrieval. IEEE Transactions on Image Processing, 30, 6324-6338.

9. Yang, Y., Zhu, L., Li, X., & Liu, J. (2021). Adversarial training for robust deep hashing. In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME).

10. Yu, Z., Wu, S., Dou, Z., & Bakker, E. M. (2022). Deep hashing with self-supervised asymmetric semantic excavation and margin-scalable constraint. Neurocomputing, 483, 87-104.

11. Goodfellow, I. J., Shlens, J., & Szegedy, C. (2015). Explaining and harnessing adversarial examples. In International Conference on Learning Representations (ICLR).

12. Zhang, H., Cisse, M., Dauphin, Y. N., & Lopez-Paz, D. (2018). mixup: Beyond empirical risk minimization. In International Conference on Learning Representations (ICLR).

13. Athalye, A., Engstrom, L., Ilyas, A., & Kwok, K. (2018). Synthesizing robust adversarial examples. In International Conference on Machine Learning (ICML) (pp. 284-293).

14. Cui, Y., Jia, M., Lin, T. Y., Song, Y., & Belongie, S. (2019). Class-balanced loss based on effective number of samples. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 9268-9277).

15. Barocas, S., Hardt, M., & Narayanan, A. (2019). Fairness and machine learning. fairmlbook.org.

16. Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017). Grad-CAM: Visual explanations from deep networks via gradient-based localization. In Proceedings of the IEEE International Conference on Computer Vision (ICCV) (pp. 618-626).

17. Recht, B., Roelofs, R., Schmidt, L., & Shankar, V. (2019). Do ImageNet classifiers generalize to ImageNet? In International Conference on Machine Learning (ICML) (pp. 5389-5400).

18. Papernot, N., McDaniel, P., Wu, X., Jha, S., & Swami, A. (2016). Distillation as a defense to adversarial perturbations against deep neural networks. In IEEE Symposium on Security and Privacy (SP) (pp. 582-597).

19. Kurakin, A., Goodfellow, I., & Bengio, S. (2017). Adversarial examples in the physical world. In International Conference on Learning Representations (ICLR) Workshop.

20. Chen, T., Kornblith, S., Swersky, K., Norouzi, M., & Hinton, G. (2020). Big self-supervised models are strong semi-supervised learners. Advances in Neural Information Processing Systems (NeurIPS).

Downloads

Published

2026-06-01

How to Cite

Warren Jacobs, & Ranfei Meng. (2026). Robust Deep Hashing Against Adversarial Attacks through Self-Supervised Semantic Consistency Optimization. International Journal of Clinical and Translational Medicine, 1(1). Retrieved from https://ijctmed.org/index.php/home/article/view/142