Published on Tue Dec 29 2020

Deep Hashing for Secure Multimodal Biometrics

Veeru Talreja, Matthew Valenti, Nasser Nasrabadi

M multimodal biometric systems have an increased demand for integrity and privacy because they must store multiple biometric traits associated with each user. We present a deep learning framework for feature-level fusion that generates a secure template from each user's face and iris biometrics. We integrate a deep hashing (binarization)technique into the fusion architecture.

0
0
0
Abstract

When compared to unimodal systems, multimodal biometric systems have several advantages, including lower error rate, higher accuracy, and larger population coverage. However, multimodal systems have an increased demand for integrity and privacy because they must store multiple biometric traits associated with each user. In this paper, we present a deep learning framework for feature-level fusion that generates a secure multimodal template from each user's face and iris biometrics. We integrate a deep hashing (binarization) technique into the fusion architecture to generate a robust binary multimodal shared latent representation. Further, we employ a hybrid secure architecture by combining cancelable biometrics with secure sketch techniques and integrate it with a deep hashing framework, which makes it computationally prohibitive to forge a combination of multiple biometrics that pass the authentication. The efficacy of the proposed approach is shown using a multimodal database of face and iris and it is observed that the matching performance is improved due to the fusion of multiple biometrics. Furthermore, the proposed approach also provides cancelability and unlinkability of the templates along with improved privacy of the biometric data. Additionally, we also test the proposed hashing function for an image retrieval application using a benchmark dataset. The main goal of this paper is to develop a method for integrating multimodal fusion, deep hashing, and biometric security, with an emphasis on structural data from modalities like face and iris. The proposed approach is in no way a general biometric security framework that can be applied to all biometric modalities, as further research is needed to extend the proposed framework to other unconstrained biometric modalities.

Mon Feb 11 2019
Machine Learning
Learning to Authenticate with Deep Multibiometric Hashing and Neural Network Decoding
The MDHND consists of two separate modules: a multimodal deep hashing(MDH) module, which is used for feature-level fusion and binarization of multiple biometrics, and a neural network decoder (NND) module. Use of NND helps to improve the
0
0
0
Mon Aug 07 2017
Artificial Intelligence
Multibiometric Secure System Based on Deep Learning
We present a feature-level fusion framework to generate a secure multibiometric template from each user's multiple biometrics. The efficacy of the proposed approach is shown using amultimodal database where we achieve state-of-the-art matching performance.
0
0
0
Fri Apr 03 2020
Computer Vision
Error-Corrected Margin-Based Deep Cross-Modal Hashing for Facial Image Retrieval
0
0
0
Mon Dec 07 2020
Artificial Intelligence
IHashNet: Iris Hashing Network based on efficient multi-index hashing
Massive biometric deployments are pervasive in today's world. Despite the high accuracy of biometric systems, their computational efficiency degrades with an increase in the database size. An ideal indexing scheme needs to preserve the intra-subject similarity as well as inter-subject dissimilarity.
0
0
0
Mon Aug 05 2019
Computer Vision
Zero-Shot Deep Hashing and Neural Network Based Error Correction for Face Template Protection
A novel architecture that integrates a deep hashing framework with a neural network decoder (NND) improves upon existing face template protection techniques. A key novelty of our proposed architecture is that the framework can also be used with zero-shot enrollment. The final binary code generated by the NND is then cryptographically hashed and stored as a
0
0
0
Sun Jun 14 2015
Computer Vision
Deep Secure Encoding: An Application to Face Recognition
Using deep convolutional neural networks, we learn a robust mapping of face classes to high entropy secure codes. These secure codes are then hashed using standard hash functions like SHA-256 to generate secure face templates. The efficacy of the approach is shown on two face databases, namely,
0
0
0