Karnik, Tapan and Shivakumara, Palaiahnakote and Chowdhury, Pinaki Nath and Pal, Umapada and Lu, Tong and Anuar, Nor Badrul (2022) A new deep model for family and non-family photo identification. Multimedia Tools and Applications, 81 (2). pp. 1765-1785. ISSN 1380-7501, DOI https://doi.org/10.1007/s11042-021-11631-3.
Full text not available from this repository.Abstract
Human trafficking is a global issue of the world and the problems related to human trafficking remain unsolved. This paper presents a new method for the identification of photos of different types of families and non-families such that the method can assist investigation team to find a solution to such issue. We believe that parts of human beings are the main resources for representing family and non-family photos. Based on this intuition, we propose to segment hair, head, cloth, torso, and skin regions from each human in input photos by exploring a self-correlation for human parsing method. This step results in region of interest (ROI). Motivated by ability of deep learning models in solving complex issues and special property of MobileNet, which is light weight model, we further explore MobileNetv2 for the identification of photos of different families and non-families by considering ROI as the input. For the experiment of this work, we consider a dataset of ten classes, which include five family classes, namely, Couple, Nuclear Family, Multi-Cultural Family, Father-Child, Mother-Child and five more non-family classes, namely, Male Friends, Female Friends, Mixed Friends, Male Celebrity, Female Celebrity. The results of the proposed method are demonstrated by testing on our dataset of family and non-family photos classification. Comparative results with the existing methods show that our proposed method outperforms existing methods in terms of classification rate and F-Score.
| Item Type: | Article |
|---|---|
| Funders: | Universiti Malaya [GPF096A-2020] [GPF096B-2020] [GPF096C-2020] |
| Uncontrolled Keywords: | Human trafficking; Kinship verification; Human parsing; Deep learning; Multimodal approach; Family and non-family photos |
| Subjects: | Q Science > QA Mathematics > QA75 Electronic computers. Computer science T Technology > TA Engineering (General). Civil engineering (General) |
| Divisions: | Faculty of Computer Science & Information Technology > Department of Computer System & Technology |
| Depositing User: | Ms. Juhaida Abd Rahim |
| Date Deposited: | 28 Apr 2022 05:36 |
| Last Modified: | 28 Apr 2022 05:36 |
| URI: | http://eprints.um.edu.my/id/eprint/33738 |
Actions (login required)
 |
View Item |
