Cadoni, Marinella Iole and Lagorio, Andrea and Grosso, Enrico and Huei, Tan Jia and Chan, Chee Seng (2021) From early biological models to CNNs: Do they look where humans look? In: 2020 25th International Conference on Pattern Recognition (ICPR), 10-15 Jan 2021.
Full text not available from this repository.Abstract
Early hierarchical computational visual models as well as recent deep neural networks have been inspired by the functioning of the primate visual cortex system. Although much effort has been made to dissect neural networks to visualize the features they learn at the individual units, the scope of the visualizations has been limited to a categorization of the features in terms of their semantic level. Considering the ability humans have to select high semantic level regions of a scene, the question whether neural networks can match this ability, and if similarity with humans attention is correlated with neural networks performance naturally arise. To address this question we propose a pipeline to select and compare sets of feature points that maximally activate individual networks units to human fixations. We extract features from a variety of neural networks, from early hierarchical models such as HMAX up to recent deep convolutional neural netwoks such as Densnet, to compare them to human fixations. Experiments over the ETD database show that human fixations correlate with CNNs features from deep layers significantly better than with random sets of points, while they do not with features extracted from the first layers of CNNs, nor with the HMAX features, which seem to have low semantic level compared with the features that respond to the automatically learned filters of CNNs. It also turns out that there is a correlation between CNN's human similarity and classification performance.
| Item Type: | Conference or Workshop Item (Paper) |
|---|---|
| Funders: | UNSPECIFIED |
| Uncontrolled Keywords: | Computer Science; Engineering; Imaging Science & Photographic Technology |
| Subjects: | Q Science > QA Mathematics > QA75 Electronic computers. Computer science T Technology > T Technology (General) |
| Divisions: | Faculty of Computer Science & Information Technology |
| Depositing User: | Ms. Juhaida Abd Rahim |
| Date Deposited: | 18 Feb 2022 03:09 |
| Last Modified: | 18 Feb 2022 03:09 |
| URI: | http://eprints.um.edu.my/id/eprint/26279 |
Actions (login required)
 |
View Item |
