A machine learning approach for cross-domain plant identification using herbarium specimens

Chulif, Sophia and Lee, Sue Han and Chang, Yang Loong and Chai, Kok Chin (2023) A machine learning approach for cross-domain plant identification using herbarium specimens. Neural Computing & Applications, 35 (8, SI). pp. 5963-5985. ISSN 0941-0643, DOI https://doi.org/10.1007/s00521-022-07951-6.

Full text not available from this repository.

Abstract

The preservation of plant specimens in herbaria has been carried out for centuries in efforts to study and confirm plant taxa. With the increasing collection of herbaria made available digitally, it is practical to use herbarium specimens for the automation of plant identification. They are also substantially more accessible and less expensive to obtain compared to field images. In fact, in remote and inaccessible habitats, field images of rare plant species are still immensely lacking. As a result, rare plant species identification is challenging due to the deficiency of training data. To address this problem, we investigate a cross-domain adaptation approach that allows knowledge transfer from a model learned from herbarium specimens to field images. We propose a model called Herbarium-Field Triplet Loss Network (HFTL network) to learn the mapping between herbarium and field domains. Specifically, the model is trained to maximize the embedding distance of different plant species and minimize the embedding distance of the same plant species given herbarium-field pairs. This paper presents the implementation and performance of the HFTL network to assess the herbarium-field similarity of plants. It corresponds to the cross-domain plant identification challenge in PlantCLEF 2020 and PlantCLEF 2021. Despite the lack of field images, our results show that the network can generalize and identify rare species. Our proposed HFTL network achieved a mean reciprocal rank score of 0.108 and 0.158 on the test set related to the species with few training field photographs in PlantCLEF 2020 and PlantCLEF 2021, respectively.

Item Type: Article
Funders: Fundamental Research Grant Scheme (FRGS) MoHE Grant from the Ministry of Higher Education Malaysia (Grant No: FRGS/1/2021/ICT02/SWIN/03/2), NEUON AI SDN. BHD.
Uncontrolled Keywords: Plant identification; Herbarium; Triplet loss; Convolutional neural networks; Computer vision
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Divisions: Faculty of Computer Science & Information Technology
Depositing User: Ms Zaharah Ramly
Date Deposited: 29 Nov 2023 01:10
Last Modified: 29 Nov 2023 01:10
URI: http://eprints.um.edu.my/id/eprint/39334

Actions (login required)

View Item View Item