Pl@ntNet Crops: merging citizen science observations and structured survey data to improve crop recognition for agri-food-environment applications
2023
van Der Velde, Marijn | Goëau, Hervé | Bonnet, Pierre | d'Andrimont, Raphaël | Yordanov, Martin | Affouard, Antoine | Claverie, Martin | Czúcz, Bálint | Elvekjær, Neija | Martinez-Sanchez, Laura | Rotllan-Puig, Xavier | Sima, A. | Verhegghen, Astrid | Joly, Alexis | European Commission - Joint Research Centre [Ispra] (JRC) | Botanique et Modélisation de l'Architecture des Plantes et des Végétations (UMR AMAP) ; Centre de Coopération Internationale en Recherche Agronomique pour le Développement (Cirad)-Centre National de la Recherche Scientifique (CNRS)-Institut de Recherche pour le Développement (IRD [Occitanie])-Institut National de Recherche pour l’Agriculture, l’Alimentation et l’Environnement (INRAE)-Université de Montpellier (UM) | Département Systèmes Biologiques (Cirad-BIOS) ; Centre de Coopération Internationale en Recherche Agronomique pour le Développement (Cirad) | Scientific Data Management (ZENITH) ; Centre Inria d'Université Côte d'Azur (CRISAM) ; Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire d'Informatique de Robotique et de Microélectronique de Montpellier (LIRMM) ; Centre National de la Recherche Scientifique (CNRS)-Université de Montpellier (UM)-Centre National de la Recherche Scientifique (CNRS)-Université de Montpellier (UM) | European Project: 863463,Cos4Cloud project
International audience
显示更多 [+] 显示较少 [-]英语. We present a new application to recognize 218 species of cultivated crops on geo-tagged photos, 'Pl@ntNet Crops'. The application and underlying algorithms are developed using more than 750k photos voluntarily collected by Pl@ntNet users. The app is then enriched by data and photos coming from the European Union's (EU) Land Use and Coverage Area frame Survey (LUCAS). During five tri-annual LUCAS campaigns from 2006 to 2018, 242 476 close-up 'cover' photos of crops were collected. The survey protocol for these photos specified that 'the picture should be taken at a close distance, so that the structure of leaves can be clearly seen, as well as flowers or fruits'. This unique labelled data provides an opportunity to further generalize the Pl@ntNet computer vision algorithms to recognize crops and enlarge their geographic representivity across the EU. To include LUCAS cover photos, we semantically match Pl@ntNet species and LUCAS legends, predict the species on LUCAS cover photos with the existing Pl@ntNet algorithm, and consider the accuracy of the classification and the number of species enriched by the photos. By setting a threshold of >0.5 on the Pl@ntNet prediction probabilities, 70 170 LUCAS photos representing 101 species classified with an accuracy of 0.9 were added to the 'Crops' app. The thematic accuracy of the legacy LUCAS data was improved by distinguishing 218 species, opposed to the original 36 LUCAS levels. Official and publicly financed LUCAS datastreams can now be improved because of Pl@ntNet citizen science, photo collection, and deep learning model development. Further use of the app and policy-relevant workflows in the agri-food-environment domain are discussed.
显示更多 [+] 显示较少 [-]