Automated extraction of pod phenotype data from micro-computed tomography

• DOI: 10.3389/fpls.2023.1120182
• Publication Date: 2023-02-24T07:14:00Z
• Authors: Evangeline Corcoran; Laura Siles; Smita Kurup; Sebastian Ahnert
• Keywords: 0301 basic medicine; 2. Zero hunger; phenotyping; Plant culture; Plant Science; computer vision; SB1-1110; micro-compute tomography; 03 medical and health sciences; machine learning; Phenotyping; Plant development; Machine learning; Computer vision; Microcompute tomography; plant development

IntroductionPlant image datasets have the potential to greatly improve our understanding of the phenotypic response of plants to environmental and genetic factors. However, manual data extraction from such datasets are known to be time-consuming and resource intensive. Therefore, the development of efficient and reliable machine learning methods for extracting phenotype data from plant imagery is crucial.MethodsIn this paper, a current gold standard computed vision method for detecting and segmenting objects in three-dimensional imagery (StartDist-3D) is applied to X-ray micro-computed tomography scans of oilseed rape (Brassica napus) mature pods.ResultsWith a relatively minimal training effort, this fine-tuned StarDist-3D model accurately detected (Validation F1-score = 96.3%,Testing F1-score = 99.3%) and predicted the shape (mean matched score = 90%) of seeds.DiscussionThis method then allowed rapid extraction of data on the number, size, shape, seed spacing and seed location in specific valves that can be integrated into models of plant development or crop yield. Additionally, the fine-tuned StarDist-3D provides an efficient way to create a dataset of segmented images of individual seeds that could be used to further explore the factors affecting seed development, abortion and maturation synchrony within the pod. There is also potential for the fine-tuned Stardist-3D method to be applied to imagery of seeds from other plant species, as well as imagery of similarly shaped plant structures such as beans or wheat grains, provided the structures targeted for detection and segmentation can be described as star-convex polygons.