Figures
Abstract
This paper explores whether it is feasible to use the RGB color information in images of wheat canopies that were exposed to low temperatures during the growth season to achieve fast, non-destructive, and accurate determination of the severity of any freeze injury it may have incurred. For the study presented in this paper, we compared the accuracy of a number of algorithmic classification models using either meteorological data reported by weather services or the color gradation skewness-distribution from high-definition digital canopy images acquired in situ as inputs against a reference obtained by manually assessing the severity of the freeze injury inflicted upon wheat populations at three experimental stations in Shandong, China. The algorithms we used to construct the models included in our study were based on either K-means clustering, systematic clustering, or naïve Bayesian classification. When analyzing the reliability of our models, we found that, at more than 85%, the accuracy of the Bayesian model, which used the color information as inputs and involved the use of prior data in the form of the reference data we had obtained through manual classification, was significantly higher than that of the models based on systematic or the K-means clustering, which did not involve the use of prior data. It was interesting to note that the determination accuracy of algorithms using meteorological factors as inputs was significantly lower than that of those using color information. We also noted that the determination accuracy of the Bayesian model had some potential for optimization, which prompted us to subject the inputs of the model to a factor analysis in order to identify the key independent leaf color distribution parameters characterizing wheat freeze injury severity. This optimization allowed us to improve the determination accuracy of the model to over 90%, even in environments comprising several different ecological zones, as was the case at one of our experimental sites. In conclusion, our naïve Bayesian classification algorithm, which uses six key color gradation skewness-distribution parameters as inputs and involves the use of prior data in the form of manual assessments, qualifies as a contender for the development of commercial-grade wheat freeze injury severity monitoring systems supporting post-freeze management measures aimed at ensuring food security.
Citation: Zhang J, Huan H, Qiu C, Chen Q, Yi C, Zhang P (2024) Accurate classification of wheat freeze injury severity from the color information in digital canopy images. PLoS ONE 19(8): e0306649. https://doi.org/10.1371/journal.pone.0306649
Editor: Mojtaba Kordrostami, Nuclear Science and Technology Research Institute, ISLAMIC REPUBLIC OF IRAN
Received: May 14, 2024; Accepted: June 20, 2024; Published: August 9, 2024
Copyright: © 2024 Zhang et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the manuscript.
Funding: This study was funded by the key project of science and technology research of Shandong Meteorological Bureau (2023sdqxz12) (to JZ), the Science and Technology Project of Jiangsu Meteorological Bureau (KM202303) (to PZ). The founders are just the authors, and we have stated their roles in the “Author’s contributions” in the paper.
Competing interests: The authors have declared that no competing interests exist.
1. Introduction
Safeguarding food security is an essential requirement for maintaining global peace and stability [1, 2], but the increasingly frequent and severe consequences of extreme weather events and climate change brought about by global warming make fulfilling this task more and more arduous [3–5]. Wheat, as one of the world’s most widely grown and highest-yielding food crops [6], plays an important role in guaranteeing global food security. Overwinter freeze injury to winter wheat crops is common worldwide and in severe cases, it can result in a 30–50% yield reduction [7]. In the wheat growing areas in northern China, freeze injury is considered to be the biggest meteorological disaster befalling the farming community [8]. During our experiment, which ran from November 2022 to January 2023, the region where several of the experimental sites included in our study were located was subjected to a severe cold spell, confirming the current trend towards low-temperature spells becoming more frequent and more severe. This climatic development can be expected to exacerbate the negative impacts of freeze injury in times to come, thereby jeopardizing the stability of winter wheat production systems and increasing the risk of winter wheat yield losses [9]. Evidently, in order to ensure food security, it is imperative to timely and accurate monitor and assess the impact of freeze injury on winter wheat production systems so that appropriate remedial measures can be taken as early as possible.
Traditionally, the severity and extent of freeze injury incurred by wheat crops was usually assessed through field surveys conducted by agricultural technicians [10]. Surveys, however, have numerous limitations: they are affected by changes in the ambient environmental conditions (wind, sun angle, temperature, humidity) and circadian rhythms [11] and often suffer from inefficiencies and difficulties with respect to data quality [12]. As the development of science and technology progresses, more and more researchers looking to provide an early warning system for wheat yield losses from freeze injury have turned to utilizing multi-source information such as satellite remote sensing data and hyperspectral imagery [13–19]. Several researchers have reported successfully utilizing remote sensing image data from optical remote sensing satellites (for example optical satellites HJ-1 A and B), MODIS satellites, and multi-temporal GF-1 satellites for monitoring the severity of winter wheat freeze injury [13, 20, 21]. In addition, Feng et al. (2018) [22] found that the hyperspectral reflectance of wheat canopies at the seedling stage was significantly affected by freeze injury, allowing them to ascertain the best period and simulation techniques for estimating yield losses due to winter wheat freezing damage from hyperspectral images. However, satellite remote sensing and hyperspectral imaging techniques exhibit several shortcomings; they tend to be associated with a relatively low spatial and temporal resolution and a relatively high cost [23, 24], making them unsuitable for most agricultural meteorological services. Recently, however, the increasing availability of affordable high-resolution digital camera equipment has made the deployment of digital imagery much more accessible, and, as a result, a growing number of studies have started to utilize digital images for both qualitative and quantitative characterization of the phenotypic traits of crop plants [25, 26]. Reported findings include that the color of leaves gleaned from a digital image can be used as an indicator for crop growth and environmental stress [27–30]. Elaborating on these reports, Chen et al. (2020) [31] proposed a method for deriving a number of crop damage indicators from the so-called Color Gradation Skewness-Distribution (CGSD) parameters extracted from the leaf color information in digital canopy images, which heralded the use of digital images for rapid and nondestructive assessment of wheat freeze injury severity [32]. In an attempt to further Chen’s proposal, the study presented in this paper outlines a naïve Bayesian algorithm that takes a number of these CGSD parameters as inputs in order to provide a classification for the severity of any freeze injury it has incurred. It should be noted that, when applied to image classification, models based on Bayesian classification algorithms tend to be more successful when using prior data to reduce overfitting during training; using a prior improves the algorithm’s robustness and capacity for making generalizations.
Our study used high-definition digital images of wheat canopies made before and after the winter wheat growing season by crop growth observers in wheat fields at research stations at the following three locations in Shandong Province: Gaomi City (resorting under Weifang City), Jiyang District (resorting under Jinan City) and Qihe County (resorting under Dezhou City). By combining a prior obtained through manual classification with data analyses based on K-means clustering, systematic clustering and naïve Bayesian classification, we managed to construct a model capable of rapidly and non-destructively classifying wheat freeze injury severity from the leaf color information in digital wheat canopy images. We hope that our study can improve the accuracy and timeliness of the freeze injury monitoring, provide technological support for mitigating the impacts of freeze injury and help limiting yield losses due to cold weather.
2. Materials and methods
2.1 Experimental design
Our study involves data from three experimental sites. One of these was located in Jiangzhuang Town, which resorts under Gaomi City, Weifang City in eastern Shandong Province (36°28’12"N, 119°43’48"E). The other two were at the Experimental Station of the Shandong Academy of Agricultural Sciences in Taiping Town, which is in the Jiyang District of Jinan City (36°58’38"N, 116°58’282"E), and in Jiaomiao Town in Qihe county, which resorts under Dezhou City (N36°40’32"N, 116°38’56"E), both in northern Shandong Province (see Fig 1).
As the experimental subjects we used the wheat variety Yangguang 818 at the Gaomi site, Jimai 44 at the Jiyang site and Jimai 22 at the Qihe site.
The experimental wheat was sowed using strip sowing with a row spacing of 0.2 m. It should be noted that local differences between the growing environments in the northern and eastern regions of Shandong affected the start of the wheat growing season, which is why the sowing date we used for the Gaomi site was earlier than that used for the other two sites.
2.2 Collection of canopy images
The wheat canopy images we used for our study were acquired in situ, using a camera with an image resolution of 1920×1080 pixels (model number: DH-SD-65F630U-HN-Q; manufacturer: Zhejiang Dahua Technology Co. Ltd, China), which was mounted on top of a mast measuring 580 cm in height (see Fig 1). When creating the images, we applied a fixed focal length exposure and the automatic white balance feature provided by the camera. Images were acquired every day at 16:00 for the duration of the experiment. At the Gaomi site, the experiment ran from November 22, 2022 to January 21, 2023; at the Jiyang site it ran from November 10, 2022 to January 13, 2023, and at the Qihe site it ran from November 23, 2022 to January 26, 2023. To improve the accuracy of the color gradation, we discarded images acquired during conditions of intense lighting, frost or snow cover, leaving us with a total of 78 canopy images we deemed usable as input for our analysis; 16 images were acquired at the Gaomi site, 31 at the Jiyang site, and 31 at the Qihe site (see Table 2).
2.3 Meteorological data acquisition
Our experiment used meteorological data collected by in-situ microclimate observatories at each site, as well as meteorological data obtained from the national weather stations in Gaomi, Jiyang and Qihe. The Shandong Meteorological Information Center codes representing the meteorological factors used in our study are shown in Table 1.
2.4 Determination of the CGSD parameters
To determine the CGSD parameters characterizing wheat freeze injury severity, we used the method proposed by Chen et al. (2020) [31], which involves obtaining a histogram of the cumulative color gradation from the canopy images we acquired, and separating, denoising, and ordering the resulting RGB information. Subsequent application of mean, median, mode, skewness, and kurtosis functions yields the following 20 CGSD parameters: RMean, RMedian, RMode, RSkewness, RKurtosis, GMean, GMedian, GMode, GSkewness, GKurtosis, BMean, BMedian, BMode, BSkewness, BKurtosis, YMean, YMedian, YMode, YSkewness and YKurtosis, where the quantities labeled R refer to the red channel of the image, those labeled G refer to the green channel, those labeled B refer to the blue channel, and those labeled Y refer to the gray-level image. A detailed description of how these parameters were extracted from the images can be found in the aforementioned paper by Chen et al.
2.5 Classification of wheat freeze injury severity
2.5.1 Manual classification of wheat freeze injury severity according to the standard.
Our study deployed the services of three agrometeorological observers with associate senior titles who performed daily manual assessments of the severity of the wheat freeze injury inflicted upon the experimental crops through on-site inspection of the wheat leaf color and the extent of any frozen leaf areas. Our consultants followed the “Specification for Agrometeorological Observations” [33], which classifies the severity of observed wheat freeze injury into the following three categories: no freeze injury, mild freeze injury, and severe freeze injury. In the subsequent analysis, we assigned 0 to no freeze injury, 1 to mild freeze injury, and 2 to severe freeze injury (see Table 2).
2.5.2 Classification using clustering and Bayesian methods.
To classify the severity of wheat freeze injury from the CGSD characteristics extracted from canopy images, we used algorithms involving K-means clustering, systematic clustering and Bayesian classification based upon meteorological factors or CGSD parameters extracted from digital canopy images.
K-means clustering and systematic clustering are commonly used for algorithmic classification methods [34, 35]; neither of these needs a prior, meaning they can both obtain results directly from the input variables, which is typical for this type of unsupervised learning algorithm. Bayesian classification methods, on the other hand, use a so-called naïve Bayesian classifier, which needs to be obtained through training the algorithm with prior data in order to build a probabilistic model. Only after completing the training step, the model can be used to classify new data [36–38].
For our study, we decided to divide the canopy images into four equal sections, and use each section as a sample to be used as input for our algorithms: The upper-left section of each image at Gaomi and Jiyang stations was selected to construct the modeling group sample, with a total of 47 images; the remaining three sections were used for validation, with a total of 141 images (see Fig 2). In addition, the images acquired at the Qihe station were also divided into four equal sections and used for applied testing, with a total of 124 images (see Table 1).
Using either the 20 CGSD parameters extracted from the 47 modeling samples shown in Table 2 or the 31 meteorological factors shown in Table 1 as inputs for models based on one of the aforementioned algorithms, we constructed the wheat freeze injury class classification models shown in Table 3: Models F1 and F2 use meteorological factors and CGSD parameters as inputs for a systematic clustering algorithm, respectively; Models F3 and F4 use meteorological factors and CGSD parameters as inputs for a K-means algorithm, respectively; and Model F5 uses CGSD parameters as inputs for a Bayesian classification model while using the same categories as those used for manual assessment of the wheat freeze injury severity (see section “2.5.1 Manual Classification of wheat freeze injury severity according to the standard”) as the output variables.
2.5.3 Detailed description of the factor analysis used to optimize model F5.
Factor analyses can be used to extract a limited number of indicators that characterize a large set of variables, thus simplifying the task of screening and structuring the data. Using the factor analysis method proposed by Zhang et al. (2022) [32], we reduced the set of 20 CGSD parameters to a total of six key indicators for wheat freeze injury severity, and used those as inputs for an optimized version of the Bayesian model F5. Our factor analysis included the steps described below.
- We used the top-left sections of the 47 images acquired at the Gaomi and Jiyang stations to determine the 20 CGSD parameters described in section “2.4 Determination of the CGSD parameters”. The resulting parameters were subjected to the Kaiser-Meyer-Olkin (KMO) test and Bartlett’s sphericity test, and the samples for which the KMO value was higher than 0.7 while the P value associated with Bartlett’s test was lower than 0.05 were qualified to be passed on to the next step of factor analysis.
- We then determined the most significant composite factor based on the eigenvalues, cumulative contribution ratios, and fragmentation diagrams characterizing each parameter.
- Using the index i to enumerate the CGSD parameters, we calculated a principal component score for each parameter using the following formula:
In this formula, FSCi denotes the principal component score; VDRj denotes the variance contribution of composite factor j; CDRj is the cumulative contribution rate of composite factor j; and SCij is the contribution of composite factor j to parameter i. The five parameters with the highest absolute value of their principal component score were identified as the key indicators of wheat freeze injury severity.
2.5.4 Accuracy determination of nominal wheat freeze injury severity classification algorithms
Based on the classification results from the agrometeorological observers in 2.5.1, the wheat freeze injury severity classification accuracy of the classification algorithms in 2.5.2 and 2.5.3 was calculated. The formula is as follows:
(2)
3. Results
3.1 Freezing-induced changes in the color distribution of wheat canopy images
Plants exposed to severe abiotic stress tend to suffer from significant impairments to their growth and development. The most common adversity experienced by winter crops is freeze injury due to excessive cooling under the influence of cold air during cold weather periods. In order to determine whether it is possible to assess the severity of freeze injury suffered by wheat crops from digital canopy images, we selected three images of the canopies of wheat populations at Gaomi station that, according to the manual assessment described in section “2.5.1 Mannual Classification of wheat freeze injury severity according to the standard”, exhibited different degrees of freeze injury, and subjected them to a comparative analysis with respect to histograms revealing their color scale distribution and color bias (Fig 3). Our findings indicated that the color distribution histograms of images of canopies affected by various degrees of freeze injury exhibited an amount of shifting, flattening and skewing that was directly proportional to the degree of freeze injury. The color shift we observed suggests that the color of a wheat canopy turns lighter after being exposed to freezing; evidently, the leaf color gradually changed from bright green to yellow-green and ultimately to yellow. The flattening and skewing we observed indicates that the number of leaf colors present in the canopy increases with the severity of the freeze injury: in the absence of freeze injury, the canopy leaf color is bright green, which is reflected by its leaf color scale value being relatively concentrated; under the influence of freeze injury, however, the canopy color changes from bright green to yellow-green, thereby introducing additional colors that spread out the leaf color histogram and flatten and skew its shape. The color of leaves that were afflicted by severe freeze injury was a neutral yellow, which confirms that changes in the distribution of leaf colors in a wheat canopy are proportional to the severity of the freeze injury it suffered.
3.2 Wheat freeze injury severity correlation with meteorological factors and CGSD parameters
The wheat freeze injury severity exhibited a significantly correlation with the meteorological factors included in our study (Table 4). At p < 0.01, Z1 was significantly positively correlated with the wheat freeze injury severity while Z2-16 and Z20-28 were significantly negatively correlated. It should be noted that except for cumulative temperature, the farmland microclimate factors (Z5-13) exhibited a stronger correlation with the freeze injury severity than the other meteorological factors, as reflected in the absolute values of the corresponding correlation coefficients exceeding 0.7.
The wheat freeze injury severity also exhibited a significant correlation with the CGSD parameters extracted from images of an affected wheat canopy (Table 5). At p < 0.01, all five leaf color parameters extracted from the red (R) channel of the leaf color distribution (RMean, RMedian, RMode, RSkewness and RKurtosis), as well as the kurtosis parameter extracted from the green (G) channel (Gkurtosis), the mean and median parameters extracted from the blue (B) channel (BMean, BMedian) and the mean, median and kurtosis parameters extracted from the gray-level image (YMean, YMedian and YKurtosis) were significantly correlated with the observed wheat freeze injury severity, and at p < 0.05, the same was true for the plurality and kurtosis parameters extracted from the B channel (BMode and BKurtosis) as well as for the plurality parameter extracted from the gray-level image (YMode). It is interesting to note that although both the CGSD parameters extracted from the leaf color distribution and the meteorological factors exhibited evidence of being strongly correlated with the wheat freeze injury severity, the magnitude and direction of the correlations we observed for the CGSD parameters was varied: The parameters associated with leaf color depth (mean value, median value, and plurality) tended to be strongly and positively correlated with the wheat freeze injury severity, whereas those associated with the color distribution (skewness and kurtosis) tended to be less strongly and negatively correlated.
3.3 Accuracy of nominal wheat freeze injury severity classification algorithms
To assess the accuracy of the classification algorithms described in section “2.5.2 Classification using clustering and Bayesian methods”, we compared the classifications they provided against the results obtained through manual assessment.
With respect to the clustering algorithms, which do not involve the use of prior data, we found that the accuracy of the classification algorithms based on systematic clustering or K-means clustering using wheat canopy leaf color information as the independent variable (F2 and F4) were 63.83% and 72.34%, respectively, while the accuracy of the corresponding algorithms using meteorological factors as the independent variable (F1 and F3) was only 4.20% and 23.04%, respectively (Table 6). Evidently, classification based on clustering leaf color information is significantly more accurate than classification based on clustering meteorological factors, but nevertheless, even the former only reached an accuracy level of about 70%, which is insufficient for the purpose of commercial wheat freeze injury monitoring.
Bayesian classification algorithms do involve the use of prior data, and for the naïve Bayesian classification algorithm used for our study (F5) we utilized the manually assessed wheat freeze injury severity classification (see section “2.5.1 Manual Classification of wheat freeze injury severity according to the standard”) to fulfill this purpose. As the independent variable, we used the CGSD parameters extracted from the modeling sections of canopy images acquired at the Gaomi and Jiyang stations. After analyzing the classification results we obtained by subjecting the modeling samples to F5 (Table 7), we found that its accuracy, which ranged from 81.25% to 100% with an average value of 87.23%, was significantly higher than that of the algorithms that do not involve the use of prior data. When using the validation samples, the accuracy ranged from 85.42% to 100%, with an average value of 90.07%.
3.4 Optimization of the Bayesian classification model
In the light of the accuracy analysis provided in the previous section, we concluded that the best approach to monitoring wheat freeze injury severity is to deploy a Bayesian algorithm that involves using prior data. However, analysis of the results obtained by applying the nominal Bayesian algorithm F5 described before to canopy images acquired at Qihe station revealed that the accuracy it achieved in this practical application, which included cross-ecological zones, was only 66.13% (Table 8), and therefore below the commercially required accuracy level. In this section, we propose and evaluate several optimizations of the Bayesian classification model aimed at improving its accuracy in this type of situation.
In our attempt to optimize the F5 model, we took a closer look at the 20 CGSD parameters it uses a inputs. Although these parameters can comprehensively characterize the leaf condition, we found evidence of covariance among them, and, as previously reported, the accuracy of a classification model using too many covariate variables as inputs can end up being compromised (Zhang et al. 2020). To overcome this issue, we carried out a factor analysis to determine which subset of the 20 CGSD parameters we extracted were the key indicators for wheat freeze injury, thus allowing us to disregard less relevant covariate parameters and removing any interference they may introduce. Before carrying out our factor analysis, we first subjected the CGSD parameters to a sphericity test. The KMO value we found was 0.781, and the associated P-value according to Bartlett’s test was close to zero, indicating that the data was suitable for being subjected to factor analysis. After performing the sphericity test we carried out an ANOVA analysis on the parameter set, the results of which are shown in Table 9. The results enabled us to identify the two most promising composite factors (labeled “1” and “2” in Table 9), which were characterized by having an eigenvalue significantly greater than one as well as a significant cumulative variance contribution. A loading analysis of these two composite factors, the results of which are shown in Table 10, revealed that the parameters with the highest load with respect to composite factor 1 were GSkewness, GMedian, GMode, GMean, YSkewness, and YMode, and that those with the highest load with respect to composite factor 2 were RKurtosis, YKurtosis, GKurtosis, RMode, RSkewness, and BKurtosis. Further analysis of the scores of these parameters allowed us to identify the six key parameters reflecting the bias of the RGB color distribution of the canopy images as RKurtosis, GSkewness, GMedian, GMode, YSkewness, and GMean.
We then optimized the Bayesian classification model F5 by limiting the input parameters to these six key parameters, thus obtaining model F5Optimized. The test results of applying F5Optimized to the acquired samples are shown in Table 11; the results indicate that the overall accuracy of F5Optimized with respect to the modeling samples and the validation samples from the same image is close to that of model F5, and that, at 90.32%, it is significantly better than that of F5 with respect to the validation samples from other images.
4. Discussion
Wheat freeze injury frequently befalls winter wheat crops exposed to low temperatures during their growth period. At present, the most common way to monitor the severity of winter wheat freeze injury is to evaluate meteorological observation data using established meteorological assessment indicators for the occurrence of wheat freeze injury [39, 40]. Meteorological observation stations, however, are usually located in the suburbs of cities far away from the farmland, and the meteorological data they acquire is unlikely to accurately reflect the microclimatic conditions existing at actual wheat production facilities; for this reason, the results produced by wheat freeze injury severity monitoring methods using meteorological indicators often exhibit significant errors. A potentially more reliable approach to wheat freeze injury severity monitoring might be to make use of the fact that wheat freeze injury is associated with a significant color change of the leaves, stalks, and other organs of affected plants. The study presented in this paper proposes a method for monitoring wheat freeze injury severity utilizing high-definition digital images of wheat canopies acquired in situ at wheat fields throughout Shandong Province. It investigates the correlations between the wheat freeze injury severity grade, a number of meteorological factors and a number of parameters extracted from the leaf color distribution in wheat canopy images.
Our results indicate that the sensitivity of the response of both the meteorological factors we investigated and the CGSD parameters we extracted from the leaf color distribution to the freeze injury severity inflicted upon the canopy was sufficient to merit using them as indicators. However, in terms of accuracy, the methods using the leaf color as input consistently outperformed those using meteorological factors as inputs. A possible explanation for this finding is that the wheat freeze injury severity is not determined by a single factor: in addition to meteorological factors, the growth stage of the affected wheat population also plays an essential role in the severity of the impact of cold temperatures, and because the leaf color directly depends on the plant growth stage, freeze injury severity assessment methods based on leaf color implicitly include the growth stage as a factor. In terms of accuracy, we found that leaf-color-based wheat freeze injury severity classification methods deploying algorithms that do not involve the use of prior data (notably K-means clustering and systematic clustering) typically exhibited an accuracy of less than 75%, whereas the accuracy of Bayesian classification methods, which do involve the use of prior data, turns out to be better. When applying the Bayesian leaf-color-based wheat freeze injury severity classification we developed for this study to the images acquired at the experimental stations in Gaomi and Jiang sites, we found that the average accuracy exceeded 85%, which meets commercial requirements.
With respect to the results obtained at the experimental station in Qihe, however, the accuracy of our Bayesian model was only 66.13%, which was likely due to the fact that the station encompasses several different ecological zones. In an attempt to improve the accuracy of our model in this kind of situation, we took a closer look at the CGSD parameters. It has been suggested that, although the CGSD parameters can adequately characterize the leaf color information needed to assess the wheat freeze injury severity, a degree of covariance exists among these parameters [31]. This covariance amplifies the contributions of specific parameters, which in turn affects the determination accuracy of classification models using CGSD parameters as inputs. Zhang et al. (2020) [41] proposed the use of factor analysis, principal component extraction and other methods to construct new composite factors from more than one hundred meteorological factors. After the development of a new zoning index, those new factors could replace the traditional factors as inputs for classification models, thereby improving their accuracy by solving the problems caused by using too many input variables [41]. It should be noted that composite factors have certain limitations: they can be difficult to calculate and extract and they tend to require complication transformations before they can be applied by a model, which might constrain the large-scale application of models using them. For our study, however, these limitations were surmountable, so in order to improve the accuracy of our Bayesian model, we carried out a factor analysis and used the result to optimize the model by limiting the factors used as inputs to the Bayesian model to two composite factors calculated from the six most independent key parameters, thereby removing any inaccuracies caused by covariance between the CGSD parameters. The six key parameters we identified were RKurtosis, GSkewness, GMedian, GMode, YSkewness, and GMean. The accuracy of the optimized classification model reached 90.32% when applied to the data acquired at Qihe station, while the accuracy when applied to the acquired at Gaomi and Jiyang station was similar to that of the model before optimization.
Because the leaf color parameters used in our study were based on descriptive statistics associated with a skewed color distribution, the number of basic leaf color parameters that the traditional RGB color model could extract was greatly expanded. However, the classification model could only maintain a high accuracy in the presence of precise or high correlation between the parameters. Our results confirm that factor analysis can be used to determine the key leaf color parameters and remove inaccuracies caused by amplification of certain parameters due to factor covariance, thus providing a promising approach to constructing a scientifically sound and stable Bayesian wheat freeze injury severity classification model that is accurate enough to meet the requirements for commercial wheat freeze severity monitoring.
5. Conclusions
This paper explores the potential for utilizing the color information in digital images of crop canopies for classifying wheat freeze injury classes. Our results lead to the following conclusions:
- Both meteorological factors and the color information in digital images of wheat canopies correlate well with the observed wheat leaf freeze injury severity, which proves the concept of using meteorological factors and leaf color information to classify wheat freeze injury severity.
- The accuracy of models using leaf color information as input was significantly higher than that of models using meteorological factors as inputs, whether they involved the use of prior data or not.
- At the experimental stations in Gaomi and Jiyang, the classification accuracy of the Bayesian classification model we tested, which involved the use of prior data in the form of manually assessed wheat freeze injury severity classifications, was over 85%, which was significantly higher than that of the systematic clustering and K-means clustering models that did not involve the use of prior data. At the experimental station in Qihe, however, which encompassed different ecological zones, the accuracy reached only 66.13%, but after optimizing our Bayesian wheat freeze injury severity classification model through factor analysis, its accuracy was over 90%, which is significantly better than before optimization and suggests that the optimized model might be applicable to a wide range of wheat production sites.
The identification method of wheat freeze injury severity obtained in this paper is based on the rule that wheat canopy color characteristics are different under different freeze injury severity. This method can also be applied to the intelligent judgment of other agrometeorological disasters such as drought, high temperature, etc. However, we found that the collected wheat canopy image needed to be eliminated in the research due to light interference and lens attachment interference, which greatly reduced the utilization rate of the images and the efficiency of analysis and application. In the future, we should explore ways to solve this problem. On the one hand, the equipment can be optimized from the crop image acquisition terminal; In addition, correction algorithms for canopy images under different light conditions can also be explored.
References
- 1. Liang XY, JIN XB, HAN B, et al. China’s food security situation and key questions in the new era: A perspective of farmland protection. Journal of Geographical Sciences, 2022, 32(6): 1001–1019. https://doi.org/10.1007/s11442-022-1982-9.
- 2. Lu YJ, Zhang YX, Hong Y, et al. Experiences and lessons from Agri-Food system transformation for sustainable food security: A review of China’s practices. Foods, 2022, 11(2): 137. pmid:35053869
- 3. Zhou TJ, Chen XL, Wu B. Frontier issues on climate change science for supporting Future Earth. Chinese Science Bulletin, 2019, 64(19): 1967–1974. (in Chinese)
- 4. Zhou BT, Qian J. Changes of weather and climate extremes in the IPCC AR6. Climate Change Research, 2021, 17 (6): 713–718. (in Chinese)
- 5. Yu R, Zhai PM, Advances in scientific understanding on compound extreme events. Trans Atmos Sci, 2021, 44 (5): 645–649. (in Chinese)
- 6. Shiferaw B, Smale M, Braun HJ. et al. Crops that feed the world 10. Past successes and future challenges to the role played by wheat in global food security. Food Security, 2013, 5: 291–317. https://doi.org/10.1007/s12571-013-0263-y.
- 7. Li MS, Wang DL, Zhang Q, et al. Cause analysis of frost damage to winter wheat in Huang-Huai-Hai plain during 2004–2005. Journal of Natural Disasters, 2005, 14(4): 51–55. (in Chinese)
- 8. Zhao LC, Li QZ, Zhang Y, et al. Normalized NDVI valley area index (NNVAI)-based framework for quantitative and timely monitoring of winter wheat frost damage on the Huang-Huai-Hai Plain, China. Agriculture, Ecosystems & Environment. 2020, 292 (0):106793–106793. https://doi.org/10.1016/j.agee.2019.106793.
- 9. Zheng BY, Chenu K, Fernanda DM, et al. Breeding for the future: What are the potential impacts of future frost and heat events on sowing and flowering time requirements for Australian bread wheat (Triticumaestivium) varieties? Global Change Biology, 2012, 18(9): 2899–2914. pmid:24501066
- 10. Tappi M, Carucci F, Gagliardi A, et al. Crop varieties, phenological phases and the yield-weather relationship: evidence from the Italian durum wheat production. Bio-based and Applied Economics, 2023, 12(2): 115–125. https://doi.org/10.36253/bae-13745.
- 11. Felderhoff TJ, Murray SC, Klein PE, et al. QTLs for energy-related traits in a sweet×grain sorghum [Sorghum bicolor (L.) Moench] mapping population. Crop Science, 2012, 52(5): 2040–2049. https://doi.org/10.2135/cropsci2011.11.0618.
- 12. Xie C, Yang C. A review on plant high-throughput phenotyping traits using UAV-based sensors. Computers and Electronics in Agriculture, 2020, 178: 105731. https://doi.org/10.1016/j.compag.2020.105731.
- 13. Chen D, Liu BC, Lei TJ, et al. Monitoring and Map Winter Wheat Spring Frost Damage with MODIS Data and Statistical Data. Plants, 2023, 12(23): 3954. https://doi.org/10.3390/plants12233954.
- 14. Wu YH, Ma Y, Hu X, et al. Narrow-waveband spectral indices for prediction of yield loss in frost-damaged winter wheat during stem elongation. European Journal of Agronomy. 2021;124 (0):126240–126240. https://doi.org/10.1016/j.eja.2021.126240.
- 15. Zhao YQ, Xiao DP, Bai HZ, et al. Climatic suitability of winter wheat and summer maize in the North China Plain. Chinese Journal of Ecology, 2020, 39(7): 2251–2262. (in Chinese)
- 16. Xie YK, Wang C, Yang WD, et al. Canopy hyperspectral characteristics and yield estimation of winter wheat (Triticumaestivum) under low temperature injury. Scientific Reports, 2020, 10(1): 244. pmid:31937859
- 17. Liu YX, Yu R, Wu JH, et al. High-throughput phenotyping for different genotype wheat frost using UAV-based remote sensing. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2023, 39(5): 128–136. (in Chinese). 10.11975/j.issn.1002-6819.202206279.
- 18. Ejaz I, Li W, Naseer MA, et al. Detection of combined frost and drought stress in wheat using hyperspectral and chlorophyll fluorescence imaging. Environmental Technology & Innovation, 2023, 30: 103051. https://doi.org/10.1016/j.eti.2023.103051.
- 19. Shammi S, Sohel F, Diepeveen D, et al. Machine learning-based detection of frost events in wheat plants from infrared thermography. European journal of agronomy, 2023,149: 126900. https://doi.org/10.1016/j.eja.2023.126900.
- 20. Wang HF, Huo ZG, Zhou GS, et al. Monitoring and forecasting winter wheat freeze injury and yield from multi-temporal remotely sensed data. Intelligent Automation & Soft Computing, 2015, 22(2): 255–260. https://doi.org/10.1080/10798587.2015.1095475.
- 21.
Guo Y, Wang LG, He J, et al. Monitoring and estimation of late spring frost and its impact on winter wheat through multi-temporal GF-1 remotely sensed imagery[C]//2021 9th International Conference on Agro-Geoinformatics (Agro-Geoinformatics). IEEE, 2021: 1–5. https://doi.org/10.1109/Agro-Geoinformatics50104.2021.9530308.
- 22. Feng M, Guo X, Wang C, et al. Monitoring and evaluation in freeze stress of winter wheat (Triticumaestivum L.) through canopy hyperspectrum reflectance and multiple statistical analysis. Ecological Indicators, 2018, 84: 290–297. https://doi.org/10.1016/j.ecolind.2017.08.059.
- 23. Wang S, Chen J, Rao Y, et al. Response of winter wheat to spring frost from a remote sensing perspective: Damage estimation and influential factors. ISPRS Journal of Photogrammetry and Remote Sensing, 2020, 168: 221–235. https://doi.org/10.1016/j.isprsjprs. 2020.08.014.
- 24. Wang ZG, Wang HQ, Feng MC, et al. Study on the monitoring and classification of winter wheat freezing injury in spring based on 3S technology. The Journal of Agricultural Science,2021,159(9–10): 623–635. https://doi.org/10.1017/S0021859621001076.
- 25. Chen DJ, Neumann K, Friedel S, et al. Dissecting the phenotypic components of crop plant growth and drought responses based on high-throughput image analysis. Plant Cell, 2014, 26: 4636–4655. pmid:25501589
- 26. Vasseur F, Bresson J, Wang G, et al. Image-based methods for phenotyping growth dynamics and fitness components in Arabidopsis thaliana. Plant Methods. 2018, 14: 63. pmid:30065776
- 27. Humplík J F, Lazár D, Husičková A, et al. Automated phenotyping of plant shoots using imaging methods for analysis of plant stress responses-a review. Plant Methods, 2015a, 11, 29. pmid:25904970
- 28. Barbedo JGA. Detection of nutrition deficiencies in plants using proximal images and machine learning: A review. Computers and Electronics in Agriculture, 2019, 162: 482–492. https://doi.org/10.1016/j.compag.2019.04.035.
- 29. Fu XQ, Bai Y, Zhou J, et al. A Method for Obtaining Field Wheat Freezing Injury Phenotype Based on RGB Camera and Software Control. Plant Methods, 2021, 17(1): 1–10. https://doi.org/10.21203/rs.3.rs-779098/v1.
- 30. Liu YW, Ban ST, Wei SW, et al. Estimating the frost damage index in lettuce using UAV-based RGB and multispectral images. Frontiers in Plant Science, 2024, 14: 1242948. pmid:38239223
- 31. Chen ZM, Wang FZ, Zhang P, et al. Skewed distribution of leaf color RGB model and application of skewed parameters in leaf color description model. Plant Methods, 2020, 16, 23. pmid:32127910
- 32. Zhang P, Chen ZM, Wang FZ, et al. Response of Population Canopy Color Gradation Skewed Distribution Parameters of the RGB Model to Micrometeorology Environment in Begonia Fimbristipula Hance. Atmosphere, 2022, 13, 890. https://doi.org/10.3390/atmos13060890.
- 33.
China Meteorological Administration (CMA). Specification for Agrometeorological Observations. Beijing: China Meteorological Press, 1993. (in Chinese)
- 34. Erisoglu M, Calis N, Sakallioglu S. A new algorithm for initial cluster centers in k-means algorithm. Pattern Recogn Lett, 2011, 32: 1701–5. https://doi.org/10.1016/j.patrec.2011.07.011.
- 35. Reza MN, Na IS, Baek SW, Lee KH. Rice yield estimation based on K-means clustering with graph-cut segmentation using low-altitude UAV images. Biosyst Eng, 2019, 177: 109–21. https://doi.org/10.1016/j.biosystemseng.2018.09.014.
- 36. Kumar Y, Singh R, Moudgil MR, et al. A Systematic Review of Different Categories of Plant Disease Detection Using Deep Learning-Based Approaches. Archives of Computational Methods in Engineering, 2023, 30(8):4757–4779. https://doi.org/10.1007/s11831-023-09958-1.
- 37. Murphy K, Ludwig E, Gutierrez J, et al. Deep Learning in Image-Based Plant Phenotyping. Annual Review of Plant Biology. 2024;75 (1):0–0. pmid:38382904
- 38. Abade A, Ferreira PA, Vidal FdB. Plant diseases recognition on images using convolutional neural networks: A systematic review. Computers and Electronics in Agriculture. 2021;185 (0):106125–106125.
- 39. Zheng DX, Yang XG, Mínguez MI. Effect of freezing temperature and duration on winter survival and grain yield of winter wheat. Agricultural and forest meteorology, 2018, 260: 1–8. https://doi.org/10.1016/j.agrformet.2018.05.011.
- 40. Meng FY, Feng LP, Zhang FY, et al. Temporal and spatial variations of winter wheat freezing injury in northern winter wheat region. Acta Agronomica Sinica, 2019, 45(10): 1576–1585. (in Chinese). 10.3724/SP.J.1006.2019.81076.
- 41. Zhang P, Chen ZM, Liu CW, et al. Method for the prediction of wheat yield components. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2020, 36(8): 78–87. (in Chinese)