Laserfiche WebLink
MEMO 89.2 <br />Figure 16 shows the development of overall accuracy and Kappa Index of Agreement (KIA) of three <br />iterations of the classification refinement process. The Initial Classification (1) and the Refined <br />Classification (2) were conducted using the initial and optimized thresholds shown in Table 4 of Section <br />2.5.1. The `Final Classification' corresponds to the last iteration of the classification refinement process, <br />after manual delineation of irrigated parcel boundaries and edits from water user inputs. The overall <br />accuracy achieved in this classification was 96 percent. Notable is not only the progressive improvement <br />of overall accuracy and KIA with each refinement iteration but the diminishing gap between the KIA and <br />overall accuracy, indicating an improvement in the reliability of the results6. Error matrices and their <br />corresponding derived accuracy assessment parameters for all three classifications are presented in <br />Appendix D. <br />100% 1 <br /> <br />90% 0 <br />9 <br /> . <br />80% 0 <br />8 <br /> . <br /> sv <br />70% 0 <br />7 ~ <br /> . <br />~ ~ <br />60% 0 <br />6 Q <br />3 <br />~ . <br />. <br />~ <br />x <br />~ <br />Q 50% 0.5 0, <br /> <br />40% D <br />0 <br />4 <br /> . <br />O <br />30% fD <br />0 <br />3 ~ <br /> . <br /> rt <br />20% - 0.2 <br />10% 0.1 <br />0% 0 <br /> (1) Initial Classification (2) Refined ~3~ Final Classification <br /> Classification <br />(Overall Accuracy 68.42°k 76.54°k 96.16°k <br />~ KIA 0.37 0.53 0.92 <br />Figure 16. Overall Accuracy and Kappa Index of Agreement (KIA) for the Iterations of Irrigated Lands <br />Classification <br />The error matrices in Appendix D show an initial overestimation of irrigated lands in the first two <br />classifications. This overestimation was reduced in the classification refinement process as a result of the <br />improved calibration of the thresholds, manual delineation of parcels, and later on, with edits from <br />information obtained from water users. The overestimation can be explained in part by a decision made <br />by the analysts to be inclusive in the initial classification attempts and then proceed to eliminate the <br />identified errors gradually in the classification refinement process. Table 5 shows an evaluation of edits <br />made to the irrigated parcels data based on comments from water users. The purpose of this evaluation <br />was to corroborate results obtained with the accuracy assessment described above using a different <br />evaluation approach. From Table 5 it is evident that the amount of parcels eliminated was approximately <br />6 The Kappa Index of Agreement (KIA) is based on the difference between the actual agreement in the error matrix (i.e., the <br />agreement between the classification and the reference data as indicated by the major diagonal) and the chance agreement (i.e., <br />indicated by the marginals) (Congalton and Green 1999). The higher the KIA, the farther apart the classification results from a <br />classification resulting from chance. <br />Page 24 of 45 ~R~versfde FecAnotogy, fnc. <br />4'JaYer Resources Errgi~ecr:np an~i CansuFlrnp <br />