{"id":260,"date":"2023-10-04T14:05:37","date_gmt":"2023-10-04T14:05:37","guid":{"rendered":"https:\/\/staging-venezuela.mapbiomas.org\/?page_id=260"},"modified":"2023-11-10T14:10:08","modified_gmt":"2023-11-10T14:10:08","slug":"exactitud","status":"publish","type":"page","link":"https:\/\/venezuela.mapbiomas.org\/en\/exactitud\/","title":{"rendered":"Accuracy"},"content":{"rendered":"

ESTIMATES OF THE ACCURACY OF GROUND COVER MAPPING BY THE VENEZUELA MAPBIOMAS PROJECT<\/h4>\n\n\n\n

ACCESS TO THE COLLECTION STATISTICS PANEL 1.0 <\/em>[LINK]<\/strong><\/p>\n\n\n\n

Accuracy analysis is the primary way to assess the quality of the mapping performed by MapBiomas. In addition to telling what the overall hit rate is, the accuracy analysis also reveals estimates of the hit and miss rates for each assigned class. MapBiomas Venezuela evaluated the global precision and for each class of use and cover for all the years between 1985 and 2022.<\/p>\n\n\n\n

Precision estimates were based on evaluating a sample of pixels, which we call the reference database, consisting of ~71,500 samples. The number of pixels in the reference database was predetermined by statistical sampling techniques. In each year, each pixel in the reference database was evaluated by technicians trained in visual interpretation of Landsat images. The accuracy evaluation was performed using metrics that compare the assigned class with the class evaluated by the technicians in the reference database.<\/p>\n\n\n\n

In each year, the precision analysis is performed from the cross-tabulation of the sampled frequencies of the mapped and actual classes, in the format of Table 1. The frequencies ni,j<\/em> represent the number of pixels in the sample classified as class i, and evaluated as class j. Marginal line totals \"\" represent the number of samples mapped as class i, while the marginal totals of columns \"\"  represent the number of samples evaluated by the technicians as class j. Table 1 is called the error matrix or confusion matrix.<\/p>\n\n\n\n

Table 1: Generic sample error matrix<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

From the results in Table 1, the sample proportions in each table cell are estimated by \"\" \"\". The Value Matrix \"\" then used to generate:<\/p>\n\n\n\n

    \n
  1. The user precision:<\/strong> are the estimates of the pixel fractions of the mapping, for each class, correctly classified. User accuracy is associated with a commission error<\/strong>, which is the error made when assigning a pixel to class i, when it belongs to another class. The user precision for class i is estimated by \"\" and the commission error for \"\"These metrics are associated with the reliability <\/strong>from each assigned class. <\/li>\n\n\n\n
  2. Producer Accuracy:<\/strong> these are the sample fractions of pixels from each class correctly assigned to their classes by the classifiers. Producer precision is associated with the omission error<\/strong>, which occurs when we cannot assign a pixel of class j correctly. The producer precision for class j is estimated by \"\" and the omission error<\/strong> by \"\"These metrics are associated with the sensitivity <\/strong>of the classifier, that is, the ability to correctly distinguish a particular class from others.<\/li>\n\n\n\n
  3. overall precision:<\/strong> It is the estimate of the overall correctness ratio of the classifiers. The estimate is given by \"\", the sum of the main diagonal of the proportions matrix. The precision complement or the error total<\/strong> \"\" it still breaks down into area disagreement and assignment disagreement1<\/strong><\/a>. Area discrepancy measures the fraction of the error attributed to the amount of area misallocated to classes by the mapping, while assignment discrepancy measures the proportion of offset errors.<\/li>\n<\/ol>\n\n\n\n

    The matrix also provides estimates of the different types of errors. For example, it is possible to see through these the estimation of the composition of the area of \u200b\u200beach assigned class. Therefore, in addition to the success rate of the class assigned as forest, for example, we also estimate what fraction of these areas may be pasture or other land cover and use classes, per year. We understand that this level of transparency informs users and maximizes the potential of mapping various types of users.<\/p>\n\n\n\n

    1- Pontius Jr, R. G., & Millones, M. (2011). Death to Kappa: birth of quantity disagreement and allocation disagreement for accuracy assessment. International Journal of Remote Sensing, 32(15), 4407-4429.<\/strong><\/a><\/p>\n\n\n\n

    \n\n\n\n

    ABOUT THE GRAPHICS<\/h4>\n\n\n\n

    GENERAL STATISTICS<\/h4>\n\n\n\n

    Show the mean yearly total precision and the decomposed error for area and assignment disagreement.\"\"<\/p>\n\n\n\n

    Graph 1. Total annual precision graph<\/strong><\/h4>\n\n\n\n

    This graph shows the total precision and the total error by year. Total error is broken down into area disagreement and assignment disagreement. Precision is plotted at the top and errors at the bottom of the graph.<\/p>\n\n\n\n

    \"\"<\/figure>\n\n\n\n

    Graph 2. Error matrix<\/strong><\/h4>\n\n\n\n

    This chart shows the accuracy of user, producer, and class confusion, for each year. The first shows the confusions of each assigned class. The second shows the confusions of each real class.<\/p>\n\n\n\n

    \"\"<\/figure>\n\n\n\n
    \"\"<\/figure>\n\n\n\n

    Graph 3. History of the class<\/strong><\/h4>\n\n\n\n

    This chart allows you to inspect the confusions of a particular class over time. The user and producer precision for each class is shown, along with the confounds in each year.\"\"
    \"\"<\/p>\n\n\n\n

    ACCESS TO THE COLLECTION STATISTICS PANEL 1.0 <\/em>[LINK]<\/strong><\/p>","protected":false},"excerpt":{"rendered":"

    ESTIMACIONES DE LA PRECISI\u00d3N DEL MAPEO DE LA COBERTURA DEL SUELO POR EL PROYECTO MAPBIOMAS VENEZUELA ACCESO AL PANEL DE ESTAD\u00cdSTICAS DE LA COLECCI\u00d3N 1.0 [ENLACE] El an\u00e1lisis de precisi\u00f3n es la principal forma de evaluar la calidad del mapeo realizado por MapBiomas. Adem\u00e1s de decir cu\u00e1l es la tasa de aciertos general, el an\u00e1lisis […]<\/p>","protected":false},"author":2,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_uag_custom_page_level_css":""},"acf":[],"uagb_featured_image_src":{"full":false,"thumbnail":false,"medium":false,"medium_large":false,"large":false,"1536x1536":false,"2048x2048":false,"trp-custom-language-flag":false,"infographic":false,"team":false},"uagb_author_info":{"display_name":"Adriel Fernandes","author_link":"https:\/\/venezuela.mapbiomas.org\/en\/author\/adriel-fernandes\/"},"uagb_comment_info":0,"uagb_excerpt":"ESTIMACIONES DE LA PRECISI\u00d3N DEL MAPEO DE LA COBERTURA DEL SUELO POR EL PROYECTO MAPBIOMAS VENEZUELA ACCESO AL PANEL DE ESTAD\u00cdSTICAS DE LA COLECCI\u00d3N 1.0 [ENLACE] El an\u00e1lisis de precisi\u00f3n es la principal forma de evaluar la calidad del mapeo realizado por MapBiomas. Adem\u00e1s de decir cu\u00e1l es la tasa de aciertos general, el an\u00e1lisis…","_links":{"self":[{"href":"https:\/\/venezuela.mapbiomas.org\/en\/wp-json\/wp\/v2\/pages\/260"}],"collection":[{"href":"https:\/\/venezuela.mapbiomas.org\/en\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/venezuela.mapbiomas.org\/en\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/venezuela.mapbiomas.org\/en\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/venezuela.mapbiomas.org\/en\/wp-json\/wp\/v2\/comments?post=260"}],"version-history":[{"count":10,"href":"https:\/\/venezuela.mapbiomas.org\/en\/wp-json\/wp\/v2\/pages\/260\/revisions"}],"predecessor-version":[{"id":491,"href":"https:\/\/venezuela.mapbiomas.org\/en\/wp-json\/wp\/v2\/pages\/260\/revisions\/491"}],"wp:attachment":[{"href":"https:\/\/venezuela.mapbiomas.org\/en\/wp-json\/wp\/v2\/media?parent=260"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}