Forest cover dynamics
Although some authors deem necessary the use of medium spatial resolution imagery acquired by satellite sensors such as Landsat TM, Landsat ETM+, or SPOT (Satellite Pour l’Observation de la Terre) for forest cover change assessments (
30), many areas around the world experience frequent cloud cover. Thus, insufficient cloud-free medium spatial resolution imagery is available for forest change assessments (
31,
32), particularly when evaluating the effects of conservation policy implementation over short temporal windows. In addition, Landsat-based products, such as the Global Forest Change 2000–2013 (
3), map forest cover as an internally homogeneous land cover type, which is inadequate for assessing forest cover dynamics that do not necessarily correspond with complete land surface transformations (that is, from forest to nonforest or vice versa). Therefore, we assessed the spatiotemporal dynamics of China’s forest cover using the annual Vegetation Continuous Fields (VCF) tree cover product derived from surface reflectance data acquired by NASA’s MODIS (
33). This product represents the percentage of annual per-pixel tree cover at a spatial resolution of approximately 250 m and has successfully been used to quantify forest cover dynamics, exhibiting results comparable with those derived using medium spatial resolution imagery (for example, Landsat-based) (
34).
Using the MODIS VCF, we evaluated changes in forest cover from 2000 to 2010. We chose this period to capture the first decade of NFCP implementation and to match the availability of relevant socioeconomic data. Because changes in forest cover at a MODIS VCF pixel may not necessarily account for actual changes in forest cover on the ground, we performed two different procedures to assess the change in forest cover, which were later combined to produce a final change output.
In the first procedure, we assessed the change in forest cover by thresholding the VCF to separate forest from nonforest pixels and estimated the minimum magnitude of the percent change required to assess a significant change in forest cover. To find the optimal VCF threshold to separate forest from nonforest pixels and to validate the MODIS VCF tree cover product, we developed a data set of 4000 “ground-truth” polygons of the same size as a MODIS pixel (ca. 0.0625 km
2), randomly distributed throughout China. Within each of these polygons, we randomly distributed 25 points. Using the high spatial resolution imagery available in Google Earth, we visually ascertained the number of points per polygon coinciding with a tree canopy. The horizontal positional accuracy of Google Earth’s high-resolution imagery has been established to vary between 0.4 and 171.6 m, with average accuracies of 24.1 m in developed countries and 44.4 m in developing countries (
35). Such horizontal positional accuracies are much lower than the spatial resolution of a MODIS pixel (ca. 250 m per pixel) and thus are suitable for assessing the classification accuracy of the MODIS VCF product.
We considered a polygon to be forested if three or more points (that is, >10%) coincided with a tree canopy, on the basis of the classification of forested areas established by the United Nations Food and Agriculture Organization (
36). To assess the reliability of the interpretation of the Google Earth imagery, two image interpreters independently performed the point counts for each polygon. The average point count between the two interpreters was obtained, and only those polygons exhibiting a point count difference of less than 20% between the two interpreters were used in the validation. Google Earth imagery acquired between 2000 and 2005 was used to validate the 2000 MODIS VCF data set, whereas Google Earth imagery acquired between 2006 and 2010 was used to validate the 2010 MODIS VCF data set. Thus, given that not all of China’s territory is covered by Google Earth high-resolution imagery, not all polygons were used in the validation. In addition, because high-resolution image availability between 2000 and 2005 is considerably lower than that between 2006 and 2010, the final number of ground-truth polygons used in the validation was 569 (14.2% of the polygons) for the 2000 MODIS VCF data set and 1973 (49.3% of the polygons) for the 2010 MODIS VCF data set (fig. S2).
With these data, we conducted threshold-dependent and threshold-independent validation procedures. The threshold-dependent procedure was the κ statistic, which is a chance-corrected measure of agreement (
37). Using equality in sensitivity and specificity as a criterion (reported to be the most reliable criterion for cumulative threshold selection) (
38), we found that a percent tree cover of 24 and 23% in the 2000 and 2010 MODIS VCF data sets, respectively, constitutes the optimal threshold for separating forest from nonforest pixels, and we obtained κ coefficients of 0.64 (overall accuracy, 90%) and 0.60 (overall accuracy, 87%) for the 2000 and the 2010 MODIS VCF data sets, respectively. The threshold-independent procedure was the area under the receiver operating characteristic curve (AUC) (
39). The AUC ranges from 0 to 1, where a score of 1 indicates perfect discrimination, a score of 0.5 is expected from a random prediction, and a score lower than 0.5 indicates discrimination that is worse than random. The AUC values obtained were ca. 0.94 for both the 2000 and the 2010 MODIS VCF data sets (fig. S3), which were significantly different (
P < 0.0001) from 0.5 (that is, a random prediction). Both of these validation procedures (that is, threshold-dependent and threshold-independent) demonstrate that the MODIS VCF tree cover product constitutes an accurate depiction of forest cover in China.
The per-pixel change in forest cover was then obtained by calculating the Δ in the VCF tree cover between 2000 and 2010 (that is, Tree Cover Δ2010–2000 = Tree Cover2010 − Tree Cover2000). To validate this change, we used the Δ in the percent tree cover of the ground-truth polygons, obtained using Google Earth. Validation of the change in forest cover was based on the threshold-dependent κ statistic, which suggested a percent change in tree cover of ±20% as the optimal threshold for detecting changes in percent tree cover. The κ coefficients obtained were 0.39 (overall accuracy, 68.2%) and 0.40 (overall accuracy, 69.8%) for forest recovery and forest loss, respectively.
In the second procedure, we assessed per-pixel annual trends in the VCF percent tree cover over the decade (that is, 2000–2010). This was performed not only because a change in forest cover in a MODIS VCF pixel may not necessarily represent the same areal change in forest cover on the ground but also because the values of the VCF tree cover product may change from year to year as a result of changes in climate conditions accumulated over time (for example, annual precipitation and incoming radiation). To assess the significance of per-pixel trends (monotonic increases and decreases in the VCF between 2000 and 2010), we used the Spearman rank correlation coefficient. The significance of the Spearman rank correlation coefficient was determined through a permutation analysis in which the order of the ranks was randomly permuted 99 times. The significance measure corresponds to the number of times the correlation coefficient of the permuted data set exceeded the original (that is, nonpermuted) coefficient. When fewer than 5 of 99 permutations yielded higher correlation coefficients, these pixels were determined to exhibit significant positive (for r > 0) or negative (r < 0) trends.
Finally, we combined the two procedures to assess the number of pixels that exhibited a significant change (that is, gain or loss) in forest cover. To this effect, among the pixels exhibiting an absolute change in percent forest cover equal to, or larger than, 20% (assessed through the validation of the change in percent tree cover) between 2000 and 2010, we only selected those exhibiting significant positive/negative trends based on the significance of the Spearman rank correlation coefficient. Although the combination of these two procedures noticeably reduced the number of pixels considered to exhibit significant positive and negative changes in forest cover, it was preferred because it reduces the potential effects of the coarse pixel resolution of the MODIS VCF and accounts for the effects of accumulated climate conditions on the MODIS VCF tree cover product. Our estimates of forest cover dynamics are therefore conservative but reduce potential overestimations of forest gain or loss, yielding more robust analytical findings. The use of such combination of approaches to assessing changes in forest cover takes advantage of the fuzzy classification nature of the VCF tree cover product, together with its annual frequency. This constitutes an alternative to recent procedures designed to incorporate land cover classification errors into areal estimates of land cover change (
40).
Figure 3 shows a summary of the procedures used.
Statistical analyses
To assess the relationship between forest loss or gain and the implementation of the NFCP, we used a stepwise multilevel approach, which accommodates data acquired at different scales.
Figure 3 shows a summary of the procedures used. In the first step, we developed logistic regression models (
41) to assess the probability of forest loss and gain at the pixel level during the 2000–2010 period. We randomly selected 30,000 pixels across China that have a minimum sampling distance of 5 km to limit potential spatial autocorrelation effects. Two-thirds of these pixels were used to calibrate a pair of logistic regression models (
41), whereas the remainder were reserved for validating them. The dependent binary variable (either forest loss or gain) was set to 1 if the pixel exhibited a significant positive (or negative) change [that is, a percent tree cover Δ equal to, or higher than, 20% (equal to, or lower than, −20%) and with significant positive (negative) trends in percent tree cover] and to 0 if the pixel exhibited significant negative (or positive) change or no change. Biophysical and demographic factors that were shown to be strongly correlated with forest cover dynamics in previous spatially explicit models [for example, Rudel
et al. (
9), Geist and Lambin (
42), and Rudel (
43)] were selected for use as predictor variables. These included the geographic position of each pixel (that is, easting and northing), elevation, slope, aspect [converted into soil moisture classes (
44)], and the CTI [a measure of soil water accumulation (
45)] derived from a digital elevation model constructed from data acquired by the Shuttle Radar Topography Mission (
46), initial tree cover (that is, VCF in 2000), distance to main roads [obtained from the Digital Chart of the World Dataset (
47)], gridded population density in 2000 (
48), and mean annual temperature and total annual precipitation in grid format obtained from the WorldCLIM database (
49). We acknowledge that, like almost all other data sets, these global data sets have limitations (for example, lack of uniformity across different regions) that may reduce their reliability. However, given that standardized procedures have been applied in their production and that they are publicly available, their use not only allows replication and verification but also allows rapid updates of the analyses as more data become available. As a result, such data sets have been widely used in numerous publications over the last several years [for example, Yang
et al. (
50), Zheng
et al. (
51), and Zhang
et al. (
52)]. All grids were resampled and coregistered to match the MODIS VCF product (that is, 250 m per pixel). Model validation was conducted using the AUC procedure (
39). These logistic regression models registered AUC scores of 0.71 and 0.67, respectively, which were significantly different (
P < 0.0001) from 0.5 (that is, a random prediction). Using the coefficients obtained in these logistic regression models, we calculated the probability of forest loss and gain for all pixels comprising mainland China. Logistic regression model residuals were then obtained by subtracting these probability values from the observed forest loss and gain values, with the latter expressed in binary format [that is, 1 for any significant negative (positive) change and 0 for any significant positive (negative) change or no change] (fig. S4). These pixel-level residuals represent the unexplained variance of the logistic regression models.
In the second step, we obtained aggregate model residual values on a per-county basis by averaging the pixel-level residuals (both positive and negative) within the county divisions (including city districts) of China (
Fig. 1). These per-county aggregate residuals (county-based aggregate of the unexplained variance of the logistic regression models) were used as the dependent variables in spatial autoregressive models (
53,
54). Independent predictor variables included implementation of the NFCP [expressed in binary format; that is, 1 for counties where the NFCP was implemented and 0 for counties where it was not (
17)], county-based per-capita GDP for 2000, change in county-based per-capita GDP (that is, GDP 2010 − GDP 2000), agricultural production (in the form of total grain and meat production) for 2000 and its change (that is, 2010 − 2000), total population in 2000 and its change (that is, 2010 − 2000), and rural labor in 2000 and its change (that is, 2010 − 2000). These data were obtained from the China Data Center (
55). Spatial weighting matrices at the county level were created, defining a neighbor based on both the Queen and the Rook contiguity approaches (
56). We report results obtained using the Queen contiguity approach, although results using the two approaches were similar. Using these data, we developed lag and error spatial autoregressive models (
53,
54) for each dynamic (that is, forest loss and gain, respectively). We report the results of the lag model for both forest loss and gain (
Table 1) because these exhibited the best (that is, lowest) Akaike information criterion values (
53,
54).
Response to Pang et al. (May 2016)
We appreciate Pang et al.’s interest in our article, and wholeheartedly agree with their main point: better information will lead to a better understanding of the effectiveness of China’s efforts to increase forest cover across the country. We thank them for their comments on our study. However, in some important aspects they have misinterpreted our results and overstated the limitations of our approach.
Pang et al. state that “MODIS lacks the spatial resolution to accurately evaluate changes in forest cover to the degree required to draw the desired conclusions”. They then suggest that the use of “Landsat data at 30x30 m pixel resolution would generate more accurate forest cover data compared to the authors’ analysis with MODIS”. While we agree that the MODIS-derived vegetation continuous fields (VCF) tree cover product may not be able to detect all afforestation/deforestation processes occurring on the ground due to its coarser spatial resolution (something we stated in our article), we do not agree that the use of Landsat data is necessarily more accurate simply by virtue of its finer spatial resolution. It is important to avoid conflating greater spatial precision with higher accuracy. Previous work has demonstrated that the use of high spatial resolution data can in fact reduce the accuracy of land change models, as there are more opportunities for error (1). Furthermore, the MODIS sensors collect data at a considerably higher frequency than the Landsat systems, enabling a higher temporal precision view of vegetation phenology. By revealing crucial aspects of the development of the vegetative cover through the growing season, MODIS data permit more robust differentiation of forest from other land covers with which it might otherwise be confounded. To reduce uncertainty due to the coarser spatial resolution of the MODIS-VCF tree cover product, in our study we used a combination of procedures (change detection and trend analysis). This combination generated a conservative estimate of change in forest cover, which may partially explain the disparity between our assessment of 1.6% increase in forest cover, compared to the 2.15% increase shown in the government reports mentioned by Pang et al. While we did not directly acknowledge this disparity in our article, we did explicitly state that our results, while conservative, agreed with government estimates in that forest cover in China increased over the study period.
Pang et al. state that our study did not include other conservation programs implemented concurrently with the Natural Forest Conservation Program (NFCP), undermining the contribution of those programs to forest cover gains. However, the significant contribution of NFCP does not mean that other programs are not contributing to forest recovery. In fact, the R2 of our forest gain model was 0.742, which means that there is a substantial amount of variance due to other factors that our model did not capture. In our article we explicitly acknowledged that other conservation programs may have made significant contributions to China’s forest recovery. Pang et al. also opine that our study “should have focused on the locations where NFCP activities were undertaken and excluded areas where the other programs were active”. As stated above, our analysis of forest cover change was conservative. This conservative approach allows a focus on areas exhibiting unambiguous positive or negative changes, as detected by the MODIS-VCF product. As a result, many areas subject to the implementation of other conservation programs, such as those in Qinghai or Inner Mongolia mentioned by Pang et al., appear to have witnessed no significant change, and thus were excluded from our step-wise multilevel models. This does not necessarily mean that afforestation has not happened in some of these excluded areas (perhaps related to the implementation of those programs), but rather that their detection is not sufficiently unambiguous using the MODIS-VCF tree cover product. Our conservative approach focused on the most significant forest cover dynamics, and their spatial variability was found to be significantly related with the spatial variability in the implementation of the NFCP. Furthermore, the contribution of NFCP to forest recovery has been verified in regions without any of the other programs mentioned by Pang et al. (with the exception of the GTGP) (2, 3).
Finally, Pang et al. state that the “parameters used for the county-based spatial autoregressive model are insufficient to evaluate the relation between forest loss and gain and the implementation of the NFCP” and argued that we “should have considered additional parameters related to local livelihoods and industry”, such as “household income, government compensation, change in labor in various industries, and change in non-timber forest products (e.g. tea, fruit)”. Although some or all of these variables may be correlated with the variables that our model has already considered, we would have explored the possible roles of these and other variables had relevant data been available to us across all counties in China. We hope Pang et al. will join efforts to develop, analyze and make freely available such data, accompanied by robust metadata and accuracy assessments. Until such data are available, the approach we pursued is the best we are able to do to address crucial questions about the causes and consequences of land cover dynamics in the most populous nation on Earth.
References
1. Pontius, R., W. Boersma, J.-C. Castella, K. Clarke, T. de Nijs, C. Dietzel, Z. Duan, E. Fotsing, N. Goldstein, K. Kok, E. Koomen, C. D. Lippitt, W. McConnell, A. M. Sood, B. Pijanowski, S. Pithadia, S. Sweeney, T. N. Trung, A. T. Veldkamp, P. H. Verburg, Comparing the input, output, and validation maps for several models of land change. Annals of Regional Science. 42(1): 11-37 (2008).
2. Tuanmu, M-N., A. Viña, W. Yang, X. Chen, A. Shortridge and J. Liu, Effects of payments for ecosystem services on wildlife habitat recovery. Conservation Biology doi: 10.1111/cobi.12669 (2016).
3. Liu, J., V. Hull, W. Yang, A. Viña, X. Chen, Z. Ouyang and H. Zhang (Eds.), “Pandas and People - Coupling Human and Natural Systems for Sustainability” (Oxford University Press, 2016).
RE: Effects of Conservation policy on China's forest recovery
Comment on "Effects of conservation policy on China's forest recovery"
Yong Pang1, Guangyu Wang2, Shari L. Mang2, Zhongqi Xu3, Hongbo Zhai4, Zhijian Yang5, and John L. Innes1*
1Institute of Forest Resource Information Techniques, Chinese Academy of Forestry, Beijing China
2Faculty of Forestry, University of British Columbia, Vancouver, BC, Canada
3College of Forestry Agriculture University of Hebei, Baoding, China
4Chinese Academy of Forestry Inventory and Planning, Beijing, China
5College of Forestry, Fujian Agriculture and Forestry University
Vina et al. (Reports, 18 March 2016) use MODIS VCF to assess change in forest cover in China in an attempt to verify government statistics regarding forest cover and to evaluate the effectiveness of the government's Natural Forest Conservation Program (NFCP). However, they fail to verify their data against the government's own data in a quantitative way, and their evaluation of NFCP ignores the five other forest conservation programs run simultaneously by the government. Furthermore, they use a limited number of parameters to evaluate success and rely on MODIS, which lacks the spatial resolution to address the authors' objectives.
The authors aim to verify Chinese government statistics on forest recovery, an element they correctly highlight as being crucial in ensuring reliable and transparent information for conservation and climate change action; however, this verification is not performed in depth. Both parties conclude that forests have been recovering over the period of 2000-2010, but the authors do not quantitatively compare their findings against the government's own statistics. Vina et al.'s analysis indicates that 1.6% of China's territory experienced a significant increase in percent tree cover from 2000-2010, which is substantially lower than the value reported by the Chinese government. From 2003-2008 alone, the government reports an increase in total forest cover from 18.21% (1) to 20.36% (2) - a change of 2.15%. The 10-year change presented by Vina et al. is much lower than that reported by the Chinese government, but the authors do not acknowledge this disparity.
The authors relate their findings to the Natural Forest Conservation Program (NFCP). However, from 2000-2010, China had six key programs aimed at addressing forest loss and ecosystem degradation. Four of these programs overlap with NFCP's implementation area – there is 82.4% overlap with Conversion of Cropland to Forest Program (CCFP) (referred to as Grain-to-Green in the paper), 29.4% with Three North Shelterbelt Development Program, 50.8% with Shelterbelt Development Program along the Yangtze River Basin (3Ns&YRB) (3), and 11.8% with Afforestation Projects in the plain areas (4). Although the authors acknowledge the other programs, they do not account for the substantial overlap in the analysis. Based on their methods, it is not feasible to evaluate the success of the NFCP in isolation from other government environmental programs as there are no steps taken to separate the source of forest cover change. This is of concern as the authors aim to "evaluate the effectiveness of… NFCP" and state that "… the implementation of NFCP exhibited a significant relationship with forest gain…". Although NFCP contributed to increased forest cover, it is unreasonable to claim that the changes in forest cover are significantly related to NFCP as the contributions of each program are not evaluated. All programs carried out forest preservation and restoration activities between 2000-2010, such as logging bans and afforestation. However, the authors assume all changes are a result of NFCP activities when the program was responsible for only 18.7% of the area reforested by government programs from 1998-2010 (2). Furthermore, statements such as "NFCP seems to significantly contribute to carbon sequestration…" and claims that the dramatic increase in forest cover is in response to NFCP implementation undermines the contribution of other programs. If the authors wished to evaluate the NFCP, they should have focused on the locations where NFCP activities were undertaken and excluded areas where the other programs were active. As such, the primary objective to 'evaluate the effectiveness of the NFCP at the national scale… and its contribution to changes in net primary productivity…' is not achieved by this research.
The parameters used for the county-based spatial autoregressive model are insufficient to evaluate "the relation between forest loss and gain and the implementation of the NFCP", which is the authors' stated purpose. Although several industry- and demographic-related factors were used, several factors critical for an analysis at the county level are not included. To fully understand county level factors that relate to the NFCP and change in forest cover, the authors should have considered additional parameters related to local livelihoods and industry. The NFCP program led to the layoff and replacement of over 910,000 forest workers during 2001-2010 (5); as such, factors such as household income, government compensation, change in labor in various industries, and change in non-timber forest products (e.g. tea, fruit) need to be considered (6, 7). This analysis misses these critical elements, and thus is not robust enough to draw meaningful conclusions.
The authors' assessment using Vegetation Continuous Fields (VCF) tree cover products derived from MODIS is a significant advance for forestry. However, MODIS lacks the spatial resolution to accurately evaluate changes in forest cover to the degree required to draw the desired conclusions. Forestry activities in China are carried out in management compartments that range from 1-3 ha in size. The spatial resolution of the MODIS data used is 6.25 ha; thus the analysis is unable to capture the diversity of activity occurring within a single pixel, reducing the accuracy of the perceived changes in forest cover across the landscape. Although the authors point out that evaluation using LANDSAT can often be hindered due to cloud cover, there is cloud-free LANDSAT data at 30X30m resolution available for the entire area of mainland China (8, 9). Analyses with these data would yield pixels that are 0.09 ha (smaller than forestry compartments), which would generate more accurate forest cover data compared to the authors' analysis with MODIS.
Reference
1. State Forestry Administration, "Forest Resource Statistics of China, 6th Report" (China Forestry Publishing House, Beijing, China, 2005).
2. State Forestry Administration, "Forest Resource Statistics of China, 7th Report" (China Forestry Publishing House, Beijing, China, 2010).
3. G. Wang, J.L. Innes, J. Lei, S. Dai, S.W. Wu, China's Forestry Reforms. Science, 318, 1556-1557 (2007).
4. China Sustainable Forest Management Strategy Research Task Force, "China Sustainable Forest Management Strategy Research" (China Forestry Publishing House, Beijing, China, 2003).
5. State Forestry Administration, "Forest Statistical Yearbook" (China Forestry Publishing House, Beijing, China, 2010).
6. E. Uchida, J. Xu, Z. Xu, S. Rozelle, Are the poor benefiting from China's land conservation program? Environ. Dev. Econ., 12, 593-620 (2007).
7. E. Uchida, S. Rozelle, J. Xu, Conservation payments, liquidity constraints, and off-farm labor: Impacts of the Grain-to-Green Program on rural households in China. Am. J. Agric. Econ., 91, 70-86 (2009).
8. Global Land Cover Facility, "Landsat Imagery" (2014) (available at <http://glcf.umd.edu/data/landsat/).
9. GlobeLand30, "GlobeLand30" (2016) (available at http://www.globallandcover.com/home/Enbackground.aspx).