Satellite observations show that the surface urban heat island intensity (SUHII) has been increasing over the last two decades. This is often accompanied by an increased urban-rural contrast of vegetation greenness. However, the contribution of uneven vegetation trends in urban and rural areas to the trend of SUHII is unclear, due to the confounding effects of climate change and changes in man-made amenities and anthropogenic heat sources. Here we use a data-model fusion approach to quantify such contributions during the peak growing season. We show that the LAIdif (the urban-rural difference of leaf area index) is increasing (P<0.05) in 189 of the selected 228 global megacities. The increasing trend of LAIdif from 2000 to 2019 accounts for about one-quarter of the trend in satellite34 derived SUHII, and the impact is particularly evident in places with rapid urbanization and rural cropland intensification. The marginal sensitivity of SUHII to LAIdif is the strongest in hot-humid megacities surrounded by croplands and in hot-dry megacities surrounded by mixed woody and herbaceous vegetation. Our study highlights the role of long-term vegetation trends in modulating the trends of urban-rural temperature differences.