Multimodal Causal Inference Analysis of Urban Landscape Therapeutic Effects with XGBoost and DiD
Abstract
Urban landscapes play a crucial role in promoting mental and physical health, yet existing methods often fail to integrate diverse data sources for assessing transformation impacts, leading to incomplete evaluations of therapeutic effects. This study addresses this gap by combining computer vision (CV) analysis of street view imagery, natural language processing (NLP) for text sentiment analysis, and environmental data (weather and air quality index) via XGBoost, followed by causal inference using difference-in-differences (DiD) to assess treatment effects of landscape changes. The aims are to develop a robust multimodal fusion model using XGBoost and apply difference-in-differences (DiD) for causal inference. Data from empirical datasets across 10 urban sites in cities like Beijing, changchun, and Nanjing (2020–2025) were analyzed, revealing a 45% increase in therapeutic indices post-transformation, with greenery visibility (35% importance) and positive sentiment (28%) as key predictors. Causal estimates confirmed significant health benefits, particularly in high-pollution areas (ATT=0.52, p<0.001). The findings demonstrate the efficacy of multimodal approaches over unimodal baselines (R²=0.85 vs. 0.58–0.72), highlighting green elements’ role in mitigating urban stressors. The study demonstrates the effectiveness of multimodal approaches in evaluating urban landscape transformations and their health benefits. The findings suggest that integrating green elements into urban planning can significantly enhance public health, especially in areas with high pollution. This framework can guide evidence-based urban planning for healthier cities.
Downloads
References
Acosta, J. N., Falcone, G. J., Rajpurkar, P., & Topol, E. J. (2022). Multimodal biomedical AI. Nature Medicine, 28(9), 1778–1784. https://doi.org/10.1038/s41591-022-01981-2
Biljecki, F., & Ito, K. (2021). Street view imagery in urban analytics and GIS: A review. Landscape and Urban Planning, 215, 104217. https://doi.org/10.1016/j.landurbplan.2021.104217
Bornioli, A., & Subiza-Pérez, M. (2023). Restorative urban environments for healthy cities: A theoretical model for the study of restorative experiences in urban built settings. Landscape Research, 48(1), 152-163. https://doi.org/10.1080/01426397.2022.2124962
De Chaisemartin, C., & d’Haultfoeuille, X. (2023). Two-way fixed effects and differences-in-differences with heterogeneous treatment effects: A survey. The econometrics journal, 26(3), C1-C30. https://doi.org/10.1093/ectj/utac017
Chen, T., & Guestrin, C. (2016). XGBoost: A scalable tree boosting system. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 785–794). Association for Computing Machinery. https://doi.org/10.1145/2939672.2939785
Despotovic, M., & Brunauer, W. A. (2024). Scalable multimodal assessment of the micro-neighborhood using orthogonal visual inputs. Journal of Housing and the Built Environment, 39(4), 1937-1964. https://doi.org/10.1007/s10901-024-10153-2
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) (pp. 4171–4186). Association for Computational Linguistics. https://doi.org/10.18653/v1/N19-1423
Gao, B., Wang, J., Stein, A., & Chen, Z. (2022). Causal inference in spatial statistics. Spatial Statistics, 50, 100621. https://doi.org/10.1016/j.spasta.2022.100621
Giné, D. S., Albert, M. Y. P., & Buendía, A. V. P. (2021). Aesthetic assessment of the landscape using psychophysical and psychological models: Comparative analysis in a protected natural area. Landscape and Urban Planning, 214, 104197. https://doi.org/10.1016/j.landurbplan.2021.104197
Gordon, L., Lang, N., Ressijac, C., & Davies, A. (2024, September). Multimodal fusion strategies for mapping biophysical landscape features. In European Conference on Computer Vision (pp. 208-216). Cham: Springer Nature Switzerland. https://doi.org/10.1007/978-3-031-92387-6_16
Hou, C. (2025). Urban Landscape Design from the Conceptual Perspective of Healing Environment Theory. Polish Journal of Environmental Studies, 7137–7148. https://doi.org/10.15244/pjoes/192368
Kekulanadara, K. M. O. V. K., Kumara, B. S., & Kuhaneswaran, B. (2021, December). Comparative Analysis of Machine Learning Algorithms for Predicting Air Quality Index. In 2021 from Innovation to Impact (FITI) (pp. 1-5). IEEE. https://doi.org/10.1109/FITI54902.2021.9833033
Krasilnikova, E. E., Zhuravleva, I. V., & Zaika, I. A. (2021). Creating healing and therapeutic landscapes: Design experience. RUDN Journal of Agronomy and Animal Industries, 16(3), 238-254. https://doi.org/10.22363/2312-797X-2021-16-3-238-254
Li, Z., & Dong, T. (2025). Exploring the Mental Health Benefits of Urban Green Spaces Through Social Media Big Data: A Case Study of the Changsha–Zhuzhou–Xiangtan Urban Agglomeration. Sustainability, 17(8), 3465. https://doi.org/10.3390/su17083465
Liu, T., Chen, H., Ren, J., Zhang, L., Chen, H., Hong, R., Li, C., Cui, W., Guo, W., & Wen, C. (2024). Urban functional zone classification via advanced multi-modal data fusion. Sustainability, 16(24), 11145. https://doi.org/10.3390/su162411145
Ren, H., Wang, X., Zhang, J., Zhang, L., & Wang, Q. (2024). Evaluation of rural healing landscape design based on virtual reality and electroencephalography. Buildings, 14(6), Article 1560. https://doi.org/10.3390/buildings14061560
Ren, Q., Weng, Y., & Hu, Z. (2025). A study of space creation for healing landscape design in the post-epidemic era. Frontiers in Psychology, 16, 1618451. https://doi.org/10.3389/fpsyg.2025.1618451
Richardson, E. A., & Mitchell, R. (2010). Gender differences in relationships between urban green space and health in the United Kingdom. Social Science & Medicine, 71(3), 568–575. https://doi.org/10.1016/j.socscimed.2010.04.015
Schaffer, A. L., Dobbins, T. A., & Pearson, S. A. (2021). Interrupted time series analysis using autoregressive integrated moving average (ARIMA) models: A guide for evaluating large-scale health interventions. BMC Medical Research Methodology, 21(1), 58. https://doi.org/10.1186/s12874-021-01235-8
Souter-Brown, G. (2023). Urban Health: Applying Therapeutic Landscape Design. Methods, Design Strategies and New Scientific Approaches. In: Therapeutic Landscape Design. (SpringerBriefs in Applied Sciences and Technology). Springer, Cham. https://doi.org/10.1007/978-3-031-09439-2_1
Tırınk, S. (2025). Machine learning-based forecasting of air quality index under long-term environmental patterns: A comparative approach with XGBoost, LightGBM, and SVM. Plos One, 20(10), e0334252. https://doi.org/10.1371/journal.pone.0334252
Wagner, A. K., Soumerai, S. B., Zhang, F., & Ross‐Degnan, D. (2002). Segmented regression analysis of interrupted time series studies in medication use research. Journal of Clinical Pharmacy and Therapeutics, 27(4), 299-309. https://doi.org/10.1046/j.1365-2710.2002.00430.x
Wedyan, M., & Saeidi-Rizi, F. (2024). Assessing the impact of urban environments on mental health and perception using deep learning: A review and text mining analysis. Journal of Urban Health, 101(2), 327-343. https://doi.org/10.1007/s11524-024-00830-6
Woodman, T. L., Alexander, P., Burslem, D. F., Travis, J. M., Winkler, K., & Eigenbrod, F. (2025). Global assessment of landscape pattern changes from 1992 to 2020. Landscape Ecology, 40(11), 1-21. https://doi.org/10.1007/s10980-025-02210-0
Xie, Y., Mu, Y., Chen, P., Liu, Z., Wang, Y., Li, Q., Li, M., Liang, J., & Zhu, J. (2022). Interrupted-time-series analysis of the immediate impact of COVID-19 mitigation measures on preterm birth in China. Nature Communications, 13(1), 5190. https://doi.org/10.1038/s41467-022-32814-y
Zhao, H., Shi, J., Qi, X., Wang, X., & Jia, J. (2017). Pyramid scene parsing network. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 2881–2890). IEEE. https://doi.org/10.1109/CVPR.2017.660















