Multimodal Causal Inference Analysis of Urban Landscape Therapeutic Effects with XGBoost and DiD

  • Dan Wan Department of Built Environment Studies and Technology, Faculty of Built Environment, Universiti Teknologi MARA Perak Branch, Seri Iskandar Campus, 32610, Seri Iskandar, Perak, Malaysia
  • Norhafizah Binti Abdul Rahman Department of Built Environment Studies and Technology, Faculty of Built Environment, Universiti Teknologi MARA Perak Branch, Seri Iskandar Campus, 32610, Seri Iskandar, Perak, Malaysia
  • Helmi Bin Hamzah Department of Built Environment Studies and Technology, Faculty of Built Environment, Universiti Teknologi MARA Perak Branch, Seri Iskandar Campus, 32610, Seri Iskandar, Perak, Malaysia
Keywords: Multimodal fusion, Causal inference, Urban landscapes, Therapeutic effects, XGBoost

Abstract

Urban landscapes play a crucial role in promoting mental and physical health, yet existing methods often fail to integrate diverse data sources for assessing transformation impacts, leading to incomplete evaluations of therapeutic effects. This study addresses this gap by combining computer vision (CV) analysis of street view imagery, natural language processing (NLP) for text sentiment analysis, and environmental data (weather and air quality index) via XGBoost, followed by causal inference using difference-in-differences (DiD) to assess treatment effects of landscape changes. The aims are to develop a robust multimodal fusion model using XGBoost and apply difference-in-differences (DiD) for causal inference. Data from empirical datasets across 10 urban sites in cities like Beijing, changchun, and Nanjing (2020–2025) were analyzed, revealing a 45% increase in therapeutic indices post-transformation, with greenery visibility (35% importance) and positive sentiment (28%) as key predictors. Causal estimates confirmed significant health benefits, particularly in high-pollution areas (ATT=0.52, p<0.001). The findings demonstrate the efficacy of multimodal approaches over unimodal baselines (R²=0.85 vs. 0.58–0.72), highlighting green elements’ role in mitigating urban stressors. The study demonstrates the effectiveness of multimodal approaches in evaluating urban landscape transformations and their health benefits. The findings suggest that integrating green elements into urban planning can significantly enhance public health, especially in areas with high pollution. This framework can guide evidence-based urban planning for healthier cities.

Downloads

Download data is not yet available.

References

Acosta, J. N., Falcone, G. J., Rajpurkar, P., & Topol, E. J. (2022). Multimodal biomedical AI. Nature Medicine, 28(9), 1778–1784. https://doi.org/10.1038/s41591-022-01981-2

Biljecki, F., & Ito, K. (2021). Street view imagery in urban analytics and GIS: A review. Landscape and Urban Planning, 215, 104217. https://doi.org/10.1016/j.landurbplan.2021.104217

Bornioli, A., & Subiza-Pérez, M. (2023). Restorative urban environments for healthy cities: A theoretical model for the study of restorative experiences in urban built settings. Landscape Research, 48(1), 152-163. https://doi.org/10.1080/01426397.2022.2124962

De Chaisemartin, C., & d’Haultfoeuille, X. (2023). Two-way fixed effects and differences-in-differences with heterogeneous treatment effects: A survey. The econometrics journal, 26(3), C1-C30. https://doi.org/10.1093/ectj/utac017

Chen, T., & Guestrin, C. (2016). XGBoost: A scalable tree boosting system. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 785–794). Association for Computing Machinery. https://doi.org/10.1145/2939672.2939785

Despotovic, M., & Brunauer, W. A. (2024). Scalable multimodal assessment of the micro-neighborhood using orthogonal visual inputs. Journal of Housing and the Built Environment, 39(4), 1937-1964. https://doi.org/10.1007/s10901-024-10153-2

Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) (pp. 4171–4186). Association for Computational Linguistics. https://doi.org/10.18653/v1/N19-1423

Gao, B., Wang, J., Stein, A., & Chen, Z. (2022). Causal inference in spatial statistics. Spatial Statistics, 50, 100621. https://doi.org/10.1016/j.spasta.2022.100621

Giné, D. S., Albert, M. Y. P., & Buendía, A. V. P. (2021). Aesthetic assessment of the landscape using psychophysical and psychological models: Comparative analysis in a protected natural area. Landscape and Urban Planning, 214, 104197. https://doi.org/10.1016/j.landurbplan.2021.104197

Gordon, L., Lang, N., Ressijac, C., & Davies, A. (2024, September). Multimodal fusion strategies for mapping biophysical landscape features. In European Conference on Computer Vision (pp. 208-216). Cham: Springer Nature Switzerland. https://doi.org/10.1007/978-3-031-92387-6_16

Hou, C. (2025). Urban Landscape Design from the Conceptual Perspective of Healing Environment Theory. Polish Journal of Environmental Studies, 7137–7148. https://doi.org/10.15244/pjoes/192368

Kekulanadara, K. M. O. V. K., Kumara, B. S., & Kuhaneswaran, B. (2021, December). Comparative Analysis of Machine Learning Algorithms for Predicting Air Quality Index. In 2021 from Innovation to Impact (FITI) (pp. 1-5). IEEE. https://doi.org/10.1109/FITI54902.2021.9833033

Krasilnikova, E. E., Zhuravleva, I. V., & Zaika, I. A. (2021). Creating healing and therapeutic landscapes: Design experience. RUDN Journal of Agronomy and Animal Industries, 16(3), 238-254. https://doi.org/10.22363/2312-797X-2021-16-3-238-254

Li, Z., & Dong, T. (2025). Exploring the Mental Health Benefits of Urban Green Spaces Through Social Media Big Data: A Case Study of the Changsha–Zhuzhou–Xiangtan Urban Agglomeration. Sustainability, 17(8), 3465. https://doi.org/10.3390/su17083465

Liu, T., Chen, H., Ren, J., Zhang, L., Chen, H., Hong, R., Li, C., Cui, W., Guo, W., & Wen, C. (2024). Urban functional zone classification via advanced multi-modal data fusion. Sustainability, 16(24), 11145. https://doi.org/10.3390/su162411145

Ren, H., Wang, X., Zhang, J., Zhang, L., & Wang, Q. (2024). Evaluation of rural healing landscape design based on virtual reality and electroencephalography. Buildings, 14(6), Article 1560. https://doi.org/10.3390/buildings14061560

Ren, Q., Weng, Y., & Hu, Z. (2025). A study of space creation for healing landscape design in the post-epidemic era. Frontiers in Psychology, 16, 1618451. https://doi.org/10.3389/fpsyg.2025.1618451

Richardson, E. A., & Mitchell, R. (2010). Gender differences in relationships between urban green space and health in the United Kingdom. Social Science & Medicine, 71(3), 568–575. https://doi.org/10.1016/j.socscimed.2010.04.015

Schaffer, A. L., Dobbins, T. A., & Pearson, S. A. (2021). Interrupted time series analysis using autoregressive integrated moving average (ARIMA) models: A guide for evaluating large-scale health interventions. BMC Medical Research Methodology, 21(1), 58. https://doi.org/10.1186/s12874-021-01235-8

Souter-Brown, G. (2023). Urban Health: Applying Therapeutic Landscape Design. Methods, Design Strategies and New Scientific Approaches. In: Therapeutic Landscape Design. (SpringerBriefs in Applied Sciences and Technology). Springer, Cham. https://doi.org/10.1007/978-3-031-09439-2_1

Tırınk, S. (2025). Machine learning-based forecasting of air quality index under long-term environmental patterns: A comparative approach with XGBoost, LightGBM, and SVM. Plos One, 20(10), e0334252. https://doi.org/10.1371/journal.pone.0334252

Wagner, A. K., Soumerai, S. B., Zhang, F., & Ross‐Degnan, D. (2002). Segmented regression analysis of interrupted time series studies in medication use research. Journal of Clinical Pharmacy and Therapeutics, 27(4), 299-309. https://doi.org/10.1046/j.1365-2710.2002.00430.x

Wedyan, M., & Saeidi-Rizi, F. (2024). Assessing the impact of urban environments on mental health and perception using deep learning: A review and text mining analysis. Journal of Urban Health, 101(2), 327-343. https://doi.org/10.1007/s11524-024-00830-6

Woodman, T. L., Alexander, P., Burslem, D. F., Travis, J. M., Winkler, K., & Eigenbrod, F. (2025). Global assessment of landscape pattern changes from 1992 to 2020. Landscape Ecology, 40(11), 1-21. https://doi.org/10.1007/s10980-025-02210-0

Xie, Y., Mu, Y., Chen, P., Liu, Z., Wang, Y., Li, Q., Li, M., Liang, J., & Zhu, J. (2022). Interrupted-time-series analysis of the immediate impact of COVID-19 mitigation measures on preterm birth in China. Nature Communications, 13(1), 5190. https://doi.org/10.1038/s41467-022-32814-y

Zhao, H., Shi, J., Qi, X., Wang, X., & Jia, J. (2017). Pyramid scene parsing network. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 2881–2890). IEEE. https://doi.org/10.1109/CVPR.2017.660

Published
2026-10-14
Section
Articles