Using machine learning to examine associations between the built environment and physical function: A feasibility study

Linking geospatial neighbourhood design characteristics to health and behavioural data from population-representative cohorts is limited by data availability and difficulty collecting information on environmental characteristics (e.g. greenery, building setbacks, dwelling structure). As an alternative, this study examined the feasibility of Generative Adversarial Networks (GANs) – machine learning – to measure neighbourhood design using ‘street view’ and aerial imagery to explore the relationship between the built environment and physical function. This study included 3102 adults aged 45 years and older clustered in 200 neighbourhoods in 2016 from the How Areas in Brisbane Influence Health and Activity (HABITAT) project in Brisbane, Australia. Exposure data were Google Street View and Google Maps images from within the 200 neighbourhoods, and outcome data were self-reported physical function using the PF-10 (a subset of the SF-36). Physical function scores were aggregated to the neighbourhood level, and the highest and lowest 20 neighbourhoods respectively were used in analysis. We found that the aerial imagery retrieved was unable to be used to adequately train the model, meaning that aerial imagery failed to produce meaningful results. Of the street view images, n = 56,330 images were downloaded and used to train the GAN model. Model outputs included augmented street view images between neighbourhoods classed as having high function and low function residents. The GAN model detected differences in neighbourhood design characteristics between neighbourhoods classed as high and low physical function at the aggregate level. Specifically, differences were identified in urban greenery (including tree heights) and dwelling structure (e.g. building height). This study provides important lessons for future work in this field, especially related to the uniqueness, diversity and amount of imagery required for successful applications of deep learning methods.