# Cleanup vs. Crime: A Case Study in 4 Parts

A simple concept and a decent result.

10-17-2021

I’m a big fan of this paper looking at how cleaning up vacant lots has the potential to affect crime. There’s a lot to love here, and I’m hoping to use this paper as an excuse to explore several different ideas relevant to both understanding the built environment and statistical methods more generally. In this post we’ll focus on a high-level understanding of the paper while future posts will focus on (1) the measures of gun violence and statistical models used, (2) the assumptions and approach that go into the causal inference associated with this trial and finally (3), I’ll devote a post to the conceptual models at play here. Why would cleaning up a vacant lot affect nearby gun violence, or other measures of community health?

I’ll go on to show alternative methods that could be used to analyze these data and the advantages they may have over the current author’s approach. I’ll leave that, however, for a different series of posts. Hopefully this brief outline has you excited for what’s to come, but for now, let’s dive into the paper!

# Background

The authors’ objective in this work is to determine whether cleaning up a series of vacant lots in the areas where, unfortunately, many shootings regularly occur, could lead to a reduced rate of gun violence.

In order to test this hypothesis, the authors randomly assign 1 of three “interventions” to each of 110 geographically close clusters of vacant lots — 541 lots in total — spread across Philadelphia between April and June of 2013.

The first intervention called “greening,” involved “removing trash and debris, grading the land, planting new grass and a small number of trees to create a parklike setting, installing low wooden perimeter fences, and regularly maintaining the lot.” . You can see a demonstration of this idea in Figure 1.

The second intervention labeled “mowing,” made the vacant lot not so much park-like as just generally maintained. The description states it as “mowing existing grass and weeds, removing trash and debris, and regularly maintaining the lot.” .

The third and final “intervention” was simply the control group, where no action was taken on the vacant lot whatsoever.

The author’s used the Philadelphia Department of Police data of reported shootings not involving police officers from years 2011-2015 as their outcome of interest. You can see a sample of these data from 2015 in the neighborhood of Upper Kensington in Figure 2.

# Methods

The author’s used two different measures of the number of shootings each month in and around vacant lots to determine whether their interventions were effective: a kernel density estimate and two — differently sized — buffer counts. The author’s fit two models of a similar form, estimating the difference in the kernel density estimate and rate, respectively as a function of whether the observed lot density estimate or buffer count had received one of the two interventions during June 2013 - April, 2015.
They also adjusted for correlation across time, space and within clusters. The kernel density estimate model is shown below, but we’ll leave a more thorough examination of it and the buffer models for a later post.

$Y_{it} := \text{# Shootings / km}^2 \text{at lot cluster } i\text{, month } t \\$ \begin{aligned} Y_{it} &= \beta_0 + \beta_1 \text{Greening}_i + \beta_2\text{Mowing}_i + \beta_3\text{Post}_t + \beta_4\text{AllTreated}_i \\ &+ \beta_5 \text{Greening}_i \times \text{Post}_t + \beta_6\text{Mowing}_i \times \text{Post}_t \\ &+ \beta_7\text{Greening}_i\times \text{AllTreated}_t + \beta_8\text{Mowing}_i \times \text{AllTreated}_t \\ &+ \alpha_{m(t)} + \delta_{s(i)} + \xi_{c(i)} + \epsilon_{it} \end{aligned}

# Results

Converting their estimates to percent change in the number of expected shootings, the author’s determined that the monthly shootings per square kilometer (density estimate model) decreased by 6.8 % (95% Confidence Interval: -10.6%,-2.7%) for those lots in the greening intervention compared to the pre-intervention baseline and -9.2% (-13.2%,-4.8%) compared to baseline for those lots in the mowing intervention. The author’s estimated a similar significant result for the greening intervention for their buffer analysis and a non-significant change from the mowing intervention from their buffer analysis. The author’s sought to check for “spillover effects” from their interventions using the second, larger buffer model and found no significant difference for those areas adjacent to the greening intervention and a significant decrease in those areas adjacent to the mowing intervention. The author’s state that “these results suggest spillover benefits of vacant lot remediation, rather than displacement.” Meaning that they took this result to be evidence that the interventions didn’t simply push shootings to be one or two blocks away from where the clean-up occurred.

# Conclusion

So … that’s neat! What’s the take home message? If you clean up that dirty parking lot near where you live, you’ll disincentive crime? Well, maybe. As with all human endeavors, nothing is perfect and rarely simple. In the posts to come we’ll talk more about the strengths and limitations of the author’s approach as well as why this result is still so encouraging in spite of those problems. One overarching theme to keep in mind, is that this is a fairly cheap endeavor, just cleaning up some vacant lots, with a potentially huge payoff — saving human lives! This represents both the simplicity and the power that I hope to show is a regular theme in building better built environments.

I added further details on how Branas’ PNAS paper is related to the Moyer paper of concern in this case study on 10/26/21.

Branas, Charles C., Eugenia South, Michelle C. Kondo, Bernadette C. Hohl, Philippe Bourgois, Douglas J. Wiebe, and John M. MacDonald. 2018. “Citywide Cluster Randomized Trial to Restore Blighted Vacant Land and Its Effects on Violence, Crime, and Fear.” Proceedings of the National Academy of Sciences 115 (12): 2946–51. https://doi.org/10.1073/pnas.1718503115.
Moyer, Ruth, John M MacDonald, Greg Ridgeway, and Charles C Branas. 2019. “Effect of Remediating Blighted Vacant Land on Shootings: A Citywide Cluster Randomized Trial.” American Journal of Public Health 109 (1): 140–44.

### Corrections

If you see mistakes or want to suggest changes, please create an issue on the source repository.

### Reuse

Text and figures are licensed under Creative Commons Attribution CC BY 4.0. Source code is available at https://github.com/apeterson91/XStreetValidated, unless otherwise noted. The figures that have been reused from other sources don't fall under this license and can be recognized by a note in their caption: "Figure from ...".

### Citation

Peterson (2021, Oct. 17). X Street Validated: Cleanup vs. Crime: A Case Study in 4 Parts. Retrieved from https://xstreetvalidated.com/posts/2021-10-17-cleanup-vs-crime/
@misc{peterson2021cleanup,
}