In this module we work with spatial vector and raster data to test whether the legacy of redlining is still visible in the vegetation of American cities today. From this module on, Kilo Code runs in code mode, which lets the agent edit files and run code.
Learning goalsยถ
read and manipulate spatial vector data at scale
discover and stream satellite imagery from a public catalog
compute a vegetation index from remote sensing bands and summarize it by neighborhood
make interactive maps that a reader can explore
understand how structural racism shapes urban ecology
Backgroundยถ
In 2020, Christopher Schell and colleagues published a review in Science, The ecological and evolutionary consequences of systemic racism in urban environments. They show that systemic racism and classism shape ecological and evolutionary processes in cities. The University of Washington press release is a good short introduction.
In the 1930s the federal Home Ownersโ Loan Corporation (HOLC) graded the neighborhoods of more than 200 US cities from A (โbestโ) to D (โhazardousโ). The grades were written in the neutral language of real estate appraisal, but surveyors recorded the race and ethnicity of each neighborhoodโs residents, and the neighborhoods graded D were overwhelmingly those of Black, immigrant and working-class families. Lenders then used the maps to steer mortgage credit away from those neighborhoods, a practice now called redlining.
Disinvestment lasted for decades after the maps were drawn. Street trees and parks take decades to grow and maintain, so the vegetation we measure today still records where that investment did and did not happen. Figure 2 of Schell et al. shows that the Normalized Difference Vegetation Index (NDVI), a satellite measure of green vegetation, tracks the historical HOLC grade. We reproduce that pattern for several cities and ask whether it holds across the country or only in particular places.
Dataยถ
Mapping Inequality (vector data) provides the digitized HOLC maps. Please read the introduction on that site before class.
Sentinel-2 (raster data) provides 10 m satellite imagery, which we find through a STAC catalog.
Toolsยถ
Spatial data come in two basic types. Vector data describe points, lines and polygons, such as the boundary of each HOLC neighborhood. Raster data are grids of pixels, such as a satellite image in which each pixel records reflectance in several wavelength bands.
Both types of data are now large enough that downloading whole files is slow or impossible. The tools in this module are cloud native: data are stored in formats that let a program read only the part it needs, over an ordinary web connection, without downloading the rest.
DuckDB spatial through
ibishandles the vector data. We use the same table verbs as in Module 1, plus spatial operations such as intersections and areas.Cloud-optimized GeoTIFFs (COGs) store the Sentinel-2 imagery. A COG is an ordinary GeoTIFF whose internal tiles and lower-resolution overviews let a program request only the pixels inside one city at the resolution it needs.
STAC (SpatioTemporal Asset Catalog) is a standard way to describe imagery, so that we can search for scenes by location, date and cloud cover.
odc.stacandrioxarrayload the imagery lazily as arrays, in the same way thatibisloads tables lazily.
Further readingยถ
The Cloud-Native Geospatial Forum publishes clear introductions to these ideas.
Why does cloud-native geospatial matter to GIS professionals? explains what cloud native means and why it changes how we work with spatial data.
The Cloud-Optimized Geospatial Formats Guide surveys the formats, and its chapter on COGs covers tiling, overviews and range requests.
Where is COG for vector? explains why vector data needed different formats, such as GeoParquet.
Analysis-ready data in practice from a cloud-native perspective discusses what makes satellite data ready for analysis.
Templateยถ
- Schell, C. J., Dyson, K., Fuentes, T. L., Des Roches, S., Harris, N. C., Miller, D. S., Woelfle-Erskine, C. A., & Lambert, M. R. (2020). The ecological and evolutionary consequences of systemic racism in urban environments. Science, 369(6510). 10.1126/science.aay4497