Troy's Scratchpad

November 8, 2010

A More Robust Method of Finding a UHI signal

Filed under: Uncategorized — troyca @ 10:44 pm

This new iteration I’ve been working on in the background for a little while.  Previously, the correlation between the increase in temperature over a region and the coincidental increase in population density, along with the limited amount of population data, created a few stumbling blocks.

Basically, as in before, I want to examine how the change in population affects the station temperatures, since this change could theoretically occur in both rural and urban stations. See my original post here for more background.

Intermediate data and code for this post can be downloaded here.

New Population Data

Previously, I’ve been using GWPv3 for my population density data.  Unfortunately, this only included actual population data for the years 1990 and 2000 in the U.S.  However, aggregate U.S. census data for every decade can be downloaded from the
Nation Historical Geographic Information System.

There is perhaps a better way to do it, but after downloading the population data by “place” from the NHGIS data finder, I matched it to the various U.S. stations from the USHCN database using a combination of Excel macros and by hand.  (A sample macro for how I performed some of the mapping is included in the code above, as well as the population data by station for the years 1970, 1980, 1990, and 2000).  So now we at least have 3 decades of station population data to work with.

The Method

The temperature data I’m using is once again USHCNv2

1) For each station, the linear temperature trend (dT) is calculated based on the data from 1970-2000.  Similarly, we calculate the linear trend of the log of the population for the station (referred to as dP for simplicity) using the 1970, 1980, 1990, and 2000 population data. A station is only included IF at least 25 of its 31 years report annual temperature AND it has population for all 4 population years.

2) Based on latitude and longitude, we match all close station pairs.  (I should mention that Ron suggested something similar way back in an earlier comment).  For now I’ve matched based on “distance” in terms of degrees, which technically is not a valid physical distance, but should be close enough for this preliminary work.  The station pairs that are included are based on this “threshold” distance…I’ll show how this threshold affects various results below.  Obviously, the higher the threshold, the more station pairs we get.

3) We then graph these station pairs, plotting the difference in their linear temperature trends against the difference in their log population trends.  We should see a positive correlation if we believe population to be a proxy for UHI and that this effect is discernible in the station records.

Results – USHCN raw

Results – USHCN TOB Adjusted

Results – USHCN F52 Adjustments


At first glimpse, this looks to me like there is indeed a UHI signal present based on population change.  All of the tests above seem to show at least some significant correlation.  This method seems to be fairly robust, but I’ve been wrong before.

On the other hand, it is hard to get a feel for the magnitude of this effect, since the slope varies wildly among each test.  Furthermore, even if we DO pick one of the higher ends, an early glance suggests the relative effect would not be very large compared to the temperature trend in the U.S. during the period.   I hope to do a more formal post investigating the magnitude of this effect in the future.

There are a number of other things I hope to do to help tease out the signal.  The population data per station I still feel is suspect, so I’m looking for ways to improve the accuracy at the actual station location.  Including more decades going back may also help eliminate some of the noise.  But perhaps what I’m most excited about are the other variables available for download at NHGIS, some of which include land use, which may be a better proxy for determining the magnitude of the UHI effect than population.

About these ads


  1. [...] Troy_CA's blog Troy_CA's blog Skip to content HomeAbout ← A More Robust Method of Finding a UHI signal [...]

    Pingback by AMRMo Finding a UHI Signal P2 – Increase vs decrease in population | Troy_CA's blog — November 11, 2010 @ 1:35 pm

  2. [...] population data from NOAA for the U.S. going back to 1930.  Performing similar tests to Part 1 and Part 2 gives us an opportunity to use these extra years to search for any UHI [...]

    Pingback by AMRMo Finding a UHI Signal P3 – Using NOAA Population data | Troy_CA's blog — November 12, 2010 @ 6:32 pm

  3. [...] Since starting this blog, I’ve been trying to determine the UHI effect based on how changing populations trends correlate with changing temperature trends at various stations.  I believe the most successful demonstration of that was here. [...]

    Pingback by A New Model for UHI in US 1970-2000 Temperature Trends | Troy_CA's blog — November 24, 2010 @ 6:42 pm

  4. there is 30 arc second data for the US going back quite a while.
    I passed on the link to zeke and ron. if you want it I can
    pass it on to you.

    Also, I can give you another source to historical population data. gridded.
    5 minute grids per decade back before 1900. I’ve turned that into a density
    file in GIS.

    Comment by Steven Mosher — November 30, 2010 @ 12:51 am

RSS feed for comments on this post. TrackBack URI

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

The Silver is the New Black Theme Blog at


Get every new post delivered to your Inbox.

%d bloggers like this: