The spreading of COVID-19 has led to an increased interest in displaying region and country-specific information on geographic heat maps. Geographic heat maps use color shadings to visualize data that includes a spatial component and refers, for example, to countries, cities, towns, mountains, etc. The color shades are defined in a color palette and determined by numerical values on a scale. In this way, geographic heat maps give the viewer a quick overview of what is happening in different regions. This tutorial shows how to create geographic heat maps in Python using the GeoPandas library. We will work with COVID-19 data and visualize it using various color-coded maps.
The rest of this article proceeds as follows: We begin by going through the steps to visualize COVID-19 data on a geographic heat map. We will be using the GeoPandas library to plot the maps. Geopandas is an open-source project for working with geospatial data in Python. Our heat map will use color shades to visualize growth rates and total cases of COVID-19 in different countries. In addition, we will zoom in on specific map regions.
Creating Geographic Heat Maps with Python and GeoPandas
In the following, we implement several geographic heat maps using Python and the GeoPandas package. GeoPandas extends the datatypes of Pandas so that they support spatial operations on geometric data types. In this way, Geopandas allows us to create maps without dealing with other dependencies, thus making it an excellent way to work with spatial information in Python.
The code is available on the GitHub repository.
Prerequisites
Before starting the coding part, make sure that you have set up your Python 3 environment and required packages. If you don’t have an environment set up yet, you can follow the steps in this tutorial to set up the Anaconda environment.
Also, make sure you install all required packages. In this tutorial, we will be working with the following standard packages:
You can install packages using console commands:
- pip install <package name>
- conda install <package name> (if you are using the anaconda packet manager)
We will create geographic heat maps with the GeoPandas Python library. You can install GeoPandas via the console by using the following command:
- conda install –channel conda-forge geopandas
- pip install geopandas
Update (23.9.2020): With the release of Python 3.8, there is a new install procedure:
- conda create -n geo_env
- conda activate geo_env
conda config --env --add channels
conda-forge
conda config --env --set channel_priority strict
conda install python=3 geopandas
Download the Geographic Map Data From Naturalearthdata
First, we will get the map with the geospatial data. Rendering maps with GeoPandas requires a shapefile. A shapefile is a DataFrame with some graphical data attached. For instance, some shapefiles show cities, countries, continents, or maps of the whole world. So in our case, the shapefile is a list of countries, whereby each country has its graphical representation in polygons. The example presented in this tutorial will use a world map.
Various sources on the web provide shapefiles for different geographical regions and in varying detail. For example, naturalearthdata.com provides a map of the world. To download the map, go to the natualearthdata webpage, and with a click on the green button, you can download version 4.1.0.
Once the download is complete, unpack the files into the folder of your Python notebook or a subfolder in the folder of your Python notebook (e.g., data/shapefiles/worldmap/).
Step #1 Loading the COVID-19 Data
Next, we retrieve the COVID-19 data for all countries via an API. If you are not yet familiar with using APIs, check out this tutorial on accessing data sources via REST APIs.
# Setting up Packages import json import country_converter as coco from datetime import datetime, timedelta import requests import pandas as pd import geopandas as gpd import matplotlib.pyplot as plt # Getting the data PAYLOAD = {'code': 'ALL'} URL = 'https://api.statworx.com/covid' RESPONSE = requests.post(url=URL, data=json.dumps(PAYLOAD)) # Convert the response to a data frame covid_df = pd.DataFrame.from_dict(json.loads(RESPONSE.text)) covid_df.head(3)
date | day | month | year | cases | deaths | country | code | population | continent | cases_cum | deaths_cum | |
---|---|---|---|---|---|---|---|---|---|---|---|---|
0 | 2019-12-31 | 31 | 12 | 2019 | 0 | 0 | Afghanistan | AF | 38041757.0 | Asia | 0 | 0 |
1 | 2020-01-01 | 1 | 1 | 2020 | 0 | 0 | Afghanistan | AF | 38041757.0 | Asia | 0 | 0 |
2 | 2020-01-02 | 2 | 1 | 2020 | 0 | 0 | Afghanistan | AF | 38041757.0 | Asia | 0 | 0 |
We continue by preparing the COVID-19 data for visualizing them on a heat map.
Step #2 Specifying a Shapefile
The next step is to specify the shapefile for GeoPandas to plot the map. We select the file path to our shapefile and load the data via the GeoPandas read_file function.
# Setting the path to the shapefile SHAPEFILE = 'data/shapefiles/worldmap/ne_10m_admin_0_countries.shp' # Read shapefile using Geopandas geo_df = gpd.read_file(SHAPEFILE)[['ADMIN', 'ADM0_A3', 'geometry']] # Rename columns. geo_df.columns = ['country', 'country_code', 'geometry'] geo_df.head(3)
country | country_code | geometry | |
---|---|---|---|
0 | Indonesia | IDN | MULTIPOLYGON (((117.70361 4.16341, 117.70361 4… |
1 | Malaysia | MYS | MULTIPOLYGON (((117.70361 4.16341, 117.69711 4… |
2 | Chile | CHL | MULTIPOLYGON (((-69.51009 -17.50659, -69.50611 |
We have created a dataframe with three columns, as you can see above. The column geometry contains the graphical representation of countries. Now that we have prepared the data, we can plot our first geographic map. We create the map by using the GeoPandas plot function.
# Drop row for 'Antarctica'. It takes a lot of space in the map and is not of much use geo_df = geo_df.drop(geo_df.loc[geo_df['country'] == 'Antarctica'].index) # Print the map geo_df.plot(figsize=(20, 20), edgecolor='white', linewidth=1, color='lightblue')
Step #3 Bringing It All Together
Next, we need to ensure that our data matches the country codes. The dataframe with the geospatial data of the world map contains country codes that adhere to iso3. However, our COVID-19 data uses iso2_codes. Luckily there is a country_converter available that does this job for us:
# Next, we need to ensure that our data matches with the country codes. iso3_codes = geo_df['country'].to_list() # Convert to iso3_codes iso2_codes_list = coco.convert(names=iso3_codes, to='ISO2', not_found='NULL') # Add the list with iso2 codes to the dataframe geo_df['iso2_code'] = iso2_codes_list # There are some countries for which the converter could not find a country code. # We will drop these countries. geo_df = geo_df.drop(geo_df.loc[geo_df['iso2_code'] == 'NULL'].index)
We have a list with all nations’ names (country) and codes (country_code). An additional column includes the geographical representation of each country.
Step #4 Preprocessing
Our COVID-19 data so far contains the historical cases. We want to drop these historical cases and only get the data from the last day. Then we merge the data frames.
Before we plot the heat map, we have to specify a variable that determines the color of the countries on the map. Our goal is to color the countries depending on the growth rate of COVID-19 cases per day. The formula for the growth rate is ‘new cases’ / total present cases.
# We want to drop the history and only get the data from the last day d = datetime.today()-timedelta(days=1) date_yesterday = d.strftime("%Y-%m-%d") # Preparing the data covid_df = covid_df[covid_df['date'] == date_yesterday] # Merge the two dataframes merged_df = pd.merge(left=geo_df, right=covid_df, how='left', left_on='iso2_code', right_on='code') # Delete some columns that we won't use df = merged_df.drop(['day', 'month', 'year', 'country_y', 'code'], axis=1) #Create the indicator values df['case_growth_rate'] = round(df['cases']/df['cases_cum'], 2) df['case_growth_rate'].fillna(0, inplace=True) df.head(3)
Step #5 Creating a Geographic Heat Map
In the previous step, we have set up the data for our map. Next, we create the geographical heat map.
# Print the map # Set the range for the choropleth title = 'Daily COVID-19 Growth Rates' col = 'case_growth_rate' source = 'Source: relataly.com \nGrowth Rate = New cases / All previous cases' vmin = df[col].min() vmax = df[col].max() cmap = 'viridis' # Create figure and axes for Matplotlib fig, ax = plt.subplots(1, figsize=(20, 8)) # Remove the axis ax.axis('off') df.plot(column=col, ax=ax, edgecolor='0.8', linewidth=1, cmap=cmap) # Add a title ax.set_title(title, fontdict={'fontsize': '25', 'fontweight': '3'}) # Create an annotation for the data source ax.annotate(source, xy=(0.1, .08), xycoords='figure fraction', horizontalalignment='left', verticalalignment='bottom', fontsize=10) # Create colorbar as a legend sm = plt.cm.ScalarMappable(norm=plt.Normalize(vmin=vmin, vmax=vmax), cmap=cmap) # Empty array for the data range sm._A = [] # Add the colorbar to the figure cbaxes = fig.add_axes([0.15, 0.25, 0.01, 0.4]) cbar = fig.colorbar(sm, cax=cbaxes)
As shown in the map above, countries in Central Asia and Africa currently report the highest COVID-19 growth rates.
There are different color palettes. You can use them by altering the cmap variable. Below is a sample of ready-to-use color scales. You can find more color scales on the matblotlib page.
Step #6 Zooming in on Specific Regions
We can zoom in on a continent or a country by filtering our dataframe. Luckily, there is no need to manually enter the country codes for the filter operation. Instead, we can use a list of country codes that I found on datahub.io. In the following, we create a geographic map specifically for Africa.
Running the code below will filter the spatial-geo data to African countries and plot the heat map.
# The map shows that many african countries are currently reporting increasing case numbers # Next we create a new df based on a filter for african countries africa_country_list = ['ZM', 'BF', 'TZ', 'EG', 'UG', 'TN', 'TG', 'SZ', 'SD', 'EH', 'SS', 'ZW', 'ZA', 'SO', 'SL', 'SC', 'SN', 'ST', 'SH', 'RW', 'RE', 'GW', 'NG', 'NE', 'NA', 'MZ', 'MA', 'MU', 'MR', 'ML', 'MW', 'MG', 'LY', 'LR', 'LS', 'KE', 'CI', 'GN', 'GH', 'GM', 'GA', 'DJ', 'ER', 'ET', 'GQ', 'BJ', 'CD', 'CG', 'YT', 'KM', 'TD', 'CF', 'CV', 'CM', 'BI', 'BW', 'AO', 'DZ'] africa_map_df = df[df['iso2_code'].isin(africa_country_list)] # Plot the map for Africa title = 'COVID-19 Growth Rate per Day in Africa' col = 'case_growth_rate' source = 'Source: relataly.com \nGrowth Rate = New cases / All previous cases' vmin = df[col].min() vmax = df[col].max() fig, ax = plt.subplots(1, figsize=(20, 9)) ax.axis('off') africa_map_df.plot(column=col, ax=ax, edgecolor='0.8', linewidth=1, cmap=cmap) ax.set_title(title, fontdict={'fontsize': '25', 'fontweight': '3'}) ax.annotate(source, xy=(0.24, .08), xycoords='figure fraction', horizontalalignment='left', verticalalignment='bottom', fontsize=10) sm = plt.cm.ScalarMappable(norm=plt.Normalize(vmin=vmin, vmax=vmax), cmap=cmap) cbaxes = fig.add_axes([0.35, 0.25, 0.01, 0.5]) {"type":"block","srcIndex":53,"srcClientId":"2ddd9666-6def-46e0-803e-4bf7b0366a27","srcRootClientId":""}cbar = fig.colorbar(sm, cax=cbaxes)
In case you encounter an error with the mapclassify-package, you can try the following command to reinstall it: conda install -c conda-forge mapclassify
Voilá, now we only see the African continent. The map shows that the countries in Africa that currently report the highest total case numbers are South Africa, Algeria, Morocco, Kamerun, and Egypt.
Let’s take a look at the total cases per country in Africa:
# Insert cases per population # Alternative: africa_map_df2['cases_population'] = round(africa_map_df['cases_cum'] / africa_map_df['population'] * 100) africa_map_df2 = africa_map_df.copy() # Remove NAs africa_map_df2.loc[: , 'cases_cum'].fillna(0, inplace=True) # Show the data africa_map_df2.head() # Plot the map title = 'Total COVID-19 Cases on the African Continent' col = 'cases_cum' source = 'Source: relataly.com ' vmin = africa_map_df2[col].min() vmax = africa_map_df2[col].max() fig, ax = plt.subplots(1, figsize=(20, 9)) ax.axis('off') africa_map_df2.plot(column=col, ax=ax, edgecolor='1', linewidth=1, cmap=cmap) ax.set_title(title, fontdict={'fontsize': '25', 'fontweight' : '3'}) ax.annotate( source, xy=(0.24, .08), xycoords='figure fraction', horizontalalignment='left', verticalalignment='bottom', fontsize=10) sm = plt.cm.ScalarMappable(norm=plt.Normalize(vmin=vmin, vmax=vmax), cmap=cmap) cbaxes = fig.add_axes([0.35, 0.25, 0.01, 0.5]) cbar = fig.colorbar(sm, cax=cbaxes)
The highest growth rate was reported by South Sudan, followed by Botswana and Niger.
Step #7 Saving a Geo-Heat Maps to PNG
If you want to save the map, you can do this with the following command.
# Safe the map to a png fig.savefig('map_export.png', dpi=300)
Summary
This article has created geographic heat maps using GeoPandas in Python. We have prepared spatial data and color-coded the maps using COVID-19 data. In addition, you have learned how to create maps for specific geographical regions by filtering the DataFrame. We have also learned to zoom in on specific regions and change a heat map’s color style using different color maps. With this knowledge, you are well equipped to use geographic maps to visualize other spatial data.
I hope this article was helpful. If you have any questions or remarks, please write them in the comments.
Looking for more exciting map visualizations? Consider this relataly tutorial on predicting and visualizing crimes on a map of San Francisco.
This is so helpfuul for my DA assignment thank you!!