Difference between revisions of "IDW interpolation using QGIS"

From CUOSGwiki
Jump to navigationJump to search
Line 53: Line 53:
 
===Loading CSV File and Provincial Boundary File===
 
===Loading CSV File and Provincial Boundary File===
   
[[File:Screen Shot 2021-12-22 at 10.49.12 PM.png|thumb]]
 
   
 
* Launch QGIS and create a new project file. Save your project to the folder you created at the start of the tutorial
 
* Launch QGIS and create a new project file. Save your project to the folder you created at the start of the tutorial
   
# at the top of your toolbar, click the plugin tab and click the "manage and install plugins" item.
+
* At the top of your toolbar, click the plugin tab and click the "manage and install plugins" item.
# In the "all" tab, search for the "QuickMapServices" plugin and install it to QGIS. once this is done restart QGIS
+
* Search for the "QuickMapServices" plugin in the pop-up window and install it to QGIS. Save your project, close and re-open the QGIS application to activate the plug-in
  +
# once you are back into a new project layer, click the web tab at the top and go to the QuickMapServices dropdown and select oms standard. (this should add in a base map to your project)
 
  +
[[File:Plugin 1.png|500px|thumb|left]]
# we will now add in our 2 layers starting with the weather stations. by clicking on the layer tab at the top of the page go to the "add layer" tab and scroll to the "Delimited Text layer"
 
  +
[[File:Plugin 2.png|300px|thumb|center]]
# in the new window, click the 3 dots at the top right corner of the screen (you will be finding the CVS file that we edited earlier) once you have found it make sure that the "Comma" and "tab" boxes are checked off in the "custom delimiters" file format
 
  +
# in the Geometry definition option set your x field to "Long" and your y field to "Lat" so that QGIS knows how to read your coordinates
 
# click on the layer tab at the top of the page go to the "add layer" tab and scroll to the "add Vector layer" tab
+
* After reopening your project, click the Web tab on the menu, then QuickMapServices dropdown and select OSM standard. This will serve as a base map to your project
  +
# in the new window, click the 3 dots at the top right corner of the screen (you will be finding the boundary file we downloaded) in the package you downloaded click the file with the .shp end to it and add it to your project
 
  +
[[File:Plugin 3.png|300px|thumb]]
## once it is loaded in right-click on it and select "Open attribute table"
 
  +
## once open click the pencil at the top of the window. then select all layers besides Alberta and click the " delete selected feature" tap on the toolbar you clicked the pencil on
 
  +
* Add in the monthly climate summary data by clicking on the layer tab in the menu, selecting "Add Layer" and clicking "Add Delimited Text layer"
## once this is complete correctly you should only have the Alberta boundary file on your project layer (and the weather stations)
 
  +
  +
[[File:CSVI 1.png|300px|thumb]]
  +
  +
* In the pop up window, click the 3 dots at the top right corner of the screen (highlighted in blue in the image below) and navigate to your project folder. Select the climate summary CSV file. In the Geometry definition option set your x field to "Long" and your y field to "Lat" (highlighted in yellow) to set your coordinates
  +
  +
[[File:CSVI 2.png|300px|thumb]]
  +
  +
* Click on the layer tab in the menu, go to the "Add Layer" tab and select "Add Vector Layer"
  +
  +
[[File:VI 1.png|300px|thumb]]
  +
 
* In the pop up window, click the 3 dots at the top right corner of the screen (highlighted in blue in the image below) and navigate to your project folder. Select boundary file with a .shp ending
  +
  +
[[File:VI 2.png|300px|thumb]]
  +
 
* Right-click on the boundary layer and select "Open attribute table"
  +
* In the pop up window, click the pencil (circled in yellow) at the top right of the window to begin editing. Select all layers except Alberta and click the " Delete Selected Feature" tool (circled in red) on the menu
  +
  +
[[File:AT 1.png|thumb]]
  +
  +
* Right-click on the boundary and toggle editing to stop editing the layer. Select the "Save your Edits" option from the ensuing pop-up
 
* once this is complete correctly you should only have the Alberta boundary file on your project layer (and the weather stations)
 
[[File:Screen Shot 2021-12-22 at 10.32.11 PM.png|thumb]]
 
[[File:Screen Shot 2021-12-22 at 10.32.11 PM.png|thumb]]
 
# The next step will be to create a permeate layer for your weather station points. to do this right-click on the layer and click export "save feature as"
 
# The next step will be to create a permeate layer for your weather station points. to do this right-click on the layer and click export "save feature as"

Revision as of 19:31, 29 September 2023

Introduction and Purpose

Using spatial data, it is possible to analyze, interpret, and represent phenomena almost everywhere on Earth. But what can be done when data exists near our area of interest, but not directly at the location? In these situations, we can use Inverse Distance Weighting (IDW) interpolation, a process which calculates values for locations based on nearby known values. It operates on the first law of geography, which states that near things are more alike than far things and assigns greater influence to known values which are nearby than those that are distant. In this tutorial, we will be conducting IDW interpolation in QGIS, an open-source GIS system. Open-source ([1]) is a term that refers to having accessible, free and redistributable programs available to the public. This allows for individuals to work on the code together to create a model that encourages open collaboration and develops code together. To look at GIS programs available for free download, you can visit the [2] page to look at all the projects currently being worked on by the community.

The purpose of this tutorial is to expand your abilities in QGIS by teaching you how to run an important analysis tool- IDW interpolation [[3]], with the end goal of creating an interpolated raster surface. The difficulty level for this tutorial is an entry-level QGIS user. This tutorial will contain screen-shots for each step to show the path to create all the layers that are in the finished product

QGIS logo.png

Tutorial

Downloading QGIS

This tutorial uses QGIS, you will need to have the software installed [[4]] on your desktop or laptop. This tutorial uses QGIS 3.23. Once you have selected the version you wish to download based on your operating system, follow the guide that is installed in the package. With QGIS now installed on your computer and a proper path for accessing the application on your hard drive, you are now able to start the tutorial!


Data

The data used in this tutorial is monthly climate summaries from Statistics Canada, which publishes extensive and easily accessible data for all provinces and territories in Canada. For more information about the data, visit the "About the Data" page here [[5]]. This in-depth look at provincial weather will be an easily malleable data set to use for the tutorial. In this example, we will be looking at Alberta's average mean temperature. This will give us a well-distributed data set that we will be able to use to create an IDW model and help us calculate the approximate temperature values of areas that do not have weather stations.

Downloading the data

  1. First, set up a folder in your file directory for your project. This will be where you save all your data and your QGIS project
  2. Next, go to [[6]] and set the date to December of 2019
  3. Select your area of interest (for this assessment Alberta was used as it has the most climate stations in the country)
  4. Select CSV as the data format and click "Download data" to start your download
  5. You can also download the Legend(txt) file as it will allow you to see what all the data is meant to represent
  6. Next, we will download our provincial boundary file from [[7]]
  7. Select your preferred language, the .shp file format, and provinces/territories under "Cartographic Boundary File"
  8. Next hit continue at the bottom of the page, this will redirect you to a new page with a link labelled "Archived – gpr_000b11a_e.zip (ZIP version, 40,968.0 kb)" click the link to download the .zip folder
Screen Shot 2021-12-23 at 10.47.38 AM.png
Screen Shot 2021-12-23 at 10.52.41 AM.png



Editing the data

With this data having so many variables we need to edit it to make it easier to work with:

  1. Open your CSV file using a spreadsheet software like Excel
  2. Right click on the "Clim_ID" column to select the entire row
  3. Use the sort/filter drop-down menu and filter the "Clim_ID" column from largest to smallest
  4. Select the rows with values that contain letters and delete them from your file. These rows are not needed and can create some issues when loading the data into QGIS
  5. Save your worksheet as a CSV in your project folder and close your spreadsheet software
Screen Shot 2021-12-23 at 11.07.44 AM.png



QGIS

Loading CSV File and Provincial Boundary File

  • Launch QGIS and create a new project file. Save your project to the folder you created at the start of the tutorial
  • At the top of your toolbar, click the plugin tab and click the "manage and install plugins" item.
  • Search for the "QuickMapServices" plugin in the pop-up window and install it to QGIS. Save your project, close and re-open the QGIS application to activate the plug-in
Plugin 1.png
Plugin 2.png
  • After reopening your project, click the Web tab on the menu, then QuickMapServices dropdown and select OSM standard. This will serve as a base map to your project
Plugin 3.png
  • Add in the monthly climate summary data by clicking on the layer tab in the menu, selecting "Add Layer" and clicking "Add Delimited Text layer"
CSVI 1.png
  • In the pop up window, click the 3 dots at the top right corner of the screen (highlighted in blue in the image below) and navigate to your project folder. Select the climate summary CSV file. In the Geometry definition option set your x field to "Long" and your y field to "Lat" (highlighted in yellow) to set your coordinates
CSVI 2.png
  • Click on the layer tab in the menu, go to the "Add Layer" tab and select "Add Vector Layer"
VI 1.png
  • In the pop up window, click the 3 dots at the top right corner of the screen (highlighted in blue in the image below) and navigate to your project folder. Select boundary file with a .shp ending
VI 2.png
  • Right-click on the boundary layer and select "Open attribute table"
  • In the pop up window, click the pencil (circled in yellow) at the top right of the window to begin editing. Select all layers except Alberta and click the " Delete Selected Feature" tool (circled in red) on the menu
AT 1.png
  • Right-click on the boundary and toggle editing to stop editing the layer. Select the "Save your Edits" option from the ensuing pop-up
  • once this is complete correctly you should only have the Alberta boundary file on your project layer (and the weather stations)
Screen Shot 2021-12-22 at 10.32.11 PM.png
  1. The next step will be to create a permeate layer for your weather station points. to do this right-click on the layer and click export "save feature as"
  2. Give this a name and click the 3 dots next to your name for the layer. create a space where you will be saving all your file layers ( I would recommend creating a new folder to keep everything in to keep all your paths the same for the project) once all of this is done it should look something like this
Screen Shot 2021-12-22 at 11.23.32 PM.png



















Interpolating data to create a Raster Surface layer

Screen Shot 2021-12-23 at 12.16.29 AM.png
  1. Begin by clicking the processing tab at the top of the application window and selecting the

"toolbox" tab. This should bring up a menu on the left side of the application with a search bar at the top of its menu.

  1. in the search bar type in "IDW Interpolation". there will be several options that come up but for our tutorial, we will be using the proprietary tool that QGIS officially backs and created for its software. Once you have located it double click the tool to open the IDW window
  2. In the new window, where it says "Vector layer" select the name of the weather station layer we created earlier. Once this is done it will ask for the interpolation attribute that you will be interpolating, select the "Tm" attribute as this is what we will be working with
  3. right bellow interpolation attribute drop down there is a plus button, click this and the layer will be added the table below. In this table select the "points" tab under the type dropdown.
  4. below this we have the Distance coefficient P set at a default of 2, I would recommend increasing this to 5 to account for the northern and western portion of Alberta since these areas have very little station data available compared to southern Alberta. this will add more weight to pixel values and their distance to other stations.
  5. below this there is the extent tab with a dropdown on the right side of the terminal, click this and go to calculate from layer, this will bring up the other layers currently on your map. Select your boundary file as the extent
  6. if everything is done correctly it should look like the picture shown below. if it does click the "Run" button at the bottom of the window.



Clipping Interpolation Surface to create a final raster layer

  • This portion of the tutorial will focus on creating a masked layer for the raster layer we just created to fit within our boundary file.
  • at the top of the application there is a raster tab, click this and scroll to the "extraction" tab and select the "clip raster by mask layer"
Screen Shot 2021-12-23 at 12.25.12 AM.png
  • At the top of the window select your interpolated layer as the "input layer". you want to mask it to the shape of Alberta so choose the boundary file as your "mask layer"
  • Ensure that both layers are using the same projection and then click run.
Screen Shot 2021-12-23 at 12.39.28 AM.png




  • You will notice that these layers are only temporary and if you were to close the application right now the layer would not save to combat this we need to export the layer as its GeoTIFF file so that we can share your data later.
  1. to do this right-click on the layer and click export "save feature as"
  2. Make sure the format is GeoTIFF and click the 3 dots next to the file name. in the folder you created earlier give this layer a name like AB Weather IDW. once all of this is done it should look something like the figure on the left
Screen Shot 2021-12-23 at 12.48.13 AM.png




  • to finish this layer off we will be changing the symbology as the tones of gray are hard to grasp with a dataset like this. to change this right-click on the new layer and select the "properties" button at the bottom of the pop-up window.
  • at the top of this window it says "render type" click that menu and select "single-band pseudocolour". this will allow you to select a colour ramp different from black and white select something that makes sense for your map, of this example I have used the "plasma" ramp to show the difference between the warmest temperatures and the coldest.






Screen Shot 2021-12-23 at 1.08.23 AM.png




  • Once this has been completed and looks complete save your project by clicking the project tab and selecting "save as" this will bring you to the folder you created earlier. Name your project Alberta Weather IDW map and click "save".
  • once this is completed the analysis portion of the tutorial is over and you successfully ran an interpolation on open source software!












Exporting the Final Maps

  • Under the ‘Project’ tab, select “New Print Layout".
  • Name this print layout something like IDW MAP FINAL then click ok, this should bring you to an entirely different window like the one on the right.





Screen Shot 2021-12-23 at 1.23.03 AM.png







Screen Shot 2021-12-23 at 1.28.46 AM.png



  • on the left side of the screen you will see an icon that looks like a rolled-up map and if you hover over the button it says 'add Map' click this to bring in the map we just created. You can now fit the map to the size of the print layout and adjust the placement and size of the map on the left with the move "item content" and "select/move item" tools.
  • once you are satisfied with the placement you can start adding in other map elements to display the data in the easiest way possible, we will start by adding in a legend to make sense of our IDW
  • By clicking the legend icon labelled "add legend" you can now click and size your legend to fit in your map. Since we are in the layout view and not the mapping tool itself you may see some items in our legend that we do not want there. to remove these unwanted items be sure to unclick the "auto-update" box under the "legend items" tab on your right.






Screen Shot 2021-12-23 at 1.50.54 AM.png




  • Once it is unclicked you can select a feater that you do not need in your legend and remove it with the minus button on the bottom of the "Legend item" menu. make sure to title your legend something appropriate for your reader to understand what the symbols are representing in your data.
  • from this menu you can adjust the font, size and background for the legend to get your desired aesthetic (get creative while keeping the elements of what make a good map in mind).
  • Below the "add legend" button, add in a scale bar and northern arrow of your choosing adjusting the design elements to match the rest of the map. For the Scale bar, you can adjust how many segments are being displayed and how the increments go up.
  • to cap off the layout include a title that explains a little about the map itself for example "Alberta weather interpolation for December 2019"
  • when you are happy with what you have click the layout tab at the top of the application and select "export as image" or "export as SVG" to export it as a jpeg or SVG. Both are acceptable it just depends on what you will be needing it for after you have finished.




IDW map layout.jpg






  • Once you have saved this you have fully completed this tutorial!

Conclusion

In conclusion, this tutorial aimed to try and bridge the gap between this software and Esri’s products, to make it easier to learn how to use the software and carry out the functions that the user is already familiar with. This all ties into making this tutorial practical and accessible for all users picking up this software for the first time, or just wanting to expand their knowledge. I had originally intended to make this tutorial a kriging tutorial as the data we were using would greatly benefit from weighting distance and degree of variation when predicting the data in an area of interest. unfortunately, all the plugins I tried to use did not work when I tried to run any data through them to create a kriged layer. This led me to make the switch to an IDW map even though it would not allow me to work with the semivariogram to adjust the model. I tried using open Smart map and SAGA plugins with no success even after trying to troubleshoot with the professors themselves. In the future, I would love to see if someone could change this into a kriging tutorial as it would greatly benefit this data and push the tutorial even further. Had I been given more time I would have also expanded the tutorial to use PostGIS, GeoNode or MapServer to expand the tutorial’s viability even more. This would have allowed for easy sharing and the ability to update the data in real-time. None less I hope you learned something about open source programs with this tutorial and that you can update any areas I missed in the future. Feel free to email me if you have any questions or need any advice about the tutorial

best, Pierce


. pierce.w.burch@gmail.com

Resources

Boundary files. (n.d.). Retrieved December 23, 2021, from https://www12.statcan.gc.ca/census-recensement/2011/geo/bound-limit/bound-limit-2011-eng.cfm

Kriging Interpolation—The Prediction Is Strong in this One. (2017, February 4). GIS Geography. https://gisgeography.com/kriging-interpolation-prediction/

Types of Interpolation—Advantages and Disadvantages. (n.d.). GIS Resources. Retrieved December 22, 2021, from https://www.gisresources.com/types-interpolation-methods_3/

Media, G. R. is an initiative of S. (2013, October 4). Interpolation. GIS Resources. https://www.gisresources.com/gis_interpolation_techniques_2/

Canada, E. and C. C. (2011, October 31). Monthly Climate Summaries—Climate—Environment and Climate Change Canada. https://climate.weather.gc.ca/prods_servs/cdn_climate_summary_e.html

Meng, Q., Liu, Z., & Borders, B. E. (2013). Assessment of regression kriging for spatial interpolation – comparisons of seven GIS interpolation methods. Cartography and Geographic Information Science, 40(1), 28–39. https://doi.org/10.1080/15230406.2013.762138

Li, J., & Heap, A. D. (2014). Spatial interpolation methods applied in the environmental sciences: A review. Environmental Modelling & Software, 53, 173–189. https://doi.org/10.1016/j.envsoft.2013.12.008