Cleaning data | Map and Data Library

Although the Map & Data Library is physically closed, we are still available remotely and happy to help. We can conduct consultations using online teleconferencing software. Please feel free to contact us at mdl@library.utoronto.ca or use our help form. We have a number of tutorials available, are still supplying software licenses, and have compiled a list of resources for working with COVID-19 data.

Please note that our computer lab is also accessible for use through remote access. See this link for more information.

COVID-19: Updates on library services and operations

Start your search

Geospatial data

Scholars GeoPortal | Geospatial data | Remote sensing | Air photos

Numeric data

Microdata | Statistics | Census of Canada

Maps and atlases

Scanned Maps (new interface) | Scanned maps | Fire insurance plans | Rare maps | Topographic maps

Cleaning data in STATA

Table of Contents

Matching Census Data to Postal Codes using SPSS

This guide shows you how to match census data to postal codes, and how to merge them in a SPSS file. We will select income variables from the 2006 Census and PCCFs from Toronto.

Summary of Steps:

Introduction to R

This guide is suitable for new R-users or advanced level R-users looking for information on specific topics. It was created using R version 3.2.2. You can find the most recent copy of R from the the R website: Download R. If your computer already has R, make sure that it is R3.0.2 or higher in order to run some packages, especially Swirl, which we use later in the guide.

OpenRefine Augmenting Activity 4: Using Python

Wikimedia provides a web API that we can use to access Wikipedia data. To learn more about how to use this API, see: https://en.wikipedia.org/api/rest_v1/
This page helps you construct URLs to make specific API calls. You can expand the section you are interested in, fill in the form and click on the Try it Out button to see what results you will get from a call. For our example, we are going to use the summary page example. On the Wikimedia REST API documentation page, first expand Page Content.

OpenRefine Augmenting Activity 3: Using Add Column by Fetching URLs

In this activity, you are going to:

Add a column of JSON data resulting from a Wikidata API call
Parse this JSON data column to obtain the property “first line”

OpenRefine Augmenting Activity 2: Using Reconciliation Services

In this activity, you are going to:

Reconcile (match) the titles of books with Wikidata
Add new columns of data from Wikidata

OpenRefine Augmenting Activity 1: Preparing the data

In this activity, you are going to:

A. Create a new project from a JSON file of book information and learn about rows vs records

B. Join multiple cells into one cell to reduce the number of rows

C. Use some advanced GREL and regex to reverse the author names in our dataset

OpenRefine Tutorial 4. 311 Calls Activity

In this activity, you are going to:

A. Create a new project by making an API call to pull in data and parse the resulting JSON

B. Manipulate the data by using GREL date expressions and facet the data to make discoveries

OpenRefine Tutorial 3. Regular Expressions (Regex) Activity

In this activity, you are going to:

Open regex101.com and load some sample data
Practice some regex basics
Use regex in OpenRefine

OpenRefine Tutorial 2. Citizen Science Activity

In this activity, you are going to:

1
2
next
last