Extracting data

Post Date:

Table of Contents
Our tutorial for the Digital Scholar Lab (DSL) includes the introductory page you are reading, plus six major sections. Click on any of the links below to jump to the relevant tutorial. We suggest following them in order:

Access… Read more.

Post Date:

This tutorial has been developed for OpenRefine version 3.7.5
Sometimes when you construct an API call and use the Add Column by Fetching URLs feature, it won’t work. In these cases, you can use python to help. So far we’ve been writing GREL… Read more.

Post Date:

This tutorial has been developed for OpenRefine version 3.7.5
You may have noticed from Activity 2 that sometimes you searched for a property to add from Wikidata, but got an error. Other times you might want to augment your dataset with data that… Read more.

Post Date:

This tutorial has been developed for OpenRefine version 3.7.5
To learn more about reconciliation services and how you can use them to augment your data, check out the official OpenRefine guide to reconciling Feel free to read just the introduction… Read more.

Post Date:

In this activity, you are going to:
Create a new project by making an API call to pull in data and parse the resulting JSON
Manipulate the data by using GREL date expressions and facet the data to make discoveries
 
Create a new project by… Read more.

Post Date:

Scholars GeoPortal is part of a growing collection of the Ontario Council of University Libraries (OCUL). Scholars GeoPortal allows users to customize their data extracts by selecting the appropriate area of interest, temporal extent, file format,… Read more.

Post Date:

The interface enables the selection of relevant variables and census geographies, providing access to data down to the dissemination area (DA) level. Census data can be incorporated into analytical and GIS software. Furthermore, this is a… Read more.

Post Date:

 
1. In SDA
Go to the SDA website and select a survey of interest. If you are off campus, you will need to be on the VPN or use the following link.

 

It is advisable to run this procedure on a few selected variables the first time around… Read more.

Post Date:

Scraping tweets using Python
 






Table of Content

Introduction
The Twitter API
Python environment
Unicode strings
oauth2 library
Get Twitter data

 
Introduction
Twitter is a popular online social network where users can send and read… Read more.

Post Date:

The main dataset used is the flights dataset. It contains the US domestic flights in January 2020 [1]. The other two datasets used are fabricated datasets created for the purpose of this guide.
 
The link to the recording of this workshop can… Read more.