Northgate Institute

Cleaning and Preparing Data

Getting from what you were given to what you can use

  • 7 weeks
  • 7 lessons
  • Intermediate
  • By application

Part of Become a data practitioner.

You’ll learn to
  • Profile an unfamiliar dataset before changing anything in it
  • Cluster and reconcile values that mean the same thing
  • Keep a record of every change so the work can be repeated
About

Real data arrives inconsistent, duplicated and half-typed by hand. This is the unglamorous work that makes everything after it possible, taught on messy data rather than tidy examples.

Contents
  1. Look before you touch3 lessons
    • The first twenty minutesReading
    • Cleaning a real dataset, start to finishVideo
    • Check: profiling firstShort assessment
  2. Making values agree4 lessons
    • Same thing, different spellingReading
    • Cleaning movesFlashcards
    • Cleaning that can be repeatedReading
    • OpenRefine — download and docsDownload