About this course: This course will show how one can treat the Internet as a source of data. We will scrape, parse, and read web data as well as access data using web APIs. We will work with HTML, XML, and JSON data formats in Python. This course will cover Chapters 11-13 of the textbook “Python for Everybody”. To succeed in this course, you should be familiar with the material covered in Chapters 1-10 of the textbook and the first two courses in this specialization. These topics include variables and expressions, conditional execution (loops, branching, and try/except), functions, Python data structures (strings, lists, dictionaries, and tuples), and manipulating files. This course covers Python 3.
Created by: University of Michigan
Taught by: Charles Severance, Associate Professor
School of Information
| Basic Info | Course 3 of 5 in the Python for Everybody Specialization |
| Commitment | 6 weeks of study, 2-4 hours/week |
| Language | English |
| How To Pass | Pass all graded assignments to complete the course. |
| User Ratings |
Syllabus
WEEK 1
Getting Started
In this section you will install Python and a text editor. In previous classes in the specialization this was an optional assignment, but in this class it is the first requirement to get started. From this point forward we will stop using the browser-based Python grading environment because the browser-based Python environment (Skulpt) is not capable of running the more complex programs we will be developing in this class.
6 videos, 4 readings
- Video: Welcome to The Course
- Reading: Python Textbook
- Reading: Help us learn more about you!
- Video: Welcome to Python - Guido van Rossum
- Reading: Welcome to Python 3
- Reading: Notes on Choice of Text Editor
- Video: Windows 10: Installing Python and Writing A Program
- Video: Windows: Taking Screen Shots
- Video: Macintosh: Using Python and Writing A Program
- Video: Macintosh: Taking Screen Shots
Graded: Peer Review: Installing and Running Python Screen Shots
WEEK 2
Regular Expressions (Chapter 11)
Regular expressions are a very specialized language that allow us to succinctly search strings and extract data from strings. Regular expressions are a language unto themselves. It is not essential to know how to use regular expressions, but they can be quite useful and powerful.
4 videos, 1 reading
- Video: 11.1 - Regular Expressions
- Video: 11.2 - Extracting Data
- Reading: Python Regular Expression Quick Guide
- Video: Bonus: Office Hours - Den Haag
- Video: Bonus Interview: Bjarne Stroustrup - C++
Graded: Regular Expressions
Graded: Extracting Data With Regular Expressions
WEEK 3
Networks and Sockets (Chapter 12)
In this section we learn about the protocols that web browsers use to retrieve documents and web applications use to interact with Application Program Interfaces (APIs).
7 videos, 1 reading
- Video: 12.1 - Networked Technology
- Video: 12.2 - Hypertext Transfer Protocol (HTTP)
- Video: Worked Example: Sockets (Chapter 12)
- Reading: If You Want to Learn More
- Video: Bonus: Leonard Kleinrock - The First Two Packets on the ARPANET
- Video: Bonus Video: Robert Cailliau - co-Inventor of the Web
- Video: Bonus: Office Hours - Atlanta GA (Buckhead)
- Video: Fun: Dr. Chuck @ CNN Reading the News
Graded: Networks and Sockets
Graded: Understanding the Request / Response Cycle
WEEK 4
Programs that Surf the Web (Chapter 12)
In this section we learn to use Python to retrieve data from web sites and APIs over the Internet.
8 videos, 1 reading
- Video: 12.3 - Unicode Characters and Strings
- Video: 12.4 - Retrieving Web Pages
- Video: Worked Example: Using Urllib (Chapter 12)
- Video: 12.5 - Parsing Web Pages
- Video: Worked Example: BeautifulSoup (Chapter 12)
- Reading: Notes Regarding the Use of BeautifulSoup
- Video: Bonus: Office Hours - Montreal
- Video: Bonus Interview: Tim Berners-Lee - Inventing the Web
- Video: Fun: I Got My Mojo Working - Geneva, Switzerland
Graded: Reading Web Data From Python
Graded: Scraping HTML Data with BeautifulSoup
Graded: Assignment: Following Links in HTML Using BeautifulSoup
WEEK 5
Web Services and XML (Chapter 13)
In this section, we learn how to retrieve and parse XML (eXtensible Markup Language) data.
8 videos
- Video: 13.1 - Data on the Web
- Video: 13.2 eXtensible Markup Language (XML)
- Video: 13.3 - XML Schema
- Video: 13.4 - Parsing XML
- Video: Worked Example: XML (Chapter 13)
- Video: Interview: Roy Fielding - Understanding the REST Architecture
- Video: Bonus: Office Hours - Boston
- Video: Bonus Video: Ian Horrocks / RDF / OWL (Advanced)
Graded: eXtensible Markup Language
Graded: Extracting Data from XML
WEEK 6
JSON and the REST Architecture (Chapter 13)
In this module, we work with Application Program Interfaces / Web Services using the JavaScript Object Notation (JSON) data format.
12 videos, 2 readings
- Video: 13.5 - JavaScript Object Notation (JSON)
- Video: Worked Example: JSON (Chapter 13)
- Video: Interview: Douglas Crockford - Discovering JSON
- Video: 13.6 - Service Oriented Approach
- Video: Video: Service Oriented Architectures
- Video: 13.7 - Using Application Programming Interfaces
- Video: Worked Example: GeoJSON API (Chapter 13)
- Video: 13.8 - Securing API Requests
- Video: Worked Example: Twitter API (Chapter 13)
- Video: Bonus: Office Hours - Melbourne, AU
- Video: Bonus: Office Hours - Santa Monica, CA
- Video: Bonus: Class Reunion at Bletchley Park
- Reading: Please Rate this Course on Class-Central
- Reading: Post-Course Survey
Graded: REST, JSON, and APIs
Graded: Extracting Data from JSON
Graded: Using the GeoJSON API
FAQs
How It Works
Coursework
Each course is like an interactive textbook, featuring pre-recorded videos, quizzes and projects.
Help from Your Peers
Connect with thousands of other learners and debate ideas, discuss course material, and get help mastering concepts.
Certificates
Earn official recognition for your work, and share your success with friends, colleagues, and employers.
Creators
University of Michigan
The mission of the University of Michigan is to serve the people of Michigan and the world through preeminence in creating, communicating, preserving and applying knowledge, art, and academic values, and in developing leaders and citizens who will challenge the present and enrich the future.
Pricing
| Audit | Purchase Course | |
|---|---|---|
| Access to course materials | Available | Available |
| Access to graded materials | Not available | Available |
| Receive a final grade | Not available | Available |
| Earn a shareable Course Certificate | Not available | Available |
Ratings and Reviews
Good course to understand the basics of web scrapping using python especially for python beginner.
Dr Chuck...is the best...thanks for your hard work.
It is building upon prior courses and just keeps getting more interesting and more fun. Dr. Severance is fantastic, you feel like he is talking directly to you and he has a great teaching methodology and very funny!
Coursera provides universal access to the world’s best education, partnering with top universities and organizations to offer courses online.
© 2017 Coursera Inc. All rights reserved.
great course