Session 8 (SQL, Scraping, and Workflow)

Aims / Outcomes / Expectations of Workshop:

  1. Use SQL to read from pre-formed databases

  2. Write Python files in a text editor

  3. Write Python files directly rather than working in the notebook

  4. Understand the basics of html

  5. Be able to use data scraping tools like BeautifulSoup, requests, and pd.read_html

  6. What are kedro and prefect? What problems do they solve?

Week 2, Session 8 (Tuesday 30th March)

Time

Topic

14:00 - 15:00

SQL

15:00 - 15:30

Text editors

15:30 - 15:45

Break

15:45 - 16:00

Writing and running Python files

16:00 - 16:45

Web scraping

16:45 - 17:00

Workflow tools

We also worked through some notebooks on Tuesday and Thursday that are linked below:

Exercises SQL