Data Engineering

UC Berkeley, Fall 2022

Lakshya Jain

Lakshya Jain

lakshya.jain@berkeley.edu

Pronouns: he/him/his

Welcome to the first official offering of Data 101! The schedule and dates listed below are tentative and may be subject to change. Check out the syllabus for course information.


Week Date Lecture Discussion Assignment
0 Th 8/25 1. Introduction & Data Science Lifecycle (Recording)   Pre-semester Survey
1 Tu 8/30 2. Relational Model & Algebra (Recording)    
  Th 9/1 3. SQL Intro (Recording, Note)    
2 Tu 9/6 4. Subqueries and Aggregation (Recording, Note)    
  Th 9/8 5. Window Functions, Sampling, String Manipulation (Recording)   Project 1 (due 9/23)
3 Tu 9/13 6. Updates, DDL, Referential Integrity, Constraints (Recording, Note) Discussion 1 (Slides) (Solutions)  
  Th 9/15 No Lecture   Multivitamin 1 (due 9/30)
4 Tu 9/20 7. Foreign Keys, Index Selection (Recording, Note) Discussion 2 (Slides) (Solutions)  
  Th 9/22 8. Index Selection, Query Processing & Optimization (Recording)   Project 2 (due 10/7)
5 Tu 9/27 9. Query Processing & Optimization (II) (Recording) Discussion 3 (Slides) (Solutions)  
  Th 9/29 10. Relations, Tensors and Dataframes (Recording, Note)   Multivitamin 2 (due 10/14)
6 Tu 10/4 11. Data Preparation (Recording) Discussion 4 (Slides) (Solutions)  
  Th 10/6 12. Data Preparation (II) (Recording, Note)   Multivitamin 3 (due 10/28)
7 Tu 10/11 13. Data Cleaning (Recording) Discussion 5 (Slides) (Solutions)  
  Th 10/13 14. Data Cleaning (II) (Recording, Note)   Project 3 (due 10/28)
8 Tu 10/18 15. Normalization and ER (Recording) Discussion 6 (Slides) (Solutions)  
  Th 10/20 16. NoSQL & Semistructured Data (Recording)   Multivitamin 4 (due 11/4)
9 Tu 10/25 17. Querying Semistructured Data (Notebook) (Recording) Discussion 7 (Slides) (Solutions) Mid-Semester Survey (due 11/4)
  Th 10/27 18. Querying Semistructured Data (II) (Recording, Note)   Project 4 (checkpoint 11/10, due 12/2)
10 Tu 11/1 19. SQL Modifications, Transactions and Recovery (Recording, Note) Discussion 8 (Slides) (Solutions)  
  Th 11/3 20. Parallel and Distributed Computing (Recording)   Multivitamin 5 (due 12/2)
11 Tu 11/8 No Lecture (Election Day) Discussion 9 (Slides) (Solutions)  
  Th 11/10 21. Data Pipelines    
12 Tu 11/15 22.OLAP + Visualizations (Recording) Discussion 10 (Solutions)  
  Th 11/17 23. Transactions Review Lecture (Recording)    
13 Tu 11/22 No Lecture (Thanksgiving)    
  Th 11/24 No Lecture (Thanksgiving)    
14 Tu 11/29 24. Sampling, Data Vis (Recording)    
  Th 12/1 Closing Thoughts    
15 Tu 12/6 RRR Week    
  Th 12/8 RRR Week    
16 Th 12/15 Final Exam (11:30am - 2:30pm)