Theoretical Foundations of Data Science I 🧠

DSC 40A, Fall 2021 at UC San Diego

Suraj Rampure

Suraj Rampure
he/him

rampure@ucsd.edu

Lecture: Tu/Th 11AM-12:30PM, Center 109

Lecture Recordings Assignment Solutions

Week 0 – Welcome to DSC 40A! 👋

Sep 23

LEC 1 Introduction, Learning From Data

Week 1 – Empirical Risk Minimization

Sep 28

LEC 2 Minimizing Mean Absolute Error (code)

Sep 29

DISC 1 Mathematical Foundations (due 9/30)

Sep 30

LEC 3 Mean Squared Error and Empirical Risk Minimization (code) (video)

Week 2 – Gradient Descent

Oct 4

HW 1 MAE and MSE (due 10/4)

SRV 1 Survey 1 (due 10/4)

Oct 5

LEC 4 Spread, Other Loss Functions, Gradient Descent

C1, P12-15; Notes

Oct 6

DISC 2 Empirical Risk and Gradient Descent (due 10/7)

Oct 7

LEC 5 Gradient Descent and Convexity (code)

Week 3 – Simple Linear Regression

Oct 11

HW 2 Empirical Risk and Gradient Descent (due 10/11)

SRV 2 Survey 2 (due 10/11)

Oct 12

LEC 6 Simple Linear Regression

Oct 13

DISC 3 Simple Linear Regression (due 10/14)

Oct 14

LEC 7 More Simple Linear Regression (code)

C2, P1-7, DSC10

Week 4 – Midterm

Oct 18

HW 3 Simple Linear Regression (due 10/18)

SRV 3 Survey 3 (due 10/18)

Oct 19

LEC 8 Regression and Linear Algebra (code)

REV Midterm Review Session (5-8PM, PCYNH 109)

Oct 21

Exam Midterm (in lecture)

Week 5 – Feature Engineering

Oct 26

LEC 9 Multiple Linear Regression and Feature Engineering (blank) (code)

Oct 27

DISC 4 Multiple Linear Regression (due 10/28)

Oct 28

LEC 10 Feature Engineering, Clustering (blank) (code)

Week 6 – Clustering, Probability

Nov 2: LEC 11 Clustering, Introduction to Probability (blank) (code); HW 4 Multiple Linear Regression and Feature Engineering (due 11/2); SRV 4 Survey 4 (due 11/2)
Nov 13: DISC 5 Foundations of Probability (due 11/4)
Nov 4: LEC 12 Foundations of Probability (blank)

Week 7 – Combinatorics

Nov 8: HW 5 Transformations, Clustering, and Probability (due 11/8); SRV 5 Survey 5 (due 11/8)
Nov 9: LEC 13 Combinatorics (blank) (extra video)
Nov 10: DISC 6 Combinatorics (due 11/12)
Nov 11: N/A (Veteran’s Day)

Week 8 – More Probability

Nov 16: LEC 14 More Combinatorics, Conditional Probability (blank) (code); HW 6 Combinatorics (due 11/16); SRV 6 Survey 6 (due 11/16)
Nov 17: DISC 7 Conditional Probability and Independence (due 11/18)
Nov 18: LEC 15 Independence (blank) (extra note)

Week 9 – Naive Bayes

Nov 22: HW 7 Conditional Probability and Independence (due 11/22); SRV 7 Survey 7 (due 11/22)
Nov 23: LEC 16 Naive Bayes (blank)
Nov 25: N/A (Thanksgiving 🦃)

Week 10 – Conclusion

Nov 30: LEC 17 More Naive Bayes (blank) (code)
Dec 1: DISC 8 Probability Review (Optional) (recording)
Dec 2: LEC 18 Review, Conclusion (blank)
Dec 3: HW 8 Naive Bayes (due 12/3)

Week 11

Dec 6: SRV End of Quarter Survey (due 12/6)
Dec 8: Exam Final Exam (11:30AM-2:30PM, remote)