Week 4
1, Managed to download the datasets associated with the notebooks, I extracted the source data info from notebook metadatas
2, Resolved issue about kaggle API premission, shifted to openddatasets API, but eventually go back to kaggle API
3, An issue sets in:

The “:” after the for loop is causing trouble:
Final solution: If a line is not recoginzed, then collect this line and output it
4, Implement quality control for the notebooks The code would need parameters: Minimum valid operations, upvotes, number of dataset.
Minimum valid operations: parse the notebook to json and see how many wrangling, we only want the note book with certain minimum number of operations, they are viewed as good quality.
Number of dataset: we want to ensure that the notebooks are from at least n datasets
upvotes: notebooks with higher upvotes have better quality
Last update on June 27th
