Colab
Colab

Colab

Created
Feb 13, 2022 03:26 AM
Tags
colab
gcs
data-engineering

Integrating With Google Cloud Platform

  • Google Cloud Storage
    • upload file to google cloud storage
  • Big Query
    • load file to Big Query
    • create a schema for the external table before uploading it to big query
  • Google Drive
    • Accessing to file in your google drive
    • Create, Update, Delete file on google drive

Pandas

  • Pandas Note

PySpark

  • Data Cleansing with Spark
 
  • Setup PySpark on Colab
  • PySpark with Ngrok for Spark Jobs Web UI (Coming Soon)