ETL Processing on GCP Using Dataflow and BigQuery
In this lab you will build several Data Pipelines that will ingest data from a publicly available dataset into BigQuery, using these GCP components:
- GCS - Google Cloud Storage
- Dataflow - Google Dataflow
- BigQuery - BigQuery tables
You will create your own Data Pipeline, including the design considerations, as well as implementation details, to ensure that your prototype meets the requirements. Be sure to open the python files and read the comments when instructed to.
- Temporary Access
- Bite Sized