data-engineering-zoomcamp

linnealovespie/data-engineering-zoomcamp

Fork 0

Files

History

JMGGarcia adc0410afb Updated code in week 3 to use new file locations (#367 )

2023-04-16 16:28:34 +02:00

README.md

fixed month range, comments (#108 )

2022-03-14 09:22:48 +01:00

web_to_gcs.py

Updated code in week 3 to use new file locations (#367 )

2023-04-16 16:28:34 +02:00

README.md

Quick hack to load files directly to GCS, without Airflow. Downloads csv files from https://nyc-tlc.s3.amazonaws.com/trip+data/ and uploads them to your Cloud Storage Account as parquet files.

Install pre-reqs (more info in web_to_gcs.py script)
Run: python web_to_gcs.py