Goal of the Project The goal of this project is to create a streamlined pipeline that loads data from the Shopify REST API into a Google Cloud Storage...
Inspired by a recent blog post, I decided to experiment with various technologies and build a small data lake for Shopify data. In this project, the...
Create a new Cloud Push Worker in Google Cloud Read the tutorial on creating a Cloud Push Worker in Google Cloud in the Prefect Docs Docs. Ensure...
What is dlt? These were my initial questions when I first encountered the dlt (data load tool) package (https://dlthub.com/) several months ago. The...
What is dbt? dbt, short for data build tool, allows analysts and engineers to easily transform data within a database or data warehouse. Data...
DBT installation guide: The dbt package will be installed into a Python virtual environment. This allows us to install different versions of dbt (or...
