Image by Anderson for eQuest

Creating a complete solution of BigData ingestion using Google Cloud

BigData Ingestion Project: Google Cloud ecosystem: Storage, Function, Composer, Dataflow & BigQuery

Motivation: Client has site that every 1 minute generates a log file in CSV format of 1 GB.