DataOpsBarcelona- Automated Data Pipeline in GCP

Presentation: Automated Data Pipeline in GCP
Build a fully automated data pipeline in GCP with Terraform. In this topic, I will pick-up the different tools available in GCP (Kubernetes, Dataflow, DataProc, Big Query, Pub/Sub, etc) the pros and cons of each and how to build and automate (with Terraform) a streaming and batch data pipeline. I will also showcase a real-use case for streaming and batch processing. Keywords: GCP, Terraform, Dataflow, Kubernetes
by -Carlos Rolo
Day 2 | Room A-1 June 21, 2019

Binlogic,DataOps,Terraform,Dataflow,Kubernetes,