Google cloud recently announce latest about Dataflow Prime, the next generation of Dataflow: Google Cloud’s truly unified batch and streaming data processing product. Dataflow Prime has two new features: vertical auto scaling and right fitting, which provide automatic fine tuning of memory and stage specific resource allocation. Plus, a new pricing model to simplify your billing.
Click on the video below to watch it in details. Also don’t forget to check our C2C team member
Chapters:
0:00 - Intro
1:02 - Understanding Dataflow
2:02 - Vertical autoscaling
2:52 - Example of vertical autoscaling
3:44 - Horizontal autoscaling
4:30 - Right fitting
6:00 - Example of right fitting
7:06 - Recap of new features
7:41 - Simplified pricing
9:04 - Wrap up
Extra credit:
- What is Dataflow? → https://goo.gle/3RnUEwN
- Dataflow Product Page → https://goo.gle/3T2FL3Y
- Dataflow Documentation → https://goo.gle/3evJh7W
- Switch to Dataflow Prime → https://goo.gle/3MsLP3s
- Change Autoscaling Range Limits → https://goo.gle/3yF5fMM
- Enable Vertical Autoscaling → https://goo.gle/3CW4jpN
- Dataflow Prime Pricing → https://goo.gle/3CY1vsq
- Pricing Calculator → https://goo.gle/3CulOvT