Data is generated in real-time from websites, mobile apps, IoT devices,and other workloads.
But, data from these systems is not often in the format that is conducive for analysis or for effective use, by downstream systems.
That’s where Dataflow comes in! Dataflow is a serverless, fast and cost-effective service that supports both stream and batch processing.
You can read more here
@ilias for sharing.
Let's imagine a use case that requires the use APIs to retrieve data in realtime. How could we imagine the architecture of this pipeline with or without dataflow?
Thanks in advance
Great question - scenario
How are you dealing with it in your company?