Cloud Data Processing and Streaming Questions

Design and operate data processing architectures in the cloud for both streaming and batch workloads including extract transform and load pipelines ingestion and messaging patterns partitioning strategies stateful and stateless processing windowing semantics fault tolerance checkpointing and recovery idempotent design back pressure and flow control orchestration and scheduling for batch jobs and cost and performance trade offs. Discuss testing deployment and observability approaches and be ready to reference common tools and managed services for streaming and batch processing and how you ensure correctness latency and scalability in production.