Professional Data Engineer · Free Practice Question Easy
Question 4
You want to monitor a Cloud Dataflow job and know the maximum duration that an item has been waiting in the pipeline. What Cloud Monitoring metric would you use to track the maximum duration?
- A job/data_watermark_age
- B job/system_lag
- C job/elapsed_time
- D job/element_count
Reveal correct answer
Correct answer: B
Explanation
The correct answer is job/system_lag. The job/data_watermark_age is the age of the most recent item that's been fully processed by the pipeline. Job/elapsed_time is the elapsed time of the pipeline run time. Job/element_count is the number of items processed in a PCollection for the Read_input and Process_element transforms. See https://cloud.google.com/architecture/building-production-ready-data-pipelines-using-dataflow-monitoring
Discussion
Think the marked answer is wrong, or have a better explanation? Share it below — comments appear after review.
