Databricks Certified Data Engineer Associate · Free Practice Question Medium
Question 9
- A Manually restart the entire job from the beginning.
- B Ignore the alert and wait for the next scheduled run.
- C Use the repair feature to rerun only the failed transformation task after resolving the cluster issue.
- D Permanently remove the transformation task from the pipeline to avoid future failures.
Reveal correct answer
Correct answer: C
Explanation
Utilizing the repair feature allows you to address the failure without having to rerun the successful ingestion part of the job, saving time and preserving the work that has already been completed. This targeted approach is efficient and ensures that the pipeline's integrity is maintained.A. Manually restarting the entire job from the beginning may result in unnecessary reprocessing of data that has already been successfully ingested and transformed. This approach can increase downtime and resource consumption.
B. Ignoring the alert and waiting for the next scheduled run can lead to prolonged downtime and potential data loss. It is crucial to address the issue promptly to minimize the impact on the data processing pipeline.
C. Using the repair feature to rerun only the failed transformation task after resolving the cluster issue is the most efficient and targeted solution. This approach minimizes downtime by focusing on the specific task that failed, ensuring data integrity without unnecessary reprocessing.
D. Permanently removing the transformation task from the pipeline to avoid future failures is not a recommended solution. Removing a critical task can compromise the integrity of the data processing pipeline and may lead to incomplete or inaccurate data in the data warehouse. It is essential to address and resolve the issue rather than bypassing it.
Discussion
Think the marked answer is wrong, or have a better explanation? Share it below — comments appear after review.
