Databricks Certified Data Engineer Associate · Free Practice Question Easy
Question 39
You are currently working on a notebook that will populate a reporting table for downstream process consumption, this process needs to run on a schedule every hour. what type of cluster are you going to use to set up this job?
-
A
Since it’s just a single job and we need to run every hour, we can use an all-purpose cluster
-
B
The job cluster is best suited for this purpose.
-
C
Use Azure VM to read and write delta tables in Python
-
D
Use delta live table pipeline to run in continuous mode
Reveal correct answer
Correct answer: B
Explanation
The answer is, The Job cluster is best suited for this purpose.
Since you don't need to interact with the notebook during the execution especially when it's a scheduled job, job cluster makes sense. Using an all-purpose cluster can be twice as expensive as a job cluster.
FYI,
When you run a job scheduler with option of creating a new cluster when the job is complete it terminates the cluster. You cannot restart a job cluster.
Discussion
Think the marked answer is wrong, or have a better explanation? Share it below — comments appear after review.
