Databricks Certified Data Engineer Associate · Free Practice Question Medium
Question 38
A dataset has been defined using Delta Live Tables and includes an expectations clause: CONSTRAINT valid_timestamp EXPECT (timestamp > '2020-01-01')
What is the expected behavior when a batch of data containing data that violates these constraints is processed?
-
A
Records that violate the expectation are added to the target dataset and recorded as invalid in the event log.
-
B
Records that violate the expectation are dropped from the target dataset and recorded as invalid in the event log.
-
C
Records that violate the expectation cause the job to fail.
-
D
Records that violate the expectation are added to the target dataset and flagged as invalid in a field added to the target dataset.
-
E
Records that violate the expectation are dropped from the target dataset and loaded into a quarantine table.
Reveal correct answer
Correct answer: A
Explanation
The answer is, Records that violate the expectation are added to the target dataset and recorded as invalid in the event log.
Delta live tables support three types of expectations to fix bad data in DLT pipelines
Review below example code to examine these expectations,
Discussion
Think the marked answer is wrong, or have a better explanation? Share it below — comments appear after review.
