Databricks Exam Databricks-Certified-Professional-Data-Engineer Topic 1 Question 22 Discussion

Actual exam question for Databricks's Databricks Certified Data Engineer Professional exam

Question #: 22
Topic #: 1

[All Databricks Certified Data Engineer Professional Questions]

A user wants to use DLT expectations to validate that a derived table report contains all records from the source, included in the table validation_copy.

The user attempts and fails to accomplish this by adding an expectation to the report table definition.

Which approach would allow using DLT expectations to validate all expected records are present in this table?

ADefine a SQL UDF that performs a left outer join on two tables, and check if this returns null values for report key values in a DLT expectation for the report table.

BDefine a function that performs a left outer join on validation_copy and report and report, and check against the result in a DLT expectation for the report table

CDefine a temporary table that perform a left outer join on validation_copy and report, and define an expectation that no report key values are null

DDefine a view that performs a left outer join on validation_copy and report, and reference this view in DLT expectations for the report table

Show Suggested Answer

Suggested Answer: D

To validate that all records from the source are included in the derived table, creating a view that performs a left outer join between the validation_copy table and the report table is effective. The view can highlight any discrepancies, such as null values in the report table's key columns, indicating missing records. This view can then be referenced in DLT (Delta Live Tables) expectations for the report table to ensure data integrity. This approach allows for a comprehensive comparison between the source and the derived table.

Databricks Documentation on Delta Live Tables and Expectations: Delta Live Tables Expectations

by Sheridan at Sep 19, 2024, 12:52 AM

Limited Time Offer

25%

25 days ago

Option D seems like the way to go. Defining a view to perform the left outer join and then referencing that in the DLT expectations is a clean and efficient approach.

upvoted 0 times

Luann

8 days ago

Option D seems like the way to go. Defining a view to perform the left outer join and then referencing that in the DLT expectations is a clean and efficient approach.

upvoted 0 times

...