Databricks Exam Databricks-Certified-Data-Engineer-Associate Topic 5 Question 38 Discussion

Actual exam question for Databricks's Databricks-Certified-Data-Engineer-Associate exam

Question #: 38
Topic #: 5

[All Databricks-Certified-Data-Engineer-Associate Questions]

A Delta Live Table pipeline includes two datasets defined using streaming live table. Three datasets are defined against Delta Lake table sources using live table.

The table is configured to run in Production mode using the Continuous Pipeline Mode.

What is the expected outcome after clicking Start to update the pipeline assuming previously unprocessed data exists and all definitions are valid?

AAll datasets will be updated once and the pipeline will shut down. The compute resources will be terminated.

BAll datasets will be updated at set intervals until the pipeline is shut down. The compute resources will persist to allow for additional testing.

CAll datasets will be updated once and the pipeline will shut down. The compute resources will persist to allow for additional testing.

DAll datasets will be updated at set intervals until the pipeline is shut down. The compute resources will be deployed for the update and terminated when the pipeline is stopped.

Show Suggested Answer

Suggested Answer: D

In Delta Live Tables (DLT), when configured to run in Continuous Pipeline Mode, particularly in a production environment, the system is designed to continuously process and update data as it becomes available. This mode keeps the compute resources active to handle ongoing data processing and automatically updates all datasets defined in the pipeline at predefined intervals. Once the pipeline is manually stopped, the compute resources are terminated to conserve resources and reduce costs. This mode is suitable for production environments where datasets need to be kept up-to-date with the latest data.

Reference: Databricks documentation on Delta Live Tables: Delta Live Tables Guide

by Kirk at Sep 18, 2024, 05:00 PM

Limited Time Offer

25%

23 days ago

Hmm, I'm not sure. Probably B or D, but I'm leaning towards D. Seems more logical that the compute resources would be tied to the updates.

upvoted 0 times

Precious

10 days ago

Yeah, I agree. It would be more efficient to tie the compute resources to the updates.

upvoted 0 times

...

Evelynn

11 days ago

I think D makes sense. The compute resources should be deployed for the update.

upvoted 0 times

...

Daniel

27 days ago

D seems like the correct answer. The datasets will be updated at intervals, and the compute resources will only be deployed during the updates, then terminated when the pipeline stops.

upvoted 0 times

...

2 months ago

I think the answer is B. The pipeline will continuously update the datasets at set intervals until it's shut down, and the compute resources will persist for further testing.

upvoted 0 times

Dell

29 days ago

Yes, that sounds right. It's important to have the resources available for testing and troubleshooting.

upvoted 0 times

...

Chantay

1 months ago

I agree with you. It makes sense that the compute resources would stay active for testing purposes.

upvoted 0 times

...

Rima

1 months ago

I think the answer is B. The pipeline will continuously update the datasets at set intervals until it's shut down, and the compute resources will persist for further testing.

upvoted 0 times

...

Candra

2 months ago

I think the answer is B. The datasets will be updated at set intervals until the pipeline is shut down.

upvoted 0 times

...