Databricks Exam Databricks-Certified-Data-Engineer-Associate Topic 4 Question 37 Discussion

Actual exam question for Databricks's Databricks Certified Data Engineer Associate Exam exam

Question #: 37
Topic #: 4

[All Databricks Certified Data Engineer Associate Exam Questions]

A data engineer and data analyst are working together on a data pipeline. The data engineer is working on the raw, bronze, and silver layers of the pipeline using Python, and the data analyst is working on the gold layer of the pipeline using SQL The raw source of the pipeline is a streaming input. They now want to migrate their pipeline to use Delta Live Tables.

Which change will need to be made to the pipeline when migrating to Delta Live Tables?

AThe pipeline can have different notebook sources in SQL & Python.

BThe pipeline will need to be written entirely in SQL.

CThe pipeline will need to be written entirely in Python.

DThe pipeline will need to use a batch source in place of a streaming source.

Show Suggested Answer

Suggested Answer: A

When migrating to Delta Live Tables (DLT) with a data pipeline that involves different programming languages across various data layers, the migration does not require unifying the pipeline into a single language. Delta Live Tables support multi-language pipelines, allowing data engineers and data analysts to work in their preferred languages, such as Python for data engineering tasks (raw, bronze, and silver layers) and SQL for data analytics tasks (gold layer). This capability is particularly beneficial in collaborative settings and leverages the strengths of each language for different stages of data processing.

Reference: Databricks documentation on Delta Live Tables: Delta Live Tables Guide

by Paz at Sep 18, 2024, 07:28 PM

Limited Time Offer

25%

Off

Get Premium Databricks-Certified-Data-Engineer-Associate Questions as Interactive Web-Based Practice Test or PDF

Contribute your Thoughts:

Submit Cancel

Kiley

4 days ago

Actually, I think the pipeline can still have different notebook sources in SQL & Python even with Delta Live Tables.

upvoted 0 times

...

Louvenia

11 days ago

I bet the data analyst is secretly hoping for option B, just so they can lord their SQL skills over the data engineer. Classic power move!

upvoted 0 times

...

Brande

12 days ago

I agree. I believe the pipeline will need to be written entirely in SQL for Delta Live Tables.

upvoted 0 times

...

Gerardo

13 days ago

Wait, what? Option B wants me to write the entire pipeline in SQL? That's a hard pass. I'm sticking with Python, thanks.

upvoted 0 times

...

Kiley

15 days ago

I think we will need to make some changes to our pipeline when migrating to Delta Live Tables.

upvoted 0 times

...

Jenise

15 days ago

Option B? Really? Forcing the whole pipeline to be in SQL seems like a bit of a stretch. This is a tough one.

upvoted 0 times

...

Azalee

17 days ago

Interesting dilemma. I wonder if they could keep the SQL and Python separation, but just wrap it all in Delta Live Tables. Guess we'll have to see what the experts say!

upvoted 0 times