Amazon Exam Amazon-DEA-C01 Topic 3 Question 3 Discussion

Actual exam question for Amazon's Amazon-DEA-C01 exam

Question #: 3
Topic #: 3

A data engineer uses Amazon Managed Workflows for Apache Airflow (Amazon MWAA) to run data pipelines in an AWS account. A workflow recently failed to run. The data engineer needs to use Apache Airflow logs to diagnose the failure of the workflow. Which log type should the data engineer use to diagnose the cause of the failure?

AYourEnvironmentName-WebServer

BYourEnvironmentName-Scheduler

CYourEnvironmentName-DAGProcessing

DYourEnvironmentName-Task

Show Suggested Answer

Suggested Answer: D

In Amazon Managed Workflows for Apache Airflow (MWAA), the type of log that is most useful for diagnosing workflow (DAG) failures is the Task logs. These logs provide detailed information on the execution of each task within the DAG, including error messages, exceptions, and other critical details necessary for diagnosing failures.

Option D: YourEnvironmentName-Task Task logs capture the output from the execution of each task within a workflow (DAG), which is crucial for understanding what went wrong when a DAG fails. These logs contain detailed execution information, including errors and stack traces, making them the best source for debugging.

Other options (WebServer, Scheduler, and DAGProcessing logs) provide general environment-level logs or logs related to scheduling and DAG parsing, but they do not provide the granular task-level execution details needed for diagnosing workflow failures.

Amazon MWAA Logging and Monitoring

Apache Airflow Task Logs

by Cherry at Oct 21, 2024, 07:03 PM

Limited Time Offer

25%

Off

Get Premium Amazon-DEA-C01 Questions as Interactive Web-Based Practice Test or PDF

Contribute your Thoughts:

Submit Cancel

Latanya

2 months ago

Hmm, this is a tough one. I guess I'll go with B) YourEnvironmentName-Scheduler. Gotta love those Airflow logs, they're always a party!

upvoted 0 times

Twila

1 months ago

I agree, let's check the scheduler logs to see where the workflow failed.

upvoted 0 times

...

Lakeesha

1 months ago

Hopefully the scheduler logs will give us some clues on why the workflow failed.

upvoted 0 times

...

Catalina

2 months ago

I think B) YourEnvironmentName-Scheduler is the right choice. Those logs should help us figure out what went wrong.

upvoted 0 times

...

Ruthann

2 months ago

I'm going with C) YourEnvironmentName-DAGProcessing. It's important to understand how the overall data pipeline was executed, not just the individual tasks.

upvoted 0 times

Colene

1 months ago

I believe D) YourEnvironmentName-Task could provide insights into the specific tasks that failed in the workflow.

upvoted 0 times

...

Valda

2 months ago

I agree with you, C) YourEnvironmentName-DAGProcessing is crucial to understand the overall execution of the data pipeline.

upvoted 0 times

...

Shawn

2 months ago

I would go with B) YourEnvironmentName-Scheduler to check the scheduling of the workflow.

upvoted 0 times

...

Mabelle

2 months ago

I think A) YourEnvironmentName-WebServer might have some clues on what went wrong.

upvoted 0 times

...

Luke

3 months ago

D) YourEnvironmentName-Task seems like the best choice to me. If the workflow failed, the task logs should contain the most detailed information about the root cause.

upvoted 0 times

...

Lucy

3 months ago

I think the answer is B) YourEnvironmentName-Scheduler. This log type should provide the most relevant information about the failure, as the scheduler is responsible for triggering and coordinating the workflow.

upvoted 0 times