ExamGecko
Question list
Search
Search

List of questions

Search

Related questions











Question 121 - DEA-C01 discussion

Report
Export

A data engineer uses Amazon Managed Workflows for Apache Airflow (Amazon MWAA) to run data pipelines in an AWS account. A workflow recently failed to run. The data engineer needs to use Apache Airflow logs to diagnose the failure of the workflow. Which log type should the data engineer use to diagnose the cause of the failure?

A.

YourEnvironmentName-WebServer

Answers
A.

YourEnvironmentName-WebServer

B.

YourEnvironmentName-Scheduler

Answers
B.

YourEnvironmentName-Scheduler

C.

YourEnvironmentName-DAGProcessing

Answers
C.

YourEnvironmentName-DAGProcessing

D.

YourEnvironmentName-Task

Answers
D.

YourEnvironmentName-Task

Suggested answer: D

Explanation:

In Amazon Managed Workflows for Apache Airflow (MWAA), the type of log that is most useful for diagnosing workflow (DAG) failures is the Task logs. These logs provide detailed information on the execution of each task within the DAG, including error messages, exceptions, and other critical details necessary for diagnosing failures.

Option D: YourEnvironmentName-Task Task logs capture the output from the execution of each task within a workflow (DAG), which is crucial for understanding what went wrong when a DAG fails. These logs contain detailed execution information, including errors and stack traces, making them the best source for debugging.

Other options (WebServer, Scheduler, and DAGProcessing logs) provide general environment-level logs or logs related to scheduling and DAG parsing, but they do not provide the granular task-level execution details needed for diagnosing workflow failures.

Amazon MWAA Logging and Monitoring

Apache Airflow Task Logs

asked 29/10/2024
Web Administrator
43 questions
User
Your answer:
0 comments
Sorted by

Leave a comment first