ExamGecko
Question list
Search
Search

List of questions

Search

Related questions











Question 181 - DAS-C01 discussion

Report
Export

A company has multiple data workflows to ingest data from its operational databases into its data lake on Amazon S3. The workflows use AWS Glue and Amazon EMR for data processing and ETL. The company wants to enhance its architecture to provide automated orchestration and minimize manual intervention Which solution should the company use to manage the data workflows to meet these requirements?

A.
AWS Glue workflows
Answers
A.
AWS Glue workflows
B.
AWS Step Functions
Answers
B.
AWS Step Functions
C.
AWS Lambda
Answers
C.
AWS Lambda
D.
AWS Batch
Answers
D.
AWS Batch
Suggested answer: B

Explanation:

This solution meets the requirements because:

AWS Step Functions is a fully managed service that allows you to create and orchestrate workflows that connect various AWS services, such as AWS Glue, Amazon EMR, Amazon S3, and others1.You can use Step Functions to automate your data workflows and handle complex logic, such as branching, parallel processing, error handling, retries, and timeouts1.

AWS Step Functions provides a graphical interface that lets you design and visualize your workflows as state machines, which are composed of a series of steps or tasks1.You can use the AWS Step Functions console, the AWS CLI, or the AWS SDKs to create and manage your state machines1.

AWS Step Functions integrates with AWS Glue and Amazon EMR to enable you to run data processing and ETL jobs as part of your workflows23.You can use the built-in connectors for these services to invoke them from your state machines23.You can also use Step Functions to monitor the status of your jobs and trigger actions based on the job outcomes23.

AWS Step Functions can help you minimize manual intervention by providing features such as automatic retries, catch blocks, and fallback states, which allow you to handle errors and failures gracefully in your workflows1.You can also use Step Functions to trigger your workflows based on events, such as a new file in S3 or a CloudWatch alarm1.

asked 16/09/2024
Aldrin Plata
43 questions
User
Your answer:
0 comments
Sorted by

Leave a comment first