List of questions
Related questions
Question 335 - Professional Data Engineer discussion
You are using Workflows to call an API that returns a 1 KB JSON response, apply some complex business logic on this response, wait for the logic to complete, and then perform a load from a Cloud Storage file to BigQuery. The Workflows standard library does not have sufficient capabilities to perform your complex logic, and you want to use Python's standard library instead. You want to optimize your workflow for simplicity and speed of execution. What should you do?
A.
Invoke a Cloud Function instance that uses Python to apply the logic on your JSON file.
B.
Invoke a subworkflow in Workflows to apply the logic on your JSON file.
C.
Create a Cloud Composer environment and run the logic in Cloud Composer.
D.
Create a Dataproc cluster, and use PySpark to apply the logic on your JSON file.
Your answer:
0 comments
Sorted by
Leave a comment first