ExamGecko
Question list
Search
Search

List of questions

Search

Question 81 - DEA-C01 discussion

Report
Export

Data engineer designed the data pipelines using Snowpipe to load data files into Snowflake tables, what will happen in case few files with same name but modified data are queued for reloading?

A.
Data will be reloaded as files are modified & its associated metadata also changed. But Snowflake handle implicitly deduplication.
Answers
A.
Data will be reloaded as files are modified & its associated metadata also changed. But Snowflake handle implicitly deduplication.
B.
eTAG is changed for Files even they are having same name, so data will be duplicated in SnowFlake tables.
Answers
B.
eTAG is changed for Files even they are having same name, so data will be duplicated in SnowFlake tables.
C.
Snowpipe uses file loading metadata associated with each table object, so no metadata available to prevent duplication.
Answers
C.
Snowpipe uses file loading metadata associated with each table object, so no metadata available to prevent duplication.
D.
Snowpipe uses file loading metadata associated with each pipe object to prevent reload-ing the same files (and duplicating data) in a table.
Answers
D.
Snowpipe uses file loading metadata associated with each pipe object to prevent reload-ing the same files (and duplicating data) in a table.
Suggested answer: D

Explanation:

Snowflake uses file loading metadata to prevent reloading the same files (and duplicating data) in a table. Snowpipe prevents loading files with the same name even if they were later modified (i.e.

have a different eTag).

The file loading metadata is associated with the pipe object rather than the table. As a result:

· Staged files with the same name as files that were already loaded are ignored, even if they have been modified, e.g. if new rows were added or errors in the file were corrected.

· Truncating the table using the TRUNCATE TABLE command does not delete the Snowpipe file loading metadata.

asked 23/09/2024
xczzxc zzxczxxz
41 questions
User
Your answer:
0 comments
Sorted by

Leave a comment first