How Data Engineer can do Monitoring of Files which are Staged Internally during Continuous data pipelines loading process? [Select all that apply]

Question

Mahmoud Ismail · Accepted Answer

She Can Monitor the files using Metadata maintained by Snowflake i.e. file-name,last_modified date etc.

Mahmoud Ismail · Accepted Answer

Snowflake retains historical data for COPY INTO commands executed within the pre-vious 14 days.

Mahmoud Ismail · Accepted Answer

She can Monitor the status of each COPY INTO <table> command on the History tab page of the classic web interface.

Mahmoud Ismail · Answer

She can use the DATA_LOAD_HISTORY Information Schema view to retrieve the history of data loaded into tables using the COPY INTO command.

Mahmoud Ismail · Answer

She can use the DATA_VALIDATE function to validate the data files She have loaded and can retrieve any errors encountered during the load.

List of questions