ExamGecko
Question list
Search
Search

List of questions

Search

Related questions











Question 49 - MLS-C01 discussion

Report
Export

A machine learning (ML) specialist is administering a production Amazon SageMaker endpoint with model monitoring configured. Amazon SageMaker Model Monitor detects violations on the SageMaker endpoint, so the ML specialist retrains the model with the latest dataset. This dataset is statistically representative of the current production traffic. The ML specialist notices that even after deploying the new SageMaker model and running the first monitoring job, the SageMaker endpoint still has violations.

What should the ML specialist do to resolve the violations?

A.
Manually trigger the monitoring job to re-evaluate the SageMaker endpoint traffic sample.
Answers
A.
Manually trigger the monitoring job to re-evaluate the SageMaker endpoint traffic sample.
B.
Run the Model Monitor baseline job again on the new training set. Configure Model Monitor to use the new baseline.
Answers
B.
Run the Model Monitor baseline job again on the new training set. Configure Model Monitor to use the new baseline.
C.
Delete the endpoint and recreate it with the original configuration.
Answers
C.
Delete the endpoint and recreate it with the original configuration.
D.
Retrain the model again by using a combination of the original training set and the new training set.
Answers
D.
Retrain the model again by using a combination of the original training set and the new training set.
Suggested answer: B

Explanation:

The ML specialist should run the Model Monitor baseline job again on the new training set and configure Model Monitor to use the new baseline. This is because the baseline job computes the statistics and constraints for the data quality and model quality metrics, which are used to detect violations. If the training set changes, the baseline job should be updated accordingly to reflect the new distribution of the data and the model performance. Otherwise, the old baseline may not be representative of the current production traffic and may cause false alarms or miss violations.References:

Monitor data and model quality - Amazon SageMaker

Detecting and analyzing incorrect model predictions with Amazon SageMaker Model Monitor and Debugger | AWS Machine Learning Blog

asked 16/09/2024
Rocco Cristofaro
45 questions
User
Your answer:
0 comments
Sorted by

Leave a comment first