ExamGecko
Question list
Search
Search

List of questions

Search

Related questions











Question 43 - DP-100 discussion

Report
Export

You are a data scientist building a deep convolutional neural network (CNN) for image classification.

The CNN model you build shows signs of overfitting.

You need to reduce overfitting and converge the model to an optimal fit.

Which two actions should you perform? Each correct answer presents a complete solution.

NOTE: Each correct selection is worth one point.

A.
Add an additional dense layer with 512 input units.
Answers
A.
Add an additional dense layer with 512 input units.
B.
Add L1/L2 regularization.
Answers
B.
Add L1/L2 regularization.
C.
Use training data augmentation.
Answers
C.
Use training data augmentation.
D.
Reduce the amount of training data.
Answers
D.
Reduce the amount of training data.
E.
Add an additional dense layer with 64 input units.
Answers
E.
Add an additional dense layer with 64 input units.
Suggested answer: B, D

Explanation:

B: Weight regularization provides an approach to reduce the overfitting of a deep learning neural network model on the training data and improve the performance of the model on new data, such as the holdout test set.

Keras provides a weight regularization API that allows you to add a penalty for weight size to the loss function.

Three different regularizer instances are provided; they are:

L1: Sum of the absolute weights.

L2: Sum of the squared weights.

L1L2: Sum of the absolute and the squared weights.

D: Because a fully connected layer occupies most of the parameters, it is prone to overfitting. One method to reduce overfitting is dropout. At each training stage, individual nodes are either "dropped out" of the net with probability 1-p or kept with probability p, so that a reduced network is left; incoming and outgoing edges to a dropped-out node are also removed.

By avoiding training all nodes on all training data, dropout decreases overfitting.

Reference:

https://machinelearningmastery.com/how-to-reduce-overfitting-in-deep-learning-with-weight-regularization/

https://en.wikipedia.org/wiki/Convolutional_neural_network

asked 02/10/2024
Mark Oh
36 questions
User
Your answer:
0 comments
Sorted by

Leave a comment first