Deep Learning Advanced Quiz 8

Which activation function is preferred in deep networks to prevent vanishing gradients?

Which technique is commonly used in NLP for word representation?

What is the purpose of using skip connections in ResNet?

Which of the following is a type of autoencoder used for unsupervised learning?

What does the softmax function do in the output layer of a neural network?

Which optimization algorithm adapts the learning rate for each parameter?

What is the vanishing gradient problem?

In a convolutional neural network (CNN), what is the purpose of pooling layers?To add non-linearityTo add non-linearity

What is the primary purpose of the activation function in a neural network?

Which of the following techniques can help prevent overfitting in a neural network?