Deep Learning Expert Quiz 10

Which regularization technique is NOT commonly used in deep reinforcement learning?

What is the role of attention heads in multi-head attention in Transformer models?

Which of the following is true for Residual Networks (ResNets) with very deep architectures?

Which of the following metrics is typically optimized in a reinforcement learning setup with policy gradients?

Which type of RNN is most effective in handling very long sequences?

What is the purpose of gradient penalty in Wasserstein GANs (WGAN-GP)?

Which optimization algorithm uses both first and second moments of the gradients?

In Transformer models, the "Scaled Dot-Product Attention" uses a scaling factor. Why is this scaling factor applied?

Which approach is used to improve the generalization of GANs when training on diverse datasets?

Which activation function is preferred in deep networks to prevent vanishing gradients?