Deep Learning Expert Quiz 9

What is one main purpose of the “query” in the attention mechanism of Transformer models?

In an LSTM network, which component controls what information is forgotten in each cell state?

In neural networks, what is the primary advantage of using group normalization over batch normalization?

Which is a limitation of reinforcement learning in real-world applications?

Which method is commonly used to reduce mode collapse in GANs?

What is one primary reason Transformer models achieve superior results in NLP over RNNs and LSTMs?

Why are skip connections essential in U-Net architectures for semantic segmentation tasks?

In which situation would Layer Normalization be preferred over Batch Normalization?

In NLP, the BERT model uses a 'masked language model' (MLM) objective. Why is this done?

What is a key difference between Variational Autoencoders (VAEs) and Generative Adversarial Networks (GANs)?