In chapter 10.4.1:
- where the decoder hidden state st′−1st′−1 at time step t′−1t′−1 is the query, and the encoder hidden states htht are both the keys and values,
However, in the code implementation:
- context = self.attention(
query, enc_outputs, enc_outputs, enc_valid_lens)
I think that the keys and values are enc_outputs instead of the encoder hidden states h_t. Is it a mistake?
Please correct me if I am wrong!