Word Embedding with Global Vectors (GloVe)

English Version
1

https://d2l.ai/chapter_natural-language-processing-pretraining/glove.html

2

In exercise 2 of this section, you hint to us to check section “4.2” or the Pennington paper on GloVe, but I don’t think that paper has a section “4.2”?

3

I think it has?

4

My solutions to the exs: 15.5

5

In the Interpretation section, the ratio p_1/p_2 calculated in the table has the form p_ik/p_jk. However, in the GloVe mathematical derivation part, the considered ratio is p_ij/p_ik. Could anyone please help me to clarify this?

6

The table is correct. In the GloVe mathematical derivation part, p_ij/p_ik should be p_ji/p_ki. w_j and w_k are center words. w_i is context word.