Implementation of Recurrent Neural Networks from Scratch

There seems to be a broken reference in section 8.5.3 in the second paragraph " :numref: sec_mlp"

Hi @HarryDC, eagle eyes! Can you post an issue on our github? Thanks for contributing!

1 Like

Thanks. Now it’s fixed. See comments in

1 Like

the second traning (use_random_iter=True) uses the model trained by the first time:
(1)the ppl is from about 2.0
(2)the curve is bumpy

So misleading :sweat_smile:

1 Like

I argee with “uses the model trained by the first time”. Thank you for reminding us.
I think use_random_iter=True maybe is a way to converge better when it is hard to converge our model.