Adam Algorithm

English Version mxnet
1

https://d2l.ai/chapter_optimization/adam.html

2

I just want to share a great blog post on differences between Adam and AdamW for anyone who is interested.