Why say “RMSProp algorithm as a simple fix to decouple rate scheduling from coordinate-adaptive learning rates”? I think the RMSProp is still adjusting every coordinate of grad individually except a common parameter γ is involved (as in 11.8.1).
Is this what you mean “decouple rate scheduling from coordinate-adaptive learning rates”?