Nostalgic Adam: Weighing more of the past gradients when designing the adaptive learning rate

Published in IJCAI 2019, 2019

Download paper here