Momentum helps SGD navigate the relevant directions and softens the oscillations in the irrelevant directions. (מועד ב 2022)