Common ladder mechanic - you are moving in that direction where are you looking at. And it's convenient.
But here we need to go back to move down. If you just go back, you will fall down form the tower. So you need to do it slowly... may be jump a bit.... it's annoying... for me at least.
Could you do the Common ladder mechanic, please?