While you are on the wall hit the reset button, it'll will try to reset to the first castle room which is higher up, but because you are on the wall you'll instead just go straight up.