Hm, it may be easier to plan routes looking at the full map image. You can see it here:

http://yumenikki.wikia.com/wiki/Category:Maps

The entrance puts you in the middle of the cluster in the top left quadrant of the image. It seems pretty clear that the fastest way to the towel is to try to go down to it, as opposed to going up (as in your guide.)