When you're at the water tower, after you kill the sniper, there is a rope over to the right of where the sniper just was. If you look up toward's the rope it will indicate that you can use the rope.