Ensure you have built a section of wall next to your towers and connected some stairs in order to access them.