Click on a building in your village and press the TAB key, this will cycle you to the next building, according to the order in which they were built.  To reverse cycle, hold down the SHIFT key and press the TAB key.

If you have a Premium Token in play, you can also move the Village Hall.