The wall gives your village a defence bonus. Rams knock down the wall, catapults damage buildings. With a high enough rally point you can choose the catapult target, and with many catapults two targets; otherwise they hit randomly.
Buildings such as the stonemason and some artefacts make buildings sturdier.