The Zoar Chapel was built by a sect of the Baptists in the late 1880s in a bastion in the city wall that used to house the main water reservior.