The chapel can be glimpsed through the archway. The town had a Baptist community even before religious nonconformity became legal. As soon as the Act of Toleration in 1689 permitted freedom of worship to Dissenters, a Baptist chapel was built on this site. The congregation swelled in the 18th century and in 1797 the chapel was rebuilt and an arch created to give access to it. It is still in use.