Along with nearby Skenfrith and Grosmont castles, White Castle was built by the Normans as they won control over the area of North Gwent. The earliest parts of White Castle are the 12th Century curtain walls of the inner ward. The castle was fortified in the 13th Century and a twin-towered gatehouse and four further towers were added. The outer gatehouse was defended by a drawbridge, portcullis and two gates. The castle gets its name from the white rendering that once coated the outer walls.