Kilve beach is famous for its exposed rock formations and fossils and has been designated a geological Site of Specific Scientific Interest. The beach and surrounding cliffs are made up of layers of limestone and oil-bearing shale, dating back to around 200 million years ago; they contain some of the earliest ammonites to be recorded in the UK during the mid Jurassic period. William Wordsworth, who lived for a short time at Alfoxden House in nearby Holford, described the beach as ‘Kilve’s delightful shore’ in his poem, Anecdote for Fathers.