Haughley developed within the outer bailey of a Norman castle. This gives the village its distinctive shape. Only the earthworks remain (a privately owned and protected site).
The ancient heart of Haughley is now a Conservation Area and contains many pretty, timber framed-cottages.
Haughley Park nearby opens its bluebell woods for two Sundays in the spring. The house is open by appointment only.
There are village shops, a pub and a restaurant in Haughley.