The oldest part of the castle is a tower built soon after 1478 with a detached gatehouse, by George Maxwell. The main part was added in 1597-99 in a most elegant style. Enlarged in the 16th century by his descendent, the wicked Patrick Maxwell who murdered two of his neighbours.