William de Percy (d. 1096), founder of his family, came to England with William the Conqueror. He came from the Caen region of the Norman duchy where villages still bear the name Perci.
Throughout history, the Percy family have built, maintained and expanded the castle.