Hugo Williams was born in Windsor in 1942. He was the eldest son of the actor/dramatists Hugh Williams and his second wife Margaret Vyner. His younger siblings are the actor Simon Williams and the late actress and model Polly Williams, who married the actor Nigel Havers.