That's what I've heard, with an addendum that he may have attended some dubious parties with young males. Unconfirmed, though it leaves open the possibility of a relationship with some young Conservatives.
Portillo springs to mind, possibly falsely, though there must be other plausible candidates amongst people who rose to prominence later on.
Maybe after leaving the premiership Edward Heath, starts a sexual relationship with David Cameron, William Hague or Boris Johnson?