Hmm, true. Though he was married to Mary and Elizabeth’s Mother’s (which could’ve played a part). He wasn’t with Fitzroy, but the again if he wants to he can just declare them legitimate. So as you said it probably is Edward, Henry, Mary, Elizabeth.
What’s interesting is what happens when Henry...