I think it would be more fun if Patrick was a freak accident, after Ted. That way, you have Joe Jr, Jack, Bobby, Ted, and Patrick. If it somehow manages to butterfly Joe II's death, we might see some interesting consequences.
(imagine a brother-brother ticket, or brother presidencies back to back!)