I wouldn't assume that.
Around the same time as those rumours were floating around, Henry Tudor was reportedly putting out feelers for a possible marriage with Maud Herbert, which could have brought him some useful support in Wales, but was a pretty poor substitute for EoY, whilst Elizabeth Woodville invited the surviving son of her first marriage to return to England. All in all, it suggests something in the wind about a possible reconciliation between Richard and the Woodvilles, and one which would put EoY beyond Henry's reach. Inconclusive, but suggestive.
I suspect that Richard may have toyed with the idea, but rejected it, or been dissuaded, because too many of his existing supporters would be in danger if the Woodvilles returned to influence at court - and the Woodvilles might prove treacherous allies. He could have ended up weaker rather than stronger.