The USA without the French would be weird indeed.
Other effects would include the Maritimes being less beefed up, no British support for Mexico then its seceded states of Texas and California, California itself probably wouldn't have merged with New Albion.
The US and British rapprochement would have happened earlier, perhaps before Abolition?