That would depend on the individual case, but if we're talking Pure Syndicalism, then probably yes. It depends on whether the regime sees regionalism/nationalism as a Bourgeois Distraction From The Class Struggle or not. There would also potentially be a tendency towards hyper-localism if this is Syndicalism mixed with Anarchism or non-statist Communism.
In terms of infrastructure, the Congress of Trade Unions would presumably direct the Union of Road Builders to build a road in a place where other unions/delegates have expressed a need for one. Same for schools, hospitals, etc. Depending on how utopian this society is, either there is no crime or war ever again and the Violent Power Of The State withers away, or the Police/Army/etc. simply organise their own unions.