Quite true. The earliest post war radars had such difficulty, even having trouble tracking supersonic aircrafts. Huges Airwest Flight 706 was quite an example of such problems.My understanding is that it did matter, and that in practice targets with a larger RCS were easier for the older search radars (and their operators) to derive enough information from the radar returns to generate tracks that the air defense system could then deal with.
But by the time the SR-71S entered service radars had also advance to the point where they eliminate the possible benifits offered by the reduction in RCS.
I wonder did Western radars had trouble tracking the U-2s , that they doubted the capability of the Soviets to do so?