Austria and Finland were neutral as part of compromises with the Soviet Union. For Finland it was part of the policy as a result of the WWII treaty between Finland and the Soviet Union. Finland realized that to remain an independent, neutral, and capitalist society next to the Soviet Union they would have to clear their foreign policy with the USSR in a way that allowed them trade and good relations with pro-western nations (Norway, Denmark, and Sweden) without pissing off the Soviet Union by doing things like not joining NATO, the EEC (or other EU predecessors), and not allowing military bases from NATO countries.
Austria was the result of having been divided up like Germany into four zones, with Vienna in the Soviet zone likewise being divided like Berlin. Unlike Germany, Austria was able to get a united independence agreed to by the French, British, American, and Soviet overlords. In return for peace, free elections, and capitalism Austria had to guarantee neutrality.
Other countries couldn't really find ways to get such good neutral grounds, because as soon as you got close to one super power you were tainted in the eyes of the other. Israel, India, Indonesia all tried to be on the good side of both nations for practical reasons; but in the end Israel is seen as pro-USA, India pro-Soviet (because Pakistan was even more pro-USA), and Indonesia depending on the decade was seen as pro-USA or pro-Soviet and due to shifting policies it is probably considered one of the most truly non-aligned countries of the "Non-aligned bloc".