A worn idler arm bushing manifests itself as a high frequency vibration. The idler bushing would have to be _really_ shot to cause loose steering.
The other end of the idler arm is an eye that is coupled to the center link balljoint. If there is looseness in that area, you'd do better replace the center link.