Thanks mate.. You were spot on everything you described is what is happening at the moment.

Will replacing the castor correction bushes and panhard rod bushes fix the problem?

I also have the kits for the swivel hubs and front and rear bearings as I thought that was the cause at first should I replace them all aswell?, its an 2007 3lt but its only got 41,000km on the clock..