Absolutely agree... the Patrol front end is so 'touchy' that over the years I have found that pretty much every single component can be the culprit.
IMHO the slight favourites (but only just) would be the Panhard Bushes and Wheel Bearings as they are the quickest to wear or go out of adjustment.
Yes, Swivel hub preload, tie rod ends etc will all cause the death wobble (my latest episode of death wobble was wheel bearings, prev one was swivel hubs) but those areas usually take a substantially longer time to crap out so the amount of K's on the car can be a hint on where to initially look.
What I do is start with the cheapest/easiest inspections or replacements and work thru the list.

