The oil bakes on the bearing journals and slightly damages the surfaces.Then the shaft picks up on the uneven spots which increases wear over time.
After that you will eventually get excess run out on the shaft and contact between compressor or turbine wheels on the housing,then it gets messy.