It's not losing coolant? Hmmm. But it is holding residual pressure for a while after shut down? Hmmm.
Sound like it can only be one of two things.
Radiator cap kaput or maybe wrong pressure rating.
Small leak in head gasket. Have the same trouble at the moment.
The constant overheating bit is troublesome. Water pump.........?