The pipe at that point will be relatively cold, so it should be fine. If in doubt, wrap it in some foil and insulation, but I would not bother.