The strange thing is I always thought it was illegal to leave the towball and tongue on the vehicle unless it was being used to tow a trailer. I always take mine off, and curse others when I hit my shin on theirs.
I also wonder about the fatigue factor. You might get away with the snatch, but will the hitch/ball still handle a sudden stop with your prized boat or van hitched up?