I had a similar noise when I had a front wheel bearing on the way out. It was intermittent as well but would come and go with corners/swerving.