That's crap.

Get a diary and everytime he says something to you or someone else note down the time and date and what was said so if it continues you can take it back to the union or management and show them what is being said and how often and the like.


Good luck mate hope it all works out and he doesn't talk to you anymore