There are a few camp sites/caravan sites up north of Coffs Harbour, a bit over 3/4 to Grafton, called Wooli/Minnie Waters. It can be crowded but I'm pretty sure that's only the case on long weekends.