The road works on the pacific are up the northern end. It can become bit of a snarl between Ballina and Port Macquarie as a lot of that area is still single lane with road works to expand it to dual lane (and with school holidays, it'll have a lot of holiday traffic).
For an inland option to Vic, I'd suggest the Pacific down to Bangalow, then across to Lismore, Casino, follow the Bruxner Hwy to Tenterfield, New England to Tamworth, then Oxley Hwy across to Coonabarabran, then south on the Newell to Vic.