Just had another look at your connection, and your weight seems okay.
You describe it as "bumpy/ juttery"
Is it bad handling?
Or noisy?
If it is this then it might as simple as the hitch bouncing in the towbar. Tightening the anti-rattle bolt in hitch will solve that. I also assume you know overrun brakes clunk as you stop and start if you aren't smooth.