You will get way more charge from the car when driving than the solar (which can be or get shaded / dirty / wet etc).
It will also negate having to rely on the weather to stay charged up as in a worst case scenario, plug the car in for an hour to boost it.
Additionally, you may find that your power usage increase's over time and the solar wont be able to keep up, which then means upgrades to panels / controllers etc.
I have a simple set up like you described, running into 2 130 AH AGMs. I have found I always pull into camp fully charged and then if stationary for more than a day or two I set up the solar for the afternoon free boost and pack up a few days later to fully recharge on my way to the next spot.
Granted I have large reserves to play with, but in principal you will never have the risk of pulling into camp at 75% and then having to scrimp and save battery life to get through if you know, absolutely, that you'll arrive full.