Know what you mean, although I did have one person tell me they didn't mind the cabins at the local riverside caravan park, but that was a few years ago.
Main suggestion is don't go anywhere near Trawool.............. but Nagambie or Heathcote should be ok.
I have driven past a sign for these cabins near Yea, but not sure what they're like.
http://www.australianbedandbreakfast.com.au/Cheviot+Glen+Cottages_High+Country_B+&+B_accommodation.htm
The other good thing about Seymour is that there's heaps of little towns within 1/2 hour drive of Seymour and the roads are pretty good.
Yea, Kilmore, Nagambie and Heathcote might be worth a look.
I've got a housefull at the moment otherwise would have offered.