I think you should talk to the county building inspector and ask for a re inspection. Or see if you can get a structural engineer to take a look.
Just who is this "inspector", and who does he work for?
Do you have any photo's?
And Beemer is right on with the plane of the wall. If it's out of plane, that's slam dunk trouble.