Small exterior cosmetic problems can be fixed quite easily by a good dealer. The problem is, you can't know for sure how the car has been treated until you see it. A low mileage car, which did a lot of short trips, can have a ruined interior. Imagine someone, or a whole family, constantly getting in and out of the car. This will have a much more detrimental effect than one guy sitting in the car doing 500 miles in one go. As for resale value, I assume the lower resale value will be negated by the lower purchase price now.
I'd never disregard a car, which is proven to be reliable, if it has high mileage.