I live in a busy street and don't have my own driveway, I've found that usually the day after I've 'gone all out' someone keyed my car so I now only do QD and interiors in front of my house and take the car to my parents' as they only live a few blocks away, have their own driveway, hoses and the coffee ready when I've finished cleaning the wheels
Most of the neighbors know me from since I was a kid, and so they know I'm a 'bit' car-crazy (like my father) and are generally nice. Sometimes they even ask for advice which I don't mind giving. Quite a few of 'the paints going to come off' and 'mine next'-s aswell, but all in a friendly matter.
The only nasty responses I get is from the neighbors directly next door. They've moved in a year or two back and are the kind of people who seem to be obsessed with property, wealth and all that. They cannot talk about anything without mentioning the pricetag and they have everything (house, garden, dogs, etc.) done by 'professionals'. Preferably ones with really big vans with really big company logos.
So, they can't stand me and my family who basically give a rat's *ss about what they do, and do most work on the house, cars, etc. by themselves because they don't care too much about money and so never have enough to get someone to do it
And so, whenever I'm working on my 20 year old BMW they usually make comments how OLD and what a piece of crap it is. For some reason it really upsets them, dunno why, maybe it's because they can never have fun unless it's expensive (maybe I should show them my bills of the autosupply store...

) .
Admittedly, the BMW is old and also has lots of small dents (hell, I should know, I probably know every inch of paint on the car by heart), but I see it as my 'guinea pig' - once I get something really nice I at least know perfectly well how to take car of it.
But okay, the fun part of all this is that (due to my shiny old dented BMW) a few more fortunate friends lend their cars to me once in a while (basic deal is: I detail them and I get to drive 'm in return), so about every other time I get there I'm driving a new BMW, Merc, 911 or the like - by the looks of them it seems to completely freak them out - but they never make a comment when I've got one of those with me! Hehe, I love those weekends
Weird people..