If you are trying to remove swirls then you must remove some clear coat, but it is almost impossible to damage your paint by hand. I recently did my wife's car by hand and it was hell, but the results came out well. Megs has a new product
M105 that is very aggressive, but gives excellent results by hand. Check out my process and results here
By hand-- - Car Care Forums: Meguiar's Online