Throw away that chamois! It can cause significant scratches. Invest in a good waffleweave (from CMA, PakShak, and others here) for drying.
Also, have you read the
Autopia Guide to Detailing? It will give you lots of good techniques on proper washing/drying techniques, so you can avoid any swirls/microscratches. Also, reading through several threads here -- especially in the Autopia University forum -- will give you several useful tips. I quickly ran
this search and turned up

372 threads! You might want to scan through several of them, but
this thread seemed to have a good number of basic, helpful pointers.
BlackRegal mentioned Poorboy's Spray & Wipe available at
www.poorboysworld.com. I've used it too, and am very pleased with it. Recently I used it after a 350-mile trip to a Concours, in lieu of a water-wash. Be sure to get some high-quality microfiber towels to use with it. Poorboys sells nice ones, as do others here. Let us know if you want some URLs.