Paint on the fairings is often on the soft side. Without seeing it in person (or even pics) it is hard to say but maybe you were being too aggressive and adding your own marring. I've had good results though with the following combo
M105, Menz IP, and 3M UF by hand on a rather neglected Suzuki Bandit.