OK, flamesuit on. This is a topic where I'm on the "wrong" side of the fence, relative to the conventional wisdom. Normal "just my experience" disclaimers, etc.
I use AIO and SG on the plastic trim on MANY of my vehicles. The black textured cladding on the rockers of my WRX, the black textured plastic on the MPV, you name it. I also use it on the rubber protective pieces on the rear bumpercovers of the WRX and MPV. It's working great for me. BTW, YoSteve uses it on the textured trim on his VW.
To help in removing the SG, I use a MF, slightly damp with #34 and/or a pretty soft detail brush (soft enough that it won't marr the plastic).
I especially like using AIO to clean the black plastic trim on the Audis (like the grill and along the bottom of the bumper covers) and the black plastic sail panels on the XJS, all of which I then top with BFII.
Another product to consider is VM. It even SAYS it's OK for this application on the bottle. Now whether you want to trust the label statements is ANOTHER topic...but it seems to work OK.