Yeah, while some surfaces are more prone to white residue than others, generally I find that something either stains or it doesn't.
To be perfectly clear about a few products- I've used Souveran on all kinds of the surfaces in question with no problems. I've been intentionally applying it to the exterior rubber trim of my XJS for many, many years and I used Malm's liquid wax on it before that (yeah, wax on rubber trim for over 20 years and said trim looks like new). I've used AIO on all kinds of trim too- gotta be very gentle applying it to rubber or it'll damage the factory texture, but it never stained for me. Same with VM- I've used this on all kinds of surfaces, including rubber with no problems whatsoever.
I use KSG and UPP on hard exterior plastic trim, especially the KSG. It's all I ever used on the WRX's exterior trim and it's all I use on the MPV's.
Oh, and no, I never referred to the PB's stuff; I've never used it.