Body filler in no way enhances adhesion.
Most likely, your plastic parts have been treated with some sort of silicone product in the past, making paint adhesion all but impossible without properly prepping. Wax and silicone remover with several new towels will be a good start.
Are you going to do some spot repairs due to color match problems or are you going to do a full custom paint job on them?
Body filler can be used to cover texture, but what works better is a medium-high build sprayable primer. It will require the above prep cleaning as well as some scuffing or even sanding, followed by a few coats, sanding, a few more coats, and sanding until you're satisfied with the end results.