First, are you doing this by hand or buffer?
The goal is to "flatten" the surface again. You want to use the least agressive abrasive to do the job. Fine Cut Rubbing Compound , FCRB, is probobably going to be the best place to start. Unfortunately, it can also be a dangerous product because if you buff too long in one spot you can easily take off too much paint. ( Any abrasive product can do so but the MORE abrasive they are the FASTER they do so. EXPERIENCE teaches you how to know when to stop and how hard to rub.)
And also, the scuff you have may have already taken off so much paint that it may be dangerously thin in that spot so that no matter what you use that when you flatten the surface to get it smooth again you may risk going through what paint surface is left. Those are the risks.