I'd first try something like Meguiar's Ultimate Polish (NOT Ultimate Compound). Goo Gone can scratch clear coat, especially on darker or fragile colors. (I don't care what they claim--I've had it happen to me.)
You must have mixed some sand in with it then. there are zero abrasives in Goo Gone. I've been using it for about 20 years.