I just got my pony spinner caps yesterday and you do not need to take off the wheels. Get a small screwdriver and wrap it with tape then carefully pry between the wheel and the grey plastic center cap. As soon as you see a space, get a larger screwdriver (wrapped with tape) in there and it pops out easily. I did this and there are no gouges or scratches to the wheel.:eyepoppin