No, I don't think that would be a problem. What would be a concern is if the label comes loose, causing wobble or even aerodynamic "lift". If pieces came off, they could gum up the works, too.
This reminded me: Anyone ever see the "Mythbusters" where they spun CDs to the point where they shattered? Funny stuff!
