Again, the problem isn’t being color blind. It’s trying to cut the discussion by claiming to be color blind.
I don’t think there is any way that any of us can truly know whether or not we are color blind. We all think we are, but there are a lot of things about ourselves that we don’t know. And even if we were, saying so is unconvincing - especially to people of color.