So if I present this the other way around. We are infants without any prior experience. We both look at an cubical object emitting a radiation at frequency about 650THz. What you experience in your brain is this:
and what I experience in my brain is this:
We are both told by the parents that this object is blue. Then we go outside and we see the sky for the first time. Will we both call it blue? Of course we will.