In Baum just like Middle Earth it exists as a real world, or like Wonderland does in the Alice books.
It’s been a spell since I read Alice’s Adventures in Wonderland/Through the Looking-Glass, but I’m 99% sure Wonderland exists only in Alice’s dreams, albeit possibly as a transient sub-reality, if the speculation that Alice herself’s a part of the Red King’s dream is anything to go by.