Yes there can be a difference between "believing" and "knowing" - but in your sentence, it is a distinction without a difference. You can't possibly know that God doesn't exist so to say he doesn't must be a belief.
I do believe the Earth goes around the sun. I also know it - insofar as I can know it. Belief and knowledge aren't as separate as you claim.